2024-09-12T17:24:16.814 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:24:16.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:24:16.928 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902743' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDKqVuY6UfLoLSGiPYE1OjLXfb99bUMrQuuA069dZy7RKMZiRjT4scTgTYflj3ftmXbPyKMPxvszFdMiO8+rnbs= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwMEv7rWm9XFIgSIJL1sN2eGEKGL801YLm8O07ZHPv/HX8GpCdUvpqyebTKBUjy9tGpCEsiIpKoAwRy6p2ZbCM= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:24:16.929 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:24:16.929 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:24:16.930 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:24:16.931 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:24:16.951 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:24:16.951 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:24:16.951 INFO:teuthology.packaging:ref: None 2024-09-12T17:24:16.952 INFO:teuthology.packaging:tag: None 2024-09-12T17:24:16.952 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:24:16.952 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:24:16.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:24:17.096 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T17:24:17.098 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:24:17.105 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:24:17.105 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:24:17.122 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:24:17.139 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:24:17.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:24:17.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:19:07.866427', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDKqVuY6UfLoLSGiPYE1OjLXfb99bUMrQuuA069dZy7RKMZiRjT4scTgTYflj3ftmXbPyKMPxvszFdMiO8+rnbs='} 2024-09-12T17:24:17.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:19:07.864963', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwMEv7rWm9XFIgSIJL1sN2eGEKGL801YLm8O07ZHPv/HX8GpCdUvpqyebTKBUjy9tGpCEsiIpKoAwRy6p2ZbCM='} 2024-09-12T17:24:17.194 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:24:17.200 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:24:17.200 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:24:17.200 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:24:17.260 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38b5173ac0>, signals=[15]) 2024-09-12T17:24:17.260 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:24:17.267 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:24:17.267 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:24:17.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:17.342 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:24:17.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:17.419 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:24:17.425 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-12T17:24:17.444 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-12T17:24:17.444 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:24:17.502 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:24:17.503 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:24:17.504 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-12T17:24:17.827 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-12T17:24:17.845 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-12T17:24:17.846 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-12T17:24:17.903 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-09-12T17:24:17.903 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-09-12T17:24:17.903 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:24:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:24:17.905 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-12T17:24:17.933 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:24:17.943 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:24:17.948 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:24:17.948 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:24:17.951 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:24:17.967 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:24:17.973 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:24:17.974 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:24:18.009 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:24:18.068 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:24:18.124 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:24:18.139 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:24:18.139 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:24:18.139 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:24:18.140 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:24:18.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:24:18.156 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-12T17:24:18.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:24:18.158 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T17:24:18.213 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:24:18.213 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.14.0-503.el9.x86_64 2024-09-12T17:24:18.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y kernel 2024-09-12T17:24:18.215 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:24:18.215 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-503.el9.x86_64 2024-09-12T17:24:18.215 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2024-09-12T17:24:20.515 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T17:24:20.568 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-12T17:24:22.483 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T17:24:23.870 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-12T17:24:26.825 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T17:24:28.218 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 19 kB 00:00 2024-09-12T17:24:28.361 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-12T17:24:29.397 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T17:24:30.662 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T17:24:31.574 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:24:34.795 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T17:24:36.709 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:24:36.709 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:24:36.787 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T17:24:36.793 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T17:24:36.794 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T17:24:36.795 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-09-12T17:24:36.795 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:24:36.795 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 79 M 2024-09-12T17:24:36.795 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 126 M 2024-09-12T17:24:36.795 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T17:24:37.081 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T17:24:37.171 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 194 kB/s | 23 kB 00:00 2024-09-12T17:24:37.688 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-12T17:24:38.238 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T17:24:38.505 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-12T17:24:38.506 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:24:38.506 INFO:teuthology.orchestra.run.smithi204.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-12T17:24:39.028 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:24:39.029 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:24:39.117 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: Package Architecture Version Repository Size 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:24:39.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:Install 4 Packages 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 79 M 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 126 M 2024-09-12T17:24:39.124 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-12T17:24:39.188 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T17:24:39.299 INFO:teuthology.orchestra.run.smithi094.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 180 kB/s | 23 kB 00:00 2024-09-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T17:24:40.524 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T17:24:40.525 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T17:24:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T17:24:43.674 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:24:43.765 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi094.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-12T17:24:46.552 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:24:46.688 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:24:48.773 INFO:teuthology.orchestra.run.smithi094.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.6 MB/s | 35 MB 00:09 2024-09-12T17:24:49.665 INFO:teuthology.orchestra.run.smithi094.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.8 MB/s | 29 MB 00:10 2024-09-12T17:24:49.665 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:24:49.665 INFO:teuthology.orchestra.run.smithi094.stdout:Total 7.5 MB/s | 79 MB 00:10 2024-09-12T17:24:50.344 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-12T17:24:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-12T17:24:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-12T17:24:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:24:51.604 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:24:51.677 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-12T17:24:51.678 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-12T17:24:54.120 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-12T17:24:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:24:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:24:56.450 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:24:57.799 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:24:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:25:02.767 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:25:02.799 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:34.791 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:34.830 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:35.134 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:35.134 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:25:35.134 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:25:35.134 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.058 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.058 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.058 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:25:36.058 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T17:25:36.391 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:25:36.483 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:25:36.484 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:25:36.484 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:25:36.484 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:25:36.485 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:25:36.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:25:36.485 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:25:36.543 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:36.543 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:25:36.543 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-09-12T17:25:36.583 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-09-12T17:25:36.583 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-09-12T17:25:36.583 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-09-12T17:25:36.583 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 82.el9 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8274670 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-09-12T17:25:36.584 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:25:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:25:36.586 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:25:36.586 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:25:36.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:25:37.198 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-12T17:25:38.550 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:25:38.580 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-12T17:25:38.583 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.NSWBeisiwV 2024-09-12T17:25:38.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NSWBeisiwV 2024-09-12T17:25:38.665 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.NSWBeisiwV 2024-09-12T17:25:38.807 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.NSWBeisiwV is 6KB 2024-09-12T17:25:38.856 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.NSWBeisiwV 2024-09-12T17:25:38.871 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:25:38.939 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:25:39.074 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-12T17:25:46.081 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:46.120 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-12T17:25:47.614 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:25:47.697 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.697 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:25:47.697 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:25:47.697 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:25:47.697 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:25:47.697 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:25:47.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:25:47.698 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:25:47.757 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:25:47.757 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:25:47.758 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2024-09-12T17:25:47.789 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 82.el9 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8274670 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:25:47.790 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:25:47.791 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:25:47.792 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:25:47.793 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:25:47.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-09-12T17:25:49.802 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:25:49.830 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-09-12T17:25:49.833 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-12T17:25:49.849 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.lriSEv16y8 2024-09-12T17:25:49.849 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lriSEv16y8 2024-09-12T17:25:49.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.lriSEv16y8 2024-09-12T17:25:50.076 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.lriSEv16y8 is 6KB 2024-09-12T17:25:50.125 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.lriSEv16y8 2024-09-12T17:25:50.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:25:50.210 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:25:50.210 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:25:50.210 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:25:50.210 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:25:50.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:25:50.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-09-12T17:26:09.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:26:09.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:26:09.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:20.379 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:26:20.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-12T17:26:20.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:43.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-12T17:26:52.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:26:52.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:27:20.410 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:27:29.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-12T17:27:29.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:27:29.693 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-12T17:27:30.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-12T17:27:30.087 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:27:30.087 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-12T17:27:30.102 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:27:30.102 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:27:30.102 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:27:30.102 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:27:31.103 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:27:31.103 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:27:31.330 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-09-12T17:27:31.351 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:52.785 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:28:04.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:28:04.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:28:05.193 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T17:28:05.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:28:05.548 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:28:05.548 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T17:28:05.564 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:28:05.564 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:28:05.564 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:28:05.565 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:28:06.566 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:28:06.566 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:28:06.655 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-12T17:28:06.671 DEBUG:teuthology.parallel:result is None 2024-09-12T17:28:06.671 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:28:06.678 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:28:06.679 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:28:06.682 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:28:06.700 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:28:06.706 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:28:06.716 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:28:06.716 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:28:06.741 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:28:06.809 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:28:06.815 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:28:06.816 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:28:06.818 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:28:06.849 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:28:06.850 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:28:06.861 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:28:06.862 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:28:06.864 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:28:06.872 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:28:06.872 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:28:06.906 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:28:06.933 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:28:06.944 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:28:06.944 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:28:06.975 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:28:06.991 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:28:07.072 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:28:07.124 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:28:07.208 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:28:07.252 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:28:07.252 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:28:07.317 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:28:07.361 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:28:07.415 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:28:07.495 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:28:07.541 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:28:07.541 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:28:07.608 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-12T17:28:07.610 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-12T17:28:07.667 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:28:07.694 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:28:08.084 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:28:08.091 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:28:08.092 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:28:08.144 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:28:08.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-09-12T17:28:08.202 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-09-12T17:28:08.204 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-09-12T17:28:08.260 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-09-12T17:28:08.262 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:28:08.262 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-09-12T17:28:08.288 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-09-12T17:28:08.288 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-09-12T17:28:08.328 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-09-12T17:28:08.329 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:28:08.329 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:28:08.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:08.355 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:28:08.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:08.400 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:28:08.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:28:08.434 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:28:08.471 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:28:08.480 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:28:08.492 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:28:08.493 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:31:57.773 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-12T17:31:57.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-12T17:31:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:31:57.854 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-12T17:31:57.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-12T17:31:57.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:31:57.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:31:58.010 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T17:31:58.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T17:31:58.093 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:31:58.105 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:31:58.105 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:31:58.106 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:31:58.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:31:58.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:31:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:31:58.153 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:31:58.163 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:31:58.178 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:31:58.180 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-09-12T17:31:58.191 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-09-12T17:31:58.203 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-09-12T17:31:58.206 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:31:58.214 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-09-12T17:31:58.220 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:31:58.228 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:31:58.245 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:31:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:31:58.276 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:31:58.277 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-12T17:31:58.277 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.277 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.277 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.277 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.297 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.300 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:31:58.301 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:31:58.309 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:31:58.310 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:31:58.310 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:31:58.310 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:31:58.316 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:31:58.316 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:31:58.316 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:31:58.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:58.319 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:31:58.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:58.469 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:31:58.470 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:31:58.473 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:31:58.474 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:31:58.582 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:31:58.583 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:31:58.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:31:58.589 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:31:58.589 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:31:58.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:31:58.609 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:31:58.609 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:31:58.615 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:31:58.615 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:31:58.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:31:58.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:31:58.750 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:31:58.757 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:31:58.814 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-09-12T17:31:58.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-09-12T17:31:58.821 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-09-12T17:31:58.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-09-12T17:31:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:45 files removed 2024-09-12T17:31:59.049 INFO:teuthology.orchestra.run.smithi094.stdout:45 files removed 2024-09-12T17:31:59.070 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:31:59.076 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:31:59.619 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-12T17:31:59.628 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-12T17:31:59.894 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-12T17:31:59.929 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-12T17:32:00.161 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T17:32:00.213 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T17:32:00.755 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T17:32:01.845 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-12T17:32:02.815 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T17:32:03.788 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T17:32:08.406 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-12T17:32:09.057 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-12T17:32:10.182 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-12T17:32:11.111 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T17:32:11.466 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-12T17:32:12.662 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T17:32:17.833 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 1.3 kB/s | 1.7 kB 00:01 2024-09-12T17:32:18.193 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-12T17:32:20.147 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:32:20.147 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:32:20.240 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:32:20.262 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:32:20.263 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-09-12T17:32:20.264 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:32:20.265 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:32:20.266 INFO:teuthology.orchestra.run.smithi204.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:32:20.267 INFO:teuthology.orchestra.run.smithi204.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:32:20.268 INFO:teuthology.orchestra.run.smithi204.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:32:20.269 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:32:20.270 INFO:teuthology.orchestra.run.smithi204.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:32:20.271 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:32:20.272 INFO:teuthology.orchestra.run.smithi204.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:32:20.273 INFO:teuthology.orchestra.run.smithi204.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:32:20.274 INFO:teuthology.orchestra.run.smithi204.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:32:20.275 INFO:teuthology.orchestra.run.smithi204.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:32:20.276 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:32:20.277 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:32:20.278 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:32:20.279 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:32:20.280 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:32:20.281 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:32:20.282 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:32:20.283 INFO:teuthology.orchestra.run.smithi204.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:32:20.284 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:32:20.285 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout:Install 283 Packages 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 2 Packages 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:32:20.286 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 322 M 2024-09-12T17:32:20.287 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T17:32:20.487 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:32:20.487 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:32:20.580 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-12T17:32:20.606 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-12T17:32:20.606 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-12T17:32:20.606 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-12T17:32:20.606 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-12T17:32:20.606 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:32:20.607 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:32:20.608 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:32:20.609 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:32:20.610 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:32:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:32:20.612 INFO:teuthology.orchestra.run.smithi094.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:32:20.613 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:32:20.614 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:32:20.615 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:32:20.616 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:32:20.617 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:32:20.618 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:32:20.619 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:32:20.620 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:32:20.621 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:32:20.622 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:32:20.623 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:32:20.624 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:32:20.625 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:32:20.626 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:32:20.627 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:32:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:32:20.629 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout:Install 283 Packages 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 2 Packages 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:32:20.630 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 322 M 2024-09-12T17:32:20.631 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-12T17:32:21.035 INFO:teuthology.orchestra.run.smithi204.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-12T17:32:21.178 INFO:teuthology.orchestra.run.smithi094.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-12T17:32:21.210 INFO:teuthology.orchestra.run.smithi204.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 5.0 MB/s | 900 kB 00:00 2024-09-12T17:32:21.277 INFO:teuthology.orchestra.run.smithi204.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T17:32:21.419 INFO:teuthology.orchestra.run.smithi204.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T17:32:21.485 INFO:teuthology.orchestra.run.smithi204.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-12T17:32:21.561 INFO:teuthology.orchestra.run.smithi204.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-12T17:32:21.870 INFO:teuthology.orchestra.run.smithi094.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 1.3 MB/s | 900 kB 00:00 2024-09-12T17:32:21.895 INFO:teuthology.orchestra.run.smithi204.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-12T17:32:21.937 INFO:teuthology.orchestra.run.smithi094.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T17:32:22.312 INFO:teuthology.orchestra.run.smithi204.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 15 MB/s | 22 MB 00:01 2024-09-12T17:32:22.354 INFO:teuthology.orchestra.run.smithi204.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 606 kB/s | 25 kB 00:00 2024-09-12T17:32:22.462 INFO:teuthology.orchestra.run.smithi094.stdout:(4/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 4.5 MB/s | 2.4 MB 00:00 2024-09-12T17:32:22.596 INFO:teuthology.orchestra.run.smithi204.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 17 MB/s | 17 MB 00:01 2024-09-12T17:32:22.637 INFO:teuthology.orchestra.run.smithi094.stdout:(5/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-12T17:32:22.729 INFO:teuthology.orchestra.run.smithi204.stdout:(11/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 13 MB/s | 11 MB 00:00 2024-09-12T17:32:22.754 INFO:teuthology.orchestra.run.smithi204.stdout:(12/285): libcephfs-devel-19.3.0-4762.gbad475c1 201 kB/s | 32 kB 00:00 2024-09-12T17:32:22.779 INFO:teuthology.orchestra.run.smithi094.stdout:(6/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 3.2 MB/s | 5.5 MB 00:01 2024-09-12T17:32:22.788 INFO:teuthology.orchestra.run.smithi204.stdout:(13/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 13 MB/s | 756 kB 00:00 2024-09-12T17:32:22.813 INFO:teuthology.orchestra.run.smithi204.stdout:(14/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.7 MB/s | 161 kB 00:00 2024-09-12T17:32:22.838 INFO:teuthology.orchestra.run.smithi204.stdout:(15/285): librados-devel-19.3.0-4762.gbad475c1. 2.5 MB/s | 126 kB 00:00 2024-09-12T17:32:22.897 INFO:teuthology.orchestra.run.smithi204.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 5.9 MB/s | 508 kB 00:00 2024-09-12T17:32:22.964 INFO:teuthology.orchestra.run.smithi204.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 678 kB/s | 45 kB 00:00 2024-09-12T17:32:23.023 INFO:teuthology.orchestra.run.smithi204.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 2.4 MB/s | 143 kB 00:00 2024-09-12T17:32:23.090 INFO:teuthology.orchestra.run.smithi204.stdout:(19/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.4 MB/s | 161 kB 00:00 2024-09-12T17:32:23.105 INFO:teuthology.orchestra.run.smithi094.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 10 MB/s | 4.8 MB 00:00 2024-09-12T17:32:23.199 INFO:teuthology.orchestra.run.smithi204.stdout:(20/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 15 MB/s | 5.5 MB 00:00 2024-09-12T17:32:23.224 INFO:teuthology.orchestra.run.smithi204.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 2.4 MB/s | 321 kB 00:00 2024-09-12T17:32:23.249 INFO:teuthology.orchestra.run.smithi204.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 6.0 MB/s | 305 kB 00:00 2024-09-12T17:32:23.283 INFO:teuthology.orchestra.run.smithi204.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.7 MB/s | 99 kB 00:00 2024-09-12T17:32:23.308 INFO:teuthology.orchestra.run.smithi204.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T17:32:23.392 INFO:teuthology.orchestra.run.smithi204.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-12T17:32:23.492 INFO:teuthology.orchestra.run.smithi204.stdout:(26/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 15 MB/s | 3.2 MB 00:00 2024-09-12T17:32:23.517 INFO:teuthology.orchestra.run.smithi204.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4762.g 273 kB/s | 34 kB 00:00 2024-09-12T17:32:23.559 INFO:teuthology.orchestra.run.smithi204.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 2.2 MB/s | 154 kB 00:00 2024-09-12T17:32:23.780 INFO:teuthology.orchestra.run.smithi094.stdout:(8/285): ceph-radosgw-19.3.0-4762.gbad475c1.el9 16 MB/s | 11 MB 00:00 2024-09-12T17:32:23.863 INFO:teuthology.orchestra.run.smithi094.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 302 kB/s | 25 kB 00:00 2024-09-12T17:32:24.068 INFO:teuthology.orchestra.run.smithi204.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-12T17:32:24.168 INFO:teuthology.orchestra.run.smithi204.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 2.8 MB/s | 291 kB 00:00 2024-09-12T17:32:24.261 INFO:teuthology.orchestra.run.smithi204.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 540 kB/s | 49 kB 00:00 2024-09-12T17:32:24.360 INFO:teuthology.orchestra.run.smithi204.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 164 kB/s | 16 kB 00:00 2024-09-12T17:32:24.461 INFO:teuthology.orchestra.run.smithi204.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 2.8 MB/s | 285 kB 00:00 2024-09-12T17:32:24.669 INFO:teuthology.orchestra.run.smithi204.stdout:(34/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 12 MB/s | 14 MB 00:01 2024-09-12T17:32:24.703 INFO:teuthology.orchestra.run.smithi204.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 3.2 MB/s | 783 kB 00:00 2024-09-12T17:32:24.870 INFO:teuthology.orchestra.run.smithi204.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 508 kB/s | 85 kB 00:00 2024-09-12T17:32:24.904 INFO:teuthology.orchestra.run.smithi204.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.4 MB/s | 335 kB 00:00 2024-09-12T17:32:24.929 INFO:teuthology.orchestra.run.smithi204.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 844 kB/s | 49 kB 00:00 2024-09-12T17:32:24.979 INFO:teuthology.orchestra.run.smithi204.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-12T17:32:25.005 INFO:teuthology.orchestra.run.smithi204.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.5 MB/s | 262 kB 00:00 2024-09-12T17:32:25.055 INFO:teuthology.orchestra.run.smithi204.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 540 kB/s | 27 kB 00:00 2024-09-12T17:32:25.113 INFO:teuthology.orchestra.run.smithi204.stdout:(42/285): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T17:32:25.147 INFO:teuthology.orchestra.run.smithi204.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-12T17:32:25.172 INFO:teuthology.orchestra.run.smithi204.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-12T17:32:25.581 INFO:teuthology.orchestra.run.smithi204.stdout:(45/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 14 MB/s | 45 MB 00:03 2024-09-12T17:32:25.606 INFO:teuthology.orchestra.run.smithi204.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 552 kB/s | 253 kB 00:00 2024-09-12T17:32:25.640 INFO:teuthology.orchestra.run.smithi204.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-09-12T17:32:25.665 INFO:teuthology.orchestra.run.smithi204.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T17:32:25.724 INFO:teuthology.orchestra.run.smithi204.stdout:(49/285): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T17:32:25.741 INFO:teuthology.orchestra.run.smithi204.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-12T17:32:25.783 INFO:teuthology.orchestra.run.smithi204.stdout:(51/285): python3-ply-3.11-14.el9.noarch.rpm 530 kB/s | 106 kB 00:00 2024-09-12T17:32:25.841 INFO:teuthology.orchestra.run.smithi204.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 5.4 MB/s | 650 kB 00:00 2024-09-12T17:32:25.864 INFO:teuthology.orchestra.run.smithi094.stdout:(10/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 23 MB/s | 45 MB 00:01 2024-09-12T17:32:25.900 INFO:teuthology.orchestra.run.smithi204.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-12T17:32:25.914 INFO:teuthology.orchestra.run.smithi094.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 640 kB/s | 32 kB 00:00 2024-09-12T17:32:25.967 INFO:teuthology.orchestra.run.smithi204.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.8 MB/s | 523 kB 00:00 2024-09-12T17:32:25.981 INFO:teuthology.orchestra.run.smithi094.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 11 MB/s | 756 kB 00:00 2024-09-12T17:32:25.992 INFO:teuthology.orchestra.run.smithi204.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 3.2 MB/s | 302 kB 00:00 2024-09-12T17:32:26.026 INFO:teuthology.orchestra.run.smithi204.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-12T17:32:26.039 INFO:teuthology.orchestra.run.smithi094.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.7 MB/s | 161 kB 00:00 2024-09-12T17:32:26.051 INFO:teuthology.orchestra.run.smithi204.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 559 kB 00:00 2024-09-12T17:32:26.068 INFO:teuthology.orchestra.run.smithi204.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2024-09-12T17:32:26.090 INFO:teuthology.orchestra.run.smithi094.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 2.5 MB/s | 126 kB 00:00 2024-09-12T17:32:26.126 INFO:teuthology.orchestra.run.smithi204.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 399 kB/s | 23 kB 00:00 2024-09-12T17:32:26.140 INFO:teuthology.orchestra.run.smithi094.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 10 MB/s | 508 kB 00:00 2024-09-12T17:32:26.185 INFO:teuthology.orchestra.run.smithi204.stdout:(60/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T17:32:26.210 INFO:teuthology.orchestra.run.smithi204.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-09-12T17:32:26.236 INFO:teuthology.orchestra.run.smithi204.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-12T17:32:26.261 INFO:teuthology.orchestra.run.smithi204.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T17:32:26.303 INFO:teuthology.orchestra.run.smithi204.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 794 kB/s | 53 kB 00:00 2024-09-12T17:32:26.328 INFO:teuthology.orchestra.run.smithi204.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2024-09-12T17:32:26.332 INFO:teuthology.orchestra.run.smithi094.stdout:(16/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 29 MB/s | 5.5 MB 00:00 2024-09-12T17:32:26.354 INFO:teuthology.orchestra.run.smithi204.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T17:32:26.379 INFO:teuthology.orchestra.run.smithi204.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 561 kB/s | 28 kB 00:00 2024-09-12T17:32:26.382 INFO:teuthology.orchestra.run.smithi094.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 908 kB/s | 45 kB 00:00 2024-09-12T17:32:26.433 INFO:teuthology.orchestra.run.smithi094.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 2.8 MB/s | 143 kB 00:00 2024-09-12T17:32:26.437 INFO:teuthology.orchestra.run.smithi204.stdout:(68/285): exempi-2.6.0-0.2.20211007gite23c213.e 8.8 MB/s | 525 kB 00:00 2024-09-12T17:32:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.0 MB/s | 113 kB 00:00 2024-09-12T17:32:26.483 INFO:teuthology.orchestra.run.smithi094.stdout:(19/285): python3-cephfs-19.3.0-4762.gbad475c1. 3.2 MB/s | 161 kB 00:00 2024-09-12T17:32:26.542 INFO:teuthology.orchestra.run.smithi094.stdout:(20/285): python3-rados-19.3.0-4762.gbad475c1.e 5.4 MB/s | 321 kB 00:00 2024-09-12T17:32:26.572 INFO:teuthology.orchestra.run.smithi204.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 7.2 MB/s | 980 kB 00:00 2024-09-12T17:32:26.592 INFO:teuthology.orchestra.run.smithi094.stdout:(21/285): python3-rbd-19.3.0-4762.gbad475c1.el9 6.0 MB/s | 305 kB 00:00 2024-09-12T17:32:26.630 INFO:teuthology.orchestra.run.smithi204.stdout:(71/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.5 MB/s | 325 kB 00:00 2024-09-12T17:32:26.642 INFO:teuthology.orchestra.run.smithi094.stdout:(22/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:32:26.689 INFO:teuthology.orchestra.run.smithi204.stdout:(72/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.7 MB/s | 218 kB 00:00 2024-09-12T17:32:26.693 INFO:teuthology.orchestra.run.smithi094.stdout:(23/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:32:26.827 INFO:teuthology.orchestra.run.smithi094.stdout:(24/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 24 MB/s | 3.2 MB 00:00 2024-09-12T17:32:26.872 INFO:teuthology.orchestra.run.smithi204.stdout:(73/285): flatpak-1.12.9-1.el9.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2024-09-12T17:32:26.877 INFO:teuthology.orchestra.run.smithi094.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 3.4 MB/s | 170 kB 00:00 2024-09-12T17:32:26.898 INFO:teuthology.orchestra.run.smithi204.stdout:(74/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 1.8 MB/s | 781 kB 00:00 2024-09-12T17:32:26.923 INFO:teuthology.orchestra.run.smithi204.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 430 kB/s | 22 kB 00:00 2024-09-12T17:32:26.927 INFO:teuthology.orchestra.run.smithi094.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 686 kB/s | 34 kB 00:00 2024-09-12T17:32:26.973 INFO:teuthology.orchestra.run.smithi204.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-12T17:32:26.977 INFO:teuthology.orchestra.run.smithi094.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:32:26.998 INFO:teuthology.orchestra.run.smithi204.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 725 kB/s | 73 kB 00:00 2024-09-12T17:32:27.049 INFO:teuthology.orchestra.run.smithi204.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-12T17:32:27.108 INFO:teuthology.orchestra.run.smithi204.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-12T17:32:27.153 INFO:teuthology.orchestra.run.smithi094.stdout:(28/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 3.9 MB/s | 17 MB 00:04 2024-09-12T17:32:27.166 INFO:teuthology.orchestra.run.smithi204.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-12T17:32:27.208 INFO:teuthology.orchestra.run.smithi204.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-12T17:32:27.275 INFO:teuthology.orchestra.run.smithi204.stdout:(82/285): google-guice-4.2.3-9.el9.noarch.rpm 6.9 MB/s | 473 kB 00:00 2024-09-12T17:32:27.333 INFO:teuthology.orchestra.run.smithi204.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T17:32:27.376 INFO:teuthology.orchestra.run.smithi204.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 817 kB/s | 34 kB 00:00 2024-09-12T17:32:27.520 INFO:teuthology.orchestra.run.smithi094.stdout:(29/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 26 MB/s | 14 MB 00:00 2024-09-12T17:32:27.551 INFO:teuthology.orchestra.run.smithi204.stdout:(85/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.2 MB/s | 1.4 MB 00:00 2024-09-12T17:32:27.570 INFO:teuthology.orchestra.run.smithi094.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 5.7 MB/s | 291 kB 00:00 2024-09-12T17:32:27.620 INFO:teuthology.orchestra.run.smithi094.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 991 kB/s | 49 kB 00:00 2024-09-12T17:32:27.662 INFO:teuthology.orchestra.run.smithi094.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 395 kB/s | 16 kB 00:00 2024-09-12T17:32:27.712 INFO:teuthology.orchestra.run.smithi094.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T17:32:27.793 INFO:teuthology.orchestra.run.smithi204.stdout:(86/285): gstreamer1-plugins-base-1.22.1-2.el9. 9.3 MB/s | 2.2 MB 00:00 2024-09-12T17:32:27.843 INFO:teuthology.orchestra.run.smithi204.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 661 kB/s | 33 kB 00:00 2024-09-12T17:32:27.938 INFO:teuthology.orchestra.run.smithi094.stdout:(34/285): ceph-common-19.3.0-4762.gbad475c1.el9 3.1 MB/s | 22 MB 00:06 2024-09-12T17:32:27.980 INFO:teuthology.orchestra.run.smithi094.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 2.9 MB/s | 783 kB 00:00 2024-09-12T17:32:28.122 INFO:teuthology.orchestra.run.smithi094.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 598 kB/s | 85 kB 00:00 2024-09-12T17:32:28.172 INFO:teuthology.orchestra.run.smithi094.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 995 kB/s | 49 kB 00:00 2024-09-12T17:32:28.197 INFO:teuthology.orchestra.run.smithi094.stdout:(38/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.3 MB/s | 335 kB 00:00 2024-09-12T17:32:28.247 INFO:teuthology.orchestra.run.smithi094.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-12T17:32:28.273 INFO:teuthology.orchestra.run.smithi094.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.5 MB/s | 262 kB 00:00 2024-09-12T17:32:28.378 INFO:teuthology.orchestra.run.smithi204.stdout:(88/285): gtk3-3.24.31-5.el9.x86_64.rpm 9.3 MB/s | 4.9 MB 00:00 2024-09-12T17:32:28.398 INFO:teuthology.orchestra.run.smithi094.stdout:(41/285): ceph-mgr-diskprediction-local-19.3.0- 5.9 MB/s | 7.4 MB 00:01 2024-09-12T17:32:28.424 INFO:teuthology.orchestra.run.smithi094.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 179 kB/s | 27 kB 00:00 2024-09-12T17:32:28.474 INFO:teuthology.orchestra.run.smithi094.stdout:(43/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-12T17:32:28.532 INFO:teuthology.orchestra.run.smithi094.stdout:(44/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-12T17:32:28.544 INFO:teuthology.orchestra.run.smithi204.stdout:(89/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.9 MB/s | 3.0 MB 00:01 2024-09-12T17:32:28.558 INFO:teuthology.orchestra.run.smithi094.stdout:(45/285): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T17:32:28.592 INFO:teuthology.orchestra.run.smithi094.stdout:(46/285): libquadmath-11.5.0-2.el9.x86_64.rpm 992 kB/s | 191 kB 00:00 2024-09-12T17:32:28.616 INFO:teuthology.orchestra.run.smithi094.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T17:32:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:(90/285): guava-30.1-6.el9.noarch.rpm 9.0 MB/s | 2.3 MB 00:00 2024-09-12T17:32:28.650 INFO:teuthology.orchestra.run.smithi094.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T17:32:28.675 INFO:teuthology.orchestra.run.smithi094.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T17:32:28.717 INFO:teuthology.orchestra.run.smithi094.stdout:(50/285): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-12T17:32:28.736 INFO:teuthology.orchestra.run.smithi204.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 1.1 MB/s | 219 kB 00:00 2024-09-12T17:32:28.751 INFO:teuthology.orchestra.run.smithi094.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-12T17:32:28.770 INFO:teuthology.orchestra.run.smithi204.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 4.5 MB/s | 657 kB 00:00 2024-09-12T17:32:28.959 INFO:teuthology.orchestra.run.smithi094.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-12T17:32:29.010 INFO:teuthology.orchestra.run.smithi094.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-12T17:32:29.052 INFO:teuthology.orchestra.run.smithi094.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.7 MB/s | 523 kB 00:00 2024-09-12T17:32:29.077 INFO:teuthology.orchestra.run.smithi094.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 4.4 MB/s | 302 kB 00:00 2024-09-12T17:32:29.087 INFO:teuthology.orchestra.run.smithi204.stdout:(93/285): iso-codes-4.6.0-3.el9.noarch.rpm 11 MB/s | 3.5 MB 00:00 2024-09-12T17:32:29.110 INFO:teuthology.orchestra.run.smithi094.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-12T17:32:29.112 INFO:teuthology.orchestra.run.smithi204.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 1.6 MB/s | 632 kB 00:00 2024-09-12T17:32:29.136 INFO:teuthology.orchestra.run.smithi094.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 559 kB 00:00 2024-09-12T17:32:29.137 INFO:teuthology.orchestra.run.smithi204.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 900 kB/s | 45 kB 00:00 2024-09-12T17:32:29.161 INFO:teuthology.orchestra.run.smithi094.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T17:32:29.179 INFO:teuthology.orchestra.run.smithi204.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-12T17:32:29.212 INFO:teuthology.orchestra.run.smithi094.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 466 kB/s | 23 kB 00:00 2024-09-12T17:32:29.270 INFO:teuthology.orchestra.run.smithi094.stdout:(60/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T17:32:29.296 INFO:teuthology.orchestra.run.smithi094.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-09-12T17:32:29.321 INFO:teuthology.orchestra.run.smithi094.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-12T17:32:29.354 INFO:teuthology.orchestra.run.smithi094.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T17:32:29.379 INFO:teuthology.orchestra.run.smithi204.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 1.7 MB/s | 413 kB 00:00 2024-09-12T17:32:29.380 INFO:teuthology.orchestra.run.smithi094.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 912 kB/s | 53 kB 00:00 2024-09-12T17:32:29.430 INFO:teuthology.orchestra.run.smithi094.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-09-12T17:32:29.455 INFO:teuthology.orchestra.run.smithi094.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 812 kB/s | 61 kB 00:00 2024-09-12T17:32:29.489 INFO:teuthology.orchestra.run.smithi094.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 482 kB/s | 28 kB 00:00 2024-09-12T17:32:29.514 INFO:teuthology.orchestra.run.smithi094.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2024-09-12T17:32:29.538 INFO:teuthology.orchestra.run.smithi204.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 9.2 MB/s | 3.3 MB 00:00 2024-09-12T17:32:29.556 INFO:teuthology.orchestra.run.smithi094.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 525 kB 00:00 2024-09-12T17:32:29.597 INFO:teuthology.orchestra.run.smithi204.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 224 kB/s | 13 kB 00:00 2024-09-12T17:32:29.663 INFO:teuthology.orchestra.run.smithi204.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 795 kB/s | 53 kB 00:00 2024-09-12T17:32:29.723 INFO:teuthology.orchestra.run.smithi094.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 781 kB 00:00 2024-09-12T17:32:29.747 INFO:teuthology.orchestra.run.smithi204.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 288 kB/s | 24 kB 00:00 2024-09-12T17:32:29.757 INFO:teuthology.orchestra.run.smithi094.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 980 kB 00:00 2024-09-12T17:32:29.831 INFO:teuthology.orchestra.run.smithi204.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 4.4 MB/s | 377 kB 00:00 2024-09-12T17:32:29.882 INFO:teuthology.orchestra.run.smithi094.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.0 MB/s | 325 kB 00:00 2024-09-12T17:32:29.906 INFO:teuthology.orchestra.run.smithi204.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 474 kB/s | 35 kB 00:00 2024-09-12T17:32:29.907 INFO:teuthology.orchestra.run.smithi094.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 1.4 MB/s | 218 kB 00:00 2024-09-12T17:32:30.007 INFO:teuthology.orchestra.run.smithi204.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 1.6 MB/s | 168 kB 00:00 2024-09-12T17:32:30.008 INFO:teuthology.orchestra.run.smithi094.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 216 kB/s | 22 kB 00:00 2024-09-12T17:32:30.057 INFO:teuthology.orchestra.run.smithi204.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 222 kB/s | 11 kB 00:00 2024-09-12T17:32:30.066 INFO:teuthology.orchestra.run.smithi094.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-12T17:32:30.117 INFO:teuthology.orchestra.run.smithi094.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-12T17:32:30.128 INFO:teuthology.orchestra.run.smithi204.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 342 kB/s | 24 kB 00:00 2024-09-12T17:32:30.182 INFO:teuthology.orchestra.run.smithi204.stdout:(107/285): libXcursor-1.2.0-7.el9.x86_64.rpm 565 kB/s | 31 kB 00:00 2024-09-12T17:32:30.192 INFO:teuthology.orchestra.run.smithi094.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2024-09-12T17:32:30.241 INFO:teuthology.orchestra.run.smithi204.stdout:(108/285): libXdamage-1.1.5-7.el9.x86_64.rpm 391 kB/s | 23 kB 00:00 2024-09-12T17:32:30.259 INFO:teuthology.orchestra.run.smithi094.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-12T17:32:30.317 INFO:teuthology.orchestra.run.smithi204.stdout:(109/285): libXfixes-5.0.3-16.el9.x86_64.rpm 264 kB/s | 20 kB 00:00 2024-09-12T17:32:30.376 INFO:teuthology.orchestra.run.smithi094.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 761 kB/s | 89 kB 00:00 2024-09-12T17:32:30.383 INFO:teuthology.orchestra.run.smithi204.stdout:(110/285): libXi-1.7.10-8.el9.x86_64.rpm 594 kB/s | 40 kB 00:00 2024-09-12T17:32:30.434 INFO:teuthology.orchestra.run.smithi204.stdout:(111/285): libXinerama-1.1.4-10.el9.x86_64.rpm 302 kB/s | 15 kB 00:00 2024-09-12T17:32:30.460 INFO:teuthology.orchestra.run.smithi094.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.5 MB/s | 124 kB 00:00 2024-09-12T17:32:30.484 INFO:teuthology.orchestra.run.smithi204.stdout:(112/285): libXrandr-1.5.2-8.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-09-12T17:32:30.510 INFO:teuthology.orchestra.run.smithi094.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-12T17:32:30.542 INFO:teuthology.orchestra.run.smithi204.stdout:(113/285): libXtst-1.2.3-16.el9.x86_64.rpm 369 kB/s | 21 kB 00:00 2024-09-12T17:32:30.593 INFO:teuthology.orchestra.run.smithi204.stdout:(114/285): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-12T17:32:30.652 INFO:teuthology.orchestra.run.smithi204.stdout:(115/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 322 kB/s | 19 kB 00:00 2024-09-12T17:32:30.702 INFO:teuthology.orchestra.run.smithi204.stdout:(116/285): libasyncns-0.8-22.el9.x86_64.rpm 610 kB/s | 30 kB 00:00 2024-09-12T17:32:30.761 INFO:teuthology.orchestra.run.smithi204.stdout:(117/285): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-12T17:32:30.777 INFO:teuthology.orchestra.run.smithi094.stdout:(82/285): google-guice-4.2.3-9.el9.noarch.rpm 1.7 MB/s | 473 kB 00:00 2024-09-12T17:32:30.811 INFO:teuthology.orchestra.run.smithi204.stdout:(118/285): libcanberra-gtk3-0.30-27.el9.x86_64. 638 kB/s | 32 kB 00:00 2024-09-12T17:32:30.861 INFO:teuthology.orchestra.run.smithi094.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 775 kB/s | 64 kB 00:00 2024-09-12T17:32:30.869 INFO:teuthology.orchestra.run.smithi204.stdout:(119/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-12T17:32:30.911 INFO:teuthology.orchestra.run.smithi094.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 683 kB/s | 34 kB 00:00 2024-09-12T17:32:30.928 INFO:teuthology.orchestra.run.smithi204.stdout:(120/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-09-12T17:32:30.987 INFO:teuthology.orchestra.run.smithi204.stdout:(121/285): libexif-0.6.22-6.el9.x86_64.rpm 7.3 MB/s | 435 kB 00:00 2024-09-12T17:32:31.037 INFO:teuthology.orchestra.run.smithi204.stdout:(122/285): libfontenc-1.1.3-17.el9.x86_64.rpm 618 kB/s | 31 kB 00:00 2024-09-12T17:32:31.163 INFO:teuthology.orchestra.run.smithi204.stdout:(123/285): adwaita-icon-theme-40.1.1-3.el9.noar 2.2 MB/s | 12 MB 00:05 2024-09-12T17:32:31.188 INFO:teuthology.orchestra.run.smithi204.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 550 kB/s | 83 kB 00:00 2024-09-12T17:32:31.238 INFO:teuthology.orchestra.run.smithi204.stdout:(125/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 735 kB/s | 37 kB 00:00 2024-09-12T17:32:31.289 INFO:teuthology.orchestra.run.smithi204.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.1 MB/s | 135 kB 00:00 2024-09-12T17:32:31.314 INFO:teuthology.orchestra.run.smithi204.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-12T17:32:31.364 INFO:teuthology.orchestra.run.smithi204.stdout:(128/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T17:32:31.415 INFO:teuthology.orchestra.run.smithi204.stdout:(129/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T17:32:31.465 INFO:teuthology.orchestra.run.smithi204.stdout:(130/285): libldac-2.0.2.3-10.el9.x86_64.rpm 827 kB/s | 41 kB 00:00 2024-09-12T17:32:31.755 INFO:teuthology.orchestra.run.smithi094.stdout:(85/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-12T17:32:31.755 INFO:teuthology.orchestra.run.smithi094.stdout:(86/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(131/285): libgsf-1.14.47-5.el9.x86_64.rpm 1.2 MB/s | 256 kB 00:00 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 869 kB/s | 44 kB 00:00 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 666 kB/s | 34 kB 00:00 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(134/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(135/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T17:32:31.756 INFO:teuthology.orchestra.run.smithi204.stdout:(136/285): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-09-12T17:32:31.775 INFO:teuthology.orchestra.run.smithi204.stdout:(137/285): libosinfo-1.10.0-1.el9.x86_64.rpm 1.2 MB/s | 319 kB 00:00 2024-09-12T17:32:31.787 INFO:teuthology.orchestra.run.smithi094.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 663 kB/s | 33 kB 00:00 2024-09-12T17:32:31.801 INFO:teuthology.orchestra.run.smithi204.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-12T17:32:31.834 INFO:teuthology.orchestra.run.smithi204.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-12T17:32:31.892 INFO:teuthology.orchestra.run.smithi204.stdout:(140/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T17:32:31.918 INFO:teuthology.orchestra.run.smithi204.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2024-09-12T17:32:31.943 INFO:teuthology.orchestra.run.smithi204.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 710 kB/s | 36 kB 00:00 2024-09-12T17:32:32.002 INFO:teuthology.orchestra.run.smithi204.stdout:(143/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-12T17:32:32.060 INFO:teuthology.orchestra.run.smithi204.stdout:(144/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-12T17:32:32.111 INFO:teuthology.orchestra.run.smithi204.stdout:(145/285): libwayland-client-1.21.0-1.el9.x86_6 667 kB/s | 33 kB 00:00 2024-09-12T17:32:32.144 INFO:teuthology.orchestra.run.smithi204.stdout:(146/285): libtracker-sparql-3.1.2-3.el9.x86_64 1.4 MB/s | 324 kB 00:00 2024-09-12T17:32:32.161 INFO:teuthology.orchestra.run.smithi204.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 385 kB/s | 19 kB 00:00 2024-09-12T17:32:32.187 INFO:teuthology.orchestra.run.smithi204.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 306 kB/s | 13 kB 00:00 2024-09-12T17:32:32.204 INFO:teuthology.orchestra.run.smithi204.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 995 kB/s | 42 kB 00:00 2024-09-12T17:32:32.246 INFO:teuthology.orchestra.run.smithi204.stdout:(150/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 3.1 MB/s | 133 kB 00:00 2024-09-12T17:32:32.313 INFO:teuthology.orchestra.run.smithi204.stdout:(151/285): libxshmfence-1.3-10.el9.x86_64.rpm 189 kB/s | 13 kB 00:00 2024-09-12T17:32:32.413 INFO:teuthology.orchestra.run.smithi204.stdout:(152/285): libwebp-1.2.0-8.el9.x86_64.rpm 1.2 MB/s | 277 kB 00:00 2024-09-12T17:32:32.438 INFO:teuthology.orchestra.run.smithi204.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 286 kB/s | 36 kB 00:00 2024-09-12T17:32:32.497 INFO:teuthology.orchestra.run.smithi204.stdout:(154/285): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T17:32:32.556 INFO:teuthology.orchestra.run.smithi204.stdout:(155/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T17:32:32.606 INFO:teuthology.orchestra.run.smithi204.stdout:(156/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-12T17:32:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 235 kB/s | 18 kB 00:00 2024-09-12T17:32:32.682 INFO:teuthology.orchestra.run.smithi204.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-12T17:32:32.748 INFO:teuthology.orchestra.run.smithi204.stdout:(159/285): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-12T17:32:32.779 INFO:teuthology.orchestra.run.smithi094.stdout:(88/285): gstreamer1-plugins-base-1.22.1-2.el9. 2.0 MB/s | 2.2 MB 00:01 2024-09-12T17:32:32.799 INFO:teuthology.orchestra.run.smithi204.stdout:(160/285): maven-shared-utils-3.3.4-3.el9.noarc 3.0 MB/s | 151 kB 00:00 2024-09-12T17:32:32.857 INFO:teuthology.orchestra.run.smithi204.stdout:(161/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-12T17:32:33.424 INFO:teuthology.orchestra.run.smithi204.stdout:(162/285): maven-lib-3.6.3-15.el9.noarch.rpm 1.8 MB/s | 1.5 MB 00:00 2024-09-12T17:32:33.483 INFO:teuthology.orchestra.run.smithi204.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 194 kB/s | 11 kB 00:00 2024-09-12T17:32:33.583 INFO:teuthology.orchestra.run.smithi204.stdout:(164/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 12 MB/s | 8.8 MB 00:00 2024-09-12T17:32:33.633 INFO:teuthology.orchestra.run.smithi204.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 923 kB/s | 139 kB 00:00 2024-09-12T17:32:33.658 INFO:teuthology.orchestra.run.smithi204.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-12T17:32:33.684 INFO:teuthology.orchestra.run.smithi204.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 720 kB/s | 36 kB 00:00 2024-09-12T17:32:33.734 INFO:teuthology.orchestra.run.smithi204.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 609 kB/s | 46 kB 00:00 2024-09-12T17:32:33.760 INFO:teuthology.orchestra.run.smithi204.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 428 kB/s | 32 kB 00:00 2024-09-12T17:32:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T17:32:33.843 INFO:teuthology.orchestra.run.smithi204.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-12T17:32:33.902 INFO:teuthology.orchestra.run.smithi204.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-12T17:32:33.920 INFO:teuthology.orchestra.run.smithi094.stdout:(89/285): guava-30.1-6.el9.noarch.rpm 2.0 MB/s | 2.3 MB 00:01 2024-09-12T17:32:33.952 INFO:teuthology.orchestra.run.smithi204.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T17:32:34.011 INFO:teuthology.orchestra.run.smithi204.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T17:32:34.053 INFO:teuthology.orchestra.run.smithi204.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.7 MB/s | 74 kB 00:00 2024-09-12T17:32:34.062 INFO:teuthology.orchestra.run.smithi094.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 1.5 MB/s | 219 kB 00:00 2024-09-12T17:32:34.123 INFO:teuthology.orchestra.run.smithi204.stdout:(176/285): ostree-libs-2024.7-2.el9.x86_64.rpm 6.6 MB/s | 468 kB 00:00 2024-09-12T17:32:34.182 INFO:teuthology.orchestra.run.smithi204.stdout:(177/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T17:32:34.213 INFO:teuthology.orchestra.run.smithi094.stdout:(91/285): adwaita-icon-theme-40.1.1-3.el9.noarc 2.2 MB/s | 12 MB 00:05 2024-09-12T17:32:34.240 INFO:teuthology.orchestra.run.smithi204.stdout:(178/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-12T17:32:34.291 INFO:teuthology.orchestra.run.smithi204.stdout:(179/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T17:32:34.309 INFO:teuthology.orchestra.run.smithi094.stdout:(92/285): gtk3-3.24.31-5.el9.x86_64.rpm 1.9 MB/s | 4.9 MB 00:02 2024-09-12T17:32:34.346 INFO:teuthology.orchestra.run.smithi204.stdout:(180/285): pipewire-jack-audio-connection-kit-1 183 kB/s | 9.1 kB 00:00 2024-09-12T17:32:34.450 INFO:teuthology.orchestra.run.smithi204.stdout:(181/285): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-09-12T17:32:34.506 INFO:teuthology.orchestra.run.smithi094.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 1.4 MB/s | 657 kB 00:00 2024-09-12T17:32:34.556 INFO:teuthology.orchestra.run.smithi094.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 902 kB/s | 45 kB 00:00 2024-09-12T17:32:34.620 INFO:teuthology.orchestra.run.smithi094.stdout:(95/285): httpcomponents-core-4.4.13-7.el9.noar 1.5 MB/s | 632 kB 00:00 2024-09-12T17:32:34.623 INFO:teuthology.orchestra.run.smithi204.stdout:(182/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 12 MB/s | 1.9 MB 00:00 2024-09-12T17:32:34.651 INFO:teuthology.orchestra.run.smithi094.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.3 MB/s | 110 kB 00:00 2024-09-12T17:32:34.679 INFO:teuthology.orchestra.run.smithi204.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.8 MB/s | 192 kB 00:00 2024-09-12T17:32:34.777 INFO:teuthology.orchestra.run.smithi204.stdout:(184/285): plexus-cipher-1.7-27.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-09-12T17:32:34.850 INFO:teuthology.orchestra.run.smithi094.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 1.7 MB/s | 413 kB 00:00 2024-09-12T17:32:34.859 INFO:teuthology.orchestra.run.smithi204.stdout:(185/285): plexus-classworlds-2.6.0-11.el9.noar 721 kB/s | 60 kB 00:00 2024-09-12T17:32:34.910 INFO:teuthology.orchestra.run.smithi204.stdout:(186/285): plexus-containers-component-annotati 369 kB/s | 18 kB 00:00 2024-09-12T17:32:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:(187/285): plexus-interpolation-1.26-11.el9.noa 956 kB/s | 80 kB 00:00 2024-09-12T17:32:35.044 INFO:teuthology.orchestra.run.smithi204.stdout:(188/285): plexus-sec-dispatcher-1.4-37.el9.noa 671 kB/s | 34 kB 00:00 2024-09-12T17:32:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:(189/285): plexus-utils-3.3.0-10.el9.noarch.rpm 2.1 MB/s | 254 kB 00:00 2024-09-12T17:32:35.378 INFO:teuthology.orchestra.run.smithi204.stdout:(190/285): poppler-21.01.0-21.el9.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2024-09-12T17:32:36.206 INFO:teuthology.orchestra.run.smithi094.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 1.9 MB/s | 3.5 MB 00:01 2024-09-12T17:32:36.257 INFO:teuthology.orchestra.run.smithi094.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-12T17:32:36.303 INFO:teuthology.orchestra.run.smithi204.stdout:(191/285): poppler-data-0.4.9-9.el9.noarch.rpm 2.0 MB/s | 1.9 MB 00:00 2024-09-12T17:32:36.307 INFO:teuthology.orchestra.run.smithi094.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T17:32:36.357 INFO:teuthology.orchestra.run.smithi094.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 481 kB/s | 24 kB 00:00 2024-09-12T17:32:36.395 INFO:teuthology.orchestra.run.smithi204.stdout:(192/285): openblas-openmp-0.3.26-2.el9.x86_64. 1.9 MB/s | 4.9 MB 00:02 2024-09-12T17:32:36.416 INFO:teuthology.orchestra.run.smithi094.stdout:(102/285): java-11-openjdk-devel-11.0.20.1.1-2. 1.9 MB/s | 3.3 MB 00:01 2024-09-12T17:32:36.420 INFO:teuthology.orchestra.run.smithi204.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-12T17:32:36.466 INFO:teuthology.orchestra.run.smithi094.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 713 kB/s | 35 kB 00:00 2024-09-12T17:32:36.512 INFO:teuthology.orchestra.run.smithi204.stdout:(194/285): publicsuffix-list-20210518-3.el9.noa 903 kB/s | 83 kB 00:00 2024-09-12T17:32:36.583 INFO:teuthology.orchestra.run.smithi094.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 1.4 MB/s | 168 kB 00:00 2024-09-12T17:32:36.617 INFO:teuthology.orchestra.run.smithi094.stdout:(105/285): jsoup-1.13.1-10.el9.noarch.rpm 1.4 MB/s | 377 kB 00:00 2024-09-12T17:32:36.642 INFO:teuthology.orchestra.run.smithi094.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 190 kB/s | 11 kB 00:00 2024-09-12T17:32:36.668 INFO:teuthology.orchestra.run.smithi094.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 477 kB/s | 24 kB 00:00 2024-09-12T17:32:36.693 INFO:teuthology.orchestra.run.smithi094.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 607 kB/s | 31 kB 00:00 2024-09-12T17:32:36.718 INFO:teuthology.orchestra.run.smithi094.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 455 kB/s | 23 kB 00:00 2024-09-12T17:32:36.743 INFO:teuthology.orchestra.run.smithi094.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-09-12T17:32:36.769 INFO:teuthology.orchestra.run.smithi094.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 787 kB/s | 40 kB 00:00 2024-09-12T17:32:36.794 INFO:teuthology.orchestra.run.smithi094.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-12T17:32:36.819 INFO:teuthology.orchestra.run.smithi094.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-09-12T17:32:36.854 INFO:teuthology.orchestra.run.smithi204.stdout:(195/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 1.9 MB/s | 679 kB 00:00 2024-09-12T17:32:36.861 INFO:teuthology.orchestra.run.smithi094.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 321 kB/s | 21 kB 00:00 2024-09-12T17:32:36.887 INFO:teuthology.orchestra.run.smithi094.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 284 kB/s | 19 kB 00:00 2024-09-12T17:32:36.912 INFO:teuthology.orchestra.run.smithi094.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-12T17:32:36.937 INFO:teuthology.orchestra.run.smithi094.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 607 kB/s | 30 kB 00:00 2024-09-12T17:32:36.946 INFO:teuthology.orchestra.run.smithi204.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-12T17:32:36.987 INFO:teuthology.orchestra.run.smithi094.stdout:(118/285): libcanberra-gtk3-0.30-27.el9.x86_64. 636 kB/s | 32 kB 00:00 2024-09-12T17:32:37.013 INFO:teuthology.orchestra.run.smithi094.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 857 kB/s | 86 kB 00:00 2024-09-12T17:32:37.088 INFO:teuthology.orchestra.run.smithi204.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 1.7 MB/s | 245 kB 00:00 2024-09-12T17:32:37.096 INFO:teuthology.orchestra.run.smithi094.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-12T17:32:37.155 INFO:teuthology.orchestra.run.smithi094.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-09-12T17:32:37.206 INFO:teuthology.orchestra.run.smithi094.stdout:(122/285): libfontenc-1.1.3-17.el9.x86_64.rpm 621 kB/s | 31 kB 00:00 2024-09-12T17:32:37.239 INFO:teuthology.orchestra.run.smithi204.stdout:(198/285): python3-jinja2-2.11.3-6.el9.noarch.r 1.6 MB/s | 248 kB 00:00 2024-09-12T17:32:37.289 INFO:teuthology.orchestra.run.smithi094.stdout:(123/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 993 kB/s | 83 kB 00:00 2024-09-12T17:32:37.314 INFO:teuthology.orchestra.run.smithi204.stdout:(199/285): python3-jsonpatch-1.21-16.el9.noarch 342 kB/s | 26 kB 00:00 2024-09-12T17:32:37.348 INFO:teuthology.orchestra.run.smithi094.stdout:(124/285): libexif-0.6.22-6.el9.x86_64.rpm 1.7 MB/s | 435 kB 00:00 2024-09-12T17:32:37.364 INFO:teuthology.orchestra.run.smithi204.stdout:(200/285): python3-jsonpointer-2.0-4.el9.noarch 383 kB/s | 19 kB 00:00 2024-09-12T17:32:37.398 INFO:teuthology.orchestra.run.smithi094.stdout:(125/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 737 kB/s | 37 kB 00:00 2024-09-12T17:32:37.431 INFO:teuthology.orchestra.run.smithi094.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 951 kB/s | 135 kB 00:00 2024-09-12T17:32:37.506 INFO:teuthology.orchestra.run.smithi204.stdout:(201/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-12T17:32:37.515 INFO:teuthology.orchestra.run.smithi094.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2024-09-12T17:32:37.556 INFO:teuthology.orchestra.run.smithi204.stdout:(202/285): python3-markupsafe-1.1.1-12.el9.x86_ 696 kB/s | 35 kB 00:00 2024-09-12T17:32:37.599 INFO:teuthology.orchestra.run.smithi094.stdout:(128/285): libgxps-0.3.2-3.el9.x86_64.rpm 948 kB/s | 79 kB 00:00 2024-09-12T17:32:37.624 INFO:teuthology.orchestra.run.smithi094.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 1.3 MB/s | 256 kB 00:00 2024-09-12T17:32:37.641 INFO:teuthology.orchestra.run.smithi094.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T17:32:37.666 INFO:teuthology.orchestra.run.smithi094.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 987 kB/s | 41 kB 00:00 2024-09-12T17:32:37.684 INFO:teuthology.orchestra.run.smithi094.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-09-12T17:32:37.708 INFO:teuthology.orchestra.run.smithi094.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 799 kB/s | 34 kB 00:00 2024-09-12T17:32:37.837 INFO:teuthology.orchestra.run.smithi094.stdout:(134/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T17:32:37.893 INFO:teuthology.orchestra.run.smithi094.stdout:(135/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-12T17:32:37.918 INFO:teuthology.orchestra.run.smithi094.stdout:(136/285): libosinfo-1.10.0-1.el9.x86_64.rpm 1.3 MB/s | 319 kB 00:00 2024-09-12T17:32:37.968 INFO:teuthology.orchestra.run.smithi094.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-12T17:32:38.119 INFO:teuthology.orchestra.run.smithi094.stdout:(138/285): libsndfile-1.0.31-8.el9.x86_64.rpm 1.3 MB/s | 206 kB 00:00 2024-09-12T17:32:38.245 INFO:teuthology.orchestra.run.smithi094.stdout:(139/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2024-09-12T17:32:38.269 INFO:teuthology.orchestra.run.smithi094.stdout:(140/285): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-12T17:32:38.336 INFO:teuthology.orchestra.run.smithi094.stdout:(141/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 533 kB/s | 36 kB 00:00 2024-09-12T17:32:38.420 INFO:teuthology.orchestra.run.smithi094.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-09-12T17:32:38.528 INFO:teuthology.orchestra.run.smithi094.stdout:(143/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-09-12T17:32:38.565 INFO:teuthology.orchestra.run.smithi094.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 1.4 MB/s | 324 kB 00:00 2024-09-12T17:32:38.612 INFO:teuthology.orchestra.run.smithi094.stdout:(145/285): libwayland-client-1.21.0-1.el9.x86_6 669 kB/s | 33 kB 00:00 2024-09-12T17:32:38.663 INFO:teuthology.orchestra.run.smithi094.stdout:(146/285): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-12T17:32:38.688 INFO:teuthology.orchestra.run.smithi094.stdout:(147/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.2 MB/s | 193 kB 00:00 2024-09-12T17:32:38.713 INFO:teuthology.orchestra.run.smithi094.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 255 kB/s | 13 kB 00:00 2024-09-12T17:32:38.738 INFO:teuthology.orchestra.run.smithi094.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 832 kB/s | 42 kB 00:00 2024-09-12T17:32:38.857 INFO:teuthology.orchestra.run.smithi094.stdout:(150/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2024-09-12T17:32:38.914 INFO:teuthology.orchestra.run.smithi094.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 1.3 MB/s | 277 kB 00:00 2024-09-12T17:32:38.939 INFO:teuthology.orchestra.run.smithi094.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 151 kB/s | 13 kB 00:00 2024-09-12T17:32:38.973 INFO:teuthology.orchestra.run.smithi094.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-12T17:32:39.090 INFO:teuthology.orchestra.run.smithi094.stdout:(154/285): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T17:32:39.115 INFO:teuthology.orchestra.run.smithi094.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-12T17:32:39.165 INFO:teuthology.orchestra.run.smithi094.stdout:(156/285): maven-3.6.3-15.el9.noarch.rpm 354 kB/s | 18 kB 00:00 2024-09-12T17:32:39.224 INFO:teuthology.orchestra.run.smithi094.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.1 MB/s | 151 kB 00:00 2024-09-12T17:32:39.274 INFO:teuthology.orchestra.run.smithi094.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 181 kB/s | 9.0 kB 00:00 2024-09-12T17:32:39.356 INFO:teuthology.orchestra.run.smithi204.stdout:(203/285): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-12T17:32:39.600 INFO:teuthology.orchestra.run.smithi094.stdout:(159/285): maven-resolver-1.6.1-10.el9.noarch.r 1.6 MB/s | 517 kB 00:00 2024-09-12T17:32:39.717 INFO:teuthology.orchestra.run.smithi094.stdout:(160/285): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-12T17:32:39.732 INFO:teuthology.orchestra.run.smithi204.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 668 kB/s | 250 kB 00:00 2024-09-12T17:32:39.801 INFO:teuthology.orchestra.run.smithi094.stdout:(161/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T17:32:39.848 INFO:teuthology.orchestra.run.smithi204.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 1.9 MB/s | 222 kB 00:00 2024-09-12T17:32:39.907 INFO:teuthology.orchestra.run.smithi204.stdout:(206/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T17:32:39.957 INFO:teuthology.orchestra.run.smithi204.stdout:(207/285): python3-prettytable-0.7.2-27.el9.noa 844 kB/s | 42 kB 00:00 2024-09-12T17:32:40.016 INFO:teuthology.orchestra.run.smithi204.stdout:(208/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-12T17:32:40.075 INFO:teuthology.orchestra.run.smithi204.stdout:(209/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-12T17:32:40.093 INFO:teuthology.orchestra.run.smithi094.stdout:(162/285): maven-lib-3.6.3-15.el9.noarch.rpm 1.6 MB/s | 1.5 MB 00:00 2024-09-12T17:32:40.133 INFO:teuthology.orchestra.run.smithi204.stdout:(210/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-12T17:32:40.134 INFO:teuthology.orchestra.run.smithi094.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 271 kB/s | 11 kB 00:00 2024-09-12T17:32:40.192 INFO:teuthology.orchestra.run.smithi204.stdout:(211/285): python3-pytz-2021.1-5.el9.noarch.rpm 879 kB/s | 51 kB 00:00 2024-09-12T17:32:40.250 INFO:teuthology.orchestra.run.smithi204.stdout:(212/285): python3-requests-oauthlib-1.3.0-12.e 921 kB/s | 54 kB 00:00 2024-09-12T17:32:40.260 INFO:teuthology.orchestra.run.smithi094.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 139 kB 00:00 2024-09-12T17:32:40.317 INFO:teuthology.orchestra.run.smithi204.stdout:(213/285): python3-numpy-1.20.1-5.el9.x86_64.rp 1.8 MB/s | 5.1 MB 00:02 2024-09-12T17:32:40.376 INFO:teuthology.orchestra.run.smithi204.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-09-12T17:32:40.377 INFO:teuthology.orchestra.run.smithi094.stdout:(165/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-12T17:32:40.427 INFO:teuthology.orchestra.run.smithi094.stdout:(166/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 724 kB/s | 36 kB 00:00 2024-09-12T17:32:40.489 INFO:teuthology.orchestra.run.smithi094.stdout:(167/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 788 kB/s | 46 kB 00:00 2024-09-12T17:32:40.551 INFO:teuthology.orchestra.run.smithi204.stdout:(215/285): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-09-12T17:32:40.569 INFO:teuthology.orchestra.run.smithi094.stdout:(168/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 387 kB/s | 32 kB 00:00 2024-09-12T17:32:40.610 INFO:teuthology.orchestra.run.smithi204.stdout:(216/285): qatlib-service-24.02.0-1.el9.x86_64. 617 kB/s | 36 kB 00:00 2024-09-12T17:32:40.611 INFO:teuthology.orchestra.run.smithi094.stdout:(169/285): openblas-0.3.26-2.el9.x86_64.rpm 923 kB/s | 38 kB 00:00 2024-09-12T17:32:40.985 INFO:teuthology.orchestra.run.smithi204.stdout:(217/285): java-11-openjdk-headless-11.0.20.1.1 3.4 MB/s | 39 MB 00:11 2024-09-12T17:32:41.011 INFO:teuthology.orchestra.run.smithi204.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 118 kB/s | 47 kB 00:00 2024-09-12T17:32:41.044 INFO:teuthology.orchestra.run.smithi204.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 960 kB/s | 56 kB 00:00 2024-09-12T17:32:41.103 INFO:teuthology.orchestra.run.smithi204.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-12T17:32:41.161 INFO:teuthology.orchestra.run.smithi204.stdout:(221/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T17:32:41.228 INFO:teuthology.orchestra.run.smithi204.stdout:(222/285): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-12T17:32:41.287 INFO:teuthology.orchestra.run.smithi204.stdout:(223/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-12T17:32:41.346 INFO:teuthology.orchestra.run.smithi204.stdout:(224/285): sisu-0.3.4-10.el9.noarch.rpm 1.5 MB/s | 510 kB 00:00 2024-09-12T17:32:41.379 INFO:teuthology.orchestra.run.smithi204.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 5.9 MB/s | 555 kB 00:00 2024-09-12T17:32:41.430 INFO:teuthology.orchestra.run.smithi204.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T17:32:41.488 INFO:teuthology.orchestra.run.smithi204.stdout:(227/285): tzdata-java-2024a-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-12T17:32:41.547 INFO:teuthology.orchestra.run.smithi204.stdout:(228/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T17:32:41.706 INFO:teuthology.orchestra.run.smithi204.stdout:(229/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T17:32:41.731 INFO:teuthology.orchestra.run.smithi204.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 1.6 MB/s | 306 kB 00:00 2024-09-12T17:32:41.756 INFO:teuthology.orchestra.run.smithi204.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T17:32:41.790 INFO:teuthology.orchestra.run.smithi204.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-12T17:32:41.815 INFO:teuthology.orchestra.run.smithi204.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 724 kB/s | 42 kB 00:00 2024-09-12T17:32:41.849 INFO:teuthology.orchestra.run.smithi204.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.4 MB/s | 385 kB 00:00 2024-09-12T17:32:41.874 INFO:teuthology.orchestra.run.smithi204.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-12T17:32:41.916 INFO:teuthology.orchestra.run.smithi204.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-12T17:32:41.941 INFO:teuthology.orchestra.run.smithi204.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-09-12T17:32:41.975 INFO:teuthology.orchestra.run.smithi204.stdout:(238/285): tracker-miners-3.1.2-4.el9.x86_64.rp 1.5 MB/s | 944 kB 00:00 2024-09-12T17:32:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.3 MB/s | 505 kB 00:00 2024-09-12T17:32:42.042 INFO:teuthology.orchestra.run.smithi204.stdout:(240/285): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-12T17:32:42.093 INFO:teuthology.orchestra.run.smithi204.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T17:32:42.118 INFO:teuthology.orchestra.run.smithi204.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 847 kB/s | 19 kB 00:00 2024-09-12T17:32:42.152 INFO:teuthology.orchestra.run.smithi204.stdout:(243/285): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-12T17:32:42.176 INFO:teuthology.orchestra.run.smithi204.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T17:32:42.202 INFO:teuthology.orchestra.run.smithi204.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:32:42.227 INFO:teuthology.orchestra.run.smithi204.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T17:32:42.252 INFO:teuthology.orchestra.run.smithi204.stdout:(247/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-12T17:32:42.286 INFO:teuthology.orchestra.run.smithi204.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T17:32:42.328 INFO:teuthology.orchestra.run.smithi204.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T17:32:42.353 INFO:teuthology.orchestra.run.smithi204.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:32:42.379 INFO:teuthology.orchestra.run.smithi204.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:32:42.404 INFO:teuthology.orchestra.run.smithi204.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 560 kB/s | 14 kB 00:00 2024-09-12T17:32:42.429 INFO:teuthology.orchestra.run.smithi204.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-12T17:32:42.463 INFO:teuthology.orchestra.run.smithi204.stdout:(254/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-12T17:32:42.497 INFO:teuthology.orchestra.run.smithi204.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T17:32:42.522 INFO:teuthology.orchestra.run.smithi204.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T17:32:42.555 INFO:teuthology.orchestra.run.smithi204.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T17:32:42.572 INFO:teuthology.orchestra.run.smithi204.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 647 kB/s | 11 kB 00:00 2024-09-12T17:32:42.631 INFO:teuthology.orchestra.run.smithi204.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2024-09-12T17:32:42.648 INFO:teuthology.orchestra.run.smithi204.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T17:32:42.665 INFO:teuthology.orchestra.run.smithi204.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T17:32:42.682 INFO:teuthology.orchestra.run.smithi204.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T17:32:42.766 INFO:teuthology.orchestra.run.smithi204.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-12T17:32:42.799 INFO:teuthology.orchestra.run.smithi204.stdout:(264/285): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-12T17:32:42.824 INFO:teuthology.orchestra.run.smithi204.stdout:(265/285): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-09-12T17:32:42.850 INFO:teuthology.orchestra.run.smithi204.stdout:(266/285): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-12T17:32:42.875 INFO:teuthology.orchestra.run.smithi204.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T17:32:42.900 INFO:teuthology.orchestra.run.smithi204.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T17:32:42.942 INFO:teuthology.orchestra.run.smithi204.stdout:(269/285): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-09-12T17:32:42.968 INFO:teuthology.orchestra.run.smithi204.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-12T17:32:42.993 INFO:teuthology.orchestra.run.smithi204.stdout:(271/285): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-12T17:32:43.012 INFO:teuthology.orchestra.run.smithi094.stdout:(170/285): openblas-openmp-0.3.26-2.el9.x86_64. 2.1 MB/s | 4.9 MB 00:02 2024-09-12T17:32:43.018 INFO:teuthology.orchestra.run.smithi204.stdout:(272/285): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-12T17:32:43.043 INFO:teuthology.orchestra.run.smithi204.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T17:32:43.069 INFO:teuthology.orchestra.run.smithi204.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-12T17:32:43.094 INFO:teuthology.orchestra.run.smithi204.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T17:32:43.119 INFO:teuthology.orchestra.run.smithi204.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T17:32:43.132 INFO:teuthology.orchestra.run.smithi094.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.3 MB/s | 163 kB 00:00 2024-09-12T17:32:43.144 INFO:teuthology.orchestra.run.smithi204.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T17:32:43.171 INFO:teuthology.orchestra.run.smithi204.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T17:32:43.195 INFO:teuthology.orchestra.run.smithi204.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-12T17:32:43.220 INFO:teuthology.orchestra.run.smithi204.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-12T17:32:43.245 INFO:teuthology.orchestra.run.smithi204.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T17:32:43.271 INFO:teuthology.orchestra.run.smithi204.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-12T17:32:43.282 INFO:teuthology.orchestra.run.smithi094.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2024-09-12T17:32:43.321 INFO:teuthology.orchestra.run.smithi204.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T17:32:43.399 INFO:teuthology.orchestra.run.smithi094.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-12T17:32:43.505 INFO:teuthology.orchestra.run.smithi204.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 13 MB/s | 3.5 MB 00:00 2024-09-12T17:32:43.555 INFO:teuthology.orchestra.run.smithi204.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-12T17:32:43.561 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:32:43.561 INFO:teuthology.orchestra.run.smithi204.stdout:Total 14 MB/s | 322 MB 00:23 2024-09-12T17:32:43.691 INFO:teuthology.orchestra.run.smithi094.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 1.8 MB/s | 531 kB 00:00 2024-09-12T17:32:43.775 INFO:teuthology.orchestra.run.smithi094.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 884 kB/s | 74 kB 00:00 2024-09-12T17:32:43.942 INFO:teuthology.orchestra.run.smithi094.stdout:(176/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 2.1 MB/s | 8.8 MB 00:04 2024-09-12T17:32:44.000 INFO:teuthology.orchestra.run.smithi094.stdout:(177/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T17:32:44.059 INFO:teuthology.orchestra.run.smithi094.stdout:(178/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-12T17:32:44.084 INFO:teuthology.orchestra.run.smithi094.stdout:(179/285): ostree-libs-2024.7-2.el9.x86_64.rpm 1.5 MB/s | 468 kB 00:00 2024-09-12T17:32:44.110 INFO:teuthology.orchestra.run.smithi094.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T17:32:44.135 INFO:teuthology.orchestra.run.smithi094.stdout:(181/285): pipewire-jack-audio-connection-kit-1 181 kB/s | 9.1 kB 00:00 2024-09-12T17:32:44.161 INFO:teuthology.orchestra.run.smithi094.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-12T17:32:44.211 INFO:teuthology.orchestra.run.smithi094.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.8 MB/s | 192 kB 00:00 2024-09-12T17:32:44.278 INFO:teuthology.orchestra.run.smithi094.stdout:(184/285): plexus-cipher-1.7-27.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-09-12T17:32:44.320 INFO:teuthology.orchestra.run.smithi094.stdout:(185/285): plexus-classworlds-2.6.0-11.el9.noar 1.4 MB/s | 60 kB 00:00 2024-09-12T17:32:44.362 INFO:teuthology.orchestra.run.smithi094.stdout:(186/285): plexus-containers-component-annotati 441 kB/s | 18 kB 00:00 2024-09-12T17:32:44.412 INFO:teuthology.orchestra.run.smithi094.stdout:(187/285): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-12T17:32:44.454 INFO:teuthology.orchestra.run.smithi094.stdout:(188/285): plexus-sec-dispatcher-1.4-37.el9.noa 810 kB/s | 34 kB 00:00 2024-09-12T17:32:44.513 INFO:teuthology.orchestra.run.smithi094.stdout:(189/285): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 254 kB 00:00 2024-09-12T17:32:44.588 INFO:teuthology.orchestra.run.smithi094.stdout:(190/285): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-12T17:32:44.680 INFO:teuthology.orchestra.run.smithi094.stdout:(191/285): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-12T17:32:44.739 INFO:teuthology.orchestra.run.smithi094.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.6 MB/s | 152 kB 00:00 2024-09-12T17:32:44.806 INFO:teuthology.orchestra.run.smithi094.stdout:(193/285): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T17:32:44.864 INFO:teuthology.orchestra.run.smithi094.stdout:(194/285): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-12T17:32:44.923 INFO:teuthology.orchestra.run.smithi094.stdout:(195/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-12T17:32:45.099 INFO:teuthology.orchestra.run.smithi094.stdout:(196/285): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-12T17:32:45.157 INFO:teuthology.orchestra.run.smithi094.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T17:32:45.216 INFO:teuthology.orchestra.run.smithi094.stdout:(198/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-12T17:32:45.258 INFO:teuthology.orchestra.run.smithi094.stdout:(199/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 1.7 MB/s | 1.9 MB 00:01 2024-09-12T17:32:45.283 INFO:teuthology.orchestra.run.smithi094.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 383 kB/s | 26 kB 00:00 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi094.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 381 kB/s | 19 kB 00:00 2024-09-12T17:32:45.342 INFO:teuthology.orchestra.run.smithi094.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T17:32:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-12T17:32:45.492 INFO:teuthology.orchestra.run.smithi094.stdout:(204/285): python3-numpy-1.20.1-5.el9.x86_64.rp 34 MB/s | 5.1 MB 00:00 2024-09-12T17:32:45.551 INFO:teuthology.orchestra.run.smithi094.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T17:32:45.576 INFO:teuthology.orchestra.run.smithi094.stdout:(206/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.2 MB/s | 250 kB 00:00 2024-09-12T17:32:45.604 INFO:teuthology.orchestra.run.smithi094.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-12T17:32:45.627 INFO:teuthology.orchestra.run.smithi094.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 834 kB/s | 42 kB 00:00 2024-09-12T17:32:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-12T17:32:45.720 INFO:teuthology.orchestra.run.smithi094.stdout:(210/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-12T17:32:45.745 INFO:teuthology.orchestra.run.smithi094.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-12T17:32:45.762 INFO:teuthology.orchestra.run.smithi094.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T17:32:45.787 INFO:teuthology.orchestra.run.smithi094.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.2 MB/s | 54 kB 00:00 2024-09-12T17:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 717 kB/s | 42 kB 00:00 2024-09-12T17:32:46.121 INFO:teuthology.orchestra.run.smithi094.stdout:(215/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-12T17:32:46.146 INFO:teuthology.orchestra.run.smithi094.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 734 kB/s | 221 kB 00:00 2024-09-12T17:32:46.171 INFO:teuthology.orchestra.run.smithi094.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-12T17:32:46.188 INFO:teuthology.orchestra.run.smithi094.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T17:32:46.217 INFO:teuthology.orchestra.run.smithi094.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-09-12T17:32:46.264 INFO:teuthology.orchestra.run.smithi094.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T17:32:46.323 INFO:teuthology.orchestra.run.smithi094.stdout:(221/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T17:32:46.381 INFO:teuthology.orchestra.run.smithi094.stdout:(222/285): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-12T17:32:46.440 INFO:teuthology.orchestra.run.smithi094.stdout:(223/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.6 MB/s | 152 kB 00:00 2024-09-12T17:32:46.499 INFO:teuthology.orchestra.run.smithi094.stdout:(224/285): sisu-0.3.4-10.el9.noarch.rpm 1.6 MB/s | 510 kB 00:00 2024-09-12T17:32:46.524 INFO:teuthology.orchestra.run.smithi094.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 6.5 MB/s | 555 kB 00:00 2024-09-12T17:32:46.574 INFO:teuthology.orchestra.run.smithi094.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T17:32:46.633 INFO:teuthology.orchestra.run.smithi094.stdout:(227/285): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-12T17:32:46.692 INFO:teuthology.orchestra.run.smithi094.stdout:(228/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T17:32:46.735 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T17:32:46.750 INFO:teuthology.orchestra.run.smithi094.stdout:(229/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T17:32:46.801 INFO:teuthology.orchestra.run.smithi094.stdout:(230/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T17:32:46.859 INFO:teuthology.orchestra.run.smithi094.stdout:(231/285): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-12T17:32:46.910 INFO:teuthology.orchestra.run.smithi094.stdout:(232/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 846 kB/s | 42 kB 00:00 2024-09-12T17:32:46.919 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T17:32:46.919 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T17:32:46.968 INFO:teuthology.orchestra.run.smithi094.stdout:(233/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.4 MB/s | 385 kB 00:00 2024-09-12T17:32:47.027 INFO:teuthology.orchestra.run.smithi094.stdout:(234/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.3 MB/s | 134 kB 00:00 2024-09-12T17:32:47.094 INFO:teuthology.orchestra.run.smithi094.stdout:(235/285): tracker-miners-3.1.2-4.el9.x86_64.rp 1.6 MB/s | 944 kB 00:00 2024-09-12T17:32:47.127 INFO:teuthology.orchestra.run.smithi094.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 8.4 MB/s | 859 kB 00:00 2024-09-12T17:32:47.178 INFO:teuthology.orchestra.run.smithi094.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-12T17:32:47.203 INFO:teuthology.orchestra.run.smithi094.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 6.6 MB/s | 505 kB 00:00 2024-09-12T17:32:47.270 INFO:teuthology.orchestra.run.smithi094.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T17:32:47.329 INFO:teuthology.orchestra.run.smithi094.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T17:32:47.354 INFO:teuthology.orchestra.run.smithi094.stdout:(241/285): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-12T17:32:47.371 INFO:teuthology.orchestra.run.smithi094.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T17:32:47.438 INFO:teuthology.orchestra.run.smithi094.stdout:(243/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-12T17:32:47.505 INFO:teuthology.orchestra.run.smithi094.stdout:(244/285): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-12T17:32:47.530 INFO:teuthology.orchestra.run.smithi094.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T17:32:47.547 INFO:teuthology.orchestra.run.smithi094.stdout:(246/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-12T17:32:47.572 INFO:teuthology.orchestra.run.smithi094.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-12T17:32:47.598 INFO:teuthology.orchestra.run.smithi094.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T17:32:47.631 INFO:teuthology.orchestra.run.smithi094.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T17:32:47.649 INFO:teuthology.orchestra.run.smithi094.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-12T17:32:47.665 INFO:teuthology.orchestra.run.smithi094.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T17:32:47.682 INFO:teuthology.orchestra.run.smithi094.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 840 kB/s | 14 kB 00:00 2024-09-12T17:32:47.716 INFO:teuthology.orchestra.run.smithi094.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 4.5 MB/s | 548 kB 00:00 2024-09-12T17:32:47.741 INFO:teuthology.orchestra.run.smithi094.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T17:32:47.766 INFO:teuthology.orchestra.run.smithi094.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T17:32:47.792 INFO:teuthology.orchestra.run.smithi094.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T17:32:47.825 INFO:teuthology.orchestra.run.smithi094.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T17:32:47.842 INFO:teuthology.orchestra.run.smithi094.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 642 kB/s | 11 kB 00:00 2024-09-12T17:32:47.859 INFO:teuthology.orchestra.run.smithi094.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T17:32:47.876 INFO:teuthology.orchestra.run.smithi094.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T17:32:47.893 INFO:teuthology.orchestra.run.smithi094.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T17:32:47.927 INFO:teuthology.orchestra.run.smithi094.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-12T17:32:48.002 INFO:teuthology.orchestra.run.smithi094.stdout:(263/285): python3-grpcio-1.46.7-10.el9.x86_64. 8.6 MB/s | 2.0 MB 00:00 2024-09-12T17:32:48.028 INFO:teuthology.orchestra.run.smithi094.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:32:48.056 INFO:teuthology.orchestra.run.smithi094.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:32:48.078 INFO:teuthology.orchestra.run.smithi094.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-12T17:32:48.120 INFO:teuthology.orchestra.run.smithi094.stdout:(267/285): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T17:32:48.146 INFO:teuthology.orchestra.run.smithi094.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T17:32:48.171 INFO:teuthology.orchestra.run.smithi094.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-12T17:32:48.196 INFO:teuthology.orchestra.run.smithi094.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T17:32:48.222 INFO:teuthology.orchestra.run.smithi094.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T17:32:48.247 INFO:teuthology.orchestra.run.smithi094.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T17:32:48.272 INFO:teuthology.orchestra.run.smithi094.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T17:32:48.297 INFO:teuthology.orchestra.run.smithi094.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-12T17:32:48.323 INFO:teuthology.orchestra.run.smithi094.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T17:32:48.348 INFO:teuthology.orchestra.run.smithi094.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T17:32:48.373 INFO:teuthology.orchestra.run.smithi094.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T17:32:48.398 INFO:teuthology.orchestra.run.smithi094.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-12T17:32:48.424 INFO:teuthology.orchestra.run.smithi094.stdout:(279/285): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-12T17:32:48.441 INFO:teuthology.orchestra.run.smithi094.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-12T17:32:48.466 INFO:teuthology.orchestra.run.smithi094.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.8 MB/s | 206 kB 00:00 2024-09-12T17:32:48.516 INFO:teuthology.orchestra.run.smithi094.stdout:(282/285): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T17:32:48.717 INFO:teuthology.orchestra.run.smithi094.stdout:(283/285): librados2-19.3.0-4762.gbad475c1.el9. 14 MB/s | 3.5 MB 00:00 2024-09-12T17:32:48.976 INFO:teuthology.orchestra.run.smithi094.stdout:(284/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 7.1 MB/s | 3.2 MB 00:00 2024-09-12T17:32:50.105 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T17:32:50.105 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T17:32:55.667 INFO:teuthology.orchestra.run.smithi094.stdout:(285/285): java-11-openjdk-headless-11.0.20.1.1 1.9 MB/s | 39 MB 00:20 2024-09-12T17:32:55.673 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:32:55.673 INFO:teuthology.orchestra.run.smithi094.stdout:Total 9.2 MB/s | 322 MB 00:35 2024-09-12T17:32:58.734 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-12T17:32:58.921 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-12T17:32:58.922 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-12T17:33:00.158 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:33:00.321 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:33:00.666 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T17:33:00.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:33:00.667 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:33:00.667 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:33:00.709 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:33:00.761 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:33:00.812 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:33:00.837 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:33:00.891 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:33:01.228 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:33:01.355 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:33:01.478 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:33:01.506 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:33:01.599 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:33:01.627 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:33:01.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:33:01.695 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:33:01.720 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:33:01.746 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:33:01.778 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:33:01.812 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:33:01.840 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:33:01.982 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:33:02.097 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-12T17:33:02.097 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-12T17:33:02.113 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:33:02.146 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:33:02.183 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:33:02.211 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:33:02.308 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:33:02.338 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:33:02.384 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:33:02.408 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:33:02.431 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:33:02.449 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:33:02.673 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:33:02.796 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:33:02.832 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:33:02.868 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:33:02.942 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:33:02.994 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:33:03.034 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:33:03.077 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:33:03.102 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:33:03.129 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:33:03.162 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:33:03.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:33:03.216 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:33:03.249 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:33:03.274 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:33:03.327 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:33:03.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:33:03.452 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:33:03.490 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:33:03.568 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:33:03.569 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:33:03.616 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:33:03.649 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:33:03.734 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:33:03.769 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:33:03.811 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:33:03.852 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:33:03.929 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:33:04.066 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:33:04.115 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:33:04.674 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:33:04.764 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:33:04.800 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:33:04.869 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:33:04.905 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:33:04.942 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:33:04.971 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:33:05.043 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:33:05.081 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:33:05.115 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:33:05.150 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:33:05.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:33:05.223 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:33:05.256 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:33:05.297 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:33:05.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:33:05.390 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:33:05.427 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:33:05.521 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:33:05.592 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:33:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:33:05.915 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:33:06.015 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:33:06.071 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:33:06.125 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:33:06.167 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:33:06.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:33:06.351 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:33:06.393 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:33:06.498 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:33:06.535 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:33:06.575 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:33:06.608 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:33:06.633 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:33:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:33:06.855 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:33:06.894 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:33:07.106 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:33:07.145 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:33:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:33:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:33:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:33:07.302 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:07.506 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:33:07.580 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:33:07.634 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:33:07.658 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:33:07.685 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:33:07.718 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:33:08.183 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:08.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:08.236 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:08.236 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:33:08.236 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:08.278 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:33:08.313 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:33:08.346 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:33:08.388 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:33:08.422 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:33:08.512 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:33:08.601 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:33:08.707 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:33:08.761 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:33:09.522 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:33:09.574 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:33:09.608 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:33:09.711 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:33:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:33:09.945 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:33:09.997 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:33:10.046 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:33:10.555 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:33:10.615 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:33:10.652 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:33:10.686 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:33:10.719 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:33:10.904 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:33:10.933 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:33:11.017 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:33:11.733 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:33:11.851 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:33:12.010 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:33:12.162 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:33:12.316 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-12T17:33:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:33:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:33:12.484 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:33:12.537 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:33:12.591 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:33:12.624 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:33:12.649 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:33:12.696 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:33:13.041 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:33:13.151 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:33:13.167 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:33:13.283 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:33:13.300 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:33:13.327 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:33:13.354 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:33:13.389 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:33:13.417 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:33:13.418 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:33:13.446 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:33:13.447 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:33:13.458 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:33:13.458 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:33:13.458 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:33:13.515 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:33:13.524 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:33:13.541 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:33:13.542 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:33:13.567 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:33:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:33:13.599 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:33:13.624 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:33:13.652 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:33:13.823 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:33:13.891 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:33:13.933 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:33:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:33:14.016 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:33:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:33:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:33:14.057 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:33:14.082 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:33:14.097 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:33:14.126 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:33:14.170 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:33:14.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:33:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:33:14.226 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:33:14.251 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:33:14.263 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:33:14.287 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:33:14.292 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:33:14.310 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:33:14.315 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:33:14.335 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:33:14.529 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:33:14.564 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:33:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:33:14.651 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:33:14.679 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:33:14.680 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:33:14.705 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:33:14.719 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:33:14.730 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:33:14.755 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:33:14.756 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:33:14.781 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:33:14.809 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:33:14.829 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:33:14.845 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:33:14.882 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:33:14.896 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:33:14.921 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:33:14.937 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:33:14.965 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:33:14.985 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:33:14.989 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:33:15.012 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:33:15.016 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:33:15.041 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:33:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:33:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:33:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:33:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:33:15.210 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:33:15.251 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:33:15.329 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:33:15.385 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:33:15.416 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:33:15.467 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:33:15.480 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:33:15.504 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:33:15.535 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:33:15.622 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:33:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:33:15.654 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:33:15.695 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:33:15.697 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:33:15.721 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:33:15.739 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:33:15.766 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:33:15.816 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:33:15.843 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:33:15.890 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:33:15.914 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:33:15.934 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:33:15.951 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:33:15.960 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:33:15.986 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:33:16.001 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:33:16.026 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:33:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:33:16.554 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:33:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:33:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:33:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:33:16.795 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:33:16.839 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:33:16.869 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:33:16.941 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:33:16.980 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:33:17.013 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:33:17.048 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:33:17.086 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:33:17.119 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:33:17.152 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:33:17.194 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:33:17.252 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:33:17.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:33:17.323 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:33:17.416 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:33:17.480 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:33:17.553 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:33:17.592 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:33:17.628 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:33:17.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:33:17.729 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:33:17.779 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:33:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:33:17.964 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:33:18.006 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:33:18.111 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:33:18.148 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:33:18.189 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:33:18.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:33:18.246 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:33:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:33:18.458 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:33:18.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:33:18.698 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:33:18.742 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:33:18.773 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:33:18.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:33:18.845 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:33:18.882 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:33:18.894 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:33:18.894 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:33:18.895 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:19.094 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:33:19.172 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:33:19.222 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:33:19.247 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:33:19.272 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:33:19.298 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:33:19.699 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:19.728 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:19.743 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:33:19.743 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:33:19.743 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:19.793 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:33:19.828 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:33:19.864 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:33:19.903 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:33:19.937 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:33:20.028 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:33:20.077 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:33:20.107 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:33:20.214 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:33:20.276 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:33:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:33:21.081 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:33:21.114 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:33:21.219 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:33:21.259 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:33:21.495 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:33:21.539 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:33:22.069 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:33:22.129 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:33:22.167 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:33:22.234 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:33:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:33:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:33:22.526 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:33:23.209 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:33:23.332 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:33:24.616 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:33:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:33:24.887 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:33:24.921 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:33:24.948 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:33:24.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:33:24.990 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:33:24.990 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:33:24.991 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:25.037 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:33:25.065 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:33:25.110 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:33:25.432 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:33:25.482 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:33:25.582 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:33:25.614 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:33:25.646 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:33:25.684 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:33:25.874 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:33:25.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:33:25.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:33:25.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:33:25.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:33:26.139 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:33:26.175 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:33:26.203 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:33:26.228 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:33:26.254 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:33:26.280 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:33:26.304 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:33:26.333 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:33:26.368 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:33:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:33:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:33:26.493 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:33:26.519 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:33:26.974 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:33:27.105 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:33:27.170 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:33:27.195 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:33:27.223 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:33:27.293 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:33:27.331 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:33:27.355 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:33:27.374 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:33:27.401 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:33:27.427 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:33:27.464 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:33:27.482 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:33:27.590 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:33:27.627 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:33:27.655 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:33:27.694 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:33:27.730 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:33:27.766 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:33:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:33:28.329 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:33:28.409 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:33:28.448 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:33:30.806 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:30.839 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:31.406 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:31.451 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:33:31.551 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:33:31.551 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:33:31.551 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:33:31.551 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:31.586 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:33:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:33:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:33:39.530 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:33:39.562 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:33:39.596 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:33:39.632 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:33:40.158 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:33:40.195 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:33:40.258 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:33:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-09-12T17:33:41.007 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-09-12T17:33:41.008 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:41.185 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:33:41.201 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:33:41.201 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:41.201 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:33:41.201 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:42.635 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:42.652 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:33:42.671 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:42.679 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:33:42.679 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:42.679 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:33:42.679 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:33:42.680 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:33:42.680 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:33:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:33:42.935 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:42.935 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:33:42.935 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:33:42.935 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:33:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:43.234 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:33:43.275 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:33:43.364 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:33:43.364 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:33:43.364 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:33:43.364 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:43.378 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:33:43.393 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:33:43.402 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:43.505 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:33:46.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:33:46.471 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:33:46.528 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:33:46.585 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:33:46.779 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:33:46.834 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:33:46.912 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:33:47.009 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:33:47.149 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:33:47.184 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:33:47.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:33:48.102 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:33:48.157 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:33:48.518 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:33:48.555 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:33:48.589 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:33:48.614 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:33:48.649 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:33:48.686 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:33:48.713 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:33:48.739 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:33:48.765 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:33:48.790 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:33:48.816 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:33:48.841 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:33:48.869 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:33:48.899 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:33:48.935 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:33:48.970 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:33:49.006 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:33:49.036 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:33:49.071 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:33:49.106 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:33:49.144 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:33:49.183 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:33:49.225 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:33:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:33:49.318 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:33:49.341 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:33:49.395 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:33:49.435 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:33:49.478 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:33:49.511 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:33:49.536 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:33:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:33:49.737 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:33:49.764 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:33:49.791 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:33:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:33:49.961 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:33:50.023 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:33:50.091 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:33:50.120 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:33:50.229 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:33:50.276 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:33:50.291 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:33:50.321 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:33:50.344 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:33:50.800 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:33:50.832 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:33:50.848 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:33:50.848 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:33:50.848 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:51.091 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:33:51.152 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:33:51.191 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:33:51.236 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:33:51.269 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:33:51.693 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:33:51.732 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:33:51.748 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:33:52.292 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:33:52.378 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:33:52.416 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:33:52.444 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:33:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:33:52.707 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:33:52.733 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:33:52.754 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-09-12T17:33:52.760 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:52.783 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:33:52.855 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:33:52.903 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:33:52.914 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:33:52.935 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:33:52.950 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:33:52.950 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:52.950 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:33:52.951 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:52.953 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:33:52.969 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:33:53.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:33:53.425 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:33:53.452 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:33:53.485 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:33:53.552 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:33:53.576 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:33:54.402 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:33:54.429 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:33:54.429 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:54.429 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:33:54.429 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:33:54.430 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:33:54.430 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:33:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:33:54.684 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:54.684 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:33:54.684 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:33:54.684 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:33:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:55.129 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:33:55.151 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:33:55.151 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:55.152 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:33:55.152 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:33:55.152 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:33:55.152 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:33:55.256 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:33:56.792 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:33:56.850 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:33:57.820 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:33:57.858 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:33:57.975 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:33:58.129 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:33:58.160 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:33:58.184 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:33:58.184 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:58.184 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:33:58.184 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:33:58.185 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:33:58.185 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:58.212 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:33:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:33:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:33:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:33:58.300 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:33:58.332 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:33:58.348 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:33:58.380 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:33:58.389 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:33:58.396 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:33:58.396 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:33:58.396 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:58.454 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:33:58.650 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:33:58.701 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:33:58.781 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:33:58.877 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:33:59.019 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:33:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:33:59.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:33:59.407 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:33:59.439 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:33:59.439 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:59.439 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:33:59.439 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:33:59.440 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:33:59.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:59.491 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:33:59.521 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:33:59.521 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:59.521 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:33:59.521 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:59.852 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:33:59.876 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:33:59.876 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:33:59.876 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:33:59.876 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:33:59.877 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:33:59.877 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:33:59.996 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:34:00.057 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:34:00.407 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:34:00.450 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:34:00.478 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:34:00.506 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:34:00.541 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:34:00.578 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:34:00.605 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:34:00.631 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:34:00.657 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:34:00.681 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:34:00.707 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:34:00.733 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:34:00.768 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:34:00.798 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:34:00.826 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:34:00.861 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:34:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:34:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:34:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:34:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:34:01.033 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:34:01.071 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:34:01.113 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:34:01.167 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:34:01.198 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:34:01.229 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:34:01.282 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:34:01.314 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:34:01.345 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:34:01.374 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:34:01.399 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:34:01.581 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:34:01.608 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:34:01.635 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:34:01.662 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:34:01.703 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:34:01.831 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:34:01.885 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:34:01.954 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:34:01.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:34:02.089 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:34:02.137 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:34:02.156 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:34:02.182 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:34:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:34:02.669 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:34:02.700 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:34:02.717 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:34:02.717 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:34:02.717 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:02.944 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:34:03.021 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:34:03.067 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:34:03.104 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:34:03.129 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:34:03.552 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:34:03.582 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:34:03.598 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:34:04.097 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:34:04.164 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:34:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:34:04.205 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:34:04.223 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:34:04.237 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:34:04.251 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:34:04.341 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:34:04.397 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:34:04.428 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:34:04.428 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:34:04.454 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:34:04.512 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:34:04.521 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:34:04.521 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:04.539 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:34:04.561 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:34:04.590 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:34:04.620 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:04.638 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:34:04.645 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:34:04.653 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:34:04.655 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:34:04.664 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:34:04.664 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:34:04.664 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:34:04.664 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:04.693 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:34:04.703 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:34:04.726 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:34:04.733 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:34:04.749 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:34:04.769 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:34:04.802 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:34:05.182 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:34:05.209 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:34:05.241 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:34:05.308 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:34:05.332 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:34:08.575 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:34:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:34:09.595 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:34:09.630 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:34:09.747 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:34:09.901 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:34:09.923 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:09.947 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:09.999 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:34:10.010 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:34:10.033 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:34:10.062 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:34:10.111 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:34:10.142 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:34:10.158 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:34:10.158 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:34:10.158 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:11.119 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:34:11.142 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:34:11.142 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:34:11.142 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:34:11.142 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:11.142 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:11.143 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:11.186 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:34:11.208 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:34:11.209 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:34:11.209 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:34:11.209 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:11.753 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:34:11.776 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:34:11.776 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:34:11.777 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:34:11.777 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:34:11.777 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:34:11.777 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:34:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:34:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:34:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:34:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:34:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:34:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:34:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:34:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:34:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:34:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:34:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:34:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:34:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:34:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:34:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:34:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:34:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:34:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:34:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:34:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:34:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:34:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:34:16.073 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:34:16.114 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:34:16.146 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:34:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:34:16.307 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:34:16.337 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:34:16.337 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:34:16.429 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:34:16.429 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:16.520 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:16.534 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:34:16.541 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:34:16.549 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:34:16.560 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:34:16.560 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:34:16.560 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:34:16.560 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:16.612 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:34:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:34:18.648 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:18.648 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:34:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.651 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:34:18.652 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:34:18.653 INFO:teuthology.orchestra.run.smithi204.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:34:18.654 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:34:18.655 INFO:teuthology.orchestra.run.smithi204.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:34:18.656 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:34:18.657 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:34:18.658 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:34:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:34:18.660 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.661 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:34:18.662 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:34:18.663 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.664 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:34:18.665 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:34:18.666 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.667 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:34:18.668 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:34:18.669 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:34:18.670 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:34:18.671 INFO:teuthology.orchestra.run.smithi204.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:34:18.671 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:34:18.671 INFO:teuthology.orchestra.run.smithi204.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:34:18.671 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:18.671 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T17:34:19.072 DEBUG:teuthology.parallel:result is None 2024-09-12T17:34:26.686 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:26.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:34:26.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:34:26.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:34:26.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:34:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:34:26.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:34:26.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:34:26.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:34:26.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:34:26.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:34:26.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:34:26.722 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:34:26.723 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:34:26.724 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:34:26.725 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:34:26.726 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:34:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:34:26.728 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:34:26.730 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:34:26.731 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:34:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:34:26.733 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:34:26.734 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:34:26.735 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:34:26.736 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:34:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:34:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:30.199 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-09-12T17:34:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.199 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:34:30.200 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.201 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.202 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:34:30.203 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:34:30.204 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:34:30.205 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:34:30.206 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:34:30.207 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:34:30.208 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:34:30.209 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:34:30.210 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:34:30.211 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.212 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:34:30.213 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:34:30.214 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:34:30.215 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:34:30.216 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:34:30.217 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:34:30.218 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.219 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:34:30.220 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:34:30.221 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:34:30.222 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:34:30.223 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:34:30.223 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:34:30.223 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:34:30.223 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:30.223 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-12T17:34:30.616 DEBUG:teuthology.parallel:result is None 2024-09-12T17:34:30.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:34:30.764 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:34:30.828 INFO:teuthology.orchestra.run.smithi094.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:34:30.829 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:34:30.829 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:34:30.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:34:30.968 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:34:31.046 INFO:teuthology.orchestra.run.smithi204.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:34:31.047 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:34:31.047 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:34:31.049 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:34:31.049 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:31.049 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:34:31.090 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:31.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:34:31.138 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:34:31.138 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:31.139 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:34:31.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:34:31.256 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:31.256 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:34:31.302 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:34:31.383 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:34:31.383 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:31.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:34:31.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:34:31.500 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:31.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:34:31.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:34:31.620 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:34:31.620 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:31.620 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:34:31.659 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:34:31.738 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:31.738 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:34:31.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:34:31.858 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:34:31.949 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:34:31.949 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-09-12T17:34:31.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-12T17:34:31.991 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:34:31.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:34:32.030 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:34:32.070 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:34:32.070 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:34:32.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:34:32.162 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:34:32.162 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:34:32.162 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902743', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDKqVuY6UfLoLSGiPYE1OjLXfb99bUMrQuuA069dZy7RKMZiRjT4scTgTYflj3ftmXbPyKMPxvszFdMiO8+rnbs=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwMEv7rWm9XFIgSIJL1sN2eGEKGL801YLm8O07ZHPv/HX8GpCdUvpqyebTKBUjy9tGpCEsiIpKoAwRy6p2ZbCM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:34:32.163 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:34:32.187 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:34:32.221 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:34:32.256 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:34:32.300 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:32.300 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:34:32.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:34:32.362 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-12T17:34:32.431 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:34:32.431 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:32.431 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-12 17:34:17.709102269 +0000 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-12 17:31:32.501763235 +0000 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-12 17:31:32.501763235 +0000 2024-09-12T17:34:32.432 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-12 17:31:32.501763235 +0000 2024-09-12T17:34:32.432 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:34:32.509 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-12T17:34:32.509 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-12T17:34:32.509 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000104529 s, 4.9 MB/s 2024-09-12T17:34:32.510 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:34:32.580 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-12T17:34:32.650 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-12 17:34:17.709102269 +0000 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-12 17:31:32.820757819 +0000 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-12 17:31:32.820757819 +0000 2024-09-12T17:34:32.651 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-12 17:31:32.820757819 +0000 2024-09-12T17:34:32.651 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:34:32.727 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-12T17:34:32.728 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-12T17:34:32.728 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000128354 s, 4.0 MB/s 2024-09-12T17:34:32.729 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:34:32.799 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-12T17:34:32.868 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:34:32.868 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-12 17:34:17.710102252 +0000 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-12 17:31:33.140752388 +0000 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-12 17:31:33.140752388 +0000 2024-09-12T17:34:32.869 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-12 17:31:33.140752388 +0000 2024-09-12T17:34:32.870 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:34:32.945 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-12T17:34:32.945 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-12T17:34:32.946 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000100464 s, 5.1 MB/s 2024-09-12T17:34:32.947 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:34:33.017 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-12 17:34:17.710102252 +0000 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-12 17:31:33.450747126 +0000 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-12 17:31:33.450747126 +0000 2024-09-12T17:34:33.086 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-12 17:31:33.450747126 +0000 2024-09-12T17:34:33.086 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:34:33.162 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-12T17:34:33.163 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-12T17:34:33.163 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000101781 s, 5.0 MB/s 2024-09-12T17:34:33.164 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:34:33.234 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:33.234 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:33.234 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:34:33.269 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:34:33.269 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-09-12T17:34:33.342 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 17:34:05.855874992 +0000 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 17:31:38.151219609 +0000 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 17:31:38.151219609 +0000 2024-09-12T17:34:33.343 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 17:31:38.151219609 +0000 2024-09-12T17:34:33.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:34:33.423 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T17:34:33.423 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T17:34:33.424 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000342914 s, 1.5 MB/s 2024-09-12T17:34:33.425 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:34:33.496 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:33.566 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 17:34:05.855874992 +0000 2024-09-12T17:34:33.567 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 17:31:38.503214601 +0000 2024-09-12T17:34:33.567 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 17:31:38.503214601 +0000 2024-09-12T17:34:33.567 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 17:31:38.503214601 +0000 2024-09-12T17:34:33.567 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:34:33.644 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T17:34:33.645 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T17:34:33.645 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000210496 s, 2.4 MB/s 2024-09-12T17:34:33.646 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:34:33.715 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 17:34:05.856874978 +0000 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 17:31:38.832209922 +0000 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 17:31:38.832209922 +0000 2024-09-12T17:34:33.785 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 17:31:38.832209922 +0000 2024-09-12T17:34:33.786 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:34:33.863 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T17:34:33.863 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T17:34:33.863 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000215566 s, 2.4 MB/s 2024-09-12T17:34:33.864 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:34:33.935 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-09-12T17:34:34.005 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 17:34:05.856874978 +0000 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 17:31:39.154205342 +0000 2024-09-12T17:34:34.006 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 17:31:39.154205342 +0000 2024-09-12T17:34:34.007 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 17:31:39.154205342 +0000 2024-09-12T17:34:34.007 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:34:34.083 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T17:34:34.083 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T17:34:34.083 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000237562 s, 2.2 MB/s 2024-09-12T17:34:34.084 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:34:34.155 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:34.155 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:34:34.155 INFO:tasks.ceph:Generating config... 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:34:34.157 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:34:34.158 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:34:34.158 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:34:34.158 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:34:34.158 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:34:34.158 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:34:34.158 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:34:34.158 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:34:34.158 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:34:34.158 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:34:34.158 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:34:34.158 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:34:34.158 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:34:34.158 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:34:34.158 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:34:34.158 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:34:34.159 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:34:34.159 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:34:34.160 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:34:34.160 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:34:34.160 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:34:34.160 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:34:34.160 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:34:34.160 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:34:34.230 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:34:34.234 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:34:34.294 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:34:34.333 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]'), ('mon.b', '172.21.15.204')] 2024-09-12T17:34:34.333 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.204', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:34:34.334 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:34.334 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:34:34.402 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --add b 172.21.15.204 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:34.506 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:34.506 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:34:34.507 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:34:34.508 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:34:34.509 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:34:34.539 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f8cf509b-ba8a-4799-b42b-c125c378387b... 2024-09-12T17:34:34.540 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:34:34.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-12T17:34:34.635 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:34:34.636 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:34:34.637 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.638 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.204" 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: mon client directed command retry = 5 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject socket failures = 5000 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: osd heartbeat grace = 40 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-12T17:34:34.639 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-12T17:34:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug objclass = 20 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-12T17:34:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: osd fast shutdown = False 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: osd shutdown pgref assert = True 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-12T17:34:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:34:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:34:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd crush smoke test = False 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:34:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw = 20 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw notification = 20 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: rgw bucket counters cache = True 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt require ssl = False 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:34:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: rgw s3 auth use sts = True 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: rgw torrent flag = True 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: rgw user counters cache = True 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: setgroup = ceph 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: setuser = ceph 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-12T17:34:34.648 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-12T17:34:34.649 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-12T17:34:34.649 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-12T17:34:34.649 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:34:34.649 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-12T17:34:34.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.651 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.204" 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: mon client directed command retry = 5 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: ms inject socket failures = 5000 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: osd heartbeat grace = 40 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:34:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-12T17:34:34.654 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.655 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-09-12T17:34:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: debug objclass = 20 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: osd fast shutdown = False 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: osd shutdown pgref assert = True 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T17:34:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-12T17:34:34.658 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:34:34.659 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd crush smoke test = False 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-12T17:34:34.660 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw = 20 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw notification = 20 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw bucket counters cache = True 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt require ssl = False 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw s3 auth use sts = True 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:34:34.661 INFO:teuthology.orchestra.run.smithi204.stdout: rgw torrent flag = True 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout: rgw user counters cache = True 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout: setgroup = ceph 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout: setuser = ceph 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-12T17:34:34.662 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-12T17:34:34.663 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:34:34.664 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:34:34.771 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:34:34.771 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:34.771 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:34:34.799 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:34.799 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:34:34.870 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:34:34.870 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:34.870 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:34:34.870 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:34:34.958 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:34:34.959 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:35.028 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:34:35.028 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:35.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:34:35.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:34:35.079 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:34:35.079 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:35.148 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:34:35.148 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:34:35.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:34:35.214 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:34:35.217 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:34:35.411 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:34:35.415 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:34:35.415 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:34:35.415 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:34:35.470 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:34:35.483 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:34:35.539 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:34:35.552 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:34:35.553 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:34:35.553 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:34:35.592 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:35.592 INFO:tasks.ceph:role: osd.0 2024-09-12T17:34:35.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:34:35.592 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:35.671 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:35.704 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-12T17:34:35.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-12T17:34:35.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:34:35.789 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:34:35.872 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:34:35.951 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:35.952 INFO:tasks.ceph:role: osd.1 2024-09-12T17:34:35.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:34:35.952 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:36.031 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:36.064 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-12T17:34:36.066 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-12T17:34:36.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:34:36.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:34:36.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:34:36.342 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:36.342 INFO:tasks.ceph:role: osd.2 2024-09-12T17:34:36.342 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:34:36.342 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:34:36.423 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:36.423 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:36.423 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:36.424 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:36.457 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-12T17:34:36.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-12T17:34:36.668 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:34:36.753 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:34:36.837 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:34:36.916 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:36.917 INFO:tasks.ceph:role: osd.3 2024-09-12T17:34:36.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T17:34:36.917 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:36.996 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:36.997 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:36.997 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:36.997 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:37.032 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-12T17:34:37.033 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-12T17:34:37.034 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:34:37.121 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:34:37.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:37.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:37.274+0000 7efe4c73e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:34:37.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:37.274+0000 7efe4c73e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:34:37.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:37.274+0000 7efe4c73e640 -1 bdev(0x561ac1bcd800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:37.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:37.274+0000 7efe4c73e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:34:40.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:34:40.234 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:40.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:40.335+0000 7f23709a6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:34:40.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:40.335+0000 7f23709a6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:34:40.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:40.335+0000 7f23709a6640 -1 bdev(0x555cb09c1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:40.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:40.336+0000 7f23709a6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:34:43.760 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:34:43.804 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:43.865+0000 7f17a14b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:34:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:43.865+0000 7f17a14b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:34:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:43.866+0000 7f17a14b2640 -1 bdev(0x55b361595800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:43.866+0000 7f17a14b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:34:46.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:34:46.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:46.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:46.880+0000 7f61793cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:34:46.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:46.880+0000 7f61793cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:34:46.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:46.880+0000 7f61793cc640 -1 bdev(0x556edffad800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:46.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:34:46.880+0000 7f61793cc640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:34:50.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:34:50.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:34:50.625 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:50.625 INFO:tasks.ceph:role: osd.4 2024-09-12T17:34:50.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:34:50.625 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:50.674 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:50.675 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:51.173 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T17:34:51.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T17:34:51.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:34:51.263 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:34:51.311 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:34:51.351 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:51.351 INFO:tasks.ceph:role: osd.5 2024-09-12T17:34:51.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:34:51.352 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:51.441 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:51.442 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:51.442 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:51.890 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T17:34:51.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T17:34:51.892 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:34:51.941 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:34:51.985 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:34:52.064 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:52.065 INFO:tasks.ceph:role: osd.6 2024-09-12T17:34:52.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:34:52.065 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:34:52.150 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:52.151 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:52.634 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T17:34:52.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T17:34:52.636 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:34:52.703 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:34:52.746 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:34:52.826 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:34:52.826 INFO:tasks.ceph:role: osd.7 2024-09-12T17:34:52.827 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T17:34:52.827 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:34:52.913 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:34:52.913 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:34:52.913 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:34:52.913 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:34:52.913 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:34:52.914 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:34:52.914 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:34:52.914 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:34:52.914 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:34:52.914 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:34:53.432 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T17:34:53.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T17:34:53.434 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:34:53.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:34:53.628 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:53.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:53.702+0000 7f48cf610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:34:53.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:53.704+0000 7f48cf610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:34:53.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:53.704+0000 7f48cf610640 -1 bdev(0x55fda0b43800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:53.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:53.704+0000 7f48cf610640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:34:57.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:34:57.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:34:57.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:57.260+0000 7f367e7dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:34:57.262 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:57.260+0000 7f367e7dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:34:57.262 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:57.261+0000 7f367e7dd640 -1 bdev(0x564519b1b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:34:57.262 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:34:57.261+0000 7f367e7dd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:35:00.449 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:35:00.495 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:00.558 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:00.556+0000 7f95d9951640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:35:00.558 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:00.557+0000 7f95d9951640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:35:00.558 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:00.557+0000 7f95d9951640 -1 bdev(0x55ea01067800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:00.558 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:00.557+0000 7f95d9951640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:35:03.466 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:35:03.509 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:03.612 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:03.610+0000 7f22fe80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:35:03.612 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:03.611+0000 7f22fe80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:35:03.612 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:03.611+0000 7f22fe80d640 -1 bdev(0x55b0ee6b1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:03.612 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T17:35:03.611+0000 7f22fe80d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:35:07.270 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:35:07.315 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:35:07.316 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:07.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:35:07.362 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:07.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:35:07.449 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:07.449 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:35:07.534 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:07.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:35:07.616 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:07.617 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:35:07.696 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:07.696 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:35:07.743 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:07.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:35:07.826 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:07.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:35:07.908 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:07.908 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:35:07.988 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:07.988 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:35:08.068 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:08.068 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:35:08.098 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:08.098 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:35:08.137 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:35:08.138 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:35:08.140 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:35:08.181 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-09-12T17:35:08.181 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQArJuNmC2nHDBAArUc+FP5g0imsIWbAIJ5w8g== 2024-09-12T17:35:08.181 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-09-12T17:35:08.181 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAtJuNmg2loEBAAEfsMgjFJqQvg346qyZdDZQ== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAwJuNm+4MSFBAAqIwjPRN0QVAvnK16T7a/PA== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAzJuNmfhCoMxAAkK0oT6DlZoMuJ7E5QhKv0w== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA2JuNmvR+INBAAYDUSsofWQQoqVt4pKdpkyA== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQArJuNmquyMGBAAAtrFcStmMdFgtj/PVrDFfg== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9JuNmDEXwKRAA3M+ySCXMYfAKjJn7HEK6uw== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBBJuNmbD2WDxAAiQYwicepum1733qj6U/WJA== 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-09-12T17:35:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBEJuNmn8s8IRAAahiYNBBW8MMrjG4yj4Y5Tw== 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBHJuNm/S11JBAAQYXXkGnurYMQyfq1UFjoNQ== 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQArJuNmOpoKHBAAHf+3WU7gE6C7kKJb89SvKA== 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-09-12T17:35:08.183 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQArJuNmC94tIBAA8Mb1r23yIIEykVy4H6D3CQ== 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQArJuNmC2nHDBAArUc+FP5g0imsIWbAIJ5w8g== 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAtJuNmg2loEBAAEfsMgjFJqQvg346qyZdDZQ== 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-09-12T17:35:08.215 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAwJuNm+4MSFBAAqIwjPRN0QVAvnK16T7a/PA== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAzJuNmfhCoMxAAkK0oT6DlZoMuJ7E5QhKv0w== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA2JuNmvR+INBAAYDUSsofWQQoqVt4pKdpkyA== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQArJuNmquyMGBAAAtrFcStmMdFgtj/PVrDFfg== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA9JuNmDEXwKRAA3M+ySCXMYfAKjJn7HEK6uw== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBBJuNmbD2WDxAAiQYwicepum1733qj6U/WJA== 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-09-12T17:35:08.216 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBEJuNmn8s8IRAAahiYNBBW8MMrjG4yj4Y5Tw== 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBHJuNm/S11JBAAQYXXkGnurYMQyfq1UFjoNQ== 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQArJuNmOpoKHBAAHf+3WU7gE6C7kKJb89SvKA== 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-09-12T17:35:08.217 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQArJuNmC94tIBAA8Mb1r23yIIEykVy4H6D3CQ== 2024-09-12T17:35:08.218 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:08.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:08.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.325 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.459 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.523 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.526 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.591 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:08.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:08.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.727 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.791 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.793 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:08.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:08.929 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:08.997 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:08.999 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:09.066 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:35:09.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:35:09.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:09.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:35:09.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:35:09.332 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:09.444 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:35:09.483 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:35:09.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:09.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:35:09.671 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:09.673 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:09.739 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:35:09.740 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:35:09.740 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:35:09.742 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:35:09.742 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:35:09.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:35:09.744 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:35:09.744 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:35:09.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:35:09.782 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:35:09.782 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:35:09.783 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:35:09.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:35:09.785 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:35:09.785 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:35:09.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:35:09.787 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:35:09.788 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:35:09.788 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:35:09.788 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:35:10.179 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-09-12T17:35:10.194 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:35:10.195 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:35:10.195 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:10.195 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:35:10.233 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:10.233 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:35:10.311 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:10.311 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:35:10.390 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:35:10.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:35:10.470 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:10.470 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:35:10.509 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:10.509 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:35:10.591 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:10.591 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:35:10.672 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T17:35:10.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:35:10.751 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 5ee79d60-a692-4955-9765-8849f7ff1653 0 2024-09-12T17:35:10.986 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-09-12T17:35:10.998 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 5ae19867-7d69-4987-9259-1f62a425eb80 1 2024-09-12T17:35:11.200 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-12T17:35:11.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 66724fdc-f8d7-4ab6-bd1c-27252c73aa5f 2 2024-09-12T17:35:11.409 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-09-12T17:35:11.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new e8acc5da-50b8-40f9-9b18-5a77d1b4f72d 3 2024-09-12T17:35:11.618 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-09-12T17:35:11.630 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c0934950-f721-4a4e-a6fc-25a6d968acb2 4 2024-09-12T17:35:11.824 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-09-12T17:35:11.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c722e3f9-4961-49e8-b23a-6edcde42c8de 5 2024-09-12T17:35:12.036 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-09-12T17:35:12.048 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new d21a8e91-c896-4394-b333-f0af456ce142 6 2024-09-12T17:35:12.242 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-09-12T17:35:12.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 501824f8-2677-4593-9d88-513dce53e3c0 7 2024-09-12T17:35:12.447 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-09-12T17:35:12.459 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:35:12.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:35:12.461 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:35:12.461 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:35:12.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:35:12.463 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:35:12.464 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:35:12.464 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:35:12.466 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:35:12.466 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:35:12.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:35:12.469 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:35:12.469 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:35:12.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:35:12.471 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:35:12.471 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:35:12.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:35:12.473 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:35:12.474 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:35:12.474 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:35:12.476 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:35:12.476 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:35:12.476 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:35:12.478 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:35:12.479 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:12.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:12.693 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:12.444964+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:12.703 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:35:12.704 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:35:13.511 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:13.686 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-12T17:35:13.686 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:12.444964+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:13.696 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:35:13.919 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-12T17:35:13.918+0000 7f5fa321c640 -1 Falling back to public interface 2024-09-12T17:35:13.967 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T17:35:13.965+0000 7f6b60e0d640 -1 Falling back to public interface 2024-09-12T17:35:13.969 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-12T17:35:13.968+0000 7f631fa2f640 -1 Falling back to public interface 2024-09-12T17:35:13.978 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T17:35:13.976+0000 7efeee2dc640 -1 Falling back to public interface 2024-09-12T17:35:13.981 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-12T17:35:13.980+0000 7f654501c640 -1 Falling back to public interface 2024-09-12T17:35:14.169 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T17:35:14.167+0000 7fed22844640 -1 Falling back to public interface 2024-09-12T17:35:14.203 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T17:35:14.201+0000 7f1277dc1640 -1 Falling back to public interface 2024-09-12T17:35:14.458 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-12T17:35:14.457+0000 7fe514719640 -1 Falling back to public interface 2024-09-12T17:35:15.317 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-12T17:35:15.316+0000 7fcc1a814640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:35:15.317 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-09-12T17:35:15.316+0000 7fcc1a814640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:35:17.435 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-12T17:35:17.434+0000 7f5fa321c640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:35:17.734 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T17:35:17.732+0000 7f1277dc1640 -1 osd.5 0 log_to_monitors true 2024-09-12T17:35:17.793 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T17:35:17.791+0000 7f6b60e0d640 -1 osd.6 0 log_to_monitors true 2024-09-12T17:35:18.028 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-12T17:35:18.026+0000 7f631fa2f640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:35:18.035 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-12T17:35:18.034+0000 7f654501c640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:35:18.161 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T17:35:18.160+0000 7fed22844640 -1 osd.4 0 log_to_monitors true 2024-09-12T17:35:18.254 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-12T17:35:18.253+0000 7fe514719640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:35:18.285 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T17:35:18.284+0000 7efeee2dc640 -1 osd.7 0 log_to_monitors true 2024-09-12T17:35:20.503 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:20.650 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-12T17:35:20.649+0000 7fe510ec1640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:35:20.661 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-12T17:35:20.660+0000 7fe5084cc640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:20.812 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-12T17:35:20.810+0000 7f5f9f3b5640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:35:20.823 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-12T17:35:20.822+0000 7f5f969d1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:20.855 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-12T17:35:20.854+0000 7f654090d640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:35:20.863 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-12T17:35:20.862+0000 7f631b795640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:35:20.870 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-12T17:35:20.869+0000 7f653873d640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:20.882 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-12T17:35:20.881+0000 7f6312db3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:20.927 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-12T17:35:20.928 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":12,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:19.321185+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:20.939 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:35:21.370 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T17:35:21.369+0000 7f1273d55640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:35:21.383 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T17:35:21.382+0000 7f126bb74640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:21.427 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T17:35:21.426+0000 7efeeaa84640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:35:21.432 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T17:35:21.431+0000 7fed1e7d8640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:35:21.435 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T17:35:21.435+0000 7f6b5c723640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:35:21.447 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T17:35:21.447+0000 7efee208f640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:21.451 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T17:35:21.451+0000 7fed165f7640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:21.455 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T17:35:21.455+0000 7f6b54542640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:35:27.746 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:28.053 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-12T17:35:28.053 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":16,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:24.684474+0000","last_up_change":"2024-09-12T17:35:21.675775+0000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:35:22.323712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6827","nonce":311581689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6829","nonce":311581689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6833","nonce":311581689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6831","nonce":311581689}]},"public_addr":"172.21.15.94:6827/311581689","cluster_addr":"172.21.15.94:6829/311581689","heartbeat_back_addr":"172.21.15.94:6833/311581689","heartbeat_front_addr":"172.21.15.94:6831/311581689","state":["exists","up"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6801","nonce":316134373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6803","nonce":316134373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6807","nonce":316134373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6805","nonce":316134373}]},"public_addr":"172.21.15.94:6801/316134373","cluster_addr":"172.21.15.94:6803/316134373","heartbeat_back_addr":"172.21.15.94:6807/316134373","heartbeat_front_addr":"172.21.15.94:6805/316134373","state":["exists","up"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6817","nonce":4230056768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6819","nonce":4230056768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6823","nonce":4230056768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6821","nonce":4230056768}]},"public_addr":"172.21.15.94:6817/4230056768","cluster_addr":"172.21.15.94:6819/4230056768","heartbeat_back_addr":"172.21.15.94:6823/4230056768","heartbeat_front_addr":"172.21.15.94:6821/4230056768","state":["exists","up"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6809","nonce":627469579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6811","nonce":627469579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6815","nonce":627469579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6813","nonce":627469579}]},"public_addr":"172.21.15.94:6809/627469579","cluster_addr":"172.21.15.94:6811/627469579","heartbeat_back_addr":"172.21.15.94:6815/627469579","heartbeat_front_addr":"172.21.15.94:6813/627469579","state":["exists","up"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6817","nonce":3161618081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6819","nonce":3161618081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6823","nonce":3161618081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6821","nonce":3161618081}]},"public_addr":"172.21.15.204:6817/3161618081","cluster_addr":"172.21.15.204:6819/3161618081","heartbeat_back_addr":"172.21.15.204:6823/3161618081","heartbeat_front_addr":"172.21.15.204:6821/3161618081","state":["exists","up"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6825","nonce":1176062071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6827","nonce":1176062071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6831","nonce":1176062071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6829","nonce":1176062071}]},"public_addr":"172.21.15.204:6825/1176062071","cluster_addr":"172.21.15.204:6827/1176062071","heartbeat_back_addr":"172.21.15.204:6831/1176062071","heartbeat_front_addr":"172.21.15.204:6829/1176062071","state":["exists","up"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6801","nonce":31982016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6803","nonce":31982016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6807","nonce":31982016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6805","nonce":31982016}]},"public_addr":"172.21.15.204:6801/31982016","cluster_addr":"172.21.15.204:6803/31982016","heartbeat_back_addr":"172.21.15.204:6807/31982016","heartbeat_front_addr":"172.21.15.204:6805/31982016","state":["exists","up"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6809","nonce":287274657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6811","nonce":287274657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6815","nonce":287274657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6813","nonce":287274657}]},"public_addr":"172.21.15.204:6809/287274657","cluster_addr":"172.21.15.204:6811/287274657","heartbeat_back_addr":"172.21.15.204:6815/287274657","heartbeat_front_addr":"172.21.15.204:6813/287274657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.296544+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.460153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.994886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.065250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.188045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.755739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.781285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.261708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:28.064 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:35:28.064 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:35:28.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:35:28.697 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'rbd' created 2024-09-12T17:35:28.712 DEBUG:teuthology.orchestra.run.smithi094:> rbd --cluster ceph pool init rbd 2024-09-12T17:35:28.767 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:28.767 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:31.726 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:35:31.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:35:31.727 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:35:32.035 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:32.048 INFO:teuthology.orchestra.run.smithi094.stdout:[{"version":9,"timestamp":"2024-09-12T17:35:21.437121+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5301.292997"}]}] 2024-09-12T17:35:32.048 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:35:32.048 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:35:32.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:35:32.048 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:35:32.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:32.409 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1451463540},{"type":"v1","addr":"172.21.15.94:6825","nonce":1451463540}]},"active_addr":"172.21.15.94:6825/1451463540","active_change":"2024-09-12T17:35:14.304198+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2250294444}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2341173342}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2507914920}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2572361565}]}]} 2024-09-12T17:35:32.414 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:35:32.414 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:35:32.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:32.714 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:32.715 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":20,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:31.708363+0000","last_up_change":"2024-09-12T17:35:21.675775+0000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:35:22.323712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:35:28.364410+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6827","nonce":311581689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6829","nonce":311581689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6833","nonce":311581689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6831","nonce":311581689}]},"public_addr":"172.21.15.94:6827/311581689","cluster_addr":"172.21.15.94:6829/311581689","heartbeat_back_addr":"172.21.15.94:6833/311581689","heartbeat_front_addr":"172.21.15.94:6831/311581689","state":["exists","up"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6801","nonce":316134373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6803","nonce":316134373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6807","nonce":316134373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6805","nonce":316134373}]},"public_addr":"172.21.15.94:6801/316134373","cluster_addr":"172.21.15.94:6803/316134373","heartbeat_back_addr":"172.21.15.94:6807/316134373","heartbeat_front_addr":"172.21.15.94:6805/316134373","state":["exists","up"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6817","nonce":4230056768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6819","nonce":4230056768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6823","nonce":4230056768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6821","nonce":4230056768}]},"public_addr":"172.21.15.94:6817/4230056768","cluster_addr":"172.21.15.94:6819/4230056768","heartbeat_back_addr":"172.21.15.94:6823/4230056768","heartbeat_front_addr":"172.21.15.94:6821/4230056768","state":["exists","up"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6809","nonce":627469579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6811","nonce":627469579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6815","nonce":627469579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6813","nonce":627469579}]},"public_addr":"172.21.15.94:6809/627469579","cluster_addr":"172.21.15.94:6811/627469579","heartbeat_back_addr":"172.21.15.94:6815/627469579","heartbeat_front_addr":"172.21.15.94:6813/627469579","state":["exists","up"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6817","nonce":3161618081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6819","nonce":3161618081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6823","nonce":3161618081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6821","nonce":3161618081}]},"public_addr":"172.21.15.204:6817/3161618081","cluster_addr":"172.21.15.204:6819/3161618081","heartbeat_back_addr":"172.21.15.204:6823/3161618081","heartbeat_front_addr":"172.21.15.204:6821/3161618081","state":["exists","up"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6825","nonce":1176062071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6827","nonce":1176062071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6831","nonce":1176062071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6829","nonce":1176062071}]},"public_addr":"172.21.15.204:6825/1176062071","cluster_addr":"172.21.15.204:6827/1176062071","heartbeat_back_addr":"172.21.15.204:6831/1176062071","heartbeat_front_addr":"172.21.15.204:6829/1176062071","state":["exists","up"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6801","nonce":31982016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6803","nonce":31982016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6807","nonce":31982016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6805","nonce":31982016}]},"public_addr":"172.21.15.204:6801/31982016","cluster_addr":"172.21.15.204:6803/31982016","heartbeat_back_addr":"172.21.15.204:6807/31982016","heartbeat_front_addr":"172.21.15.204:6805/31982016","state":["exists","up"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6809","nonce":287274657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6811","nonce":287274657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6815","nonce":287274657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6813","nonce":287274657}]},"public_addr":"172.21.15.204:6809/287274657","cluster_addr":"172.21.15.204:6811/287274657","heartbeat_back_addr":"172.21.15.204:6815/287274657","heartbeat_front_addr":"172.21.15.204:6813/287274657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.296544+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.460153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.994886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.065250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.188045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.755739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.781285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.261708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:32.729 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:35:32.729 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:35:33.031 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:33.031 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":20,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T17:35:31.708363+0000","last_up_change":"2024-09-12T17:35:21.675775+0000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:35:22.323712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:35:28.364410+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6827","nonce":311581689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6829","nonce":311581689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6833","nonce":311581689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6831","nonce":311581689}]},"public_addr":"172.21.15.94:6827/311581689","cluster_addr":"172.21.15.94:6829/311581689","heartbeat_back_addr":"172.21.15.94:6833/311581689","heartbeat_front_addr":"172.21.15.94:6831/311581689","state":["exists","up"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6801","nonce":316134373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6803","nonce":316134373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6807","nonce":316134373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6805","nonce":316134373}]},"public_addr":"172.21.15.94:6801/316134373","cluster_addr":"172.21.15.94:6803/316134373","heartbeat_back_addr":"172.21.15.94:6807/316134373","heartbeat_front_addr":"172.21.15.94:6805/316134373","state":["exists","up"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6817","nonce":4230056768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6819","nonce":4230056768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6823","nonce":4230056768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6821","nonce":4230056768}]},"public_addr":"172.21.15.94:6817/4230056768","cluster_addr":"172.21.15.94:6819/4230056768","heartbeat_back_addr":"172.21.15.94:6823/4230056768","heartbeat_front_addr":"172.21.15.94:6821/4230056768","state":["exists","up"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6809","nonce":627469579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6811","nonce":627469579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6815","nonce":627469579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6813","nonce":627469579}]},"public_addr":"172.21.15.94:6809/627469579","cluster_addr":"172.21.15.94:6811/627469579","heartbeat_back_addr":"172.21.15.94:6815/627469579","heartbeat_front_addr":"172.21.15.94:6813/627469579","state":["exists","up"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6817","nonce":3161618081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6819","nonce":3161618081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6823","nonce":3161618081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6821","nonce":3161618081}]},"public_addr":"172.21.15.204:6817/3161618081","cluster_addr":"172.21.15.204:6819/3161618081","heartbeat_back_addr":"172.21.15.204:6823/3161618081","heartbeat_front_addr":"172.21.15.204:6821/3161618081","state":["exists","up"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6825","nonce":1176062071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6827","nonce":1176062071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6831","nonce":1176062071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6829","nonce":1176062071}]},"public_addr":"172.21.15.204:6825/1176062071","cluster_addr":"172.21.15.204:6827/1176062071","heartbeat_back_addr":"172.21.15.204:6831/1176062071","heartbeat_front_addr":"172.21.15.204:6829/1176062071","state":["exists","up"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6801","nonce":31982016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6803","nonce":31982016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6807","nonce":31982016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6805","nonce":31982016}]},"public_addr":"172.21.15.204:6801/31982016","cluster_addr":"172.21.15.204:6803/31982016","heartbeat_back_addr":"172.21.15.204:6807/31982016","heartbeat_front_addr":"172.21.15.204:6805/31982016","state":["exists","up"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6809","nonce":287274657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6811","nonce":287274657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6815","nonce":287274657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6813","nonce":287274657}]},"public_addr":"172.21.15.204:6809/287274657","cluster_addr":"172.21.15.204:6811/287274657","heartbeat_back_addr":"172.21.15.204:6815/287274657","heartbeat_front_addr":"172.21.15.204:6813/287274657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.296544+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.460153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.994886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.065250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.188045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.755739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.781285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.261708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:35:33.044 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:35:33.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:35:33.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:35:33.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:35:33.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:35:33.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:35:33.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:35:33.047 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:35:33.298 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:33.299 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:35:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:33.307 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:33.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:35:33.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:35:33.310 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:33.310 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:35:33.311 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-09-12T17:35:33.311 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:35:33.314 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-09-12T17:35:33.314 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:35:33.315 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:33.315 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:35:33.316 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-09-12T17:35:33.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:35:33.917 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-09-12T17:35:33.932 INFO:teuthology.orchestra.run.smithi094.stdout:55834574850 2024-09-12T17:35:33.933 INFO:teuthology.orchestra.run.smithi094.stdout:55834574850 2024-09-12T17:35:33.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2024-09-12T17:35:33.939 INFO:teuthology.orchestra.run.smithi094.stdout:55834574850 2024-09-12T17:35:33.941 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-09-12T17:35:33.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.6 2024-09-12T17:35:33.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.5 2024-09-12T17:35:33.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2024-09-12T17:35:33.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-09-12T17:35:33.970 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:33.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2024-09-12T17:35:33.995 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-09-12T17:35:33.998 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:34.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2024-09-12T17:35:34.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2024-09-12T17:35:34.939 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:35:34.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:35:34.959 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:35:34.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:35:34.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:35:34.983 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:35:35.009 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:35:35.012 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:35:35.533 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:35.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-12T17:35:35.554 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.602 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-09-12T17:35:35.611 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:35.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-12T17:35:35.615 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.623 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:35.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.4 2024-09-12T17:35:35.629 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-09-12T17:35:35.630 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:35.630 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.631 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-09-12T17:35:35.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-09-12T17:35:35.641 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-09-12T17:35:35.650 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-12T17:35:35.651 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-12T17:35:35.652 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.659 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-09-12T17:35:35.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-12T17:35:35.673 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:35.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:35:35.673 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:35:36.014 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:36.015 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T17:35:36.027 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T17:35:34.841464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235672,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739048,"statfs":{"total":773094113280,"available":772852785152,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.141977"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.797225+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T17:35:31.797225+0000","last_peered":"2024-09-12T17:35:31.797225+0000","last_clean":"2024-09-12T17:35:31.797225+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T17:35:31.797225+0000","last_undegraded":"2024-09-12T17:35:31.797225+0000","last_fullsized":"2024-09-12T17:35:31.797225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.721843+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T17:35:31.721843+0000","last_peered":"2024-09-12T17:35:31.721843+0000","last_clean":"2024-09-12T17:35:31.721843+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T17:35:31.721843+0000","last_undegraded":"2024-09-12T17:35:31.721843+0000","last_fullsized":"2024-09-12T17:35:31.721843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132884+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T17:35:32.132884+0000","last_peered":"2024-09-12T17:35:32.132884+0000","last_clean":"2024-09-12T17:35:32.132884+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T17:35:32.132884+0000","last_undegraded":"2024-09-12T17:35:32.132884+0000","last_fullsized":"2024-09-12T17:35:32.132884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.721848+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T17:35:31.721848+0000","last_peered":"2024-09-12T17:35:31.721848+0000","last_clean":"2024-09-12T17:35:31.721848+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T17:35:31.721848+0000","last_undegraded":"2024-09-12T17:35:31.721848+0000","last_fullsized":"2024-09-12T17:35:31.721848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.720888+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T17:35:31.720888+0000","last_peered":"2024-09-12T17:35:31.720888+0000","last_clean":"2024-09-12T17:35:31.720888+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T17:35:31.720888+0000","last_undegraded":"2024-09-12T17:35:31.720888+0000","last_fullsized":"2024-09-12T17:35:31.720888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.712263+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T17:35:31.712263+0000","last_peered":"2024-09-12T17:35:31.712263+0000","last_clean":"2024-09-12T17:35:31.712263+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T17:35:31.712263+0000","last_undegraded":"2024-09-12T17:35:31.712263+0000","last_fullsized":"2024-09-12T17:35:31.712263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132875+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T17:35:32.132875+0000","last_peered":"2024-09-12T17:35:32.132875+0000","last_clean":"2024-09-12T17:35:32.132875+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T17:35:32.132875+0000","last_undegraded":"2024-09-12T17:35:32.132875+0000","last_fullsized":"2024-09-12T17:35:32.132875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.719588+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T17:35:31.719588+0000","last_peered":"2024-09-12T17:35:31.719588+0000","last_clean":"2024-09-12T17:35:31.719588+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T17:35:31.719588+0000","last_undegraded":"2024-09-12T17:35:31.719588+0000","last_fullsized":"2024-09-12T17:35:31.719588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132267+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T17:35:32.132267+0000","last_peered":"2024-09-12T17:35:32.132267+0000","last_clean":"2024-09-12T17:35:32.132267+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T17:35:32.132267+0000","last_undegraded":"2024-09-12T17:35:32.132267+0000","last_fullsized":"2024-09-12T17:35:32.132267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:35:36.028 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:35:36.323 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:36.324 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T17:35:36.335 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:35:36.313008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235672,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739048,"statfs":{"total":773094113280,"available":772852785152,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001076"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.797225+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T17:35:31.797225+0000","last_peered":"2024-09-12T17:35:31.797225+0000","last_clean":"2024-09-12T17:35:31.797225+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T17:35:31.797225+0000","last_undegraded":"2024-09-12T17:35:31.797225+0000","last_fullsized":"2024-09-12T17:35:31.797225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.721843+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T17:35:31.721843+0000","last_peered":"2024-09-12T17:35:31.721843+0000","last_clean":"2024-09-12T17:35:31.721843+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T17:35:31.721843+0000","last_undegraded":"2024-09-12T17:35:31.721843+0000","last_fullsized":"2024-09-12T17:35:31.721843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132884+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T17:35:32.132884+0000","last_peered":"2024-09-12T17:35:32.132884+0000","last_clean":"2024-09-12T17:35:32.132884+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T17:35:32.132884+0000","last_undegraded":"2024-09-12T17:35:32.132884+0000","last_fullsized":"2024-09-12T17:35:32.132884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.721848+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T17:35:31.721848+0000","last_peered":"2024-09-12T17:35:31.721848+0000","last_clean":"2024-09-12T17:35:31.721848+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T17:35:31.721848+0000","last_undegraded":"2024-09-12T17:35:31.721848+0000","last_fullsized":"2024-09-12T17:35:31.721848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.720888+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T17:35:31.720888+0000","last_peered":"2024-09-12T17:35:31.720888+0000","last_clean":"2024-09-12T17:35:31.720888+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T17:35:31.720888+0000","last_undegraded":"2024-09-12T17:35:31.720888+0000","last_fullsized":"2024-09-12T17:35:31.720888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.712263+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T17:35:31.712263+0000","last_peered":"2024-09-12T17:35:31.712263+0000","last_clean":"2024-09-12T17:35:31.712263+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T17:35:31.712263+0000","last_undegraded":"2024-09-12T17:35:31.712263+0000","last_fullsized":"2024-09-12T17:35:31.712263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132875+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T17:35:32.132875+0000","last_peered":"2024-09-12T17:35:32.132875+0000","last_clean":"2024-09-12T17:35:32.132875+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T17:35:32.132875+0000","last_undegraded":"2024-09-12T17:35:32.132875+0000","last_fullsized":"2024-09-12T17:35:32.132875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:31.719588+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T17:35:31.719588+0000","last_peered":"2024-09-12T17:35:31.719588+0000","last_clean":"2024-09-12T17:35:31.719588+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T17:35:31.719588+0000","last_undegraded":"2024-09-12T17:35:31.719588+0000","last_fullsized":"2024-09-12T17:35:31.719588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T17:35:32.132267+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T17:35:32.132267+0000","last_peered":"2024-09-12T17:35:32.132267+0000","last_clean":"2024-09-12T17:35:32.132267+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T17:35:32.132267+0000","last_undegraded":"2024-09-12T17:35:32.132267+0000","last_fullsized":"2024-09-12T17:35:32.132267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:35:36.336 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:35:36.336 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:35:36.336 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:35:36.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:35:36.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:35:36.671 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:35:36.684 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:35:36.684 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:35:36.696 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:35:36.711 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:35:36.711 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:35:36.711 INFO:tasks.rgw:Creating data pools 2024-09-12T17:35:36.711 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:35:36.711 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T17:35:37.865 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:35:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:35:39.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:35:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:35:40.905 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:35:41.880 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:35:41.903 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:35:42.881 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:35:42.915 DEBUG:tasks.rgw:Pools created 2024-09-12T17:35:42.915 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:35:42.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:35:42.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:35:42.916 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:35:43.075 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:43.075 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:44.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.925+0000 7f756b413640 0 -- 172.21.15.94:0/3888675980 >> [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] conn(0x7f7440076380 msgr2=0x7f7440078840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:44.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.930+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.931+0000 7f756ac12640 0 -- 172.21.15.94:0/408025219 >> [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] conn(0x7f7430076470 msgr2=0x7f7430078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:44.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 realm 2024-09-12T17:35:44.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:44.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.932+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.933+0000 7f756f723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:44.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.933+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.934+0000 7f756f723800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:35:44.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.934+0000 7f756f723800 20 searching for the correct realm 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:44.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.946+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:35:44.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 zone default found 2024-09-12T17:35:44.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 4 Realm: () 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 zonegroup default 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:44.947+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:46.896+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:46.896+0000 7f756f723800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:46.899+0000 7f756f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:46.899+0000 7f756f723800 20 started sync module instance, tier type = 2024-09-12T17:35:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:46.899+0000 7f756f723800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:35:48.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=0 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=1 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=2 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=3 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=4 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=5 2024-09-12T17:35:48.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.926+0000 7f756f723800 20 add_watcher() i=6 2024-09-12T17:35:48.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.927+0000 7f756f723800 20 add_watcher() i=7 2024-09-12T17:35:48.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.927+0000 7f756f723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.927+0000 7f756f723800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.927+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.927+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:35:48.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.928+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:35:48.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.929+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.930+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.931+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.932+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:35:48.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.933+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:35:48.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.934+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.935+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:35:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.936+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:35:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:35:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.937+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.938+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:35:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:35:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:35:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:35:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.939+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.940+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:35:48.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.941+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:35:48.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.942+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:35:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.943+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.944+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.945+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:35:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.946+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:35:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.947+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:35:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.948+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:35:48.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:35:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.949+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:35:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.950+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:35:48.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:35:48.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.951+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.952+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.953+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.954+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:35:48.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:35:48.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.955+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.956+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.957+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:35:48.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.958+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.959+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.959+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:35:48.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.959+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.959+0000 7f756f723800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.959+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.960+0000 7f756f723800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.966+0000 7f741dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.966+0000 7f756f723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:48.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:48.966+0000 7f756f723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.902+0000 7f756f723800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:35:51.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.902+0000 7f756f723800 5 note: GC not initialized 2024-09-12T17:35:51.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.902+0000 7f741cfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:51.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.903+0000 7f756f723800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.903+0000 7f756f723800 20 Filter name: none 2024-09-12T17:35:51.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.903+0000 7f737e7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:51.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.936+0000 7f741dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.939+0000 7f756f723800 20 remove_watcher() i=0 2024-09-12T17:35:51.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.939+0000 7f756f723800 2 removed watcher, disabling cache 2024-09-12T17:35:51.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.940+0000 7f756f723800 20 remove_watcher() i=1 2024-09-12T17:35:51.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.941+0000 7f756f723800 20 remove_watcher() i=2 2024-09-12T17:35:51.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.943+0000 7f756f723800 20 remove_watcher() i=3 2024-09-12T17:35:51.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.944+0000 7f756f723800 20 remove_watcher() i=4 2024-09-12T17:35:51.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.945+0000 7f756f723800 20 remove_watcher() i=5 2024-09-12T17:35:51.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.946+0000 7f756f723800 20 remove_watcher() i=6 2024-09-12T17:35:51.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:51.947+0000 7f756f723800 20 remove_watcher() i=7 2024-09-12T17:35:51.961 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-12T17:35:51.961 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:35:51.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:35:51.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:35:51.962 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:35:52.025 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.026 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.050+0000 7f3f8b30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.050+0000 7f3f8b30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.054+0000 7f3e477fe640 20 reqs_thread_entry: start 2024-09-12T17:35:52.070 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"42c5264b-1887-4ec0-ad3b-497d0463fb19","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:35:52.071 DEBUG:tasks.util.rgw: json result: {'id': '42c5264b-1887-4ec0-ad3b-497d0463fb19', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:35:52.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:35:52.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:35:52.071 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:35:52.127 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.127 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.159+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 realm 2024-09-12T17:35:52.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:52.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.161+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.162+0000 7f5a3932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.162+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.162+0000 7f5a3932c800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:35:52.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.162+0000 7f5a3932c800 20 searching for the correct realm 2024-09-12T17:35:52.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.166+0000 7f5a2c73d640 0 -- 172.21.15.94:0/548935662 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x555a1fe0e660 msgr2=0x555a1fe10a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:52.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.169+0000 7f5a34f3e640 0 -- 172.21.15.94:0/548935662 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f5a1c047400 msgr2=0x7f5a1c047880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.173+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:35:52.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 zone default found 2024-09-12T17:35:52.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 4 Realm: () 2024-09-12T17:35:52.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 zonegroup default 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.174+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 started sync module instance, tier type = 2024-09-12T17:35:52.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.175+0000 7f5a3932c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=0 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=1 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=2 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=3 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=4 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=5 2024-09-12T17:35:52.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.185+0000 7f5a3932c800 20 add_watcher() i=6 2024-09-12T17:35:52.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.186+0000 7f5a3932c800 20 add_watcher() i=7 2024-09-12T17:35:52.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.186+0000 7f5a3932c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:52.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f58eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f5a3932c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f5a3932c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f5a3932c800 5 note: GC not initialized 2024-09-12T17:35:52.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f58e9fe3640 20 reqs_thread_entry: start 2024-09-12T17:35:52.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f5a3932c800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:52.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f5a3932c800 20 Filter name: none 2024-09-12T17:35:52.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.188+0000 7f585b7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:52.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.198+0000 7f58eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.200+0000 7f5a3932c800 20 remove_watcher() i=0 2024-09-12T17:35:52.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.200+0000 7f5a3932c800 2 removed watcher, disabling cache 2024-09-12T17:35:52.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.201+0000 7f5a3932c800 20 remove_watcher() i=1 2024-09-12T17:35:52.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.202+0000 7f5a3932c800 20 remove_watcher() i=2 2024-09-12T17:35:52.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.203+0000 7f5a3932c800 20 remove_watcher() i=3 2024-09-12T17:35:52.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.204+0000 7f5a3932c800 20 remove_watcher() i=4 2024-09-12T17:35:52.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.205+0000 7f5a3932c800 20 remove_watcher() i=5 2024-09-12T17:35:52.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.206+0000 7f5a3932c800 20 remove_watcher() i=6 2024-09-12T17:35:52.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.207+0000 7f5a3932c800 20 remove_watcher() i=7 2024-09-12T17:35:52.218 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-12T17:35:52.219 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:35:52.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:35:52.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:35:52.219 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:35:52.282 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.282 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.306+0000 7f1139817800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.306+0000 7f1139817800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.310+0000 7f0f82ffd640 20 reqs_thread_entry: start 2024-09-12T17:35:52.327 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"42c5264b-1887-4ec0-ad3b-497d0463fb19","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:35:52.327 DEBUG:tasks.util.rgw: json result: {'id': '42c5264b-1887-4ec0-ad3b-497d0463fb19', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:35:52.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:35:52.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:35:52.328 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:35:52.383 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.383 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.414+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 realm 2024-09-12T17:35:52.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:52.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.416+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.417+0000 7f1afc6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.417+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.417+0000 7f1afc6bb800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:35:52.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.418+0000 7f1afc6bb800 20 searching for the correct realm 2024-09-12T17:35:52.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.421+0000 7f1af99a4640 0 -- 172.21.15.94:0/1209433010 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f1af404c9f0 msgr2=0x7f1af40769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:52.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.623+0000 7f1afa1a5640 0 -- 172.21.15.94:0/1209433010 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f1af00404d0 msgr2=0x7f1af0040970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.627+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 zone default found 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 4 Realm: () 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:35:52.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 zonegroup default 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.628+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 started sync module instance, tier type = 2024-09-12T17:35:52.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.629+0000 7f1afc6bb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:35:52.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=0 2024-09-12T17:35:52.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=1 2024-09-12T17:35:52.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=2 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=3 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=4 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=5 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.638+0000 7f1afc6bb800 20 add_watcher() i=6 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.639+0000 7f1afc6bb800 20 add_watcher() i=7 2024-09-12T17:35:52.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.639+0000 7f1afc6bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f19b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f1afc6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f1afc6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f1afc6bb800 5 note: GC not initialized 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f192b7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f1afc6bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f1afc6bb800 20 Filter name: none 2024-09-12T17:35:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.641+0000 7f19297fa640 20 reqs_thread_entry: start 2024-09-12T17:35:52.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.651+0000 7f19b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.653+0000 7f1afc6bb800 20 remove_watcher() i=0 2024-09-12T17:35:52.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.653+0000 7f1afc6bb800 2 removed watcher, disabling cache 2024-09-12T17:35:52.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.654+0000 7f1afc6bb800 20 remove_watcher() i=1 2024-09-12T17:35:52.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.655+0000 7f1afc6bb800 20 remove_watcher() i=2 2024-09-12T17:35:52.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.656+0000 7f1afc6bb800 20 remove_watcher() i=3 2024-09-12T17:35:52.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.657+0000 7f1afc6bb800 20 remove_watcher() i=4 2024-09-12T17:35:52.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.658+0000 7f1afc6bb800 20 remove_watcher() i=5 2024-09-12T17:35:52.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.659+0000 7f1afc6bb800 20 remove_watcher() i=6 2024-09-12T17:35:52.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.660+0000 7f1afc6bb800 20 remove_watcher() i=7 2024-09-12T17:35:52.671 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-12T17:35:52.672 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:35:52.672 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:35:52.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:35:52.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:35:52.672 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:35:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.757+0000 7ff11310c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.757+0000 7ff11310c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.761+0000 7fef56ffd640 20 reqs_thread_entry: start 2024-09-12T17:35:52.776 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:35:52.776 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:35:52.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:35:52.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:35:52.777 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:35:52.841 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.841 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.864+0000 7f5d96726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.864+0000 7f5d96726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.868+0000 7f5c54fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:52.884 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"42c5264b-1887-4ec0-ad3b-497d0463fb19","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:35:52.885 DEBUG:tasks.util.rgw: json result: {'id': '42c5264b-1887-4ec0-ad3b-497d0463fb19', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:35:52.885 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:35:52.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:35:52.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:35:52.885 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:35:52.947 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.947 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.971+0000 7f9b80339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.971+0000 7f9b80339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:52.975+0000 7f99f1ffb640 20 reqs_thread_entry: start 2024-09-12T17:35:52.990 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:35:52.990 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:35:52.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:35:52.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:35:52.991 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:35:53.055 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:53.055 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:53.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:53.079+0000 7fa9e081b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:53.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:53.079+0000 7fa9e081b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:53.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:35:53.083+0000 7fa849ffb640 20 reqs_thread_entry: start 2024-09-12T17:35:53.099 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"42c5264b-1887-4ec0-ad3b-497d0463fb19","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:35:53.099 DEBUG:tasks.util.rgw: json result: {'id': '42c5264b-1887-4ec0-ad3b-497d0463fb19', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:35:53.100 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:35:53.100 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:35:53.100 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:35:53.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo echo -n http://smithi094.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:35:53.140 INFO:teuthology.orchestra.run.smithi094.stdout:http://smithi094.front.sepia.ceph.com:80 2024-09-12T17:35:53.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:35:53.218 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:35:53.218 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:35:53.219 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:35:53.261 INFO:tasks.rgw.client.0:Started 2024-09-12T17:35:53.261 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:35:53.262 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:35:53.309 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:35:53.310 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:35:53.310 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:35:53.310 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:35:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:35:54.311 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:35:54.344 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:35:54.344 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:35:54.344 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:35:54.345 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:35:54.345 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:35:56.346 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:35:56.380 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:35:56.380 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:35:56.381 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:35:56.382 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:35:56.382 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:36:00.382 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:36:00.415 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:00.416 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:00.416 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:00.417 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:36:00.417 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:36:08.418 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:36:08.451 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:08.451 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:08.451 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:08.452 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:36:08.453 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:36:24.453 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-12T17:36:24.492 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:24.492 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:24.801 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 605 0 --:--:-- --:--:-- --:--:-- 605 2024-09-12T17:36:24.802 INFO:teuthology.orchestra.run.smithi094.stdout:anonymous 2024-09-12T17:36:24.802 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:36:24.814 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:36:24.814 DEBUG:teuthology.orchestra.run.smithi094:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:36:27.346 DEBUG:teuthology.orchestra.run.smithi094:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:36:27.856 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting tox==3.15.0 2024-09-12T17:36:27.904 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:36:28.053 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting packaging>=14 2024-09-12T17:36:28.067 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:36:28.157 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:36:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:36:28.279 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:36:28.293 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:36:28.590 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:36:28.604 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:36:28.841 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:36:28.856 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:36:28.923 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting toml>=0.9.4 2024-09-12T17:36:28.937 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:36:29.022 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:36:29.038 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:36:29.160 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:36:29.174 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:36:29.316 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:36:29.331 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:36:29.437 INFO:teuthology.orchestra.run.smithi094.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:36:30.268 INFO:teuthology.orchestra.run.smithi094.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:36:30.466 INFO:teuthology.orchestra.run.smithi094.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:36:30.466 INFO:teuthology.orchestra.run.smithi094.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:36:30.528 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:36:30.546 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:36:30.547 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:36:30.547 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:36:30.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:36:30.576 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:36:30.576 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:36:30.645 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:36:30.645 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:36:30.713 INFO:tasks.workunit:timeout=3h 2024-09-12T17:36:30.714 INFO:tasks.workunit:cleanup=True 2024-09-12T17:36:30.714 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:36:30.784 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:37:30.501 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-12T17:37:30.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.503 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-12T17:37:30.503 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.503 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:37:30.503 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:30.503 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:37:30.505 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:37:30.623 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:37:30.625 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:37:30.625 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:37:31.276 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:37:31.340 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:37:31.381 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:37:31.382 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:37:31.382 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:37:31.421 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:37:31.425 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:37:31.425 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:37:31.453 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:37:31.454 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:37:31.455 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:37:31.527 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:37:31.527 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:37:31.527 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-12T17:37:33.817 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:37:33.818 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:37:33.818 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T17:37:33.819 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-12T17:37:34.042 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:37:34.225 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-12T17:37:34.277 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:37:34.559 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-12T17:37:34.559 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-12T17:37:34.559 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:37:34.707 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:37:34.713 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:37:35.428 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-12T17:37:35.664 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-12T17:37:36.531 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-12T17:37:36.573 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:37:37.174 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:37:37.188 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:37:37.301 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:37:37.316 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:37:37.442 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:37:37.456 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:37:37.585 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:37:37.599 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:37:37.747 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:37:37.761 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:37:37.993 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:37:38.007 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:37:38.071 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:37:38.152 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:37:38.375 INFO:tasks.workunit.client.0.smithi094.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 58.9 MB/s eta 0:00:00 2024-09-12T17:37:38.390 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:37:38.437 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:37:38.504 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:37:38.572 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:37:38.639 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:37:38.767 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:37:39.785 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:37:39.903 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:37:40.030 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:37:40.067 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:40.067 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:40.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.103+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 realm 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.104+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.105+0000 7fe6f412a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:40.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.105+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.105+0000 7fe6f412a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:40.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.105+0000 7fe6f412a800 20 searching for the correct realm 2024-09-12T17:37:40.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.109+0000 7fe6ef64e640 0 -- 172.21.15.94:0/2614358107 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fe6e00c1b50 msgr2=0x7fe6e00798c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:40.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.113+0000 7fe6efe4f640 0 -- 172.21.15.94:0/2614358107 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fe6e401a040 msgr2=0x7fe6e40423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:40.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:40.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:40.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.320+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:40.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 zone default found 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 4 Realm: () 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 zonegroup default 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.321+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.322+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.322+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.322+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.322+0000 7fe6f412a800 20 started sync module instance, tier type = 2024-09-12T17:37:40.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.322+0000 7fe6f412a800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:40.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=0 2024-09-12T17:37:40.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=1 2024-09-12T17:37:40.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=2 2024-09-12T17:37:40.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=3 2024-09-12T17:37:40.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=4 2024-09-12T17:37:40.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=5 2024-09-12T17:37:40.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.332+0000 7fe6f412a800 20 add_watcher() i=6 2024-09-12T17:37:40.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.333+0000 7fe6f412a800 20 add_watcher() i=7 2024-09-12T17:37:40.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.333+0000 7fe6f412a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:40.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.335+0000 7fe5a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.335+0000 7fe6f412a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.335+0000 7fe6f412a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.335+0000 7fe6f412a800 5 note: GC not initialized 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe5a57e2640 20 reqs_thread_entry: start 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 20 Filter name: none 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe59e7fc640 20 reqs_thread_entry: start 2024-09-12T17:37:40.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.336+0000 7fe6f412a800 20 rados->read ofs=0 len=0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.337+0000 7fe6f412a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.337+0000 7fe6f412a800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.337+0000 7fe6f412a800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.337+0000 7fe6f412a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:37:40.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.337+0000 7fe6f412a800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.338+0000 7fe6f412a800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.338+0000 7fe6f412a800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.338+0000 7fe6f412a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.339+0000 7fe5ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94159866603552 notifier 4589 bl.length()=593 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.339+0000 7fe5ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:37:40.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.339+0000 7fe5ceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:37:40.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe6f412a800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:37:40.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe6f412a800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:37:40.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe6f412a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:37:40.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe5ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94159866597392 notifier 4589 bl.length()=186 2024-09-12T17:37:40.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe5ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:37:40.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.365+0000 7fe5ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:37:40.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.368+0000 7fe5a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:40.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.370+0000 7fe6f412a800 20 remove_watcher() i=0 2024-09-12T17:37:40.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.370+0000 7fe6f412a800 2 removed watcher, disabling cache 2024-09-12T17:37:40.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.371+0000 7fe6f412a800 20 remove_watcher() i=1 2024-09-12T17:37:40.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.373+0000 7fe6f412a800 20 remove_watcher() i=2 2024-09-12T17:37:40.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.374+0000 7fe6f412a800 20 remove_watcher() i=3 2024-09-12T17:37:40.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.375+0000 7fe6f412a800 20 remove_watcher() i=4 2024-09-12T17:37:40.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.377+0000 7fe6f412a800 20 remove_watcher() i=5 2024-09-12T17:37:40.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.378+0000 7fe6f412a800 20 remove_watcher() i=6 2024-09-12T17:37:40.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:40.379+0000 7fe6f412a800 20 remove_watcher() i=7 2024-09-12T17:37:42.143 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:37:42.143 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:42.145 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:37:42.174 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:42.174 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:42.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.210+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.211+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.211+0000 7f501b725800 20 realm 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.211+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.212+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.212+0000 7f501b725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:42.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.212+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.212+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.212+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.213+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.213+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.213+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:42.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.213+0000 7f501b725800 20 searching for the correct realm 2024-09-12T17:37:42.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.215+0000 7f5016b32640 0 -- 172.21.15.94:0/2650621404 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f5010059040 msgr2=0x7f5010067880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:42.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.422+0000 7f5017333640 0 -- 172.21.15.94:0/2650621404 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f500008a430 msgr2=0x7f500006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.628+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:42.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:42.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 zone default found 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 4 Realm: () 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 zonegroup default 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.629+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.630+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.630+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.630+0000 7f501b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.630+0000 7f501b725800 20 started sync module instance, tier type = 2024-09-12T17:37:42.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.630+0000 7f501b725800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=0 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=1 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=2 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=3 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=4 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=5 2024-09-12T17:37:42.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.642+0000 7f501b725800 20 add_watcher() i=6 2024-09-12T17:37:42.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.643+0000 7f501b725800 20 add_watcher() i=7 2024-09-12T17:37:42.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.643+0000 7f501b725800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:42.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.644+0000 7f4ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:42.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:42.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:42.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 5 note: GC not initialized 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f4eccfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 20 Filter name: none 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f4e467fc640 20 reqs_thread_entry: start 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:42.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.645+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:42.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:42.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:42.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.646+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:42.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.647+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:42.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.648+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:42.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.648+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:42.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.649+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:42.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.649+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:42.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.650+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:42.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.651+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:42.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.651+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:42.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.652+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:42.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.652+0000 7f501b725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:42.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.662+0000 7f4ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:42.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.664+0000 7f501b725800 20 remove_watcher() i=0 2024-09-12T17:37:42.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.664+0000 7f501b725800 2 removed watcher, disabling cache 2024-09-12T17:37:42.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.665+0000 7f501b725800 20 remove_watcher() i=1 2024-09-12T17:37:42.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.666+0000 7f501b725800 20 remove_watcher() i=2 2024-09-12T17:37:42.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.667+0000 7f501b725800 20 remove_watcher() i=3 2024-09-12T17:37:42.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.669+0000 7f501b725800 20 remove_watcher() i=4 2024-09-12T17:37:42.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.670+0000 7f501b725800 20 remove_watcher() i=5 2024-09-12T17:37:42.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.671+0000 7f501b725800 20 remove_watcher() i=6 2024-09-12T17:37:42.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.672+0000 7f501b725800 20 remove_watcher() i=7 2024-09-12T17:37:42.686 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:37:42.715 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:42.715 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:42.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.750+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 realm 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.752+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.753+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:42.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.753+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.754+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:42.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.754+0000 7f37d340e800 20 searching for the correct realm 2024-09-12T17:37:42.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.757+0000 7f37ce36a640 0 -- 172.21.15.94:0/3400598598 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f37c00a7070 msgr2=0x7f37c0095030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:42.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.761+0000 7f37cf36c640 0 -- 172.21.15.94:0/3400598598 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f37c409d140 msgr2=0x7f37c4098840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:42.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:42.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 zone default found 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 4 Realm: () 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 zonegroup default 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.765+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 started sync module instance, tier type = 2024-09-12T17:37:42.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.766+0000 7f37d340e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:42.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=0 2024-09-12T17:37:42.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=1 2024-09-12T17:37:42.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=2 2024-09-12T17:37:42.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=3 2024-09-12T17:37:42.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=4 2024-09-12T17:37:42.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=5 2024-09-12T17:37:42.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.779+0000 7f37d340e800 20 add_watcher() i=6 2024-09-12T17:37:42.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.780+0000 7f37d340e800 20 add_watcher() i=7 2024-09-12T17:37:42.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.780+0000 7f37d340e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:42.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.782+0000 7f36857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:42.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:42.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:42.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 5 note: GC not initialized 2024-09-12T17:37:42.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f35fffff640 20 reqs_thread_entry: start 2024-09-12T17:37:42.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 Filter name: none 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f35fdffb640 20 reqs_thread_entry: start 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.783+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:42.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:42.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:42.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:42.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.784+0000 7f37d340e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:42.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.786+0000 7f36857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:42.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.788+0000 7f37d340e800 20 remove_watcher() i=0 2024-09-12T17:37:42.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.788+0000 7f37d340e800 2 removed watcher, disabling cache 2024-09-12T17:37:42.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.789+0000 7f37d340e800 20 remove_watcher() i=1 2024-09-12T17:37:42.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.790+0000 7f37d340e800 20 remove_watcher() i=2 2024-09-12T17:37:42.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.791+0000 7f37d340e800 20 remove_watcher() i=3 2024-09-12T17:37:42.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.792+0000 7f37d340e800 20 remove_watcher() i=4 2024-09-12T17:37:42.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.793+0000 7f37d340e800 20 remove_watcher() i=5 2024-09-12T17:37:42.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.794+0000 7f37d340e800 20 remove_watcher() i=6 2024-09-12T17:37:42.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.795+0000 7f37d340e800 20 remove_watcher() i=7 2024-09-12T17:37:42.807 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 95, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:37:42.807 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:37:42.807 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:42.808 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:37:42.841 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:42.841 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:42.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.877+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 realm 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:42.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.878+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.879+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:42.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.879+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:42.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.879+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:42.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.880+0000 7f538d440800 20 searching for the correct realm 2024-09-12T17:37:42.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:42.882+0000 7f5382729640 0 -- 172.21.15.94:0/3894550146 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f537c017040 msgr2=0x7f537c068660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:43.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.089+0000 7f538af2a640 0 -- 172.21.15.94:0/3894550146 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f53740d2b30 msgr2=0x7f5374056960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.296+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 zone default found 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 4 Realm: () 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:43.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 zonegroup default 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.297+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.298+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.298+0000 7f538d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.298+0000 7f538d440800 20 started sync module instance, tier type = 2024-09-12T17:37:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.298+0000 7f538d440800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.310+0000 7f538d440800 20 add_watcher() i=0 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.310+0000 7f538d440800 20 add_watcher() i=1 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=2 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=3 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=4 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=5 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=6 2024-09-12T17:37:43.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 20 add_watcher() i=7 2024-09-12T17:37:43.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.311+0000 7f538d440800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:43.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.313+0000 7f52417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:43.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f538d440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:43.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f538d440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f538d440800 5 note: GC not initialized 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f51bbfff640 20 reqs_thread_entry: start 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f538d440800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f538d440800 20 Filter name: none 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.314+0000 7f51b9ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 20 rados->read ofs=0 len=0 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.315+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.316+0000 7f538d440800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:37:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.316+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.317+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:43.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.318+0000 7f538d440800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:37:43.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.318+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:43.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.318+0000 7f538d440800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:37:43.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.318+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:43.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.319+0000 7f538d440800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:37:43.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.319+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:43.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.320+0000 7f538d440800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:37:43.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.320+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:43.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.320+0000 7f538d440800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:37:43.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.320+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:43.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.321+0000 7f538d440800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:37:43.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.321+0000 7f538d440800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:43.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.321+0000 7f538d440800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:37:43.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.321+0000 7f538d440800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:37:43.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.322+0000 7f52417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:43.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.325+0000 7f538d440800 20 remove_watcher() i=0 2024-09-12T17:37:43.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.325+0000 7f538d440800 2 removed watcher, disabling cache 2024-09-12T17:37:43.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.326+0000 7f538d440800 20 remove_watcher() i=1 2024-09-12T17:37:43.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.327+0000 7f538d440800 20 remove_watcher() i=2 2024-09-12T17:37:43.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.329+0000 7f538d440800 20 remove_watcher() i=3 2024-09-12T17:37:43.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.330+0000 7f538d440800 20 remove_watcher() i=4 2024-09-12T17:37:43.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.331+0000 7f538d440800 20 remove_watcher() i=5 2024-09-12T17:37:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.332+0000 7f538d440800 20 remove_watcher() i=6 2024-09-12T17:37:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:43.333+0000 7f538d440800 20 remove_watcher() i=7 2024-09-12T17:37:43.346 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:37:43.738 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:37:45.235 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:45.237 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:37:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:45.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.311+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 realm 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:45.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.313+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.314+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.314+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.314+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:45.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.314+0000 7f74d452b800 20 searching for the correct realm 2024-09-12T17:37:45.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.318+0000 7f74d0a74640 0 -- 172.21.15.94:0/1721654648 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f74b804dae0 msgr2=0x7f74b8064340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.321+0000 7f74d0273640 0 -- 172.21.15.94:0/1721654648 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f74b80d36c0 msgr2=0x7f74b8066050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:45.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.326+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 zone default found 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 4 Realm: () 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:45.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 zonegroup default 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.327+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.328+0000 7f74d452b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.328+0000 7f74d452b800 20 started sync module instance, tier type = 2024-09-12T17:37:45.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.328+0000 7f74d452b800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=0 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=1 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=2 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=3 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=4 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=5 2024-09-12T17:37:45.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.340+0000 7f74d452b800 20 add_watcher() i=6 2024-09-12T17:37:45.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.341+0000 7f74d452b800 20 add_watcher() i=7 2024-09-12T17:37:45.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.341+0000 7f74d452b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.342+0000 7f73877de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 5 note: GC not initialized 2024-09-12T17:37:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f73867dc640 20 reqs_thread_entry: start 2024-09-12T17:37:45.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:45.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 20 Filter name: none 2024-09-12T17:37:45.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f737f7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:45.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.343+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:45.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:45.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 INFO: main: starting shard=0 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.344+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 INFO: main: starting shard=1 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 INFO: main: starting shard=2 2024-09-12T17:37:45.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.345+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 INFO: main: starting shard=3 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 INFO: main: starting shard=4 2024-09-12T17:37:45.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.346+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 INFO: main: starting shard=5 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 INFO: main: starting shard=6 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.347+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.348+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.348+0000 7f74d452b800 20 INFO: main: starting shard=7 2024-09-12T17:37:45.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.348+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:45.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.349+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.349+0000 7f74d452b800 20 INFO: main: starting shard=8 2024-09-12T17:37:45.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.349+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.349+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 INFO: main: starting shard=9 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 INFO: main: starting shard=10 2024-09-12T17:37:45.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:45.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.350+0000 7f74d452b800 20 INFO: main: done 2024-09-12T17:37:45.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.351+0000 7f73877de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.354+0000 7f74d452b800 20 remove_watcher() i=0 2024-09-12T17:37:45.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.354+0000 7f74d452b800 2 removed watcher, disabling cache 2024-09-12T17:37:45.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.355+0000 7f74d452b800 20 remove_watcher() i=1 2024-09-12T17:37:45.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.356+0000 7f74d452b800 20 remove_watcher() i=2 2024-09-12T17:37:45.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.357+0000 7f74d452b800 20 remove_watcher() i=3 2024-09-12T17:37:45.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.358+0000 7f74d452b800 20 remove_watcher() i=4 2024-09-12T17:37:45.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.359+0000 7f74d452b800 20 remove_watcher() i=5 2024-09-12T17:37:45.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.359+0000 7f74d452b800 20 remove_watcher() i=6 2024-09-12T17:37:45.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.360+0000 7f74d452b800 20 remove_watcher() i=7 2024-09-12T17:37:45.514 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:45.515 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:37:45.545 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:45.545 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:45.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.581+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.582+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.582+0000 7f8fbdb24800 20 realm 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.582+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.583+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.583+0000 7f8fbdb24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.583+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.583+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.583+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.584+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.584+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.584+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:45.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.584+0000 7f8fbdb24800 20 searching for the correct realm 2024-09-12T17:37:45.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.587+0000 7f8fb3fff640 0 -- 172.21.15.94:0/3478527267 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55fb8ad91100 msgr2=0x55fb8ad934f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.591+0000 7f8fb9702640 0 -- 172.21.15.94:0/3478527267 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8fa4096470 msgr2=0x7f8fa406e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 zone default found 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 4 Realm: () 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 zonegroup default 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.595+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 started sync module instance, tier type = 2024-09-12T17:37:45.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.596+0000 7f8fbdb24800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:45.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=0 2024-09-12T17:37:45.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=1 2024-09-12T17:37:45.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=2 2024-09-12T17:37:45.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=3 2024-09-12T17:37:45.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=4 2024-09-12T17:37:45.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=5 2024-09-12T17:37:45.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.608+0000 7f8fbdb24800 20 add_watcher() i=6 2024-09-12T17:37:45.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.609+0000 7f8fbdb24800 20 add_watcher() i=7 2024-09-12T17:37:45.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.609+0000 7f8fbdb24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:45.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8e6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8fbdb24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8fbdb24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8fbdb24800 5 note: GC not initialized 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8e6e7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8fbdb24800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.611+0000 7f8fbdb24800 20 Filter name: none 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8ddffff640 20 reqs_thread_entry: start 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 INFO: main: starting shard=0 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.612+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 INFO: main: starting shard=1 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 INFO: main: starting shard=2 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.613+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 INFO: main: starting shard=3 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:45.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 INFO: main: starting shard=4 2024-09-12T17:37:45.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.614+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:45.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 INFO: main: starting shard=5 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 INFO: main: starting shard=6 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.615+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.616+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.616+0000 7f8fbdb24800 20 INFO: main: starting shard=7 2024-09-12T17:37:45.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.616+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 INFO: main: starting shard=8 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 INFO: main: starting shard=9 2024-09-12T17:37:45.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.617+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:45.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.618+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.618+0000 7f8fbdb24800 20 INFO: main: starting shard=10 2024-09-12T17:37:45.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.618+0000 7f8fbdb24800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:45.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.618+0000 7f8fbdb24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:45.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.618+0000 7f8fbdb24800 20 INFO: main: done 2024-09-12T17:37:45.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.619+0000 7f8e6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.621+0000 7f8fbdb24800 20 remove_watcher() i=0 2024-09-12T17:37:45.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.621+0000 7f8fbdb24800 2 removed watcher, disabling cache 2024-09-12T17:37:45.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.623+0000 7f8fbdb24800 20 remove_watcher() i=1 2024-09-12T17:37:45.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.623+0000 7f8fbdb24800 20 remove_watcher() i=2 2024-09-12T17:37:45.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.625+0000 7f8fbdb24800 20 remove_watcher() i=3 2024-09-12T17:37:45.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.627+0000 7f8fbdb24800 20 remove_watcher() i=4 2024-09-12T17:37:45.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.627+0000 7f8fbdb24800 20 remove_watcher() i=5 2024-09-12T17:37:45.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.628+0000 7f8fbdb24800 20 remove_watcher() i=6 2024-09-12T17:37:45.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.629+0000 7f8fbdb24800 20 remove_watcher() i=7 2024-09-12T17:37:45.779 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:45.780 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:37:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:45.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.846+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 realm 2024-09-12T17:37:45.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.848+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.849+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.849+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.850+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:45.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.850+0000 7f8befd39800 20 searching for the correct realm 2024-09-12T17:37:45.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:45.854+0000 7f8bec1c8640 0 -- 172.21.15.94:0/2356185232 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f8bd4054040 msgr2=0x7f8bd402a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:46.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.060+0000 7f8beb9c7640 0 -- 172.21.15.94:0/2356185232 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55ca958016e0 msgr2=0x55ca95803ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:46.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.062+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:46.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 zone default found 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 4 Realm: () 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 zonegroup default 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.063+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 started sync module instance, tier type = 2024-09-12T17:37:46.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.064+0000 7f8befd39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:46.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=0 2024-09-12T17:37:46.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=1 2024-09-12T17:37:46.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=2 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=3 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=4 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=5 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.073+0000 7f8befd39800 20 add_watcher() i=6 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.074+0000 7f8befd39800 20 add_watcher() i=7 2024-09-12T17:37:46.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.074+0000 7f8befd39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8befd39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8befd39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8befd39800 5 note: GC not initialized 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8aa0fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8befd39800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.076+0000 7f8befd39800 20 Filter name: none 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8a1a7fc640 20 reqs_thread_entry: start 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:46.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 INFO: main: starting shard=0 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.077+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 INFO: main: starting shard=1 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 INFO: main: starting shard=2 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.078+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 INFO: main: starting shard=3 2024-09-12T17:37:46.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:46.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 INFO: main: starting shard=4 2024-09-12T17:37:46.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.079+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:46.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 INFO: main: starting shard=5 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 INFO: main: starting shard=6 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.080+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 INFO: main: starting shard=7 2024-09-12T17:37:46.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 INFO: main: starting shard=8 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.081+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: starting shard=9 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: starting shard=10 2024-09-12T17:37:46.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:46.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.082+0000 7f8befd39800 20 INFO: main: done 2024-09-12T17:37:46.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.083+0000 7f8aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:46.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.085+0000 7f8befd39800 20 remove_watcher() i=0 2024-09-12T17:37:46.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.085+0000 7f8befd39800 2 removed watcher, disabling cache 2024-09-12T17:37:46.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.086+0000 7f8befd39800 20 remove_watcher() i=1 2024-09-12T17:37:46.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.087+0000 7f8befd39800 20 remove_watcher() i=2 2024-09-12T17:37:46.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.088+0000 7f8befd39800 20 remove_watcher() i=3 2024-09-12T17:37:46.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.089+0000 7f8befd39800 20 remove_watcher() i=4 2024-09-12T17:37:46.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.090+0000 7f8befd39800 20 remove_watcher() i=5 2024-09-12T17:37:46.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.091+0000 7f8befd39800 20 remove_watcher() i=6 2024-09-12T17:37:46.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.092+0000 7f8befd39800 20 remove_watcher() i=7 2024-09-12T17:37:46.212 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:46.214 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:37:46.246 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:46.246 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:46.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.281+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 realm 2024-09-12T17:37:46.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:46.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.283+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.284+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:46.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.284+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.284+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:46.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.284+0000 7fc51d32e800 20 searching for the correct realm 2024-09-12T17:37:46.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.287+0000 7fc519765640 0 -- 172.21.15.94:0/1383910800 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fc504086040 msgr2=0x7fc504048030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:46.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.291+0000 7fc518f64640 0 -- 172.21.15.94:0/1383910800 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc504088640 msgr2=0x7fc50409aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:46.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:46.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:46.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.497+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 zone default found 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 4 Realm: () 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 zonegroup default 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.498+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.499+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.499+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.499+0000 7fc51d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:46.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.499+0000 7fc51d32e800 20 started sync module instance, tier type = 2024-09-12T17:37:46.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.499+0000 7fc51d32e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=0 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=1 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=2 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=3 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=4 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=5 2024-09-12T17:37:46.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.511+0000 7fc51d32e800 20 add_watcher() i=6 2024-09-12T17:37:46.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.512+0000 7fc51d32e800 20 add_watcher() i=7 2024-09-12T17:37:46.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.512+0000 7fc51d32e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:46.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.513+0000 7fc3cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:46.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:46.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:46.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 5 note: GC not initialized 2024-09-12T17:37:46.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc3cdfe3640 20 reqs_thread_entry: start 2024-09-12T17:37:46.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:46.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 20 Filter name: none 2024-09-12T17:37:46.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc33f7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:46.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.514+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 INFO: main: starting shard=0 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.515+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 INFO: main: starting shard=1 2024-09-12T17:37:46.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 INFO: main: starting shard=2 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.516+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 INFO: main: starting shard=3 2024-09-12T17:37:46.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 INFO: main: starting shard=4 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.517+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: starting shard=5 2024-09-12T17:37:46.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: starting shard=6 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 INFO: main: starting shard=7 2024-09-12T17:37:46.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.518+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 INFO: main: starting shard=8 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 INFO: main: starting shard=9 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.519+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.520+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.520+0000 7fc51d32e800 20 INFO: main: starting shard=10 2024-09-12T17:37:46.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.520+0000 7fc51d32e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:46.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.520+0000 7fc51d32e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:37:46.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.520+0000 7fc51d32e800 20 INFO: main: done 2024-09-12T17:37:46.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.521+0000 7fc3cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:46.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.523+0000 7fc51d32e800 20 remove_watcher() i=0 2024-09-12T17:37:46.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.523+0000 7fc51d32e800 2 removed watcher, disabling cache 2024-09-12T17:37:46.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.524+0000 7fc51d32e800 20 remove_watcher() i=1 2024-09-12T17:37:46.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.525+0000 7fc51d32e800 20 remove_watcher() i=2 2024-09-12T17:37:46.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.526+0000 7fc51d32e800 20 remove_watcher() i=3 2024-09-12T17:37:46.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.527+0000 7fc51d32e800 20 remove_watcher() i=4 2024-09-12T17:37:46.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.528+0000 7fc51d32e800 20 remove_watcher() i=5 2024-09-12T17:37:46.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.529+0000 7fc51d32e800 20 remove_watcher() i=6 2024-09-12T17:37:46.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:46.530+0000 7fc51d32e800 20 remove_watcher() i=7 2024-09-12T17:37:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:37:46.959 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:37:47.357 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:37:47.357 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:47.358 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:37:47.391 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:47.391 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:47.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.427+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 20 realm 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.428+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.429+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.429+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.430+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:47.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.430+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.430+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:47.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.430+0000 7fc7c7946800 20 searching for the correct realm 2024-09-12T17:37:47.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.434+0000 7fc7c5c38640 0 -- 172.21.15.94:0/4051028469 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fc7b00b2480 msgr2=0x7fc7b00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:47.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.641+0000 7fc7c5437640 0 -- 172.21.15.94:0/4051028469 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x564ce000a9b0 msgr2=0x564ce000cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:47.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.644+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 zone default found 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 4 Realm: () 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 zonegroup default 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.645+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.646+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.646+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.646+0000 7fc7c7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:47.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.646+0000 7fc7c7946800 20 started sync module instance, tier type = 2024-09-12T17:37:47.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.646+0000 7fc7c7946800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=0 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=1 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=2 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=3 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=4 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=5 2024-09-12T17:37:47.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.657+0000 7fc7c7946800 20 add_watcher() i=6 2024-09-12T17:37:47.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.658+0000 7fc7c7946800 20 add_watcher() i=7 2024-09-12T17:37:47.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.658+0000 7fc7c7946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:47.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc67bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:47.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:47.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:47.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 5 note: GC not initialized 2024-09-12T17:37:47.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc67afe5640 20 reqs_thread_entry: start 2024-09-12T17:37:47.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 20 Filter name: none 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc678fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.660+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 20 rados->read ofs=0 len=0 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:47.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:47.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:47.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.661+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.662+0000 7fc7c7946800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.662+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.663+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.663+0000 7fc7c7946800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.663+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.664+0000 7fc7c7946800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.664+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:47.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.664+0000 7fc7c7946800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:37:47.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.664+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:47.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.665+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:47.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.665+0000 7fc7c7946800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:37:47.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.665+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:47.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.666+0000 7fc7c7946800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:37:47.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.666+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:47.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.666+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:47.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:37:47.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:47.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:37:47.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:37:47.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:37:47.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:37:47.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.667+0000 7fc7c7946800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:37:47.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.668+0000 7fc67bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:47.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.671+0000 7fc7c7946800 20 remove_watcher() i=0 2024-09-12T17:37:47.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.671+0000 7fc7c7946800 2 removed watcher, disabling cache 2024-09-12T17:37:47.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.672+0000 7fc7c7946800 20 remove_watcher() i=1 2024-09-12T17:37:47.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.674+0000 7fc7c7946800 20 remove_watcher() i=2 2024-09-12T17:37:47.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.675+0000 7fc7c7946800 20 remove_watcher() i=3 2024-09-12T17:37:47.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.676+0000 7fc7c7946800 20 remove_watcher() i=4 2024-09-12T17:37:47.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.677+0000 7fc7c7946800 20 remove_watcher() i=5 2024-09-12T17:37:47.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.678+0000 7fc7c7946800 20 remove_watcher() i=6 2024-09-12T17:37:47.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:47.679+0000 7fc7c7946800 20 remove_watcher() i=7 2024-09-12T17:37:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: unlinked entries are not listable 2024-09-12T17:37:47.691 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:47.809 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:37:47.809 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:47.941 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:37:47.942 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:37:47.976 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:47.976 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:48.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.012+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 realm 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.014+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.015+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.015+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.015+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:48.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.015+0000 7fd987d42800 20 searching for the correct realm 2024-09-12T17:37:48.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.019+0000 7fd97b285640 0 -- 172.21.15.94:0/1317950056 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55802fa24da0 msgr2=0x55802fa27260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.022+0000 7fd983a86640 0 -- 172.21.15.94:0/1317950056 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fd96c07c910 msgr2=0x7fd96c07b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.026+0000 7fd987d42800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.027+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 zone default found 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 4 Realm: () 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:48.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 zonegroup default 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.028+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.029+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.029+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.029+0000 7fd987d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.029+0000 7fd987d42800 20 started sync module instance, tier type = 2024-09-12T17:37:48.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.029+0000 7fd987d42800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:48.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=0 2024-09-12T17:37:48.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=1 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=2 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=3 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=4 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=5 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.038+0000 7fd987d42800 20 add_watcher() i=6 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.039+0000 7fd987d42800 20 add_watcher() i=7 2024-09-12T17:37:48.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.039+0000 7fd987d42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:48.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.041+0000 7fd839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:48.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:48.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 5 note: GC not initialized 2024-09-12T17:37:48.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd838fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 Filter name: none 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd7b27fc640 20 reqs_thread_entry: start 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:48.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.042+0000 7fd987d42800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:48.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:48.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:48.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:48.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.043+0000 7fd987d42800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.044+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.044+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.044+0000 7fd987d42800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.044+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.045+0000 7fd987d42800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.045+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:48.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.045+0000 7fd987d42800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:37:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.045+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.046+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.047+0000 7fd987d42800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:37:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.047+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.047+0000 7fd987d42800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:37:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.047+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.048+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:48.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.048+0000 7fd987d42800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:37:48.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.048+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.049+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.049+0000 7fd987d42800 20 get_obj_state: octx=0x55802f791190 obj=check-bucket:e state=0x55802fa52968 s->prefetch_data=0 2024-09-12T17:37:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.049+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.049+0000 7fd987d42800 20 get_obj_state: octx=0x55802f7b9590 obj=check-bucket:d state=0x55802fa58b78 s->prefetch_data=0 2024-09-12T17:37:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.049+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa5c640 obj=check-bucket:c state=0x55802fa53bc8 s->prefetch_data=0 2024-09-12T17:37:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa55290 obj=check-bucket:f state=0x55802faf11f8 s->prefetch_data=0 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to ey7nb8pc876pc6nhsuqok488gxg86nwy 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state_impl: setting s->olh_tag to h5klz8bwphqwe80e3m4yau2y258utiuf 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h5klz8bwphqwe80e3m4yau2y258utiuf 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 9jez3lfydkg9dpomx6debi8elmwsu7oa 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state_impl: setting s->olh_tag to xup711p0lk83gu02xz702o6j7nobnzki 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xup711p0lk83gu02xz702o6j7nobnzki 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to dqq09lvz51b4hbz7nnxbn7y1mianvgeb 2024-09-12T17:37:48.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 get_obj_state_impl: setting s->olh_tag to g327u1eh5e153h3p705e8xsd51ol4kfy 2024-09-12T17:37:48.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.050+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g327u1eh5e153h3p705e8xsd51ol4kfy 2024-09-12T17:37:48.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.051+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 0ozag011r6jpsidcrqswarqmintjygjv 2024-09-12T17:37:48.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.051+0000 7fd987d42800 20 get_obj_state_impl: setting s->olh_tag to g87f753dql5vxp17al9q7981skn86bw0 2024-09-12T17:37:48.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.051+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g87f753dql5vxp17al9q7981skn86bw0 2024-09-12T17:37:48.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.052+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.053+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.053+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.053+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.055+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.055+0000 7fd987d42800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:37:48.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.055+0000 7fd987d42800 20 olh_log_entry: epoch=2 op=3 key=f[ubepwTSI-G4CqLjIcgCiuGzVwp3Sl2G] 2024-09-12T17:37:48.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.055+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa55290 obj=check-bucket:_:ubepwTSI-G4CqLjIcgCiuGzVwp3Sl2G_f state=0x55802fb0e178 s->prefetch_data=0 2024-09-12T17:37:48.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.055+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 10 manifest: total_size = 11 2024-09-12T17:37:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3928274113617193800 2024-09-12T17:37:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa55290 obj=check-bucket:_:ubepwTSI-G4CqLjIcgCiuGzVwp3Sl2G_f state=0x55802fb0e178 s->prefetch_data=0 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 prepare_atomic_modification: state is not atomic. state=0x55802fb0e178 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 olh_log_entry: epoch=3 op=3 key=c[izAV-1El1QbsW2xhtq0vdvWja-nAfL3] 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa5c640 obj=check-bucket:_:izAV-1El1QbsW2xhtq0vdvWja-nAfL3_c state=0x55802fb15078 s->prefetch_data=0 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 olh_log_entry: epoch=2 op=3 key=e[p9VY65-j6atne70zTnPOEHLh34Cb9rT] 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: octx=0x55802f791190 obj=check-bucket:_:p9VY65-j6atne70zTnPOEHLh34Cb9rT_e state=0x55802fb19c18 s->prefetch_data=0 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 10 manifest: total_size = 22 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15153637182735556417 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa5c640 obj=check-bucket:_:izAV-1El1QbsW2xhtq0vdvWja-nAfL3_c state=0x55802fb15078 s->prefetch_data=0 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 prepare_atomic_modification: state is not atomic. state=0x55802fb15078 2024-09-12T17:37:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.056+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 olh_log_entry: epoch=3 op=3 key=d[ZwZZ9vvmStkEGtoD5UI8nFNAT1jvdD8] 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 get_obj_state: octx=0x55802f7b9590 obj=check-bucket:_:ZwZZ9vvmStkEGtoD5UI8nFNAT1jvdD8_d state=0x55802fb23b78 s->prefetch_data=0 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 10 manifest: total_size = 22 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6660268967116982248 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 get_obj_state: octx=0x55802f791190 obj=check-bucket:_:p9VY65-j6atne70zTnPOEHLh34Cb9rT_e state=0x55802fb19c18 s->prefetch_data=0 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 prepare_atomic_modification: state is not atomic. state=0x55802fb19c18 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 10 manifest: total_size = 9 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8421464538139083049 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 get_obj_state: octx=0x55802f7b9590 obj=check-bucket:_:ZwZZ9vvmStkEGtoD5UI8nFNAT1jvdD8_d state=0x55802fb23b78 s->prefetch_data=0 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 prepare_atomic_modification: state is not atomic. state=0x55802fb23b78 2024-09-12T17:37:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.057+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.059+0000 7fd987d42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:48.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.059+0000 7fd987d42800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:37:48.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.059+0000 7fd987d42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:48.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.059+0000 7fd987d42800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:ubepwTSI-G4CqLjIcgCiuGzVwp3Sl2G_.3Y_MjP_a0d6tXU0u4OT-z-Ry2HEhtCF_0 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:ZwZZ9vvmStkEGtoD5UI8nFNAT1jvdD8_.0XOFuvCvPKD7cJgHNf5Rx_CTJGEUwkf_0 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:48.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd987d42800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:p9VY65-j6atne70zTnPOEHLh34Cb9rT_.Q_OetV3OEiA8Jlnu2Dy5eaGohc1r7UI_0 2024-09-12T17:37:48.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.061+0000 7fd862ffd640 20 handle_completion(): completion ok for obj=f[ubepwTSI-G4CqLjIcgCiuGzVwp3Sl2G] 2024-09-12T17:37:48.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.062+0000 7fd987d42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:48.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.062+0000 7fd987d42800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:37:48.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.062+0000 7fd987d42800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:48.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.062+0000 7fd987d42800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:izAV-1El1QbsW2xhtq0vdvWja-nAfL3_.7nKWtjSMVxicPtyf2Ao_9mBUCLG0dIU_0 2024-09-12T17:37:48.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.062+0000 7fd987d42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd987d42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd8627fc640 20 handle_completion(): completion ok for obj=e[p9VY65-j6atne70zTnPOEHLh34Cb9rT] 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd8627fc640 20 handle_completion(): completion ok for obj=c[izAV-1El1QbsW2xhtq0vdvWja-nAfL3] 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd987d42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd862ffd640 20 handle_completion(): completion ok for obj=d[ZwZZ9vvmStkEGtoD5UI8nFNAT1jvdD8] 2024-09-12T17:37:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.064+0000 7fd987d42800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:48.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.067+0000 7fd987d42800 20 get_obj_state: octx=0x55802fa55290 obj=check-bucket:f state=0x55802faf11f8 s->prefetch_data=0 2024-09-12T17:37:48.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.067+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g87f753dql5vxp17al9q7981skn86bw0 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 get_obj_state: octx=0x55802f791190 obj=check-bucket:e state=0x55802fa52968 s->prefetch_data=0 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h5klz8bwphqwe80e3m4yau2y258utiuf 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.069+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.074+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.074+0000 7fd987d42800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:37:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.074+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.074+0000 7fd987d42800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:37:48.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.077+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.079+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.079+0000 7fd987d42800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:37:48.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.079+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.081+0000 7fd987d42800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.081+0000 7fd987d42800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:37:48.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.081+0000 7fd987d42800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:37:48.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.082+0000 7fd839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.084+0000 7fd987d42800 20 remove_watcher() i=0 2024-09-12T17:37:48.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.084+0000 7fd987d42800 2 removed watcher, disabling cache 2024-09-12T17:37:48.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.085+0000 7fd987d42800 20 remove_watcher() i=1 2024-09-12T17:37:48.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.086+0000 7fd987d42800 20 remove_watcher() i=2 2024-09-12T17:37:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.087+0000 7fd987d42800 20 remove_watcher() i=3 2024-09-12T17:37:48.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.089+0000 7fd987d42800 20 remove_watcher() i=4 2024-09-12T17:37:48.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.089+0000 7fd987d42800 20 remove_watcher() i=5 2024-09-12T17:37:48.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.091+0000 7fd987d42800 20 remove_watcher() i=6 2024-09-12T17:37:48.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.091+0000 7fd987d42800 20 remove_watcher() i=7 2024-09-12T17:37:48.182 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:37:48.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:37:48.342 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:37:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:48.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.412+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 realm 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.414+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.617+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.617+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.617+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.617+0000 7f6fff32b800 20 searching for the correct realm 2024-09-12T17:37:48.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.621+0000 7f6ffb874640 0 -- 172.21.15.94:0/3581508413 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x560e9ebbb2c0 msgr2=0x560e9ebbd6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.625+0000 7f6ffa872640 0 -- 172.21.15.94:0/3581508413 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6fec097070 msgr2=0x7f6fec08b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:48.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.629+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 zone default found 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 4 Realm: () 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:48.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 zonegroup default 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.630+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.631+0000 7f6fff32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.631+0000 7f6fff32b800 20 started sync module instance, tier type = 2024-09-12T17:37:48.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.631+0000 7f6fff32b800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:48.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=0 2024-09-12T17:37:48.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=1 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=2 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=3 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=4 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=5 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.640+0000 7f6fff32b800 20 add_watcher() i=6 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.641+0000 7f6fff32b800 20 add_watcher() i=7 2024-09-12T17:37:48.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.641+0000 7f6fff32b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:48.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.643+0000 7f6eb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:48.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 5 note: GC not initialized 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6eb0fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 Filter name: none 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6e2a7fc640 20 reqs_thread_entry: start 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.644+0000 7f6fff32b800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:48.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:48.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:48.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.645+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.646+0000 7f6fff32b800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.646+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.646+0000 7f6fff32b800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:37:48.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.646+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.647+0000 7f6fff32b800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.647+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.647+0000 7f6fff32b800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.647+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.648+0000 7f6fff32b800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:37:48.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.648+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.649+0000 7f6fff32b800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:37:48.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.649+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:48.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.649+0000 7f6fff32b800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:37:48.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.649+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:48.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.650+0000 7f6fff32b800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:37:48.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.650+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.650+0000 7f6fff32b800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:37:48.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.651+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:48.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.651+0000 7f6fff32b800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:37:48.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.651+0000 7f6fff32b800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.651+0000 7f6fff32b800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:37:48.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.651+0000 7f6fff32b800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:37:48.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.652+0000 7f6eb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.654+0000 7f6fff32b800 20 remove_watcher() i=0 2024-09-12T17:37:48.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.654+0000 7f6fff32b800 2 removed watcher, disabling cache 2024-09-12T17:37:48.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.656+0000 7f6fff32b800 20 remove_watcher() i=1 2024-09-12T17:37:48.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.657+0000 7f6fff32b800 20 remove_watcher() i=2 2024-09-12T17:37:48.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.659+0000 7f6fff32b800 20 remove_watcher() i=3 2024-09-12T17:37:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.660+0000 7f6fff32b800 20 remove_watcher() i=4 2024-09-12T17:37:48.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.661+0000 7f6fff32b800 20 remove_watcher() i=5 2024-09-12T17:37:48.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.662+0000 7f6fff32b800 20 remove_watcher() i=6 2024-09-12T17:37:48.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.663+0000 7f6fff32b800 20 remove_watcher() i=7 2024-09-12T17:37:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:37:48.905 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:48.905 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:48.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.940+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.941+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.941+0000 7f99da816800 20 realm 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.941+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.942+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.942+0000 7f99da816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.942+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.942+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.942+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.943+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.943+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.943+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.943+0000 7f99da816800 20 searching for the correct realm 2024-09-12T17:37:48.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.946+0000 7f99d57e6640 0 -- 172.21.15.94:0/1509598515 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x555716add860 msgr2=0x555716adfc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.950+0000 7f99d5fe7640 0 -- 172.21.15.94:0/1509598515 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f99cc0a2b80 msgr2=0x7f99cc0c5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.953+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 zone default found 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 4 Realm: () 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 zonegroup default 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.954+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 started sync module instance, tier type = 2024-09-12T17:37:48.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.955+0000 7f99da816800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=0 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=1 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=2 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=3 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=4 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=5 2024-09-12T17:37:48.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.967+0000 7f99da816800 20 add_watcher() i=6 2024-09-12T17:37:48.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.968+0000 7f99da816800 20 add_watcher() i=7 2024-09-12T17:37:48.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.968+0000 7f99da816800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:48.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f9887fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f99da816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:48.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f99da816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:48.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f99da816800 5 note: GC not initialized 2024-09-12T17:37:48.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f9886ffd640 20 reqs_thread_entry: start 2024-09-12T17:37:48.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f99da816800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:48.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f99da816800 20 Filter name: none 2024-09-12T17:37:48.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.970+0000 7f9884ff9640 20 reqs_thread_entry: start 2024-09-12T17:37:48.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 INFO: main: starting shard=0 2024-09-12T17:37:48.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.971+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 INFO: main: starting shard=1 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 INFO: main: starting shard=2 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.972+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 INFO: main: starting shard=3 2024-09-12T17:37:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 INFO: main: starting shard=4 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.973+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 INFO: main: starting shard=5 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 INFO: main: starting shard=6 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.974+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 INFO: main: starting shard=7 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 INFO: main: starting shard=8 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.975+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 INFO: main: starting shard=9 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 INFO: main: starting shard=10 2024-09-12T17:37:48.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:48.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:48.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.976+0000 7f99da816800 20 INFO: main: done 2024-09-12T17:37:48.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.977+0000 7f9887fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:48.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.979+0000 7f99da816800 20 remove_watcher() i=0 2024-09-12T17:37:48.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.979+0000 7f99da816800 2 removed watcher, disabling cache 2024-09-12T17:37:48.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.980+0000 7f99da816800 20 remove_watcher() i=1 2024-09-12T17:37:48.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.981+0000 7f99da816800 20 remove_watcher() i=2 2024-09-12T17:37:48.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.983+0000 7f99da816800 20 remove_watcher() i=3 2024-09-12T17:37:48.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.984+0000 7f99da816800 20 remove_watcher() i=4 2024-09-12T17:37:48.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.985+0000 7f99da816800 20 remove_watcher() i=5 2024-09-12T17:37:48.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.985+0000 7f99da816800 20 remove_watcher() i=6 2024-09-12T17:37:48.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:48.986+0000 7f99da816800 20 remove_watcher() i=7 2024-09-12T17:37:48.999 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:37:49.030 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:49.030 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.066+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 realm 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.068+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.069+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.069+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.069+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.069+0000 7f5025b25800 20 searching for the correct realm 2024-09-12T17:37:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.072+0000 7f5021f34640 0 -- 172.21.15.94:0/2136309211 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f501800a430 msgr2=0x7f501800a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.076+0000 7f5021733640 0 -- 172.21.15.94:0/2136309211 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f5018036950 msgr2=0x7f5018008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.281+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 zone default found 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 4 Realm: () 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 zonegroup default 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.282+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.283+0000 7f5025b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.283+0000 7f5025b25800 20 started sync module instance, tier type = 2024-09-12T17:37:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.283+0000 7f5025b25800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=0 2024-09-12T17:37:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=1 2024-09-12T17:37:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=2 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=3 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=4 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=5 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.292+0000 7f5025b25800 20 add_watcher() i=6 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.293+0000 7f5025b25800 20 add_watcher() i=7 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.293+0000 7f5025b25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:49.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.295+0000 7f4ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.295+0000 7f5025b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.295+0000 7f5025b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.295+0000 7f5025b25800 5 note: GC not initialized 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f4ed67e4640 20 reqs_thread_entry: start 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f5025b25800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f5025b25800 20 Filter name: none 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f4e47fff640 20 reqs_thread_entry: start 2024-09-12T17:37:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.296+0000 7f5025b25800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 INFO: main: starting shard=0 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 INFO: main: starting shard=1 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.297+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 INFO: main: starting shard=2 2024-09-12T17:37:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 INFO: main: starting shard=3 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.298+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 INFO: main: starting shard=4 2024-09-12T17:37:49.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 INFO: main: starting shard=5 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.299+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 INFO: main: starting shard=6 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 INFO: main: starting shard=7 2024-09-12T17:37:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.300+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 INFO: main: starting shard=8 2024-09-12T17:37:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 INFO: main: starting shard=9 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.301+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.302+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.302+0000 7f5025b25800 20 INFO: main: starting shard=10 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.302+0000 7f5025b25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.302+0000 7f5025b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:49.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.302+0000 7f5025b25800 20 INFO: main: done 2024-09-12T17:37:49.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.303+0000 7f4ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.305+0000 7f5025b25800 20 remove_watcher() i=0 2024-09-12T17:37:49.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.305+0000 7f5025b25800 2 removed watcher, disabling cache 2024-09-12T17:37:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.306+0000 7f5025b25800 20 remove_watcher() i=1 2024-09-12T17:37:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.307+0000 7f5025b25800 20 remove_watcher() i=2 2024-09-12T17:37:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.309+0000 7f5025b25800 20 remove_watcher() i=3 2024-09-12T17:37:49.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.310+0000 7f5025b25800 20 remove_watcher() i=4 2024-09-12T17:37:49.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.311+0000 7f5025b25800 20 remove_watcher() i=5 2024-09-12T17:37:49.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.312+0000 7f5025b25800 20 remove_watcher() i=6 2024-09-12T17:37:49.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.313+0000 7f5025b25800 20 remove_watcher() i=7 2024-09-12T17:37:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:37:49.324 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:49.326 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:37:49.357 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:49.357 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:49.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.393+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 realm 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.394+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.395+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.395+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.396+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.396+0000 7f60ed925800 20 searching for the correct realm 2024-09-12T17:37:49.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.398+0000 7f60e3fff640 0 -- 172.21.15.94:0/2854628559 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f60dc042040 msgr2=0x7f60dc05e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:49.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.603+0000 7f60e9533640 0 -- 172.21.15.94:0/2854628559 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f60d4085940 msgr2=0x7f60d40553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.810+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 zone default found 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 4 Realm: () 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 zonegroup default 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.811+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.812+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.812+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.812+0000 7f60ed925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.812+0000 7f60ed925800 20 started sync module instance, tier type = 2024-09-12T17:37:49.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.812+0000 7f60ed925800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=0 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=1 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=2 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=3 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=4 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=5 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.825+0000 7f60ed925800 20 add_watcher() i=6 2024-09-12T17:37:49.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.826+0000 7f60ed925800 20 add_watcher() i=7 2024-09-12T17:37:49.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.826+0000 7f60ed925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:49.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.827+0000 7f5f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:49.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:49.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 5 note: GC not initialized 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f5f9e7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 20 Filter name: none 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f5f0ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:49.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.828+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:49.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.829+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.830+0000 7f60ed925800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.830+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.831+0000 7f60ed925800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:37:49.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.831+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.831+0000 7f60ed925800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.831+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:49.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:37:49.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.832+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:49.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.833+0000 7f60ed925800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:37:49.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.833+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:49.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.834+0000 7f60ed925800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:37:49.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.834+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:49.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.834+0000 7f60ed925800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:37:49.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.834+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:49.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.835+0000 7f60ed925800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:37:49.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.835+0000 7f60ed925800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:49.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.835+0000 7f60ed925800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:37:49.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.835+0000 7f60ed925800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:37:49.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.836+0000 7f5f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.838+0000 7f60ed925800 20 remove_watcher() i=0 2024-09-12T17:37:49.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.838+0000 7f60ed925800 2 removed watcher, disabling cache 2024-09-12T17:37:49.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.839+0000 7f60ed925800 20 remove_watcher() i=1 2024-09-12T17:37:49.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.841+0000 7f60ed925800 20 remove_watcher() i=2 2024-09-12T17:37:49.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.842+0000 7f60ed925800 20 remove_watcher() i=3 2024-09-12T17:37:49.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.843+0000 7f60ed925800 20 remove_watcher() i=4 2024-09-12T17:37:49.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.844+0000 7f60ed925800 20 remove_watcher() i=5 2024-09-12T17:37:49.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.845+0000 7f60ed925800 20 remove_watcher() i=6 2024-09-12T17:37:49.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.846+0000 7f60ed925800 20 remove_watcher() i=7 2024-09-12T17:37:49.858 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:37:49.858 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:49.860 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:37:49.892 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:49.892 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:49.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.928+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.929+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.929+0000 7f3021515800 20 realm 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.929+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.929+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.929+0000 7f3021515800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.930+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.930+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.930+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.931+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.931+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.931+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:49.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.931+0000 7f3021515800 20 searching for the correct realm 2024-09-12T17:37:49.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:49.934+0000 7f301f800640 0 -- 172.21.15.94:0/3818091471 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f2ee80840d0 msgr2=0x7f2ee8086500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.141+0000 7f301efff640 0 -- 172.21.15.94:0/3818091471 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f300801d910 msgr2=0x7f3008033410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.348+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 zone default found 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 4 Realm: () 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 zonegroup default 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 started sync module instance, tier type = 2024-09-12T17:37:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.349+0000 7f3021515800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=0 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=1 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=2 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=3 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=4 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=5 2024-09-12T17:37:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.360+0000 7f3021515800 20 add_watcher() i=6 2024-09-12T17:37:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.361+0000 7f3021515800 20 add_watcher() i=7 2024-09-12T17:37:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.361+0000 7f3021515800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f2ed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f3021515800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:50.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f3021515800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f3021515800 5 note: GC not initialized 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f2e4ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f3021515800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f3021515800 20 Filter name: none 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.363+0000 7f2e4dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:50.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.364+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.365+0000 7f3021515800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:37:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.365+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.365+0000 7f3021515800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.365+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.366+0000 7f3021515800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.366+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.366+0000 7f3021515800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.366+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.367+0000 7f3021515800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:37:50.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.367+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.367+0000 7f3021515800 20 get_obj_state: octx=0x55a009916180 obj=check-bucket:d state=0x55a009bdee08 s->prefetch_data=0 2024-09-12T17:37:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.368+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.368+0000 7f3021515800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:37:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.368+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.369+0000 7f3021515800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:37:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.369+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.369+0000 7f3021515800 20 get_obj_state: octx=0x55a00993e580 obj=check-bucket:c state=0x55a009be0928 s->prefetch_data=0 2024-09-12T17:37:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.369+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:50.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 get_obj_state: setting s->obj_tag to 9jez3lfydkg9dpomx6debi8elmwsu7oa 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 get_obj_state_impl: setting s->olh_tag to xup711p0lk83gu02xz702o6j7nobnzki 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 get_obj_state: setting s->obj_tag to dqq09lvz51b4hbz7nnxbn7y1mianvgeb 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 get_obj_state_impl: setting s->olh_tag to g327u1eh5e153h3p705e8xsd51ol4kfy 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 olh_log_entry: epoch=4 op=3 key=d[R3ksubDCEoiWmmpf4A84DUsu2UdYBDK] 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.370+0000 7f3021515800 20 get_obj_state: octx=0x55a009c189b0 obj=check-bucket:_:R3ksubDCEoiWmmpf4A84DUsu2UdYBDK_d state=0x55a009c3e8b8 s->prefetch_data=0 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.371+0000 7f3021515800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.371+0000 7f3021515800 20 olh_log_entry: epoch=4 op=3 key=c[RmXyuAMXq9JT0amBXEuNgOU7xkrhMP5] 2024-09-12T17:37:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.371+0000 7f3021515800 20 get_obj_state: octx=0x55a009c389b0 obj=check-bucket:_:RmXyuAMXq9JT0amBXEuNgOU7xkrhMP5_c state=0x55a009c44f48 s->prefetch_data=0 2024-09-12T17:37:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.373+0000 7f3021515800 20 get_obj_state: octx=0x55a009c189b0 obj=check-bucket:d state=0x55a009c44f48 s->prefetch_data=0 2024-09-12T17:37:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.373+0000 7f3021515800 20 get_obj_state: octx=0x55a009c389b0 obj=check-bucket:c state=0x55a009c3fef8 s->prefetch_data=0 2024-09-12T17:37:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.373+0000 7f3021515800 20 get_obj_state: setting s->obj_tag to dqq09lvz51b4hbz7nnxbn7y1mianvgeb 2024-09-12T17:37:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.373+0000 7f3021515800 20 get_obj_state_impl: setting s->olh_tag to g327u1eh5e153h3p705e8xsd51ol4kfy 2024-09-12T17:37:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.373+0000 7f3021515800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g327u1eh5e153h3p705e8xsd51ol4kfy 2024-09-12T17:37:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.374+0000 7f3021515800 20 get_obj_state: setting s->obj_tag to 9jez3lfydkg9dpomx6debi8elmwsu7oa 2024-09-12T17:37:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.374+0000 7f3021515800 20 get_obj_state_impl: setting s->olh_tag to xup711p0lk83gu02xz702o6j7nobnzki 2024-09-12T17:37:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.374+0000 7f3021515800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xup711p0lk83gu02xz702o6j7nobnzki 2024-09-12T17:37:50.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.382+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:50.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.382+0000 7f3021515800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:50.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.384+0000 7f3021515800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:37:50.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.384+0000 7f3021515800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:37:50.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.384+0000 7f3021515800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:37:50.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.385+0000 7f2ed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.387+0000 7f3021515800 20 remove_watcher() i=0 2024-09-12T17:37:50.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.387+0000 7f3021515800 2 removed watcher, disabling cache 2024-09-12T17:37:50.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.389+0000 7f3021515800 20 remove_watcher() i=1 2024-09-12T17:37:50.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.390+0000 7f3021515800 20 remove_watcher() i=2 2024-09-12T17:37:50.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.391+0000 7f3021515800 20 remove_watcher() i=3 2024-09-12T17:37:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.392+0000 7f3021515800 20 remove_watcher() i=4 2024-09-12T17:37:50.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.393+0000 7f3021515800 20 remove_watcher() i=5 2024-09-12T17:37:50.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.394+0000 7f3021515800 20 remove_watcher() i=6 2024-09-12T17:37:50.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.395+0000 7f3021515800 20 remove_watcher() i=7 2024-09-12T17:37:50.408 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:37:50.438 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:50.438 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:50.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.474+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.475+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.475+0000 7f9d33139800 20 realm 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.475+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.476+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.476+0000 7f9d33139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.476+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.476+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.476+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.477+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.477+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.477+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:50.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.477+0000 7f9d33139800 20 searching for the correct realm 2024-09-12T17:37:50.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.481+0000 7f9d2e5c6640 0 -- 172.21.15.94:0/1386075865 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f9d20085030 msgr2=0x7f9d200a4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:50.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.485+0000 7f9d2e5c6640 0 -- 172.21.15.94:0/1386075865 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f9bf8084160 msgr2=0x7f9bf8086590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:50.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.488+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 zone default found 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 4 Realm: () 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 zonegroup default 2024-09-12T17:37:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.489+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.490+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.490+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.490+0000 7f9d33139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.490+0000 7f9d33139800 20 started sync module instance, tier type = 2024-09-12T17:37:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.490+0000 7f9d33139800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=0 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=1 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=2 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=3 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=4 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=5 2024-09-12T17:37:50.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.499+0000 7f9d33139800 20 add_watcher() i=6 2024-09-12T17:37:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.500+0000 7f9d33139800 20 add_watcher() i=7 2024-09-12T17:37:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.500+0000 7f9d33139800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9d33139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9d33139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9d33139800 5 note: GC not initialized 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9be4fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9d33139800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9d33139800 20 Filter name: none 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.502+0000 7f9bddffb640 20 reqs_thread_entry: start 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:50.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 INFO: main: starting shard=0 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.503+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 INFO: main: starting shard=1 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 INFO: main: starting shard=2 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.504+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 INFO: main: starting shard=3 2024-09-12T17:37:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 INFO: main: starting shard=4 2024-09-12T17:37:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.505+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 INFO: main: starting shard=5 2024-09-12T17:37:50.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:50.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 INFO: main: starting shard=6 2024-09-12T17:37:50.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.506+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 INFO: main: starting shard=7 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 INFO: main: starting shard=8 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.507+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: starting shard=9 2024-09-12T17:37:50.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: starting shard=10 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.508+0000 7f9d33139800 20 INFO: main: done 2024-09-12T17:37:50.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.509+0000 7f9be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.511+0000 7f9d33139800 20 remove_watcher() i=0 2024-09-12T17:37:50.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.511+0000 7f9d33139800 2 removed watcher, disabling cache 2024-09-12T17:37:50.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.513+0000 7f9d33139800 20 remove_watcher() i=1 2024-09-12T17:37:50.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.514+0000 7f9d33139800 20 remove_watcher() i=2 2024-09-12T17:37:50.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.515+0000 7f9d33139800 20 remove_watcher() i=3 2024-09-12T17:37:50.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.516+0000 7f9d33139800 20 remove_watcher() i=4 2024-09-12T17:37:50.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.517+0000 7f9d33139800 20 remove_watcher() i=5 2024-09-12T17:37:50.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.518+0000 7f9d33139800 20 remove_watcher() i=6 2024-09-12T17:37:50.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.519+0000 7f9d33139800 20 remove_watcher() i=7 2024-09-12T17:37:50.531 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:37:50.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:50.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:50.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.597+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 20 realm 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.599+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.600+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.600+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.600+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.600+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.601+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:50.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.601+0000 7f90e0726800 20 searching for the correct realm 2024-09-12T17:37:50.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:50.803+0000 7f90dc309640 0 -- 172.21.15.94:0/879978007 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f90d40b7c20 msgr2=0x7f90d40a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:51.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.210+0000 7f90dcb0a640 0 -- 172.21.15.94:0/879978007 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f90c4036060 msgr2=0x7f90c4066750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.216+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 zone default found 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 4 Realm: () 2024-09-12T17:37:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 zonegroup default 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.217+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.218+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.218+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.218+0000 7f90e0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.218+0000 7f90e0726800 20 started sync module instance, tier type = 2024-09-12T17:37:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.218+0000 7f90e0726800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=0 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=1 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=2 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=3 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=4 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=5 2024-09-12T17:37:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.228+0000 7f90e0726800 20 add_watcher() i=6 2024-09-12T17:37:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.229+0000 7f90e0726800 20 add_watcher() i=7 2024-09-12T17:37:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.229+0000 7f90e0726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.231+0000 7f8f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.231+0000 7f90e0726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.231+0000 7f90e0726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.231+0000 7f90e0726800 5 note: GC not initialized 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.231+0000 7f8f91fdb640 20 reqs_thread_entry: start 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 Filter name: none 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f8f037fe640 20 reqs_thread_entry: start 2024-09-12T17:37:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.232+0000 7f90e0726800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 INFO: main: starting shard=0 2024-09-12T17:37:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 INFO: main: starting shard=1 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.233+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.234+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.234+0000 7f90e0726800 20 INFO: main: starting shard=2 2024-09-12T17:37:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.234+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 INFO: main: starting shard=3 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 INFO: main: starting shard=4 2024-09-12T17:37:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.235+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 INFO: main: starting shard=5 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 INFO: main: starting shard=6 2024-09-12T17:37:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.236+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 INFO: main: starting shard=7 2024-09-12T17:37:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 INFO: main: starting shard=8 2024-09-12T17:37:51.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.237+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 INFO: main: starting shard=9 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 INFO: main: starting shard=10 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.238+0000 7f90e0726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.239+0000 7f90e0726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.239+0000 7f90e0726800 20 INFO: main: done 2024-09-12T17:37:51.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.240+0000 7f8f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.242+0000 7f90e0726800 20 remove_watcher() i=0 2024-09-12T17:37:51.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.242+0000 7f90e0726800 2 removed watcher, disabling cache 2024-09-12T17:37:51.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.243+0000 7f90e0726800 20 remove_watcher() i=1 2024-09-12T17:37:51.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.244+0000 7f90e0726800 20 remove_watcher() i=2 2024-09-12T17:37:51.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.246+0000 7f90e0726800 20 remove_watcher() i=3 2024-09-12T17:37:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.247+0000 7f90e0726800 20 remove_watcher() i=4 2024-09-12T17:37:51.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.248+0000 7f90e0726800 20 remove_watcher() i=5 2024-09-12T17:37:51.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.249+0000 7f90e0726800 20 remove_watcher() i=6 2024-09-12T17:37:51.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.250+0000 7f90e0726800 20 remove_watcher() i=7 2024-09-12T17:37:51.262 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:37:51.262 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:51.263 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:37:51.294 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:51.295 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:51.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.330+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.331+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.331+0000 7feede325800 20 realm 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.332+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.333+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:51.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.333+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.333+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:51.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.333+0000 7feede325800 20 searching for the correct realm 2024-09-12T17:37:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.337+0000 7feed97ad640 0 -- 172.21.15.94:0/1744178963 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7feecc0e2b70 msgr2=0x7feecc0b5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:51.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.341+0000 7feed97ad640 0 -- 172.21.15.94:0/1744178963 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7feda40840d0 msgr2=0x7feda4086500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.344+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 zone default found 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 4 Realm: () 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 zonegroup default 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.345+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.346+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.346+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.346+0000 7feede325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.346+0000 7feede325800 20 started sync module instance, tier type = 2024-09-12T17:37:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.346+0000 7feede325800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=0 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=1 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=2 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=3 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=4 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=5 2024-09-12T17:37:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.357+0000 7feede325800 20 add_watcher() i=6 2024-09-12T17:37:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.358+0000 7feede325800 20 add_watcher() i=7 2024-09-12T17:37:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.358+0000 7feede325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:51.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.359+0000 7fed8bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 5 note: GC not initialized 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7fed8affd640 20 reqs_thread_entry: start 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 20 Filter name: none 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7fed88ff9640 20 reqs_thread_entry: start 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:51.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.360+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.361+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.362+0000 7feede325800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.362+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.362+0000 7feede325800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:37:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.362+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.363+0000 7feede325800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.363+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.363+0000 7feede325800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.363+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:37:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:37:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.364+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.365+0000 7feede325800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:37:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.365+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.365+0000 7feede325800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:37:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.365+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.366+0000 7feede325800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:37:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.366+0000 7feede325800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.366+0000 7feede325800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:37:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.366+0000 7feede325800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:37:51.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.367+0000 7fed8bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.369+0000 7feede325800 20 remove_watcher() i=0 2024-09-12T17:37:51.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.369+0000 7feede325800 2 removed watcher, disabling cache 2024-09-12T17:37:51.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.370+0000 7feede325800 20 remove_watcher() i=1 2024-09-12T17:37:51.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.371+0000 7feede325800 20 remove_watcher() i=2 2024-09-12T17:37:51.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.372+0000 7feede325800 20 remove_watcher() i=3 2024-09-12T17:37:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.374+0000 7feede325800 20 remove_watcher() i=4 2024-09-12T17:37:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.375+0000 7feede325800 20 remove_watcher() i=5 2024-09-12T17:37:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.375+0000 7feede325800 20 remove_watcher() i=6 2024-09-12T17:37:51.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:51.376+0000 7feede325800 20 remove_watcher() i=7 2024-09-12T17:37:51.388 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:37:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:51.505 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:37:51.505 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:37:52.291 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:37:52.682 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:37:54.166 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:54.168 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:37:54.200 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:54.200 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:54.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.238+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 realm 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:54.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.240+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.241+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.241+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.241+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:54.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.241+0000 7fa70dc0e800 20 searching for the correct realm 2024-09-12T17:37:54.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.243+0000 7fa7093e0640 0 -- 172.21.15.94:0/2032045369 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x560af144ad40 msgr2=0x7fa704019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:54.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.449+0000 7fa709be1640 0 -- 172.21.15.94:0/2032045369 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa6f405de90 msgr2=0x7fa6f4061210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.455+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 zone default found 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 4 Realm: () 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 zonegroup default 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.456+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 started sync module instance, tier type = 2024-09-12T17:37:54.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.457+0000 7fa70dc0e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=0 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=1 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=2 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=3 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=4 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=5 2024-09-12T17:37:54.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.468+0000 7fa70dc0e800 20 add_watcher() i=6 2024-09-12T17:37:54.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.469+0000 7fa70dc0e800 20 add_watcher() i=7 2024-09-12T17:37:54.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.469+0000 7fa70dc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:54.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa5bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 5 note: GC not initialized 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa5be7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 20 Filter name: none 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa52ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.471+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 INFO: main: starting shard=0 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.472+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 INFO: main: starting shard=1 2024-09-12T17:37:54.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 INFO: main: starting shard=2 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.473+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 INFO: main: starting shard=3 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 INFO: main: starting shard=4 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.474+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 INFO: main: starting shard=5 2024-09-12T17:37:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 INFO: main: starting shard=6 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.475+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.476+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.476+0000 7fa70dc0e800 20 INFO: main: starting shard=7 2024-09-12T17:37:54.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.476+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:54.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.477+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.477+0000 7fa70dc0e800 20 INFO: main: starting shard=8 2024-09-12T17:37:54.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.477+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:54.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: starting shard=9 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: starting shard=10 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.478+0000 7fa70dc0e800 20 INFO: main: done 2024-09-12T17:37:54.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.479+0000 7fa5bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:54.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.482+0000 7fa70dc0e800 20 remove_watcher() i=0 2024-09-12T17:37:54.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.482+0000 7fa70dc0e800 2 removed watcher, disabling cache 2024-09-12T17:37:54.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.483+0000 7fa70dc0e800 20 remove_watcher() i=1 2024-09-12T17:37:54.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.484+0000 7fa70dc0e800 20 remove_watcher() i=2 2024-09-12T17:37:54.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.486+0000 7fa70dc0e800 20 remove_watcher() i=3 2024-09-12T17:37:54.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.487+0000 7fa70dc0e800 20 remove_watcher() i=4 2024-09-12T17:37:54.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.488+0000 7fa70dc0e800 20 remove_watcher() i=5 2024-09-12T17:37:54.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.489+0000 7fa70dc0e800 20 remove_watcher() i=6 2024-09-12T17:37:54.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.490+0000 7fa70dc0e800 20 remove_watcher() i=7 2024-09-12T17:37:54.634 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:54.635 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:37:54.666 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:54.666 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:54.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.700+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 realm 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.703+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.704+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.704+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.704+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:54.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.704+0000 7fbc7e724800 20 searching for the correct realm 2024-09-12T17:37:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.708+0000 7fbc7ac69640 0 -- 172.21.15.94:0/1302965505 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fbc6404b040 msgr2=0x7fbc6404c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:54.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.914+0000 7fbc7a468640 0 -- 172.21.15.94:0/1302965505 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x560f7eeb1190 msgr2=0x560f7eeb35a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.916+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.917+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.917+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.917+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:54.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.917+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.917+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 zone default found 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 4 Realm: () 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 zonegroup default 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 started sync module instance, tier type = 2024-09-12T17:37:54.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.918+0000 7fbc7e724800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:54.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=0 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=1 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=2 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=3 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=4 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=5 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.928+0000 7fbc7e724800 20 add_watcher() i=6 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.929+0000 7fbc7e724800 20 add_watcher() i=7 2024-09-12T17:37:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.929+0000 7fbc7e724800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:54.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.931+0000 7fbb30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.931+0000 7fbc7e724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.931+0000 7fbc7e724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.931+0000 7fbc7e724800 5 note: GC not initialized 2024-09-12T17:37:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.931+0000 7fbaab7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 Filter name: none 2024-09-12T17:37:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbaa97fa640 20 reqs_thread_entry: start 2024-09-12T17:37:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 INFO: main: starting shard=0 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.932+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.933+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.933+0000 7fbc7e724800 20 INFO: main: starting shard=1 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.933+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: starting shard=2 2024-09-12T17:37:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: starting shard=3 2024-09-12T17:37:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 INFO: main: starting shard=4 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.934+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.935+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.935+0000 7fbc7e724800 20 INFO: main: starting shard=5 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.935+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 INFO: main: starting shard=6 2024-09-12T17:37:54.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 INFO: main: starting shard=7 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.936+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 INFO: main: starting shard=8 2024-09-12T17:37:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 INFO: main: starting shard=9 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.937+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.938+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.938+0000 7fbc7e724800 20 INFO: main: starting shard=10 2024-09-12T17:37:54.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.938+0000 7fbc7e724800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:54.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.938+0000 7fbc7e724800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:54.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.938+0000 7fbc7e724800 20 INFO: main: done 2024-09-12T17:37:54.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.939+0000 7fbb30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.942+0000 7fbc7e724800 20 remove_watcher() i=0 2024-09-12T17:37:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.942+0000 7fbc7e724800 2 removed watcher, disabling cache 2024-09-12T17:37:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.943+0000 7fbc7e724800 20 remove_watcher() i=1 2024-09-12T17:37:54.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.944+0000 7fbc7e724800 20 remove_watcher() i=2 2024-09-12T17:37:54.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.945+0000 7fbc7e724800 20 remove_watcher() i=3 2024-09-12T17:37:54.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.946+0000 7fbc7e724800 20 remove_watcher() i=4 2024-09-12T17:37:54.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.947+0000 7fbc7e724800 20 remove_watcher() i=5 2024-09-12T17:37:54.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.948+0000 7fbc7e724800 20 remove_watcher() i=6 2024-09-12T17:37:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:54.949+0000 7fbc7e724800 20 remove_watcher() i=7 2024-09-12T17:37:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:55.073 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:37:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:55.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.139+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 20 realm 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.140+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.141+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.141+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.141+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.141+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.142+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.142+0000 7feeac032800 20 searching for the correct realm 2024-09-12T17:37:55.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.145+0000 7fee9ffff640 0 -- 172.21.15.94:0/4228484702 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fee9804cbc0 msgr2=0x7fee9808d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.149+0000 7feea7b54640 0 -- 172.21.15.94:0/4228484702 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fee900a60b0 msgr2=0x7fee900193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.152+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 zone default found 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 4 Realm: () 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 zonegroup default 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.153+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 started sync module instance, tier type = 2024-09-12T17:37:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.154+0000 7feeac032800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=0 2024-09-12T17:37:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=1 2024-09-12T17:37:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=2 2024-09-12T17:37:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=3 2024-09-12T17:37:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=4 2024-09-12T17:37:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=5 2024-09-12T17:37:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.164+0000 7feeac032800 20 add_watcher() i=6 2024-09-12T17:37:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.165+0000 7feeac032800 20 add_watcher() i=7 2024-09-12T17:37:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.165+0000 7feeac032800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.166+0000 7fed5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 5 note: GC not initialized 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7fed5cfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 Filter name: none 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7fecd67fc640 20 reqs_thread_entry: start 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.167+0000 7feeac032800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 INFO: main: starting shard=0 2024-09-12T17:37:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 INFO: main: starting shard=1 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.168+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 INFO: main: starting shard=2 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 INFO: main: starting shard=3 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.169+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 INFO: main: starting shard=4 2024-09-12T17:37:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 INFO: main: starting shard=5 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.170+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 INFO: main: starting shard=6 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 INFO: main: starting shard=7 2024-09-12T17:37:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.171+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 INFO: main: starting shard=8 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 INFO: main: starting shard=9 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.172+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.173+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.173+0000 7feeac032800 20 INFO: main: starting shard=10 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.173+0000 7feeac032800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.173+0000 7feeac032800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.173+0000 7feeac032800 20 INFO: main: done 2024-09-12T17:37:55.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.174+0000 7fed5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.176+0000 7feeac032800 20 remove_watcher() i=0 2024-09-12T17:37:55.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.176+0000 7feeac032800 2 removed watcher, disabling cache 2024-09-12T17:37:55.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.177+0000 7feeac032800 20 remove_watcher() i=1 2024-09-12T17:37:55.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.178+0000 7feeac032800 20 remove_watcher() i=2 2024-09-12T17:37:55.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.179+0000 7feeac032800 20 remove_watcher() i=3 2024-09-12T17:37:55.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.180+0000 7feeac032800 20 remove_watcher() i=4 2024-09-12T17:37:55.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.181+0000 7feeac032800 20 remove_watcher() i=5 2024-09-12T17:37:55.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.182+0000 7feeac032800 20 remove_watcher() i=6 2024-09-12T17:37:55.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.183+0000 7feeac032800 20 remove_watcher() i=7 2024-09-12T17:37:55.303 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:37:55.305 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:37:55.335 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:55.335 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:55.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.370+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 realm 2024-09-12T17:37:55.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.372+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.373+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.373+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.373+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.373+0000 7f73c9030800 20 searching for the correct realm 2024-09-12T17:37:55.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.376+0000 7f73bbfff640 0 -- 172.21.15.94:0/3760672552 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f73b4086060 msgr2=0x7f73b40aaac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.380+0000 7f73c43cc640 0 -- 172.21.15.94:0/3760672552 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f73ac0496f0 msgr2=0x7f73ac00f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.586+0000 7f73c9030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 zone default found 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 4 Realm: () 2024-09-12T17:37:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 zonegroup default 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.587+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 started sync module instance, tier type = 2024-09-12T17:37:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.588+0000 7f73c9030800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=0 2024-09-12T17:37:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=1 2024-09-12T17:37:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=2 2024-09-12T17:37:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=3 2024-09-12T17:37:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=4 2024-09-12T17:37:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=5 2024-09-12T17:37:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.600+0000 7f73c9030800 20 add_watcher() i=6 2024-09-12T17:37:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.601+0000 7f73c9030800 20 add_watcher() i=7 2024-09-12T17:37:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.601+0000 7f73c9030800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.602+0000 7f727afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 5 note: GC not initialized 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f7279fdb640 20 reqs_thread_entry: start 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 Filter name: none 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f71eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.603+0000 7f73c9030800 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.604+0000 7f73c9030800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.604+0000 7f73c9030800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.604+0000 7f73c9030800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:37:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.604+0000 7f73c9030800 20 INFO: main: starting shard=0 2024-09-12T17:37:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.604+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 INFO: main: starting shard=1 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 INFO: main: starting shard=2 2024-09-12T17:37:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.605+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 INFO: main: starting shard=3 2024-09-12T17:37:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 INFO: main: starting shard=4 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.606+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 INFO: main: starting shard=5 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 INFO: main: starting shard=6 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.607+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 INFO: main: starting shard=7 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 INFO: main: starting shard=8 2024-09-12T17:37:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.608+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: starting shard=9 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: starting shard=10 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:37:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.609+0000 7f73c9030800 20 INFO: main: done 2024-09-12T17:37:55.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.610+0000 7f727afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.612+0000 7f73c9030800 20 remove_watcher() i=0 2024-09-12T17:37:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.612+0000 7f73c9030800 2 removed watcher, disabling cache 2024-09-12T17:37:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.614+0000 7f73c9030800 20 remove_watcher() i=1 2024-09-12T17:37:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.615+0000 7f73c9030800 20 remove_watcher() i=2 2024-09-12T17:37:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.617+0000 7f73c9030800 20 remove_watcher() i=3 2024-09-12T17:37:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.618+0000 7f73c9030800 20 remove_watcher() i=4 2024-09-12T17:37:55.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.619+0000 7f73c9030800 20 remove_watcher() i=5 2024-09-12T17:37:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.620+0000 7f73c9030800 20 remove_watcher() i=6 2024-09-12T17:37:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:55.621+0000 7f73c9030800 20 remove_watcher() i=7 2024-09-12T17:37:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:37:56.046 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:37:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:37:56.464 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:56.464 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.500+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 20 realm 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.501+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.502+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.502+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.503+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.503+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.503+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.503+0000 7f0e7b928800 20 searching for the correct realm 2024-09-12T17:37:56.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.507+0000 7f0e76e6e640 0 -- 172.21.15.94:0/2980872314 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5569a46a65c0 msgr2=0x5569a46a8a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.510+0000 7f0e7766f640 0 -- 172.21.15.94:0/2980872314 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f0e6c06bfe0 msgr2=0x7f0e6c0a1240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 zone default found 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 4 Realm: () 2024-09-12T17:37:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 zonegroup default 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.515+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 started sync module instance, tier type = 2024-09-12T17:37:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.516+0000 7f0e7b928800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:56.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=0 2024-09-12T17:37:56.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=1 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=2 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=3 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=4 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=5 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.527+0000 7f0e7b928800 20 add_watcher() i=6 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.528+0000 7f0e7b928800 20 add_watcher() i=7 2024-09-12T17:37:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.528+0000 7f0e7b928800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:56.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.530+0000 7f0d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.530+0000 7f0e7b928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.530+0000 7f0e7b928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 5 note: GC not initialized 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0d2cfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 20 Filter name: none 2024-09-12T17:37:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0ca67fc640 20 reqs_thread_entry: start 2024-09-12T17:37:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.531+0000 7f0e7b928800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.532+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.533+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.534+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.534+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.534+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:56.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.535+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.535+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:56.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.536+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:56.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.537+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.537+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:56.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.538+0000 7f0e7b928800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.545+0000 7f0d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.547+0000 7f0e7b928800 20 remove_watcher() i=0 2024-09-12T17:37:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.547+0000 7f0e7b928800 2 removed watcher, disabling cache 2024-09-12T17:37:56.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.548+0000 7f0e7b928800 20 remove_watcher() i=1 2024-09-12T17:37:56.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.550+0000 7f0e7b928800 20 remove_watcher() i=2 2024-09-12T17:37:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.551+0000 7f0e7b928800 20 remove_watcher() i=3 2024-09-12T17:37:56.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.553+0000 7f0e7b928800 20 remove_watcher() i=4 2024-09-12T17:37:56.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.554+0000 7f0e7b928800 20 remove_watcher() i=5 2024-09-12T17:37:56.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.555+0000 7f0e7b928800 20 remove_watcher() i=6 2024-09-12T17:37:56.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.556+0000 7f0e7b928800 20 remove_watcher() i=7 2024-09-12T17:37:56.568 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:37:56.603 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:56.603 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:56.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.640+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 realm 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.642+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.643+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.643+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.643+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.643+0000 7f82bb417800 20 searching for the correct realm 2024-09-12T17:37:56.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.647+0000 7f82affff640 0 -- 172.21.15.94:0/206071535 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x565250670ac0 msgr2=0x565250672f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.651+0000 7f82b73e8640 0 -- 172.21.15.94:0/206071535 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f82a001a040 msgr2=0x7f82a0088150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.850+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 zone default found 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 4 Realm: () 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 zonegroup default 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.851+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.852+0000 7f82bb417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.852+0000 7f82bb417800 20 started sync module instance, tier type = 2024-09-12T17:37:56.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.852+0000 7f82bb417800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:56.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=0 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=1 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=2 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=3 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=4 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=5 2024-09-12T17:37:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.864+0000 7f82bb417800 20 add_watcher() i=6 2024-09-12T17:37:56.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.865+0000 7f82bb417800 20 add_watcher() i=7 2024-09-12T17:37:56.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.865+0000 7f82bb417800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:56.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f816d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f82bb417800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:56.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f82bb417800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:56.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f82bb417800 5 note: GC not initialized 2024-09-12T17:37:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f80e7fff640 20 reqs_thread_entry: start 2024-09-12T17:37:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.867+0000 7f82bb417800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 20 Filter name: none 2024-09-12T17:37:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f80e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 : miss 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 info.flags=0x17 2024-09-12T17:37:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 to cache LRU end 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.868+0000 7f82bb417800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.869+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.0 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.869+0000 7f82bb417800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:37:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.869+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.870+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.2 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.870+0000 7f82bb417800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.870+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.3 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.871+0000 7f82bb417800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.871+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.4 2024-09-12T17:37:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.872+0000 7f82bb417800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.872+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.872+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.6 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.873+0000 7f82bb417800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.873+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.7 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.873+0000 7f82bb417800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.873+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.874+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.9 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.874+0000 7f82bb417800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:37:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.874+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.875+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.875+0000 7f82bb417800 20 get_obj_state: octx=0x5652503dd190 obj=check-bucket:e state=0x5652506a0ac8 s->prefetch_data=0 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.875+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.875+0000 7f82bb417800 20 get_obj_state: octx=0x565250405590 obj=check-bucket:d state=0x5652506a29c8 s->prefetch_data=0 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.875+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: octx=0x5652506a23f0 obj=check-bucket:c state=0x5652506a3db8 s->prefetch_data=0 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: octx=0x56525069e4a0 obj=check-bucket:f state=0x56525069ec18 s->prefetch_data=0 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to zy776a8p9sogq7ll6n2f6my2tdgumrbm 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state_impl: setting s->olh_tag to 3wis046qiyr9diaxl8s8td8v9ve63ah9 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3wis046qiyr9diaxl8s8td8v9ve63ah9 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to pic7x3s4cdsj1melj11b806tqyudq9ll 2024-09-12T17:37:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state_impl: setting s->olh_tag to kiy1y9ikasjrbe0cw14tj30wg3q9k77n 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kiy1y9ikasjrbe0cw14tj30wg3q9k77n 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to py1afuloyzp5wj5pflqzz8ivt5xpnjaf 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state_impl: setting s->olh_tag to 6gk6idb50suou7vffvz0u2ejka0fhnpy 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6gk6idb50suou7vffvz0u2ejka0fhnpy 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to f77dza7o2xq1z5q5tg3vofgo2ksbt2hn 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 get_obj_state_impl: setting s->olh_tag to g612evv9mzpjb8veci1hvz8sdz3v2mz5 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.876+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g612evv9mzpjb8veci1hvz8sdz3v2mz5 2024-09-12T17:37:56.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.880+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.881+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.883+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.883+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:37:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 olh_log_entry: epoch=2 op=3 key=f[fw1h99AvgvahhdXo07uvPQ3Cu4XkGAp] 2024-09-12T17:37:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 get_obj_state: octx=0x56525069e4a0 obj=check-bucket:_:fw1h99AvgvahhdXo07uvPQ3Cu4XkGAp_f state=0x565250759e48 s->prefetch_data=0 2024-09-12T17:37:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 10 manifest: total_size = 22 2024-09-12T17:37:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15353984352682140320 2024-09-12T17:37:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 get_obj_state: octx=0x56525069e4a0 obj=check-bucket:_:fw1h99AvgvahhdXo07uvPQ3Cu4XkGAp_f state=0x565250759e48 s->prefetch_data=0 2024-09-12T17:37:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 prepare_atomic_modification: state is not atomic. state=0x565250759e48 2024-09-12T17:37:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.885+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 olh_log_entry: epoch=3 op=3 key=d[LpJui27lf945.eONhJcUK2mb7JGltGN] 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 get_obj_state: octx=0x565250405590 obj=check-bucket:_:LpJui27lf945.eONhJcUK2mb7JGltGN_d state=0x56525074db58 s->prefetch_data=0 2024-09-12T17:37:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 olh_log_entry: epoch=3 op=3 key=c[feKkBoJ1.UCXJOP4kNyQBpE1WwYXtW1] 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 get_obj_state: octx=0x5652506a23f0 obj=check-bucket:_:feKkBoJ1.UCXJOP4kNyQBpE1WwYXtW1_c state=0x565250753208 s->prefetch_data=0 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 olh_log_entry: epoch=2 op=3 key=e[tFwNXGRLpcNLAr-qDLpHyMv05qgrSa4] 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 get_obj_state: octx=0x5652503dd190 obj=check-bucket:_:tFwNXGRLpcNLAr-qDLpHyMv05qgrSa4_e state=0x56525076a1a8 s->prefetch_data=0 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 10 manifest: total_size = 12 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1865510828590551322 2024-09-12T17:37:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 get_obj_state: octx=0x565250405590 obj=check-bucket:_:LpJui27lf945.eONhJcUK2mb7JGltGN_d state=0x56525074db58 s->prefetch_data=0 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 prepare_atomic_modification: state is not atomic. state=0x56525074db58 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.886+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 10 manifest: total_size = 22 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13688762842523452727 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 get_obj_state: octx=0x5652506a23f0 obj=check-bucket:_:feKkBoJ1.UCXJOP4kNyQBpE1WwYXtW1_c state=0x565250753208 s->prefetch_data=0 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 prepare_atomic_modification: state is not atomic. state=0x565250753208 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 10 manifest: total_size = 22 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11704354377877510778 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 get_obj_state: octx=0x5652503dd190 obj=check-bucket:_:tFwNXGRLpcNLAr-qDLpHyMv05qgrSa4_e state=0x56525076a1a8 s->prefetch_data=0 2024-09-12T17:37:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 prepare_atomic_modification: state is not atomic. state=0x56525076a1a8 2024-09-12T17:37:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.887+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.889+0000 7f82bb417800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.889+0000 7f82bb417800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.889+0000 7f82bb417800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.889+0000 7f82bb417800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:fw1h99AvgvahhdXo07uvPQ3Cu4XkGAp_.wemnkX3T2s-xczDnEkmfZwe8C7h50xZ_0 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.891+0000 7f8199ffb640 20 handle_completion(): completion ok for obj=f[fw1h99AvgvahhdXo07uvPQ3Cu4XkGAp] 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.891+0000 7f82bb417800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.891+0000 7f82bb417800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.891+0000 7f82bb417800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.891+0000 7f82bb417800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:LpJui27lf945.eONhJcUK2mb7JGltGN_.BzHsURqBJoDYpsnumMzSgMLWMue9kfq_0 2024-09-12T17:37:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.893+0000 7f82bb417800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f82bb417800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f82bb417800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f82bb417800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f82bb417800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:tFwNXGRLpcNLAr-qDLpHyMv05qgrSa4_.-NvcQ11rxrG2s97tDHK-_K51oMWe7R5_0 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f819a7fc640 20 handle_completion(): completion ok for obj=d[LpJui27lf945.eONhJcUK2mb7JGltGN] 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.894+0000 7f82bb417800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.895+0000 7f82bb417800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.895+0000 7f82bb417800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:37:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.895+0000 7f82bb417800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1__shadow:feKkBoJ1.UCXJOP4kNyQBpE1WwYXtW1_.GHbGDaFv1u1Z9SNycNpcwW6K-vGeh8F_0 2024-09-12T17:37:56.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.895+0000 7f82bb417800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.897+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.897+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f819a7fc640 20 handle_completion(): completion ok for obj=e[tFwNXGRLpcNLAr-qDLpHyMv05qgrSa4] 2024-09-12T17:37:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f82bb417800 20 get_obj_state: octx=0x56525069e4a0 obj=check-bucket:f state=0x56525069ec18 s->prefetch_data=0 2024-09-12T17:37:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g612evv9mzpjb8veci1hvz8sdz3v2mz5 2024-09-12T17:37:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f82bb417800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f82bb417800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:37:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.900+0000 7f819a7fc640 20 handle_completion(): completion ok for obj=c[feKkBoJ1.UCXJOP4kNyQBpE1WwYXtW1] 2024-09-12T17:37:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.903+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.5 2024-09-12T17:37:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.903+0000 7f82bb417800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:37:56.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.905+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.905+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.905+0000 7f82bb417800 20 get_obj_state: octx=0x5652503dd190 obj=check-bucket:e state=0x5652506a0ac8 s->prefetch_data=0 2024-09-12T17:37:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.905+0000 7f82bb417800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3wis046qiyr9diaxl8s8td8v9ve63ah9 2024-09-12T17:37:56.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.911+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.8 2024-09-12T17:37:56.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.911+0000 7f82bb417800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:37:56.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.911+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.912+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.10 2024-09-12T17:37:56.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.912+0000 7f82bb417800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:37:56.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.916+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.917+0000 7f82bb417800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1.1 2024-09-12T17:37:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.917+0000 7f82bb417800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:37:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.917+0000 7f82bb417800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:37:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.918+0000 7f816d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.921+0000 7f82bb417800 20 remove_watcher() i=0 2024-09-12T17:37:56.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.921+0000 7f82bb417800 2 removed watcher, disabling cache 2024-09-12T17:37:56.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.922+0000 7f82bb417800 20 remove_watcher() i=1 2024-09-12T17:37:56.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.923+0000 7f82bb417800 20 remove_watcher() i=2 2024-09-12T17:37:56.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.924+0000 7f82bb417800 20 remove_watcher() i=3 2024-09-12T17:37:56.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.925+0000 7f82bb417800 20 remove_watcher() i=4 2024-09-12T17:37:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.926+0000 7f82bb417800 20 remove_watcher() i=5 2024-09-12T17:37:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.927+0000 7f82bb417800 20 remove_watcher() i=6 2024-09-12T17:37:56.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:56.928+0000 7f82bb417800 20 remove_watcher() i=7 2024-09-12T17:37:57.151 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:37:57.179 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:57.179 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:57.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.215+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 realm 2024-09-12T17:37:57.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.217+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.218+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.218+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.218+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.218+0000 7f8612f26800 20 searching for the correct realm 2024-09-12T17:37:57.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.221+0000 7f860f470640 0 -- 172.21.15.94:0/2325162015 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f85f80b0040 msgr2=0x7f85f80a3be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.224+0000 7f860ec6f640 0 -- 172.21.15.94:0/2325162015 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f85f80ab940 msgr2=0x7f85f80a32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.430+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 zone default found 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 4 Realm: () 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 zonegroup default 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.431+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.432+0000 7f8612f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.432+0000 7f8612f26800 20 started sync module instance, tier type = 2024-09-12T17:37:57.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.432+0000 7f8612f26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=0 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=1 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=2 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=3 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=4 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=5 2024-09-12T17:37:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.442+0000 7f8612f26800 20 add_watcher() i=6 2024-09-12T17:37:57.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.443+0000 7f8612f26800 20 add_watcher() i=7 2024-09-12T17:37:57.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.443+0000 7f8612f26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:57.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.444+0000 7f84c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:57.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:57.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:57.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 5 note: GC not initialized 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f843ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 Filter name: none 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f843dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.445+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:37:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:37:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.446+0000 7f8612f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:57.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.448+0000 7f84c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:57.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.450+0000 7f8612f26800 20 remove_watcher() i=0 2024-09-12T17:37:57.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.450+0000 7f8612f26800 2 removed watcher, disabling cache 2024-09-12T17:37:57.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.451+0000 7f8612f26800 20 remove_watcher() i=1 2024-09-12T17:37:57.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.452+0000 7f8612f26800 20 remove_watcher() i=2 2024-09-12T17:37:57.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.453+0000 7f8612f26800 20 remove_watcher() i=3 2024-09-12T17:37:57.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.454+0000 7f8612f26800 20 remove_watcher() i=4 2024-09-12T17:37:57.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.455+0000 7f8612f26800 20 remove_watcher() i=5 2024-09-12T17:37:57.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.456+0000 7f8612f26800 20 remove_watcher() i=6 2024-09-12T17:37:57.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:37:57.457+0000 7f8612f26800 20 remove_watcher() i=7 2024-09-12T17:37:57.469 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:37:57.469 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket check-bucket 2024-09-12T17:37:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket check tests 2024-09-12T17:37:57.712 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-12T17:37:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-12T17:37:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:37:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:37:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-12T17:37:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-12T17:37:57.771 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-12T17:37:57.772 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:37:57.772 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:37:57.851 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:37:57.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:37:58.201 DEBUG:teuthology.parallel:result is None 2024-09-12T17:37:58.202 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:58.242 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:58.242 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:58.322 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:37:58.322 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:37:58.334 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:58.334 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:37:58.334 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:58.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:37:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:37:58.391 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:58.459 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:58.460 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:37:58.529 INFO:tasks.workunit:timeout=3h 2024-09-12T17:37:58.529 INFO:tasks.workunit:cleanup=True 2024-09-12T17:37:58.529 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:58.598 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:38:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:38:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:38:58.846 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:38:58.849 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:38:58.919 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:38:58.921 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:58.921 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:38:58.970 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:38:59.018 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:38:59.056 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:59.058 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:59.058 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:38:59.097 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:59.100 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:38:59.100 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:38:59.170 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:38:59.171 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:38:59.171 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:38:59.255 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:38:59.255 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:38:59.255 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:59.255 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:38:59.256 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:39:00.501 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:00.501 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-12T17:39:00.501 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:00.502 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:00.502 INFO:tasks.workunit.client.0.smithi094.stdout: client.5175 expiration=2024-09-12T17:41:00.497834+0000 addr=v1:172.21.15.94:0/1730540153 cookie= 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout: client.5175 expiration=2024-09-12T17:41:00.504042+0000 addr=v1:172.21.15.94:0/1730540153 cookie= 2024-09-12T17:39:00.505 INFO:tasks.workunit.client.0.smithi094.stdout: client.5184 expiration=0.000000 addr=v1:172.21.15.94:0/3274013177 cookie= 2024-09-12T17:39:00.506 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:00.506 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-12T17:39:00.506 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:00.506 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:00.506 INFO:tasks.workunit.client.0.smithi094.stdout: client.5184 expiration=0.000000 addr=v1:172.21.15.94:0/3274013177 cookie= 2024-09-12T17:39:01.477 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultiLocking (2222 ms) 2024-09-12T17:39:01.477 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:39:03.930 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:03.930 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-12T17:39:03.930 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:03.930 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:03.930 INFO:tasks.workunit.client.0.smithi094.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.94:0/908314964 cookie= 2024-09-12T17:39:03.932 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:03.932 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-12T17:39:03.933 INFO:tasks.workunit.client.0.smithi094.stdout: tag: new_tag 2024-09-12T17:39:03.933 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:03.933 INFO:tasks.workunit.client.0.smithi094.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.94:0/4129921122 cookie= 2024-09-12T17:39:04.496 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMeta (3019 ms) 2024-09-12T17:39:04.496 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:39:06.521 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:06.521 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-12T17:39:06.521 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:06.521 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.94:0/2700410901 cookie= 2024-09-12T17:39:06.523 INFO:tasks.workunit.client.0.smithi094.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.94:0/2700410901 cookie=new cookie 2024-09-12T17:39:07.509 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestCookie (3013 ms) 2024-09-12T17:39:07.510 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:39:10.535 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultipleLocks (3025 ms) 2024-09-12T17:39:10.535 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:39:17.616 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestLockDuration (7080 ms) 2024-09-12T17:39:17.616 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:39:20.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestAssertLocked (3029 ms) 2024-09-12T17:39:20.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:39:23.657 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestSetCookie (3014 ms) 2024-09-12T17:39:23.657 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:39:44.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestRenew (21046 ms) 2024-09-12T17:39:44.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:39:50.781 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6078 ms) 2024-09-12T17:39:50.781 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:39:58.809 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8028 ms) 2024-09-12T17:39:58.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:40:06.896 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8087 ms) 2024-09-12T17:40:06.896 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock (67641 ms total) 2024-09-12T17:40:06.896 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:40:06.897 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:06.897 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (67641 ms total) 2024-09-12T17:40:06.897 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-12T17:40:06.900 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:40:06.900 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:40:06.944 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:40:06.945 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:40:06.946 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:40:07.030 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:40:07.030 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:40:07.030 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:07.030 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log 2024-09-12T17:40:07.030 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:40:09.910 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_same_time (2880 ms) 2024-09-12T17:40:09.911 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:40:12.928 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_different_time (3018 ms) 2024-09-12T17:40:12.929 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:40:15.933 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_time (3005 ms) 2024-09-12T17:40:15.934 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:40:18.960 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_marker (3026 ms) 2024-09-12T17:40:18.960 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log (11929 ms total) 2024-09-12T17:40:18.960 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:40:18.961 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:18.961 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (11929 ms total) 2024-09-12T17:40:18.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-12T17:40:18.962 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:40:18.962 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:40:19.010 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:40:19.011 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:40:19.012 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:40:19.057 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:40:19.057 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:40:19.057 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:19.057 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:40:19.058 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:40:22.018 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit (2961 ms) 2024-09-12T17:40:22.019 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:40:25.042 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3021 ms) 2024-09-12T17:40:25.043 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:40:33.131 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap (8092 ms) 2024-09-12T17:40:33.132 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:40:36.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit (3023 ms) 2024-09-12T17:40:36.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:40:39.181 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set (3027 ms) 2024-09-12T17:40:39.182 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:40:46.203 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_ec (7022 ms) 2024-09-12T17:40:46.203 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:40:53.238 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7035 ms) 2024-09-12T17:40:53.238 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:41:05.361 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap_ec (12123 ms) 2024-09-12T17:41:05.362 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:41:12.377 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit_ec (7016 ms) 2024-09-12T17:41:12.377 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:41:19.411 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set_ec (7033 ms) 2024-09-12T17:41:19.411 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount (60353 ms total) 2024-09-12T17:41:19.411 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:41:19.411 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:19.412 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (60353 ms total) 2024-09-12T17:41:19.412 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-12T17:41:19.414 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:19.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:19.457 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:41:19.458 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:41:19.458 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:41:19.545 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:41:19.545 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:41:19.545 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:19.545 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:41:21.424 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:41:21.468 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_basic (44 ms) 2024-09-12T17:41:21.468 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:41:21.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (29 ms) 2024-09-12T17:41:21.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:41:21.541 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-12T17:41:21.541 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:41:23.005 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest (1464 ms) 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:41:23.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-12T17:41:23.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:41:23.033 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list (21 ms) 2024-09-12T17:41:23.033 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:41:41.441 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list_delimited (18407 ms) 2024-09-12T17:41:41.441 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_list (71 ms) 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:41:41.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-12T17:41:41.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:41:41.733 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_list (212 ms) 2024-09-12T17:41:41.733 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:41:49.481 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_defer (7748 ms) 2024-09-12T17:41:49.481 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:41:49.572 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_basic (91 ms) 2024-09-12T17:41:49.572 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:41:49.574 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T17:41:49.574 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:41:49.670 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-09-12T17:41:49.670 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:41:49.709 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_log_trim (39 ms) 2024-09-12T17:41:49.710 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:41:49.725 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_racing_removes (15 ms) 2024-09-12T17:41:49.725 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:41:49.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-12T17:41:49.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:41:49.750 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-12T17:41:50.487 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw (28326 ms total) 2024-09-12T17:41:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:41:50.487 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 18 tests from 1 test suite ran. (30945 ms total) 2024-09-12T17:41:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 18 tests. 2024-09-12T17:41:50.491 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:50.491 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:50.561 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:41:50.562 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:41:50.563 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:41:50.662 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:41:50.662 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:41:50.662 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:50.662 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:41:50.663 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:41:52.496 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.init (1835 ms) 2024-09-12T17:41:52.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:41:52.521 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] list info tag = chain-0 2024-09-12T17:41:52.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (25 ms) 2024-09-12T17:41:52.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:41:52.528 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:41:52.529 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-09-12T17:41:52.529 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:41:52.538 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (11 ms) 2024-09-12T17:41:52.538 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:41:52.870 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (331 ms) 2024-09-12T17:41:52.870 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:41:52.882 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (13 ms) 2024-09-12T17:41:52.883 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:41:52.894 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (12 ms) 2024-09-12T17:41:52.894 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:41:52.903 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (9 ms) 2024-09-12T17:41:52.904 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:41:53.510 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.finalize (607 ms) 2024-09-12T17:41:53.510 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc (2849 ms total) 2024-09-12T17:41:53.511 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:41:53.511 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:53.511 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (2849 ms total) 2024-09-12T17:41:53.511 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-12T17:41:53.514 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:53.514 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:53.601 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:41:53.602 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:41:53.603 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:41:53.656 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:53.656 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:53.657 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:41:53.657 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:55.529 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:41:55.529 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:41:55.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.540+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=7NVSUQ4P7P5E type=del size=1652249 2024-09-12T17:41:55.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.541+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=V3PVEOIYA5EN type=write size=1037293 2024-09-12T17:41:55.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.543+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=0TGVOXGII0VC type=del size=320195 2024-09-12T17:41:55.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.545+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~LGKPNG1MN1M9.0 size=1048576 2024-09-12T17:41:55.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.546+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~LGKPNG1MN1M9.1 size=745 2024-09-12T17:41:55.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.546+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=LGKPNG1MN1M9 tag=6N9QF51A6QKB type=write size=2097897 2024-09-12T17:41:55.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.548+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=U3DTAEN7UE05 type=del size=1862402 2024-09-12T17:41:55.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.550+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.0 size=1048576 2024-09-12T17:41:55.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.551+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.1 size=1048576 2024-09-12T17:41:55.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.552+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.2 size=130190 2024-09-12T17:41:55.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.552+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=AV0NGHF9R0D3 tag=MG7HR0IWO1VJ type=write size=3275918 2024-09-12T17:41:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.553+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=N80SU8GMV8VH type=del size=1274481 2024-09-12T17:41:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.555+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=Q9GR7Y9M7BB0 type=write size=322322 2024-09-12T17:41:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.556+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=4DM0FJ2OY2EI type=del size=2817960 2024-09-12T17:41:55.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.559+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.0 size=1048576 2024-09-12T17:41:55.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.560+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.1 size=1048576 2024-09-12T17:41:55.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.561+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.2 size=1010933 2024-09-12T17:41:55.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.561+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=6RRDXZ5FSW0P tag=D1XFRP8AGQHH type=write size=4156661 2024-09-12T17:41:55.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.562+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=IY0ICOB7HURY type=del size=1886766 2024-09-12T17:41:55.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.564+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=4484COQL7MVU type=del size=4129122 2024-09-12T17:41:55.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.566+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.0 size=1048576 2024-09-12T17:41:55.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.567+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.1 size=1048576 2024-09-12T17:41:55.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.568+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.2 size=881096 2024-09-12T17:41:55.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.568+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=0USP3P2LXZGV tag=OKJIYSD2TEV3 type=write size=4026824 2024-09-12T17:41:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.571+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~XSW949VVBLZ7.0 size=847427 2024-09-12T17:41:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.571+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=XSW949VVBLZ7 tag=1ZVXNF2CMJKF type=write size=1896003 2024-09-12T17:41:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.573+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.0 size=1048576 2024-09-12T17:41:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.574+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.1 size=1048576 2024-09-12T17:41:55.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.575+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.2 size=68094 2024-09-12T17:41:55.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.575+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=Y1CSA424SNS1 tag=LS48VYRKE55O type=write size=3213822 2024-09-12T17:41:55.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.576+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=BU3KR25CH3E0 type=del size=1374006 2024-09-12T17:41:55.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.577+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=7NVSUQ4P7P5E type=del size=1652249 2024-09-12T17:41:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.579+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.0 size=1048576 2024-09-12T17:41:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.580+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.1 size=1048576 2024-09-12T17:41:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.581+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.2 size=888437 2024-09-12T17:41:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.581+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=0ZTQEOKBN6NO tag=218YXNHTNFP9 type=write size=4034165 2024-09-12T17:41:55.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.583+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=V3PVEOIYA5EN type=write size=1037293 2024-09-12T17:41:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.585+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~H0DKVPK0FLHA.0 size=1048576 2024-09-12T17:41:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.586+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~H0DKVPK0FLHA.1 size=626000 2024-09-12T17:41:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.586+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=H0DKVPK0FLHA tag=GM8IO5IPZGXG type=write size=2723152 2024-09-12T17:41:55.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.587+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=0TGVOXGII0VC type=del 2024-09-12T17:41:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.589+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=R8S3Y00SN5SO type=del size=3324997 2024-09-12T17:41:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.590+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~LGKPNG1MN1M9.0 size=1048576 2024-09-12T17:41:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.590+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~LGKPNG1MN1M9.1 size=745 2024-09-12T17:41:55.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.592+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=LGKPNG1MN1M9 tag=6N9QF51A6QKB type=write size=2097897 2024-09-12T17:41:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.594+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~WJ2UWXEIYE6G.0 size=1048576 2024-09-12T17:41:55.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.595+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~WJ2UWXEIYE6G.1 size=255073 2024-09-12T17:41:55.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.595+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=WJ2UWXEIYE6G tag=ORB3H720WR58 type=write size=2352225 2024-09-12T17:41:55.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.598+0000 7f330fbcc780 1 < suggested update operation key=3IHGI1UMI1BA tag=U3DTAEN7UE05 type=del size=1862402 2024-09-12T17:41:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.600+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~1RYRCYC2V5OI.0 size=713347 2024-09-12T17:41:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.600+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=1RYRCYC2V5OI tag=SM4G3BXHQI0L type=write size=1761923 2024-09-12T17:41:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.602+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.0 size=1048576 2024-09-12T17:41:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.603+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.1 size=1048576 2024-09-12T17:41:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.604+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AV0NGHF9R0D3.2 size=130190 2024-09-12T17:41:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.606+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=AV0NGHF9R0D3 tag=MG7HR0IWO1VJ type=write size=3275918 2024-09-12T17:41:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.608+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.0 size=1048576 2024-09-12T17:41:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.609+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.1 size=1048576 2024-09-12T17:41:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.610+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.2 size=59532 2024-09-12T17:41:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.610+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=LB1TC223Z277 tag=3J1ND3OO7LCQ type=write size=3205260 2024-09-12T17:41:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.612+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=N80SU8GMV8VH type=del 2024-09-12T17:41:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.613+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=HGRJCW97OE6V type=del size=112629 2024-09-12T17:41:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.614+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=Q9GR7Y9M7BB0 type=write size=322322 2024-09-12T17:41:55.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.616+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.0 size=1048576 2024-09-12T17:41:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.617+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.1 size=1048576 2024-09-12T17:41:55.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.619+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.2 size=540677 2024-09-12T17:41:55.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.619+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=V6M6BMD1S99O tag=DCZY8H22Y7GQ type=write size=3686405 2024-09-12T17:41:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.620+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=4DM0FJ2OY2EI type=del 2024-09-12T17:41:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.621+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=IPY0EZWXVFXV type=del size=3216524 2024-09-12T17:41:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.623+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.0 size=1048576 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.624+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.1 size=1048576 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.624+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~6RRDXZ5FSW0P.2 size=1010933 2024-09-12T17:41:55.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.627+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=6RRDXZ5FSW0P tag=D1XFRP8AGQHH type=write size=4156661 2024-09-12T17:41:55.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.628+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=08N9DJDQAUHB type=del size=3427046 2024-09-12T17:41:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.629+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=IY0ICOB7HURY type=del 2024-09-12T17:41:55.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.631+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~MM2EO7N957DV.0 size=1048576 2024-09-12T17:41:55.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.632+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~MM2EO7N957DV.1 size=1020284 2024-09-12T17:41:55.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.632+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=MM2EO7N957DV tag=WEXG0G5M2E88 type=write size=3117436 2024-09-12T17:41:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.634+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=4484COQL7MVU type=del 2024-09-12T17:41:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.635+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=LID71ALKZD6U type=del size=2780275 2024-09-12T17:41:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.635+0000 7f330fbcc780 1 < canceled part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.0 size=1048576 2024-09-12T17:41:55.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.636+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.1 size=1048576 2024-09-12T17:41:55.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.637+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~0USP3P2LXZGV.2 size=881096 2024-09-12T17:41:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.639+0000 7f330fbcc780 1 < canceled multipart upload key=LNE0UR6JPWR8 upload=0USP3P2LXZGV tag=OKJIYSD2TEV3 type=write size=4026824 2024-09-12T17:41:55.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.640+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=Q95F1V3E9XKH type=del size=2743660 2024-09-12T17:41:55.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.641+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~XSW949VVBLZ7.0 size=847427 2024-09-12T17:41:55.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.643+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=XSW949VVBLZ7 tag=1ZVXNF2CMJKF type=write size=1896003 2024-09-12T17:41:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.645+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.0 size=1048576 2024-09-12T17:41:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.646+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.1 size=1048576 2024-09-12T17:41:55.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.647+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.2 size=328951 2024-09-12T17:41:55.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.647+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=EUD6VFZZ98Y6 tag=3PC9PK2H4QN4 type=write size=3474679 2024-09-12T17:41:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.648+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.0 size=1048576 2024-09-12T17:41:55.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.649+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.1 size=1048576 2024-09-12T17:41:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.650+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~Y1CSA424SNS1.2 size=68094 2024-09-12T17:41:55.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.652+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=Y1CSA424SNS1 tag=LS48VYRKE55O type=write size=3213822 2024-09-12T17:41:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.654+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~LC0J6W0TGF9O.0 size=1048576 2024-09-12T17:41:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.655+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~LC0J6W0TGF9O.1 size=943803 2024-09-12T17:41:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.655+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=LC0J6W0TGF9O tag=SOWCH282B6V1 type=write size=3040955 2024-09-12T17:41:55.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.656+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=BU3KR25CH3E0 type=del 2024-09-12T17:41:55.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.657+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=5K6G3Y5M6YFK type=del size=2322656 2024-09-12T17:41:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.658+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.0 size=1048576 2024-09-12T17:41:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.659+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.1 size=1048576 2024-09-12T17:41:55.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.660+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~0ZTQEOKBN6NO.2 size=888437 2024-09-12T17:41:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.662+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=0ZTQEOKBN6NO tag=218YXNHTNFP9 type=write size=4034165 2024-09-12T17:41:55.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.665+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.0 size=1048576 2024-09-12T17:41:55.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.666+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.1 size=1048576 2024-09-12T17:41:55.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.667+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.2 size=677418 2024-09-12T17:41:55.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.667+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=DMJ3HMZ813UP tag=C3YONQE9U1VX type=write size=3823146 2024-09-12T17:41:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.668+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~H0DKVPK0FLHA.0 size=1048576 2024-09-12T17:41:55.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.669+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~H0DKVPK0FLHA.1 size=626000 2024-09-12T17:41:55.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.671+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=H0DKVPK0FLHA tag=GM8IO5IPZGXG type=write size=2723152 2024-09-12T17:41:55.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.673+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.0 size=1048576 2024-09-12T17:41:55.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.674+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.1 size=1048576 2024-09-12T17:41:55.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.674+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.2 size=773603 2024-09-12T17:41:55.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.674+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=T9GQMDWDNN6N tag=4FRB7ZFCANNX type=write size=3919331 2024-09-12T17:41:55.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.676+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=R8S3Y00SN5SO type=del 2024-09-12T17:41:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.677+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=ZK4E5DOHXFL1 type=del size=3742642 2024-09-12T17:41:55.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.678+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~WJ2UWXEIYE6G.0 size=1048576 2024-09-12T17:41:55.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.679+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~WJ2UWXEIYE6G.1 size=255073 2024-09-12T17:41:55.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.681+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=WJ2UWXEIYE6G tag=ORB3H720WR58 type=write size=2352225 2024-09-12T17:41:55.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.682+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=YKJRXA8HFE2M type=write size=753499 2024-09-12T17:41:55.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.683+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~1RYRCYC2V5OI.0 size=713347 2024-09-12T17:41:55.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.685+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=1RYRCYC2V5OI tag=SM4G3BXHQI0L type=write size=1761923 2024-09-12T17:41:55.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.687+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=S989S1PWF7KM type=write size=532569 2024-09-12T17:41:55.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.688+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.0 size=1048576 2024-09-12T17:41:55.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.689+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.1 size=1048576 2024-09-12T17:41:55.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.690+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~LB1TC223Z277.2 size=59532 2024-09-12T17:41:55.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.692+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=LB1TC223Z277 tag=3J1ND3OO7LCQ type=write size=3205260 2024-09-12T17:41:55.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.694+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~W28O3D4GAV0X.0 size=1048576 2024-09-12T17:41:55.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.695+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~W28O3D4GAV0X.1 size=347282 2024-09-12T17:41:55.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.695+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=W28O3D4GAV0X tag=H28JMEIAG2CR type=write size=2444434 2024-09-12T17:41:55.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.696+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=HGRJCW97OE6V type=del 2024-09-12T17:41:55.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.697+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=F3NHDTSU2B5Y type=del size=1770083 2024-09-12T17:41:55.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.698+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.0 size=1048576 2024-09-12T17:41:55.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.699+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.1 size=1048576 2024-09-12T17:41:55.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.700+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~V6M6BMD1S99O.2 size=540677 2024-09-12T17:41:55.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.702+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=V6M6BMD1S99O tag=DCZY8H22Y7GQ type=write size=3686405 2024-09-12T17:41:55.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.704+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.0 size=1048576 2024-09-12T17:41:55.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.705+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.1 size=1048576 2024-09-12T17:41:55.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.705+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.2 size=902725 2024-09-12T17:41:55.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.705+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=LTVRHK0BJHQA tag=JKT5B0XFWTOP type=write size=4048453 2024-09-12T17:41:55.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.707+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=IPY0EZWXVFXV type=del 2024-09-12T17:41:55.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.708+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=6AQCNHFU4E5M type=del size=3564251 2024-09-12T17:41:55.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.709+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=08N9DJDQAUHB type=del 2024-09-12T17:41:55.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.710+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=4Q6NRIHZT6ZX type=write size=700570 2024-09-12T17:41:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.711+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~MM2EO7N957DV.0 size=1048576 2024-09-12T17:41:55.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.712+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~MM2EO7N957DV.1 size=1020284 2024-09-12T17:41:55.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.715+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=MM2EO7N957DV tag=WEXG0G5M2E88 type=write size=3117436 2024-09-12T17:41:55.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.717+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~PQ0Y14FWZY3U.0 size=547242 2024-09-12T17:41:55.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.717+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=PQ0Y14FWZY3U tag=1LI3F16FR460 type=write size=1595818 2024-09-12T17:41:55.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.719+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=LID71ALKZD6U type=del size=2780275 2024-09-12T17:41:55.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.720+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=YJKC6AUEJZWA type=write size=196529 2024-09-12T17:41:55.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.721+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=Q95F1V3E9XKH type=del 2024-09-12T17:41:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.723+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.0 size=1048576 2024-09-12T17:41:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.724+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.1 size=1048576 2024-09-12T17:41:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.725+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.2 size=71120 2024-09-12T17:41:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.725+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=P1IT15YR3NJC tag=0PSNRBO45N7O type=write size=3216848 2024-09-12T17:41:55.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.726+0000 7f330fbcc780 1 < canceled part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.0 size=1048576 2024-09-12T17:41:55.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.727+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.1 size=1048576 2024-09-12T17:41:55.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.728+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~EUD6VFZZ98Y6.2 size=328951 2024-09-12T17:41:55.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.730+0000 7f330fbcc780 1 < canceled multipart upload key=3IHGI1UMI1BA upload=EUD6VFZZ98Y6 tag=3PC9PK2H4QN4 type=write size=3474679 2024-09-12T17:41:55.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.731+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=G1AZNXS7K54O type=del size=3551966 2024-09-12T17:41:55.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.732+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~LC0J6W0TGF9O.0 size=1048576 2024-09-12T17:41:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.733+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~LC0J6W0TGF9O.1 size=943803 2024-09-12T17:41:55.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.735+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=LC0J6W0TGF9O tag=SOWCH282B6V1 type=write size=3040955 2024-09-12T17:41:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.737+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.0 size=1048576 2024-09-12T17:41:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.738+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.1 size=1048576 2024-09-12T17:41:55.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.739+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.2 size=333594 2024-09-12T17:41:55.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.739+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=HB949HR0OVH5 tag=8FWKZ1BGK38L type=write size=3479322 2024-09-12T17:41:55.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.740+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=5K6G3Y5M6YFK type=del 2024-09-12T17:41:55.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.742+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=69EPK4QT2IDK type=del size=3298006 2024-09-12T17:41:55.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.743+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.0 size=1048576 2024-09-12T17:41:55.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.744+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.1 size=1048576 2024-09-12T17:41:55.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.745+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~DMJ3HMZ813UP.2 size=677418 2024-09-12T17:41:55.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.747+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=DMJ3HMZ813UP tag=C3YONQE9U1VX type=write size=3823146 2024-09-12T17:41:55.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.749+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.0 size=1048576 2024-09-12T17:41:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.750+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.1 size=1048576 2024-09-12T17:41:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.751+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.2 size=383981 2024-09-12T17:41:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.751+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=D3UJESWTYJLM tag=Y38DMHK76NBR type=write size=3529709 2024-09-12T17:41:55.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.752+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.0 size=1048576 2024-09-12T17:41:55.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.753+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.1 size=1048576 2024-09-12T17:41:55.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.753+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~T9GQMDWDNN6N.2 size=773603 2024-09-12T17:41:55.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.755+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=T9GQMDWDNN6N tag=4FRB7ZFCANNX type=write size=3919331 2024-09-12T17:41:55.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.756+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=98TLV07G5L8P type=del size=910947 2024-09-12T17:41:55.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.758+0000 7f330fbcc780 1 < suggested update operation key=IEYJS7X97O1A tag=ZK4E5DOHXFL1 type=del size=3742642 2024-09-12T17:41:55.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.761+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~1EVGEVUZBFQ0.0 size=489750 2024-09-12T17:41:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.761+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=1EVGEVUZBFQ0 tag=XMXZ6X2M310J type=write size=1538326 2024-09-12T17:41:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.763+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=YKJRXA8HFE2M type=write size=753499 2024-09-12T17:41:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.764+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=T3XOQP58WDWL type=del size=2225672 2024-09-12T17:41:55.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.765+0000 7f330fbcc780 1 < canceled operation key=SPKBX4WU9A9R tag=S989S1PWF7KM type=write size=532569 2024-09-12T17:41:55.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.767+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=P3T4MM18XP00 type=write size=43243 2024-09-12T17:41:55.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.768+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~W28O3D4GAV0X.0 size=1048576 2024-09-12T17:41:55.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.769+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~W28O3D4GAV0X.1 size=347282 2024-09-12T17:41:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.772+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=W28O3D4GAV0X tag=H28JMEIAG2CR type=write size=2444434 2024-09-12T17:41:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.774+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.0 size=1048576 2024-09-12T17:41:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.775+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.1 size=1048576 2024-09-12T17:41:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.775+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.2 size=524195 2024-09-12T17:41:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.775+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=9RZMHP0KZXGH tag=TH95YL48S7EB type=write size=3669923 2024-09-12T17:41:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.777+0000 7f330fbcc780 1 < canceled operation key=IEL4VF8ROC72 tag=F3NHDTSU2B5Y type=del size=1770083 2024-09-12T17:41:55.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.778+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=YFD3P618Z5J7 type=del size=3664285 2024-09-12T17:41:55.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.779+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.0 size=1048576 2024-09-12T17:41:55.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.780+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.1 size=1048576 2024-09-12T17:41:55.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.781+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LTVRHK0BJHQA.2 size=902725 2024-09-12T17:41:55.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.783+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=LTVRHK0BJHQA tag=JKT5B0XFWTOP type=write size=4048453 2024-09-12T17:41:55.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.785+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~DG0RSCWNQ3A5.0 size=569266 2024-09-12T17:41:55.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.785+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=DG0RSCWNQ3A5 tag=C17KI7BM2VWV type=write size=1617842 2024-09-12T17:41:55.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.787+0000 7f330fbcc780 1 < suggested update operation key=3BU8T85GXCX4 tag=6AQCNHFU4E5M type=del size=3564251 2024-09-12T17:41:55.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.789+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~GGKOSP1TP8WT.0 size=1048576 2024-09-12T17:41:55.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.790+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~GGKOSP1TP8WT.1 size=874004 2024-09-12T17:41:55.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.790+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=GGKOSP1TP8WT tag=G5LXEZQHNMBC type=write size=2971156 2024-09-12T17:41:55.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.791+0000 7f330fbcc780 1 < completed write operation key=6ZDBF249S1L6 tag=4Q6NRIHZT6ZX type=write size=700570 2024-09-12T17:41:55.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.793+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.0 size=1048576 2024-09-12T17:41:55.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.794+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.1 size=1048576 2024-09-12T17:41:55.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.795+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.2 size=752603 2024-09-12T17:41:55.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.795+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=YRA6YCCM64E3 tag=5LJ1H9RLPGCM type=write size=3898331 2024-09-12T17:41:55.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.796+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~PQ0Y14FWZY3U.0 size=547242 2024-09-12T17:41:55.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.798+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=PQ0Y14FWZY3U tag=1LI3F16FR460 type=write size=1595818 2024-09-12T17:41:55.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.800+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~JMNMD9K27VQ0.0 size=820207 2024-09-12T17:41:55.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.800+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=JMNMD9K27VQ0 tag=4BHMOMZU0704 type=write size=1868783 2024-09-12T17:41:55.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.801+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=YJKC6AUEJZWA type=write size=196529 2024-09-12T17:41:55.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.803+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~5H0NVAMKK4DF.0 size=183376 2024-09-12T17:41:55.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.803+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=5H0NVAMKK4DF tag=ERFLLZVFQ382 type=write size=1231952 2024-09-12T17:41:55.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.804+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.0 size=1048576 2024-09-12T17:41:55.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.805+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.1 size=1048576 2024-09-12T17:41:55.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.806+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~P1IT15YR3NJC.2 size=71120 2024-09-12T17:41:55.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.808+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=P1IT15YR3NJC tag=0PSNRBO45N7O type=write size=3216848 2024-09-12T17:41:55.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.810+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~VXZDA3VMJSEJ.0 size=859506 2024-09-12T17:41:55.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.810+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=VXZDA3VMJSEJ tag=VOYQLH0FGEGS type=write size=1908082 2024-09-12T17:41:55.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.811+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=G1AZNXS7K54O type=del 2024-09-12T17:41:55.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.812+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=AJRUDRH34N4L type=write size=225913 2024-09-12T17:41:55.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.813+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.0 size=1048576 2024-09-12T17:41:55.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.813+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.1 size=1048576 2024-09-12T17:41:55.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.814+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~HB949HR0OVH5.2 size=333594 2024-09-12T17:41:55.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.816+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=HB949HR0OVH5 tag=8FWKZ1BGK38L type=write size=3479322 2024-09-12T17:41:55.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.817+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=IWPX0BXFCXW6 type=del size=1332387 2024-09-12T17:41:55.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.818+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=69EPK4QT2IDK type=del 2024-09-12T17:41:55.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.819+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=9U60KGB6Y5J6 type=del size=959749 2024-09-12T17:41:55.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.821+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.0 size=1048576 2024-09-12T17:41:55.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.822+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.1 size=1048576 2024-09-12T17:41:55.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.822+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~D3UJESWTYJLM.2 size=383981 2024-09-12T17:41:55.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.824+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=D3UJESWTYJLM tag=Y38DMHK76NBR type=write size=3529709 2024-09-12T17:41:55.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.826+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=82KRWUD4KY44 type=del size=2923282 2024-09-12T17:41:55.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.827+0000 7f330fbcc780 1 < canceled operation key=70COM4KLK2R1 tag=98TLV07G5L8P type=del size=910947 2024-09-12T17:41:55.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.829+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.0 size=1048576 2024-09-12T17:41:55.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.829+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.1 size=1048576 2024-09-12T17:41:55.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.830+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.2 size=627135 2024-09-12T17:41:55.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.830+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=3TZPH30OYH73 tag=0NDDS3L8V150 type=write size=3772863 2024-09-12T17:41:55.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.832+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~1EVGEVUZBFQ0.0 size=489750 2024-09-12T17:41:55.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.834+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=1EVGEVUZBFQ0 tag=XMXZ6X2M310J type=write size=1538326 2024-09-12T17:41:55.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.835+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=F4EM6AY6GXH9 type=del size=3533991 2024-09-12T17:41:55.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.836+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=T3XOQP58WDWL type=del 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.837+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=S1CUP0Y0C20Y type=del size=333393 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.838+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=P3T4MM18XP00 type=write size=43243 2024-09-12T17:41:55.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.841+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~O67B4F58Y4PN.0 size=559005 2024-09-12T17:41:55.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.841+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=O67B4F58Y4PN tag=EQLB0MDP5XJD type=write size=1607581 2024-09-12T17:41:55.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.842+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.0 size=1048576 2024-09-12T17:41:55.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.843+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.1 size=1048576 2024-09-12T17:41:55.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.844+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~9RZMHP0KZXGH.2 size=524195 2024-09-12T17:41:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.845+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=9RZMHP0KZXGH tag=TH95YL48S7EB type=write size=3669923 2024-09-12T17:41:55.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.847+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~Q4OUE46UGVPV.0 size=777316 2024-09-12T17:41:55.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.847+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=Q4OUE46UGVPV tag=4HEZVMSLNIOW type=write size=1825892 2024-09-12T17:41:55.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.850+0000 7f330fbcc780 1 < suggested remove operation key=3IHGI1UMI1BA tag=YFD3P618Z5J7 type=del 2024-09-12T17:41:55.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.852+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~RWDVCZ10IO7P.0 size=1048576 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.853+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~RWDVCZ10IO7P.1 size=735513 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.853+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=RWDVCZ10IO7P tag=K2TL8P0C6607 type=write size=2832665 2024-09-12T17:41:55.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.854+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~DG0RSCWNQ3A5.0 size=569266 2024-09-12T17:41:55.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.857+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=DG0RSCWNQ3A5 tag=C17KI7BM2VWV type=write size=1617842 2024-09-12T17:41:55.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.858+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=EW1IQEZEJHBJ type=del size=655434 2024-09-12T17:41:55.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.859+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~GGKOSP1TP8WT.0 size=1048576 2024-09-12T17:41:55.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.860+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~GGKOSP1TP8WT.1 size=874004 2024-09-12T17:41:55.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.862+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=GGKOSP1TP8WT tag=G5LXEZQHNMBC type=write size=2971156 2024-09-12T17:41:55.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.864+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~AM2H4470QRIO.0 size=345128 2024-09-12T17:41:55.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.864+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=AM2H4470QRIO tag=229ESYWDMYUW type=write size=1393704 2024-09-12T17:41:55.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.866+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.0 size=1048576 2024-09-12T17:41:55.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.867+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.1 size=1048576 2024-09-12T17:41:55.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.867+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~YRA6YCCM64E3.2 size=752603 2024-09-12T17:41:55.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.869+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=YRA6YCCM64E3 tag=5LJ1H9RLPGCM type=write size=3898331 2024-09-12T17:41:55.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.870+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=IYQB276PHYUD type=del size=3457397 2024-09-12T17:41:55.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.871+0000 7f330fbcc780 1 < canceled part key=_multipart_9IYALJED5G85.2~JMNMD9K27VQ0.0 size=820207 2024-09-12T17:41:55.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.873+0000 7f330fbcc780 1 < canceled multipart upload key=9IYALJED5G85 upload=JMNMD9K27VQ0 tag=4BHMOMZU0704 type=write size=1868783 2024-09-12T17:41:55.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.875+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.0 size=1048576 2024-09-12T17:41:55.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.876+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.1 size=1048576 2024-09-12T17:41:55.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.878+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.2 size=679042 2024-09-12T17:41:55.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.878+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=SJ52GKHFPJD2 tag=4DSOCAEV61TY type=write size=3824770 2024-09-12T17:41:55.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.879+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~5H0NVAMKK4DF.0 size=183376 2024-09-12T17:41:55.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.881+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=5H0NVAMKK4DF tag=ERFLLZVFQ382 type=write size=1231952 2024-09-12T17:41:55.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.883+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=G12UKD18GKTA type=del size=956402 2024-09-12T17:41:55.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.884+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~VXZDA3VMJSEJ.0 size=859506 2024-09-12T17:41:55.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.886+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=VXZDA3VMJSEJ tag=VOYQLH0FGEGS type=write size=1908082 2024-09-12T17:41:55.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.887+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=IMY1V2H2SSDT type=write size=366236 2024-09-12T17:41:55.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.888+0000 7f330fbcc780 1 < completed write operation key=LNE0UR6JPWR8 tag=AJRUDRH34N4L type=write size=225913 2024-09-12T17:41:55.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.890+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~VS6KNO8HIBOV.0 size=1048576 2024-09-12T17:41:55.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.891+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~VS6KNO8HIBOV.1 size=827199 2024-09-12T17:41:55.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.891+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=VS6KNO8HIBOV tag=DW5M3ZKR3RMA type=write size=2924351 2024-09-12T17:41:55.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.894+0000 7f330fbcc780 1 < suggested remove operation key=H1LAU7WDZW6S tag=IWPX0BXFCXW6 type=del 2024-09-12T17:41:55.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.895+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=YJOMSKYLIBMJ type=del size=2902216 2024-09-12T17:41:55.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.896+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=9U60KGB6Y5J6 type=del 2024-09-12T17:41:55.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.898+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=ZFU4HK9V21PA type=del size=4090339 2024-09-12T17:41:55.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.899+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=82KRWUD4KY44 type=del 2024-09-12T17:41:55.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.901+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.0 size=1048576 2024-09-12T17:41:55.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.902+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.1 size=1048576 2024-09-12T17:41:55.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.903+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.2 size=263741 2024-09-12T17:41:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.903+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=NT8GNKTYP9T4 tag=N3XTHQTS5B80 type=write size=3409469 2024-09-12T17:41:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.904+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.0 size=1048576 2024-09-12T17:41:55.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.905+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.1 size=1048576 2024-09-12T17:41:55.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.906+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~3TZPH30OYH73.2 size=627135 2024-09-12T17:41:55.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.908+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=3TZPH30OYH73 tag=0NDDS3L8V150 type=write size=3772863 2024-09-12T17:41:55.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.909+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=MUSZDTD93M97 type=del size=520353 2024-09-12T17:41:55.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.910+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=F4EM6AY6GXH9 type=del size=3533991 2024-09-12T17:41:55.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.911+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=SBP0EMP8COHL type=del size=587251 2024-09-12T17:41:55.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.913+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=S1CUP0Y0C20Y type=del 2024-09-12T17:41:55.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.914+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=Y9HUW71303A6 type=del size=3556666 2024-09-12T17:41:55.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.914+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~O67B4F58Y4PN.0 size=559005 2024-09-12T17:41:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.916+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=O67B4F58Y4PN tag=EQLB0MDP5XJD type=write size=1607581 2024-09-12T17:41:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.917+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=H8SEMP4OLFT2 type=write size=601758 2024-09-12T17:41:55.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.919+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~Q4OUE46UGVPV.0 size=777316 2024-09-12T17:41:55.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.920+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=Q4OUE46UGVPV tag=4HEZVMSLNIOW type=write size=1825892 2024-09-12T17:41:55.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.923+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~GC5X8KXJY0MU.0 size=1048576 2024-09-12T17:41:55.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.924+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~GC5X8KXJY0MU.1 size=257863 2024-09-12T17:41:55.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.924+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=GC5X8KXJY0MU tag=HRGHPD1N58UA type=write size=2355015 2024-09-12T17:41:55.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.925+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~RWDVCZ10IO7P.0 size=1048576 2024-09-12T17:41:55.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.926+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~RWDVCZ10IO7P.1 size=735513 2024-09-12T17:41:55.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.928+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=RWDVCZ10IO7P tag=K2TL8P0C6607 type=write size=2832665 2024-09-12T17:41:55.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.929+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=KUXYNHZZICZR type=del size=1224077 2024-09-12T17:41:55.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.930+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=EW1IQEZEJHBJ type=del 2024-09-12T17:41:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.931+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=BAI910OV3UG4 type=write size=800449 2024-09-12T17:41:55.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.933+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~AM2H4470QRIO.0 size=345128 2024-09-12T17:41:55.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.934+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=AM2H4470QRIO tag=229ESYWDMYUW type=write size=1393704 2024-09-12T17:41:55.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.936+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=0RRTBFRCCPM7 type=del size=783630 2024-09-12T17:41:55.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.937+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=IYQB276PHYUD type=del 2024-09-12T17:41:55.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.939+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~GPKOQC0R7TI2.0 size=264818 2024-09-12T17:41:55.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.939+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=GPKOQC0R7TI2 tag=8SDAOHSR3OI1 type=write size=1313394 2024-09-12T17:41:55.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.940+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.0 size=1048576 2024-09-12T17:41:55.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.941+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.1 size=1048576 2024-09-12T17:41:55.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.942+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SJ52GKHFPJD2.2 size=679042 2024-09-12T17:41:55.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.944+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=SJ52GKHFPJD2 tag=4DSOCAEV61TY type=write size=3824770 2024-09-12T17:41:55.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.947+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.0 size=1048576 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.948+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.1 size=1048576 2024-09-12T17:41:55.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.949+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.2 size=639279 2024-09-12T17:41:55.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.949+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=S7NPP1C72CI2 tag=NT7U26VP1XQF type=write size=3785007 2024-09-12T17:41:55.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.951+0000 7f330fbcc780 1 < suggested remove operation key=FY2BXMZBVMDL tag=G12UKD18GKTA type=del 2024-09-12T17:41:55.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.953+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~FYBE2O3QJVNE.0 size=762094 2024-09-12T17:41:55.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.953+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=FYBE2O3QJVNE tag=033POW2G4WM2 type=write size=1810670 2024-09-12T17:41:55.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.955+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=IMY1V2H2SSDT type=write size=366236 2024-09-12T17:41:55.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.956+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=OFTMGO4CODWA type=del size=3464633 2024-09-12T17:41:55.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.956+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~VS6KNO8HIBOV.0 size=1048576 2024-09-12T17:41:55.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.957+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~VS6KNO8HIBOV.1 size=827199 2024-09-12T17:41:55.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.959+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=VS6KNO8HIBOV tag=DW5M3ZKR3RMA type=write size=2924351 2024-09-12T17:41:55.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.960+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=G0EYG01WK4ZS type=del size=2427239 2024-09-12T17:41:55.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.963+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=YJOMSKYLIBMJ type=del size=2902216 2024-09-12T17:41:55.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.964+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=RAXOIARM39G6 type=del size=2964103 2024-09-12T17:41:55.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.966+0000 7f330fbcc780 1 < suggested remove operation key=3IHGI1UMI1BA tag=ZFU4HK9V21PA type=del 2024-09-12T17:41:55.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.968+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=UM8SBU321LHW type=del size=1589855 2024-09-12T17:41:55.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.969+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.0 size=1048576 2024-09-12T17:41:55.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.970+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.1 size=1048576 2024-09-12T17:41:55.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.971+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~NT8GNKTYP9T4.2 size=263741 2024-09-12T17:41:55.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.973+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=NT8GNKTYP9T4 tag=N3XTHQTS5B80 type=write size=3409469 2024-09-12T17:41:55.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.974+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=STCGMQ4WDUXN type=write size=333553 2024-09-12T17:41:55.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.975+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=MUSZDTD93M97 type=del 2024-09-12T17:41:55.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.977+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=Y1UUE18C3MKC type=write size=283361 2024-09-12T17:41:55.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.979+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=SBP0EMP8COHL type=del 2024-09-12T17:41:55.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.980+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=2ZFQNYZSOOZJ type=del size=3419658 2024-09-12T17:41:55.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.983+0000 7f330fbcc780 1 < suggested update operation key=IEYJS7X97O1A tag=Y9HUW71303A6 type=del size=3556666 2024-09-12T17:41:55.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.984+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=D9UT6A1QCI5Q type=del size=2296869 2024-09-12T17:41:55.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.985+0000 7f330fbcc780 -1 < failed to complete operation key=IEYJS7X97O1A tag=H8SEMP4OLFT2 type=write size=601758: (22) Invalid argument 2024-09-12T17:41:55.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.987+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=21AOCIZCQ1TY type=write size=486070 2024-09-12T17:41:55.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.988+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~GC5X8KXJY0MU.0 size=1048576 2024-09-12T17:41:55.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.989+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~GC5X8KXJY0MU.1 size=257863 2024-09-12T17:41:55.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.992+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=GC5X8KXJY0MU tag=HRGHPD1N58UA type=write size=2355015 2024-09-12T17:41:55.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.994+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~XOJ5PGTJG8MM.0 size=1048576 2024-09-12T17:41:55.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.995+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~XOJ5PGTJG8MM.1 size=541363 2024-09-12T17:41:55.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.995+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=XOJ5PGTJG8MM tag=LTQF1FNFR1HV type=write size=2638515 2024-09-12T17:41:55.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.997+0000 7f330fbcc780 1 < suggested update operation key=SPKBX4WU9A9R tag=KUXYNHZZICZR type=del size=1224077 2024-09-12T17:41:56.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:55.999+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.0 size=1048576 2024-09-12T17:41:56.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.000+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.1 size=1048576 2024-09-12T17:41:56.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.001+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.2 size=904618 2024-09-12T17:41:56.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.001+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=9D9TNCRP7Q9Z tag=OZE1TFVYQJF2 type=write size=4050346 2024-09-12T17:41:56.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.003+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=BAI910OV3UG4 type=write size=800449 2024-09-12T17:41:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.005+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~PU8ONLHDN9Y5.0 size=1048576 2024-09-12T17:41:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.005+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~PU8ONLHDN9Y5.1 size=871081 2024-09-12T17:41:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.005+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=PU8ONLHDN9Y5 tag=ICQEO9TAKBZE type=write size=2968233 2024-09-12T17:41:56.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.007+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=0RRTBFRCCPM7 type=del 2024-09-12T17:41:56.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.008+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=CFP525VUTEBE type=del size=915988 2024-09-12T17:41:56.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.009+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~GPKOQC0R7TI2.0 size=264818 2024-09-12T17:41:56.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.011+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=GPKOQC0R7TI2 tag=8SDAOHSR3OI1 type=write size=1313394 2024-09-12T17:41:56.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.013+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.0 size=1048576 2024-09-12T17:41:56.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.014+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.1 size=1048576 2024-09-12T17:41:56.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.015+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.2 size=738835 2024-09-12T17:41:56.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.015+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=WQMPG1BHHJXQ tag=MQLXF13HRLUB type=write size=3884563 2024-09-12T17:41:56.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.016+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.0 size=1048576 2024-09-12T17:41:56.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.017+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.1 size=1048576 2024-09-12T17:41:56.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.018+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~S7NPP1C72CI2.2 size=639279 2024-09-12T17:41:56.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.019+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=S7NPP1C72CI2 tag=NT7U26VP1XQF type=write size=3785007 2024-09-12T17:41:56.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.021+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~58C2Z7WUT41J.0 size=870187 2024-09-12T17:41:56.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.021+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=58C2Z7WUT41J tag=VRNRIHD6SHTA type=write size=1918763 2024-09-12T17:41:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.022+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~FYBE2O3QJVNE.0 size=762094 2024-09-12T17:41:56.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.024+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=FYBE2O3QJVNE tag=033POW2G4WM2 type=write size=1810670 2024-09-12T17:41:56.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.026+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~OP2RJDXWT2WB.0 size=1004493 2024-09-12T17:41:56.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.026+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=OP2RJDXWT2WB tag=E4739APPT8JR type=write size=2053069 2024-09-12T17:41:56.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.027+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=OFTMGO4CODWA type=del 2024-09-12T17:41:56.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.029+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=5IEO2IK2KDJT type=del size=717616 2024-09-12T17:41:56.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.030+0000 7f330fbcc780 -1 < failed to complete operation key=ZEC2RXNOR3D1 tag=G0EYG01WK4ZS type=del size=2427239: (22) Invalid argument 2024-09-12T17:41:56.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.031+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=VOY36CLUWW9X type=write size=370751 2024-09-12T17:41:56.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.032+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=RAXOIARM39G6 type=del 2024-09-12T17:41:56.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.034+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~1EPDWPCRTD5J.0 size=886134 2024-09-12T17:41:56.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.034+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=1EPDWPCRTD5J tag=1Z5IXDHQF2DA type=write size=1934710 2024-09-12T17:41:56.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.035+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=UM8SBU321LHW type=del 2024-09-12T17:41:56.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.036+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=0WFMVLF6CI6Z type=del size=3977213 2024-09-12T17:41:56.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.037+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=STCGMQ4WDUXN type=write size=333553 2024-09-12T17:41:56.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.039+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=MZSALZMCD2KA type=del size=835821 2024-09-12T17:41:56.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.040+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=Y1UUE18C3MKC type=write size=283361 2024-09-12T17:41:56.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.042+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.0 size=1048576 2024-09-12T17:41:56.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.042+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.1 size=1048576 2024-09-12T17:41:56.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.043+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.2 size=863632 2024-09-12T17:41:56.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.043+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=S0H08XGX7EAS tag=8YBFUOZXAWEO type=write size=4009360 2024-09-12T17:41:56.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.045+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=2ZFQNYZSOOZJ type=del 2024-09-12T17:41:56.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.046+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=9L7AB6L8QRNO type=del size=811513 2024-09-12T17:41:56.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.047+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=D9UT6A1QCI5Q type=del 2024-09-12T17:41:56.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.048+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=33VLU84E5PBX type=del size=3735349 2024-09-12T17:41:56.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.049+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=21AOCIZCQ1TY type=write size=486070 2024-09-12T17:41:56.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.050+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=G7ERRT792UQ3 type=del size=1838192 2024-09-12T17:41:56.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.052+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~XOJ5PGTJG8MM.0 size=1048576 2024-09-12T17:41:56.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.052+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~XOJ5PGTJG8MM.1 size=541363 2024-09-12T17:41:56.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.054+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=XOJ5PGTJG8MM tag=LTQF1FNFR1HV type=write size=2638515 2024-09-12T17:41:56.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.055+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=T5ZCUQJD0GO3 type=write size=972438 2024-09-12T17:41:56.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.056+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.0 size=1048576 2024-09-12T17:41:56.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.057+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.1 size=1048576 2024-09-12T17:41:56.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.057+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~9D9TNCRP7Q9Z.2 size=904618 2024-09-12T17:41:56.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.059+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=9D9TNCRP7Q9Z tag=OZE1TFVYQJF2 type=write size=4050346 2024-09-12T17:41:56.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.061+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=MESJDDXTTML3 type=del size=2535231 2024-09-12T17:41:56.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.061+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~PU8ONLHDN9Y5.0 size=1048576 2024-09-12T17:41:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.062+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~PU8ONLHDN9Y5.1 size=871081 2024-09-12T17:41:56.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.064+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=PU8ONLHDN9Y5 tag=ICQEO9TAKBZE type=write size=2968233 2024-09-12T17:41:56.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.066+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.0 size=1048576 2024-09-12T17:41:56.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.067+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.1 size=1048576 2024-09-12T17:41:56.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.068+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.2 size=853354 2024-09-12T17:41:56.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.068+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=N2CNAR47USEQ tag=SJPEA98A7OBJ type=write size=3999082 2024-09-12T17:41:56.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.069+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=CFP525VUTEBE type=del 2024-09-12T17:41:56.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.070+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=WRFHKC5VUAZE type=del size=3194456 2024-09-12T17:41:56.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.071+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.0 size=1048576 2024-09-12T17:41:56.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.072+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.1 size=1048576 2024-09-12T17:41:56.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.073+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~WQMPG1BHHJXQ.2 size=738835 2024-09-12T17:41:56.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.075+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=WQMPG1BHHJXQ tag=MQLXF13HRLUB type=write size=3884563 2024-09-12T17:41:56.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.076+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=2YPB90VTAGLM type=del size=260422 2024-09-12T17:41:56.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.077+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~58C2Z7WUT41J.0 size=870187 2024-09-12T17:41:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.079+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=58C2Z7WUT41J tag=VRNRIHD6SHTA type=write size=1918763 2024-09-12T17:41:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.080+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=M0QECITR5FTY type=del size=407780 2024-09-12T17:41:56.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.081+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~OP2RJDXWT2WB.0 size=1004493 2024-09-12T17:41:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.083+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=OP2RJDXWT2WB tag=E4739APPT8JR type=write size=2053069 2024-09-12T17:41:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.085+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~G9OILU2N9AKX.0 size=1048576 2024-09-12T17:41:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.086+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~G9OILU2N9AKX.1 size=429516 2024-09-12T17:41:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.086+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=G9OILU2N9AKX tag=LOA0PSLJ45QN type=write size=2526668 2024-09-12T17:41:56.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.087+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=5IEO2IK2KDJT type=del 2024-09-12T17:41:56.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.089+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~2XGVWGYTBNI3.0 size=659907 2024-09-12T17:41:56.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.089+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=2XGVWGYTBNI3 tag=EBGMUMWQLA13 type=write size=1708483 2024-09-12T17:41:56.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.090+0000 7f330fbcc780 1 < completed write operation key=3BU8T85GXCX4 tag=VOY36CLUWW9X type=write size=370751 2024-09-12T17:41:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.092+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~XVIVC2025EUV.0 size=299079 2024-09-12T17:41:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.092+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=XVIVC2025EUV tag=KZ94OES1UAG1 type=write size=1347655 2024-09-12T17:41:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.094+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~1EPDWPCRTD5J.0 size=886134 2024-09-12T17:41:56.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.097+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=1EPDWPCRTD5J tag=1Z5IXDHQF2DA type=write size=1934710 2024-09-12T17:41:56.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.099+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.0 size=1048576 2024-09-12T17:41:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.100+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.1 size=1048576 2024-09-12T17:41:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.100+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.2 size=426228 2024-09-12T17:41:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.100+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=UKXF3QKTFWAR tag=KDVFJAIMCQLU type=write size=3571956 2024-09-12T17:41:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.103+0000 7f330fbcc780 1 < suggested remove operation key=9X4FNKQWJCX4 tag=0WFMVLF6CI6Z type=del 2024-09-12T17:41:56.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.104+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=SJUFPBV5A1L9 type=del size=63310 2024-09-12T17:41:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.106+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=MZSALZMCD2KA type=del size=835821 2024-09-12T17:41:56.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.107+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=PUHR0M8BWK0I type=write size=905118 2024-09-12T17:41:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.109+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.0 size=1048576 2024-09-12T17:41:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.109+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.1 size=1048576 2024-09-12T17:41:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.110+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~S0H08XGX7EAS.2 size=863632 2024-09-12T17:41:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.112+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=S0H08XGX7EAS tag=8YBFUOZXAWEO type=write size=4009360 2024-09-12T17:41:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.113+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=S191E0NLKQ2J type=del size=338370 2024-09-12T17:41:56.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.116+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=9L7AB6L8QRNO type=del 2024-09-12T17:41:56.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.117+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=WM5YJZV4IJ5Y type=del size=2242001 2024-09-12T17:41:56.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.118+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=33VLU84E5PBX type=del 2024-09-12T17:41:56.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.119+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=K9QTC0NSKC3K type=write size=743193 2024-09-12T17:41:56.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.121+0000 7f330fbcc780 1 < suggested remove operation key=9IYALJED5G85 tag=G7ERRT792UQ3 type=del 2024-09-12T17:41:56.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.122+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=LCZYSCMX1NKN type=write size=140706 2024-09-12T17:41:56.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.123+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=T5ZCUQJD0GO3 type=write size=972438 2024-09-12T17:41:56.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.124+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=TVOK6YWW9CC6 type=del size=3878948 2024-09-12T17:41:56.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.126+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=MESJDDXTTML3 type=del 2024-09-12T17:41:56.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.127+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=3Q281UCBO173 type=del size=418010 2024-09-12T17:41:56.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.128+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.0 size=1048576 2024-09-12T17:41:56.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.129+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.1 size=1048576 2024-09-12T17:41:56.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.130+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~N2CNAR47USEQ.2 size=853354 2024-09-12T17:41:56.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.132+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=N2CNAR47USEQ tag=SJPEA98A7OBJ type=write size=3999082 2024-09-12T17:41:56.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.134+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~Z7H1PVWFYJUP.0 size=1048576 2024-09-12T17:41:56.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.135+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~Z7H1PVWFYJUP.1 size=780172 2024-09-12T17:41:56.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.135+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=Z7H1PVWFYJUP tag=A8Y8XQGS2QUY type=write size=2877324 2024-09-12T17:41:56.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.135+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=9X4FNKQWJCX4 tag=WRFHKC5VUAZE type=del size=3194456: (2) No such file or directory 2024-09-12T17:41:56.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.136+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=UMX4B4KYMZDR type=write size=577616 2024-09-12T17:41:56.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.137+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=2YPB90VTAGLM type=del size=260422 2024-09-12T17:41:56.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.139+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~G52CZ19N6AMT.0 size=1048576 2024-09-12T17:41:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.140+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~G52CZ19N6AMT.1 size=512357 2024-09-12T17:41:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.140+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=G52CZ19N6AMT tag=OURBVM6XWDVM type=write size=2609509 2024-09-12T17:41:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.142+0000 7f330fbcc780 1 < suggested update operation key=30CIXFQV5VBI tag=M0QECITR5FTY type=del size=407780 2024-09-12T17:41:56.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.144+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=D9UE87RDL71O type=del size=95028 2024-09-12T17:41:56.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.144+0000 7f330fbcc780 1 < canceled part key=_multipart_MQV01X5P8JLG.2~G9OILU2N9AKX.0 size=1048576 2024-09-12T17:41:56.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.145+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~G9OILU2N9AKX.1 size=429516 2024-09-12T17:41:56.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.147+0000 7f330fbcc780 1 < canceled multipart upload key=MQV01X5P8JLG upload=G9OILU2N9AKX tag=LOA0PSLJ45QN type=write size=2526668 2024-09-12T17:41:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.148+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=RBXMHT07ZI6R type=del size=1555389 2024-09-12T17:41:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.149+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~2XGVWGYTBNI3.0 size=659907 2024-09-12T17:41:56.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.151+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=2XGVWGYTBNI3 tag=EBGMUMWQLA13 type=write size=1708483 2024-09-12T17:41:56.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.153+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.0 size=1048576 2024-09-12T17:41:56.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.154+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.1 size=1048576 2024-09-12T17:41:56.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.155+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.2 size=365203 2024-09-12T17:41:56.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.155+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=PPSDV3QQJQE9 tag=QSY4TDV08BUZ type=write size=3510931 2024-09-12T17:41:56.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.156+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~XVIVC2025EUV.0 size=299079 2024-09-12T17:41:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.158+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=XVIVC2025EUV tag=KZ94OES1UAG1 type=write size=1347655 2024-09-12T17:41:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.159+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=QW3UANFP19L9 type=del size=3732389 2024-09-12T17:41:56.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.160+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.0 size=1048576 2024-09-12T17:41:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.161+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.1 size=1048576 2024-09-12T17:41:56.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.162+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UKXF3QKTFWAR.2 size=426228 2024-09-12T17:41:56.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.164+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=UKXF3QKTFWAR tag=KDVFJAIMCQLU type=write size=3571956 2024-09-12T17:41:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.165+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=D36FQ7FCR973 type=del size=3676540 2024-09-12T17:41:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.166+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=SJUFPBV5A1L9 type=del 2024-09-12T17:41:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.168+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~O0CWCOPV2BAL.0 size=336739 2024-09-12T17:41:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.168+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=O0CWCOPV2BAL tag=JOYN73WP4492 type=write size=1385315 2024-09-12T17:41:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.170+0000 7f330fbcc780 1 < suggested remove operation key=3BU8T85GXCX4 tag=PUHR0M8BWK0I type=write 2024-09-12T17:41:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.172+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~QOFWOC9A12ES.0 size=613613 2024-09-12T17:41:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.172+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=QOFWOC9A12ES tag=O9EIC9GM0L3E type=write size=1662189 2024-09-12T17:41:56.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.173+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=S191E0NLKQ2J type=del 2024-09-12T17:41:56.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.174+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=X3RQX6FACJ01 type=write size=517300 2024-09-12T17:41:56.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.176+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=WM5YJZV4IJ5Y type=del 2024-09-12T17:41:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.178+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~19DDPGN75WI7.0 size=565396 2024-09-12T17:41:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.178+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=19DDPGN75WI7 tag=0PG1DOZVK3N3 type=write size=1613972 2024-09-12T17:41:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.179+0000 7f330fbcc780 1 < completed write operation key=D5ZZ93XAPRAA tag=K9QTC0NSKC3K type=write size=743193 2024-09-12T17:41:56.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.180+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=O9OQVM6BWSHZ type=del size=2925374 2024-09-12T17:41:56.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.181+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=LCZYSCMX1NKN type=write size=140706 2024-09-12T17:41:56.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.182+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=X5JEGVN6TR1I type=del size=2065252 2024-09-12T17:41:56.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.183+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=TVOK6YWW9CC6 type=del 2024-09-12T17:41:56.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.184+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=OTGRJZ9CR8MY type=del size=737221 2024-09-12T17:41:56.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.185+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=3Q281UCBO173 type=del 2024-09-12T17:41:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.187+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=68LG2G4LY9NS type=del size=1983490 2024-09-12T17:41:56.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.188+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~Z7H1PVWFYJUP.0 size=1048576 2024-09-12T17:41:56.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.189+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~Z7H1PVWFYJUP.1 size=780172 2024-09-12T17:41:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.190+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=Z7H1PVWFYJUP tag=A8Y8XQGS2QUY type=write size=2877324 2024-09-12T17:41:56.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.191+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=58C0188CLXQ6 type=del size=1256738 2024-09-12T17:41:56.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.192+0000 7f330fbcc780 1 < canceled operation key=3IHGI1UMI1BA tag=UMX4B4KYMZDR type=write size=577616 2024-09-12T17:41:56.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.195+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.0 size=1048576 2024-09-12T17:41:56.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.196+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.1 size=1048576 2024-09-12T17:41:56.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.197+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.2 size=913753 2024-09-12T17:41:56.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.197+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=AEE4KE3WXQIM tag=OARX6QYG2NVW type=write size=4059481 2024-09-12T17:41:56.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.198+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~G52CZ19N6AMT.0 size=1048576 2024-09-12T17:41:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.199+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~G52CZ19N6AMT.1 size=512357 2024-09-12T17:41:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.201+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=G52CZ19N6AMT tag=OURBVM6XWDVM type=write size=2609509 2024-09-12T17:41:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.203+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=6XIU3FXFUVN4 type=del size=1101918 2024-09-12T17:41:56.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.204+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=D9UE87RDL71O type=del 2024-09-12T17:41:56.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.205+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=3XXGALK76M4J type=del size=366359 2024-09-12T17:41:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.208+0000 7f330fbcc780 1 < suggested update operation key=1MJ2W1WMLR85 tag=RBXMHT07ZI6R type=del size=1555389 2024-09-12T17:41:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.209+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=VNR3B1PNI2ZD type=del size=124612 2024-09-12T17:41:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.211+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.0 size=1048576 2024-09-12T17:41:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.212+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.1 size=1048576 2024-09-12T17:41:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.212+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~PPSDV3QQJQE9.2 size=365203 2024-09-12T17:41:56.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.214+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=PPSDV3QQJQE9 tag=QSY4TDV08BUZ type=write size=3510931 2024-09-12T17:41:56.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.215+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=IMX682C36AQ5 type=write size=912274 2024-09-12T17:41:56.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.216+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=QW3UANFP19L9 type=del 2024-09-12T17:41:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.218+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.0 size=1048576 2024-09-12T17:41:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.219+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.1 size=1048576 2024-09-12T17:41:56.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.220+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.2 size=887343 2024-09-12T17:41:56.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.220+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=F4IZIB5N7P6K tag=5XIRU7B91JVX type=write size=4033071 2024-09-12T17:41:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.221+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=D36FQ7FCR973 type=del 2024-09-12T17:41:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.222+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=2WCIQ7ATLN1W type=del size=1479654 2024-09-12T17:41:56.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.223+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~O0CWCOPV2BAL.0 size=336739 2024-09-12T17:41:56.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.225+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=O0CWCOPV2BAL tag=JOYN73WP4492 type=write size=1385315 2024-09-12T17:41:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.227+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~K9M0WPL1OVQ8.0 size=1048576 2024-09-12T17:41:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.228+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~K9M0WPL1OVQ8.1 size=105997 2024-09-12T17:41:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.228+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=K9M0WPL1OVQ8 tag=0MF44W2SFJ4Y type=write size=2203149 2024-09-12T17:41:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.229+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~QOFWOC9A12ES.0 size=613613 2024-09-12T17:41:56.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.231+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=QOFWOC9A12ES tag=O9EIC9GM0L3E type=write size=1662189 2024-09-12T17:41:56.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.232+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=GVMYE39C6OWP type=write size=638719 2024-09-12T17:41:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.233+0000 7f330fbcc780 1 < completed write operation key=6ZDBF249S1L6 tag=X3RQX6FACJ01 type=write size=517300 2024-09-12T17:41:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.234+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=FP0ITQOQZ3X0 type=del size=2937522 2024-09-12T17:41:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.235+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~19DDPGN75WI7.0 size=565396 2024-09-12T17:41:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.237+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=19DDPGN75WI7 tag=0PG1DOZVK3N3 type=write size=1613972 2024-09-12T17:41:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.238+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=FPHJZGI5GR84 type=write size=996697 2024-09-12T17:41:56.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.239+0000 7f330fbcc780 1 < canceled operation key=30CIXFQV5VBI tag=O9OQVM6BWSHZ type=del size=2925374 2024-09-12T17:41:56.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.240+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=L4QPCYA5CKWY type=write size=368285 2024-09-12T17:41:56.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.242+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=X5JEGVN6TR1I type=del 2024-09-12T17:41:56.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.244+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~J960EJZ4VF61.0 size=1048576 2024-09-12T17:41:56.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.244+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~J960EJZ4VF61.1 size=493306 2024-09-12T17:41:56.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.244+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=J960EJZ4VF61 tag=O9MGACNXY2BY type=write size=2590458 2024-09-12T17:41:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.246+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=OTGRJZ9CR8MY type=del 2024-09-12T17:41:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.247+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=V3A7WOYBG3C5 type=del size=426344 2024-09-12T17:41:56.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.248+0000 7f330fbcc780 1 < canceled operation key=5QBSRDY0LJ60 tag=68LG2G4LY9NS type=del size=1983490 2024-09-12T17:41:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.249+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=CAM7ZTGK21KB type=del size=3294776 2024-09-12T17:41:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.250+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=58C0188CLXQ6 type=del 2024-09-12T17:41:56.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.251+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=P0PJJY0NQGWY type=del size=3613231 2024-09-12T17:41:56.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.252+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.0 size=1048576 2024-09-12T17:41:56.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.253+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.1 size=1048576 2024-09-12T17:41:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.254+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~AEE4KE3WXQIM.2 size=913753 2024-09-12T17:41:56.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.256+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=AEE4KE3WXQIM tag=OARX6QYG2NVW type=write size=4059481 2024-09-12T17:41:56.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.257+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=Y79XDYLV62AV type=del size=3055915 2024-09-12T17:41:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.258+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=6XIU3FXFUVN4 type=del 2024-09-12T17:41:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.259+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=OB0987WRC683 type=write size=143682 2024-09-12T17:41:56.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.260+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=3XXGALK76M4J type=del 2024-09-12T17:41:56.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.262+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~QENAD7SR3UZ5.0 size=111576 2024-09-12T17:41:56.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.262+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=QENAD7SR3UZ5 tag=N5LW8OX1IW9J type=write size=1160152 2024-09-12T17:41:56.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.263+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=VNR3B1PNI2ZD type=del 2024-09-12T17:41:56.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.265+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~K41JWCQ69EP3.0 size=1048576 2024-09-12T17:41:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.266+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~K41JWCQ69EP3.1 size=479736 2024-09-12T17:41:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.266+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=K41JWCQ69EP3 tag=DBOL0R7NC4S2 type=write size=2576888 2024-09-12T17:41:56.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.268+0000 7f330fbcc780 1 < completed write operation key=TKJOJ17LIWX6 tag=IMX682C36AQ5 type=write size=912274 2024-09-12T17:41:56.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.270+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.0 size=1048576 2024-09-12T17:41:56.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.270+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.1 size=1048576 2024-09-12T17:41:56.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.271+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.2 size=596243 2024-09-12T17:41:56.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.271+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=QVG3AVLXOTR8 tag=4KFCNT0JHO46 type=write size=3741971 2024-09-12T17:41:56.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.273+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.0 size=1048576 2024-09-12T17:41:56.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.273+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.1 size=1048576 2024-09-12T17:41:56.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.274+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~F4IZIB5N7P6K.2 size=887343 2024-09-12T17:41:56.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.276+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=F4IZIB5N7P6K tag=5XIRU7B91JVX type=write size=4033071 2024-09-12T17:41:56.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.277+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=GE00W8R3NB8T type=del size=418043 2024-09-12T17:41:56.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.279+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=2WCIQ7ATLN1W type=del 2024-09-12T17:41:56.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.280+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=YMO0M7O34TKJ type=del size=569024 2024-09-12T17:41:56.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.281+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~K9M0WPL1OVQ8.0 size=1048576 2024-09-12T17:41:56.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.282+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~K9M0WPL1OVQ8.1 size=105997 2024-09-12T17:41:56.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.284+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=K9M0WPL1OVQ8 tag=0MF44W2SFJ4Y type=write size=2203149 2024-09-12T17:41:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.285+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=53E0F86QDLV3 type=del size=208919 2024-09-12T17:41:56.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.286+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=GVMYE39C6OWP type=write size=638719 2024-09-12T17:41:56.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.287+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=VT0I1Q0BJPZO type=del size=248464 2024-09-12T17:41:56.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.288+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=FP0ITQOQZ3X0 type=del 2024-09-12T17:41:56.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.289+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=Z32Z4CKOTPIS type=del size=2177747 2024-09-12T17:41:56.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.290+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=FPHJZGI5GR84 type=write size=996697 2024-09-12T17:41:56.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.291+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=2474XCRG9IN3 type=write size=924813 2024-09-12T17:41:56.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.293+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=L4QPCYA5CKWY type=write size=368285 2024-09-12T17:41:56.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.295+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.0 size=1048576 2024-09-12T17:41:56.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.296+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.1 size=1048576 2024-09-12T17:41:56.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.296+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.2 size=57480 2024-09-12T17:41:56.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.296+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=5VPT3W5KZH8V tag=ZR89PL51W17G type=write size=3203208 2024-09-12T17:41:56.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.298+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~J960EJZ4VF61.0 size=1048576 2024-09-12T17:41:56.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.298+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~J960EJZ4VF61.1 size=493306 2024-09-12T17:41:56.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.300+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=J960EJZ4VF61 tag=O9MGACNXY2BY type=write size=2590458 2024-09-12T17:41:56.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.302+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~JK7R5DBHVG8A.0 size=1048576 2024-09-12T17:41:56.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.303+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~JK7R5DBHVG8A.1 size=237184 2024-09-12T17:41:56.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.303+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=JK7R5DBHVG8A tag=JO6TRCIFNCQ5 type=write size=2334336 2024-09-12T17:41:56.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.304+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=V3A7WOYBG3C5 type=del 2024-09-12T17:41:56.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.305+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=GQWLXYU7O5VX type=del size=1137029 2024-09-12T17:41:56.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.308+0000 7f330fbcc780 1 < suggested remove operation key=9X4FNKQWJCX4 tag=CAM7ZTGK21KB type=del 2024-09-12T17:41:56.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.309+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=S6T7QLXR9JQN type=del size=2030814 2024-09-12T17:41:56.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.311+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=P0PJJY0NQGWY type=del 2024-09-12T17:41:56.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.313+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.0 size=1048576 2024-09-12T17:41:56.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.313+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.1 size=1048576 2024-09-12T17:41:56.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.314+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.2 size=950174 2024-09-12T17:41:56.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.314+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=CFIW10Z4VCML tag=S46TVJW5OU84 type=write size=4095902 2024-09-12T17:41:56.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.316+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=Y79XDYLV62AV type=del 2024-09-12T17:41:56.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.317+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=Q3LNJEBNRB2F type=write size=762768 2024-09-12T17:41:56.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.318+0000 7f330fbcc780 1 < completed write operation key=6ZDBF249S1L6 tag=OB0987WRC683 type=write size=143682 2024-09-12T17:41:56.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.319+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=7H31VN1H9NPU type=del size=2476232 2024-09-12T17:41:56.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.320+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~QENAD7SR3UZ5.0 size=111576 2024-09-12T17:41:56.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.322+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=QENAD7SR3UZ5 tag=N5LW8OX1IW9J type=write size=1160152 2024-09-12T17:41:56.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.323+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=LA8XAVCG1BMV type=del size=321149 2024-09-12T17:41:56.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.325+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~K41JWCQ69EP3.0 size=1048576 2024-09-12T17:41:56.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.325+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~K41JWCQ69EP3.1 size=479736 2024-09-12T17:41:56.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.327+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=K41JWCQ69EP3 tag=DBOL0R7NC4S2 type=write size=2576888 2024-09-12T17:41:56.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.329+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.0 size=1048576 2024-09-12T17:41:56.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.329+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.1 size=1048576 2024-09-12T17:41:56.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.330+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.2 size=310868 2024-09-12T17:41:56.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.330+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=OIX7GQISE0Z7 tag=RL6B55QY2TZC type=write size=3456596 2024-09-12T17:41:56.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.331+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.0 size=1048576 2024-09-12T17:41:56.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.332+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.1 size=1048576 2024-09-12T17:41:56.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.332+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~QVG3AVLXOTR8.2 size=596243 2024-09-12T17:41:56.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.334+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=QVG3AVLXOTR8 tag=4KFCNT0JHO46 type=write size=3741971 2024-09-12T17:41:56.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.335+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=RN5UK4BY05OI type=del size=2813164 2024-09-12T17:41:56.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.336+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=GE00W8R3NB8T type=del 2024-09-12T17:41:56.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.337+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=IT0S9R1C3HJ7 type=del size=2293421 2024-09-12T17:41:56.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.338+0000 7f330fbcc780 1 < canceled operation key=2CY67P4QM19H tag=YMO0M7O34TKJ type=del size=569024 2024-09-12T17:41:56.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.340+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~1PVU0YCTG6DH.0 size=741206 2024-09-12T17:41:56.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.340+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=1PVU0YCTG6DH tag=PQYLJA28NIXI type=write size=1789782 2024-09-12T17:41:56.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.342+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=53E0F86QDLV3 type=del 2024-09-12T17:41:56.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.343+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=1S8MTEROZN5P type=write size=358247 2024-09-12T17:41:56.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.344+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=VT0I1Q0BJPZO type=del 2024-09-12T17:41:56.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.345+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=65SW8W71A77M type=del size=1575739 2024-09-12T17:41:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.346+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=Z32Z4CKOTPIS type=del 2024-09-12T17:41:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.348+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=SKPBCPQ1L4UF type=del size=3282982 2024-09-12T17:41:56.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.349+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=2474XCRG9IN3 type=write size=924813 2024-09-12T17:41:56.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.351+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~KP585E4BQWAE.0 size=45659 2024-09-12T17:41:56.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.351+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=KP585E4BQWAE tag=A4ZTV9EZJ8J1 type=write size=1094235 2024-09-12T17:41:56.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.352+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.0 size=1048576 2024-09-12T17:41:56.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.353+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.1 size=1048576 2024-09-12T17:41:56.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.353+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~5VPT3W5KZH8V.2 size=57480 2024-09-12T17:41:56.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.355+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=5VPT3W5KZH8V tag=ZR89PL51W17G type=write size=3203208 2024-09-12T17:41:56.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.357+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.0 size=1048576 2024-09-12T17:41:56.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.358+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.1 size=1048576 2024-09-12T17:41:56.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.359+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.2 size=53736 2024-09-12T17:41:56.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.359+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=B8GMDZVTNRCR tag=PJZVVFDHK21B type=write size=3199464 2024-09-12T17:41:56.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.360+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~JK7R5DBHVG8A.0 size=1048576 2024-09-12T17:41:56.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.360+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~JK7R5DBHVG8A.1 size=237184 2024-09-12T17:41:56.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.362+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=JK7R5DBHVG8A tag=JO6TRCIFNCQ5 type=write size=2334336 2024-09-12T17:41:56.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.364+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~VGA85A7QTJ27.0 size=1048576 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.365+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~VGA85A7QTJ27.1 size=907250 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.365+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=VGA85A7QTJ27 tag=YLLBY243U229 type=write size=3004402 2024-09-12T17:41:56.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.366+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=GQWLXYU7O5VX type=del 2024-09-12T17:41:56.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.368+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~U0DQ1NF73LWA.0 size=1048576 2024-09-12T17:41:56.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.369+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~U0DQ1NF73LWA.1 size=916376 2024-09-12T17:41:56.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.369+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=U0DQ1NF73LWA tag=WUFSNWMTPYES type=write size=3013528 2024-09-12T17:41:56.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.370+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=S6T7QLXR9JQN type=del 2024-09-12T17:41:56.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.372+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.0 size=1048576 2024-09-12T17:41:56.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.373+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.1 size=1048576 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.374+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.2 size=445179 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.374+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=YTHSGKC8L32D tag=A7AYT73TPA3F type=write size=3590907 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.374+0000 7f330fbcc780 1 < canceled part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.0 size=1048576 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.375+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.1 size=1048576 2024-09-12T17:41:56.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.376+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~CFIW10Z4VCML.2 size=950174 2024-09-12T17:41:56.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.378+0000 7f330fbcc780 1 < canceled multipart upload key=6ZDBF249S1L6 upload=CFIW10Z4VCML tag=S46TVJW5OU84 type=write size=4095902 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.379+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=WR3OHQZE6XAQ type=write size=146160 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.381+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=Q3LNJEBNRB2F type=write size=762768 2024-09-12T17:41:56.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.382+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=ZOWP9J96GBI7 type=del size=2809842 2024-09-12T17:41:56.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.383+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=7H31VN1H9NPU type=del 2024-09-12T17:41:56.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.384+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=B36OFS8KCM7G type=del size=277782 2024-09-12T17:41:56.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.385+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=LA8XAVCG1BMV type=del 2024-09-12T17:41:56.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.386+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=3C698UZ615MG type=del size=3395691 2024-09-12T17:41:56.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.387+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.0 size=1048576 2024-09-12T17:41:56.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.388+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.1 size=1048576 2024-09-12T17:41:56.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.389+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~OIX7GQISE0Z7.2 size=310868 2024-09-12T17:41:56.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.391+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=OIX7GQISE0Z7 tag=RL6B55QY2TZC type=write size=3456596 2024-09-12T17:41:56.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.392+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=679BJ3TTIGGW type=del size=3682114 2024-09-12T17:41:56.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.393+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=RN5UK4BY05OI type=del 2024-09-12T17:41:56.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.394+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=IJ0DEGFM8MR3 type=write size=489072 2024-09-12T17:41:56.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.396+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=IT0S9R1C3HJ7 type=del 2024-09-12T17:41:56.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.397+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=V2J8OT3Y7YUZ type=del size=631319 2024-09-12T17:41:56.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.398+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~1PVU0YCTG6DH.0 size=741206 2024-09-12T17:41:56.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.400+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=1PVU0YCTG6DH tag=PQYLJA28NIXI type=write size=1789782 2024-09-12T17:41:56.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.402+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~X74WVW5V2H78.0 size=1048576 2024-09-12T17:41:56.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.403+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~X74WVW5V2H78.1 size=714474 2024-09-12T17:41:56.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.403+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=X74WVW5V2H78 tag=T2AQ182Z33LZ type=write size=2811626 2024-09-12T17:41:56.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.404+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=1S8MTEROZN5P type=write size=358247 2024-09-12T17:41:56.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.406+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~S19RAGTXRFFD.0 size=1048576 2024-09-12T17:41:56.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.407+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~S19RAGTXRFFD.1 size=813907 2024-09-12T17:41:56.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.407+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=S19RAGTXRFFD tag=EJHHI5Y240WT type=write size=2911059 2024-09-12T17:41:56.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.409+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=65SW8W71A77M type=del size=1575739 2024-09-12T17:41:56.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.410+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=ZS71OJ4I124M type=del size=3137039 2024-09-12T17:41:56.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.412+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=SKPBCPQ1L4UF type=del 2024-09-12T17:41:56.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.413+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=UQV6MMUS8NY2 type=del size=3738247 2024-09-12T17:41:56.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.414+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~KP585E4BQWAE.0 size=45659 2024-09-12T17:41:56.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.416+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=KP585E4BQWAE tag=A4ZTV9EZJ8J1 type=write size=1094235 2024-09-12T17:41:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.418+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.0 size=1048576 2024-09-12T17:41:56.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.419+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.1 size=1048576 2024-09-12T17:41:56.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.420+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.2 size=757169 2024-09-12T17:41:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.420+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=KSW3QP1LJTSC tag=SBD29URXXGUR type=write size=3902897 2024-09-12T17:41:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.421+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.0 size=1048576 2024-09-12T17:41:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.422+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.1 size=1048576 2024-09-12T17:41:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.422+0000 7f330fbcc780 1 < canceled part key=_multipart_6HBW7077B3MS.2~B8GMDZVTNRCR.2 size=53736 2024-09-12T17:41:56.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.424+0000 7f330fbcc780 1 < canceled multipart upload key=6HBW7077B3MS upload=B8GMDZVTNRCR tag=PJZVVFDHK21B type=write size=3199464 2024-09-12T17:41:56.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.425+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=K43GGD3IVL5Q type=write size=375127 2024-09-12T17:41:56.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.426+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~VGA85A7QTJ27.0 size=1048576 2024-09-12T17:41:56.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.427+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~VGA85A7QTJ27.1 size=907250 2024-09-12T17:41:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.429+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=VGA85A7QTJ27 tag=YLLBY243U229 type=write size=3004402 2024-09-12T17:41:56.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.430+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=M25MQJ0KJKS3 type=del size=3163753 2024-09-12T17:41:56.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.431+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~U0DQ1NF73LWA.0 size=1048576 2024-09-12T17:41:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.432+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~U0DQ1NF73LWA.1 size=916376 2024-09-12T17:41:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.434+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=U0DQ1NF73LWA tag=WUFSNWMTPYES type=write size=3013528 2024-09-12T17:41:56.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.435+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=T805SJ6KQ5KD type=write size=577582 2024-09-12T17:41:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.436+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.0 size=1048576 2024-09-12T17:41:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.437+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.1 size=1048576 2024-09-12T17:41:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.438+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~YTHSGKC8L32D.2 size=445179 2024-09-12T17:41:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.440+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=YTHSGKC8L32D tag=A7AYT73TPA3F type=write size=3590907 2024-09-12T17:41:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.441+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=Y7XCF7TDWQWV type=del size=3648064 2024-09-12T17:41:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.442+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=WR3OHQZE6XAQ type=write size=146160 2024-09-12T17:41:56.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.443+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=HEY4NO1YLM16 type=del size=831230 2024-09-12T17:41:56.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.444+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=ZOWP9J96GBI7 type=del 2024-09-12T17:41:56.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.446+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~X48ZCISQ325E.0 size=1048576 2024-09-12T17:41:56.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.447+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~X48ZCISQ325E.1 size=808146 2024-09-12T17:41:56.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.447+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=X48ZCISQ325E tag=SHAMX0BGNV3K type=write size=2905298 2024-09-12T17:41:56.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.449+0000 7f330fbcc780 1 < canceled operation key=1MJ2W1WMLR85 tag=B36OFS8KCM7G type=del size=277782 2024-09-12T17:41:56.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.451+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~RDHBG8KQQUS6.0 size=1048576 2024-09-12T17:41:56.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.451+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~RDHBG8KQQUS6.1 size=79986 2024-09-12T17:41:56.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.451+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=RDHBG8KQQUS6 tag=MAZ5JN35DUUE type=write size=2177138 2024-09-12T17:41:56.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.453+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=3C698UZ615MG type=del 2024-09-12T17:41:56.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.455+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.0 size=1048576 2024-09-12T17:41:56.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.455+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.1 size=1048576 2024-09-12T17:41:56.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.456+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.2 size=291991 2024-09-12T17:41:56.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.456+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=IBCHJHOZEYL0 tag=9GSC60W9FHY3 type=write size=3437719 2024-09-12T17:41:56.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.458+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=679BJ3TTIGGW type=del 2024-09-12T17:41:56.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.459+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=6QHGGH6AXHTK type=del size=3337662 2024-09-12T17:41:56.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.461+0000 7f330fbcc780 1 < suggested remove operation key=4KNGMX117Z7G tag=IJ0DEGFM8MR3 type=write 2024-09-12T17:41:56.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.462+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=PZ1C01T0L70Y type=del size=708878 2024-09-12T17:41:56.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.463+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=V2J8OT3Y7YUZ type=del 2024-09-12T17:41:56.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.465+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.0 size=1048576 2024-09-12T17:41:56.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.466+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.1 size=1048576 2024-09-12T17:41:56.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.467+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.2 size=589913 2024-09-12T17:41:56.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.467+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=UFZVYGZLUYTX tag=F7J0Z59EIDLR type=write size=3735641 2024-09-12T17:41:56.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.468+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~X74WVW5V2H78.0 size=1048576 2024-09-12T17:41:56.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.468+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~X74WVW5V2H78.1 size=714474 2024-09-12T17:41:56.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.470+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=X74WVW5V2H78 tag=T2AQ182Z33LZ type=write size=2811626 2024-09-12T17:41:56.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.472+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.0 size=1048576 2024-09-12T17:41:56.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.473+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.1 size=1048576 2024-09-12T17:41:56.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.474+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.2 size=624536 2024-09-12T17:41:56.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.474+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=9GZORGX1WXCI tag=ZFSKJF3G3PZE type=write size=3770264 2024-09-12T17:41:56.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.475+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~S19RAGTXRFFD.0 size=1048576 2024-09-12T17:41:56.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.476+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~S19RAGTXRFFD.1 size=813907 2024-09-12T17:41:56.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.478+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=S19RAGTXRFFD tag=EJHHI5Y240WT type=write size=2911059 2024-09-12T17:41:56.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.479+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=VRS462U18DZ7 type=del size=70972 2024-09-12T17:41:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.480+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=ZS71OJ4I124M type=del 2024-09-12T17:41:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.481+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=JNOU403QW90R type=write size=321189 2024-09-12T17:41:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.482+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=UQV6MMUS8NY2 type=del 2024-09-12T17:41:56.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.483+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=IWNM6PT8JTVK type=del size=92715 2024-09-12T17:41:56.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.484+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.0 size=1048576 2024-09-12T17:41:56.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.485+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.1 size=1048576 2024-09-12T17:41:56.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.486+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~KSW3QP1LJTSC.2 size=757169 2024-09-12T17:41:56.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.488+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=KSW3QP1LJTSC tag=SBD29URXXGUR type=write size=3902897 2024-09-12T17:41:56.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.489+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=X82S2FL7HMI5 type=del size=503243 2024-09-12T17:41:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.490+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=K43GGD3IVL5Q type=write size=375127 2024-09-12T17:41:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.492+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.0 size=1048576 2024-09-12T17:41:56.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.493+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.1 size=1048576 2024-09-12T17:41:56.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.494+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.2 size=474562 2024-09-12T17:41:56.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.494+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=XYWNWY69EGP3 tag=3LAVARYTAMCS type=write size=3620290 2024-09-12T17:41:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.495+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=M25MQJ0KJKS3 type=del 2024-09-12T17:41:56.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.496+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=W2810ZGP50SR type=del size=3754590 2024-09-12T17:41:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.497+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=T805SJ6KQ5KD type=write size=577582 2024-09-12T17:41:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.498+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=3VKI6JBCPP0J type=del size=354535 2024-09-12T17:41:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.500+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=Y7XCF7TDWQWV type=del 2024-09-12T17:41:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.501+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=2QT3JI2D62PO type=del size=1578239 2024-09-12T17:41:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.502+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=HEY4NO1YLM16 type=del 2024-09-12T17:41:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.503+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=OZ7FKNAHP4SF type=write size=421818 2024-09-12T17:41:56.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.504+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~X48ZCISQ325E.0 size=1048576 2024-09-12T17:41:56.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.505+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~X48ZCISQ325E.1 size=808146 2024-09-12T17:41:56.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.507+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=X48ZCISQ325E tag=SHAMX0BGNV3K type=write size=2905298 2024-09-12T17:41:56.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.509+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.0 size=1048576 2024-09-12T17:41:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.510+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.1 size=1048576 2024-09-12T17:41:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.511+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.2 size=983783 2024-09-12T17:41:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.511+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=A71ZZ12ZYHKJ tag=NYTVRI1K1PVW type=write size=4129511 2024-09-12T17:41:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.511+0000 7f330fbcc780 1 < canceled part key=_multipart_IEL4VF8ROC72.2~RDHBG8KQQUS6.0 size=1048576 2024-09-12T17:41:56.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.512+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~RDHBG8KQQUS6.1 size=79986 2024-09-12T17:41:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.515+0000 7f330fbcc780 1 < canceled multipart upload key=IEL4VF8ROC72 upload=RDHBG8KQQUS6 tag=MAZ5JN35DUUE type=write size=2177138 2024-09-12T17:41:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.517+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~PJ4YZ9AR9I5P.0 size=1048576 2024-09-12T17:41:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.518+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~PJ4YZ9AR9I5P.1 size=110540 2024-09-12T17:41:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.518+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=PJ4YZ9AR9I5P tag=TFKBTF00YQJK type=write size=2207692 2024-09-12T17:41:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.526+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.0 size=1048576 2024-09-12T17:41:56.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.528+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.1 size=1048576 2024-09-12T17:41:56.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.529+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~IBCHJHOZEYL0.2 size=291991 2024-09-12T17:41:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.531+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=IBCHJHOZEYL0 tag=9GSC60W9FHY3 type=write size=3437719 2024-09-12T17:41:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.533+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~IYPOJ6662T8R.0 size=547362 2024-09-12T17:41:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.533+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=IYPOJ6662T8R tag=9WW1YXIUM6QV type=write size=1595938 2024-09-12T17:41:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.534+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=6QHGGH6AXHTK type=del 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.535+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=S3J8EMNHNZUG type=del size=2588376 2024-09-12T17:41:56.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.536+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=PZ1C01T0L70Y type=del 2024-09-12T17:41:56.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.537+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=3BVDG8I7QDK1 type=del size=1870898 2024-09-12T17:41:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.538+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.0 size=1048576 2024-09-12T17:41:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.539+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.1 size=1048576 2024-09-12T17:41:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.540+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~UFZVYGZLUYTX.2 size=589913 2024-09-12T17:41:56.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.542+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=UFZVYGZLUYTX tag=F7J0Z59EIDLR type=write size=3735641 2024-09-12T17:41:56.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.544+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.0 size=1048576 2024-09-12T17:41:56.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.545+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.1 size=1048576 2024-09-12T17:41:56.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.546+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.2 size=122265 2024-09-12T17:41:56.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.546+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=C987BSVLBC4Q tag=TIEOGHHW0FSN type=write size=3267993 2024-09-12T17:41:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.547+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.0 size=1048576 2024-09-12T17:41:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.547+0000 7f330fbcc780 1 < canceled part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.1 size=1048576 2024-09-12T17:41:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.547+0000 7f330fbcc780 1 < canceled part key=_multipart_70COM4KLK2R1.2~9GZORGX1WXCI.2 size=624536 2024-09-12T17:41:56.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.549+0000 7f330fbcc780 1 < canceled multipart upload key=70COM4KLK2R1 upload=9GZORGX1WXCI tag=ZFSKJF3G3PZE type=write size=3770264 2024-09-12T17:41:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.550+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=UW4B7F1FVOPX type=del size=1429316 2024-09-12T17:41:56.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.552+0000 7f330fbcc780 1 < suggested remove operation key=HJL73WQD8SD2 tag=VRS462U18DZ7 type=del 2024-09-12T17:41:56.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.553+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=81GOSAW5OXSJ type=write size=130502 2024-09-12T17:41:56.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.554+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=JNOU403QW90R type=write size=321189 2024-09-12T17:41:56.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.556+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~FAYZDXHXB3FN.0 size=1048576 2024-09-12T17:41:56.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.557+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~FAYZDXHXB3FN.1 size=550237 2024-09-12T17:41:56.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.557+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=FAYZDXHXB3FN tag=41C0L404HBU0 type=write size=2647389 2024-09-12T17:41:56.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.558+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=IWNM6PT8JTVK type=del 2024-09-12T17:41:56.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.559+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=3OE53G20TT06 type=del size=1900866 2024-09-12T17:41:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.561+0000 7f330fbcc780 1 < canceled operation key=IEYJS7X97O1A tag=X82S2FL7HMI5 type=del size=503243 2024-09-12T17:41:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.562+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=6X04S6SB3DQY type=del size=666276 2024-09-12T17:41:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.563+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.0 size=1048576 2024-09-12T17:41:56.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.564+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.1 size=1048576 2024-09-12T17:41:56.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.565+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~XYWNWY69EGP3.2 size=474562 2024-09-12T17:41:56.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.567+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=XYWNWY69EGP3 tag=3LAVARYTAMCS type=write size=3620290 2024-09-12T17:41:56.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.569+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~P0L8NENUI1MO.0 size=1048576 2024-09-12T17:41:56.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.570+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~P0L8NENUI1MO.1 size=552893 2024-09-12T17:41:56.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.570+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=P0L8NENUI1MO tag=SPI9YR99NOKP type=write size=2650045 2024-09-12T17:41:56.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.572+0000 7f330fbcc780 1 < suggested remove operation key=LF4NGY13WYHK tag=W2810ZGP50SR type=del 2024-09-12T17:41:56.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.574+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=367RFW0OFR4N type=del size=1828546 2024-09-12T17:41:56.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.575+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=3VKI6JBCPP0J type=del 2024-09-12T17:41:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.576+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=2NCI71A3VS11 type=del size=3397942 2024-09-12T17:41:56.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.577+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=2QT3JI2D62PO type=del 2024-09-12T17:41:56.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.578+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=H3IWAJF8SW6X type=del size=170886 2024-09-12T17:41:56.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.579+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=OZ7FKNAHP4SF type=write size=421818 2024-09-12T17:41:56.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.582+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.0 size=1048576 2024-09-12T17:41:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.583+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.1 size=1048576 2024-09-12T17:41:56.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.584+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.2 size=780824 2024-09-12T17:41:56.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.584+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=OD6C3306LXTK tag=LLJARD1U8I26 type=write size=3926552 2024-09-12T17:41:56.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.585+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.0 size=1048576 2024-09-12T17:41:56.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.585+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.1 size=1048576 2024-09-12T17:41:56.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.586+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~A71ZZ12ZYHKJ.2 size=983783 2024-09-12T17:41:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.588+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=A71ZZ12ZYHKJ tag=NYTVRI1K1PVW type=write size=4129511 2024-09-12T17:41:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.590+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=O0J46QSBO9WC type=del size=3626527 2024-09-12T17:41:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.591+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~PJ4YZ9AR9I5P.0 size=1048576 2024-09-12T17:41:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.592+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~PJ4YZ9AR9I5P.1 size=110540 2024-09-12T17:41:56.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.594+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=PJ4YZ9AR9I5P tag=TFKBTF00YQJK type=write size=2207692 2024-09-12T17:41:56.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.596+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=H1J8CO1WO2H4 type=del size=1058799 2024-09-12T17:41:56.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.597+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~IYPOJ6662T8R.0 size=547362 2024-09-12T17:41:56.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.599+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=IYPOJ6662T8R tag=9WW1YXIUM6QV type=write size=1595938 2024-09-12T17:41:56.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.600+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=PV2U1Q270NV7 type=del size=2013570 2024-09-12T17:41:56.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.601+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=S3J8EMNHNZUG type=del 2024-09-12T17:41:56.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.603+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.0 size=1048576 2024-09-12T17:41:56.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.604+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.1 size=1048576 2024-09-12T17:41:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.605+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.2 size=102936 2024-09-12T17:41:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.605+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=SPN7RBSOLJTQ tag=BV1D3TLPBWX7 type=write size=3248664 2024-09-12T17:41:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.607+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=3BVDG8I7QDK1 type=del 2024-09-12T17:41:56.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.609+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~TRZE3ZVB9P1P.0 size=1048576 2024-09-12T17:41:56.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.610+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~TRZE3ZVB9P1P.1 size=127754 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.610+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=TRZE3ZVB9P1P tag=25LCI94UVU5P type=write size=2224906 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.611+0000 7f330fbcc780 1 < canceled part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.0 size=1048576 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.612+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.1 size=1048576 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.612+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~C987BSVLBC4Q.2 size=122265 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.614+0000 7f330fbcc780 1 < canceled multipart upload key=H1LAU7WDZW6S upload=C987BSVLBC4Q tag=TIEOGHHW0FSN type=write size=3267993 2024-09-12T17:41:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.616+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=587DFBGX3FKZ type=del size=2950452 2024-09-12T17:41:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.617+0000 7f330fbcc780 -1 < failed to complete operation key=TKJOJ17LIWX6 tag=UW4B7F1FVOPX type=del size=1429316: (22) Invalid argument 2024-09-12T17:41:56.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.618+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=Z4OSEELMCZT0 type=del size=3849040 2024-09-12T17:41:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.619+0000 7f330fbcc780 -1 < failed to complete operation key=TKJOJ17LIWX6 tag=81GOSAW5OXSJ type=write size=130502: (22) Invalid argument 2024-09-12T17:41:56.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.620+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=0TDVVFI4CH44 type=del size=1506896 2024-09-12T17:41:56.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.621+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~FAYZDXHXB3FN.0 size=1048576 2024-09-12T17:41:56.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.622+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~FAYZDXHXB3FN.1 size=550237 2024-09-12T17:41:56.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.624+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=FAYZDXHXB3FN tag=41C0L404HBU0 type=write size=2647389 2024-09-12T17:41:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.626+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~29KRDESMFFFU.0 size=1048576 2024-09-12T17:41:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.627+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~29KRDESMFFFU.1 size=25046 2024-09-12T17:41:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.627+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=29KRDESMFFFU tag=GYNJ3EKMAWH1 type=write size=2122198 2024-09-12T17:41:56.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.630+0000 7f330fbcc780 1 < suggested remove operation key=H1LAU7WDZW6S tag=3OE53G20TT06 type=del 2024-09-12T17:41:56.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.632+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.0 size=1048576 2024-09-12T17:41:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.633+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.1 size=1048576 2024-09-12T17:41:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.634+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.2 size=699939 2024-09-12T17:41:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.634+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=EDPDJA16WGQO tag=IHSPTV0NRJ2E type=write size=3845667 2024-09-12T17:41:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.635+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=6X04S6SB3DQY type=del 2024-09-12T17:41:56.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.637+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~PQ475V9D2NJE.0 size=1048576 2024-09-12T17:41:56.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.638+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~PQ475V9D2NJE.1 size=584245 2024-09-12T17:41:56.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.638+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=PQ475V9D2NJE tag=IRMTUQDCMK3H type=write size=2681397 2024-09-12T17:41:56.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.639+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~P0L8NENUI1MO.0 size=1048576 2024-09-12T17:41:56.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.640+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~P0L8NENUI1MO.1 size=552893 2024-09-12T17:41:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.642+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=P0L8NENUI1MO tag=SPI9YR99NOKP type=write size=2650045 2024-09-12T17:41:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.643+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=5BM5INNYSLAY type=del size=383837 2024-09-12T17:41:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.645+0000 7f330fbcc780 1 < canceled operation key=IEYJS7X97O1A tag=367RFW0OFR4N type=del size=1828546 2024-09-12T17:41:56.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.646+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=XCJVVUI05R8X type=del size=1601734 2024-09-12T17:41:56.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.647+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=2NCI71A3VS11 type=del 2024-09-12T17:41:56.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.648+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=5PEYPB9ZSSC3 type=del size=3651807 2024-09-12T17:41:56.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.649+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=H3IWAJF8SW6X type=del 2024-09-12T17:41:56.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.651+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.0 size=1048576 2024-09-12T17:41:56.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.652+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.1 size=1048576 2024-09-12T17:41:56.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.653+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.2 size=131875 2024-09-12T17:41:56.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.653+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=0K91J23WDJV7 tag=ZDK2AYM107N4 type=write size=3277603 2024-09-12T17:41:56.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.654+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.0 size=1048576 2024-09-12T17:41:56.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.655+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.1 size=1048576 2024-09-12T17:41:56.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.656+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~OD6C3306LXTK.2 size=780824 2024-09-12T17:41:56.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.658+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=OD6C3306LXTK tag=LLJARD1U8I26 type=write size=3926552 2024-09-12T17:41:56.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.660+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~YZ24WASRYB0W.0 size=763832 2024-09-12T17:41:56.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.660+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=YZ24WASRYB0W tag=GQWIK6BMI8RQ type=write size=1812408 2024-09-12T17:41:56.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.661+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=O0J46QSBO9WC type=del 2024-09-12T17:41:56.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.663+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~4PPNCCKEXN98.0 size=660768 2024-09-12T17:41:56.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.663+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=4PPNCCKEXN98 tag=59C83JGQZ5U7 type=write size=1709344 2024-09-12T17:41:56.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.666+0000 7f330fbcc780 1 < suggested update operation key=ZEC2RXNOR3D1 tag=H1J8CO1WO2H4 type=del size=1058799 2024-09-12T17:41:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.667+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=5Y0U66P35DAD type=write size=357241 2024-09-12T17:41:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.668+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=PV2U1Q270NV7 type=del 2024-09-12T17:41:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.671+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~6KQCAJQVMHMI.0 size=1048576 2024-09-12T17:41:56.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.672+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~6KQCAJQVMHMI.1 size=601064 2024-09-12T17:41:56.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.672+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=6KQCAJQVMHMI tag=V1T1KLP9KFET type=write size=2698216 2024-09-12T17:41:56.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.673+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.0 size=1048576 2024-09-12T17:41:56.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.674+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.1 size=1048576 2024-09-12T17:41:56.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.675+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~SPN7RBSOLJTQ.2 size=102936 2024-09-12T17:41:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.677+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=SPN7RBSOLJTQ tag=BV1D3TLPBWX7 type=write size=3248664 2024-09-12T17:41:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.679+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~EVSQ273WCZTW.0 size=1048576 2024-09-12T17:41:56.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.680+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~EVSQ273WCZTW.1 size=729326 2024-09-12T17:41:56.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.680+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=EVSQ273WCZTW tag=LGVDKXQ9M47Q type=write size=2826478 2024-09-12T17:41:56.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.681+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~TRZE3ZVB9P1P.0 size=1048576 2024-09-12T17:41:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.682+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~TRZE3ZVB9P1P.1 size=127754 2024-09-12T17:41:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.684+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=TRZE3ZVB9P1P tag=25LCI94UVU5P type=write size=2224906 2024-09-12T17:41:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.685+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=Z4C1SE12H2LV type=del size=1726475 2024-09-12T17:41:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.686+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=587DFBGX3FKZ type=del 2024-09-12T17:41:56.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.688+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~E4Q2DV74G1WA.0 size=1048576 2024-09-12T17:41:56.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.689+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~E4Q2DV74G1WA.1 size=753271 2024-09-12T17:41:56.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.689+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=E4Q2DV74G1WA tag=BWYQ4633TEHS type=write size=2850423 2024-09-12T17:41:56.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.690+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=Z4OSEELMCZT0 type=del 2024-09-12T17:41:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.691+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=L1NJ67ZNI5H6 type=write size=989058 2024-09-12T17:41:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.692+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=0TDVVFI4CH44 type=del 2024-09-12T17:41:56.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.694+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.0 size=1048576 2024-09-12T17:41:56.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.695+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.1 size=1048576 2024-09-12T17:41:56.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.696+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.2 size=94662 2024-09-12T17:41:56.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.696+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=45JVQ0AIEPPZ tag=VFWHR9FT5ESO type=write size=3240390 2024-09-12T17:41:56.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.697+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~29KRDESMFFFU.0 size=1048576 2024-09-12T17:41:56.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.698+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~29KRDESMFFFU.1 size=25046 2024-09-12T17:41:56.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.700+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=29KRDESMFFFU tag=GYNJ3EKMAWH1 type=write size=2122198 2024-09-12T17:41:56.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.701+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~L68QT6ZZI95P.0 size=504623 2024-09-12T17:41:56.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.701+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=L68QT6ZZI95P tag=MYHWB8EEVRQR type=write size=1553199 2024-09-12T17:41:56.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.703+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.0 size=1048576 2024-09-12T17:41:56.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.704+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.1 size=1048576 2024-09-12T17:41:56.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.704+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~EDPDJA16WGQO.2 size=699939 2024-09-12T17:41:56.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.706+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=EDPDJA16WGQO tag=IHSPTV0NRJ2E type=write size=3845667 2024-09-12T17:41:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.707+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=19Q58M0YBKIS type=del size=2662129 2024-09-12T17:41:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.708+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~PQ475V9D2NJE.0 size=1048576 2024-09-12T17:41:56.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.709+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~PQ475V9D2NJE.1 size=584245 2024-09-12T17:41:56.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.711+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=PQ475V9D2NJE tag=IRMTUQDCMK3H type=write size=2681397 2024-09-12T17:41:56.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.713+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~ZOKMWQ68C7B0.0 size=1048576 2024-09-12T17:41:56.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.714+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~ZOKMWQ68C7B0.1 size=301966 2024-09-12T17:41:56.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.714+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=ZOKMWQ68C7B0 tag=L43FCB619ZMW type=write size=2399118 2024-09-12T17:41:56.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.715+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=5BM5INNYSLAY type=del 2024-09-12T17:41:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.717+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=CAJ6HJKB5JOQ type=del size=172329 2024-09-12T17:41:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.719+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=XCJVVUI05R8X type=del size=1601734 2024-09-12T17:41:56.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.720+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=383H2O8TVQ51 type=del size=154981 2024-09-12T17:41:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.721+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=5PEYPB9ZSSC3 type=del 2024-09-12T17:41:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.722+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=OD8VI28NUAS6 type=del size=2540453 2024-09-12T17:41:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.723+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.0 size=1048576 2024-09-12T17:41:56.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.724+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.1 size=1048576 2024-09-12T17:41:56.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.725+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~0K91J23WDJV7.2 size=131875 2024-09-12T17:41:56.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.727+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=0K91J23WDJV7 tag=ZDK2AYM107N4 type=write size=3277603 2024-09-12T17:41:56.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.729+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~D3C0Q37UMF0S.0 size=1048576 2024-09-12T17:41:56.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.730+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~D3C0Q37UMF0S.1 size=1024414 2024-09-12T17:41:56.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.730+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=D3C0Q37UMF0S tag=O7QXBSDYEHRO type=write size=3121566 2024-09-12T17:41:56.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.731+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~YZ24WASRYB0W.0 size=763832 2024-09-12T17:41:56.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.733+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=YZ24WASRYB0W tag=GQWIK6BMI8RQ type=write size=1812408 2024-09-12T17:41:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.736+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~J1TL7Q82696D.0 size=270811 2024-09-12T17:41:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.736+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=J1TL7Q82696D tag=6MUR8I5J82NW type=write size=1319387 2024-09-12T17:41:56.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.737+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~4PPNCCKEXN98.0 size=660768 2024-09-12T17:41:56.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.739+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=4PPNCCKEXN98 tag=59C83JGQZ5U7 type=write size=1709344 2024-09-12T17:41:56.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.741+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~KJI3QGK5YU3M.0 size=1048576 2024-09-12T17:41:56.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.742+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~KJI3QGK5YU3M.1 size=604942 2024-09-12T17:41:56.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.742+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=KJI3QGK5YU3M tag=LNGYYBH6EG39 type=write size=2702094 2024-09-12T17:41:56.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.743+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=5Y0U66P35DAD type=write size=357241 2024-09-12T17:41:56.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.744+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=F3212KAQWLXS type=del size=1204687 2024-09-12T17:41:56.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.745+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~6KQCAJQVMHMI.0 size=1048576 2024-09-12T17:41:56.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.745+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~6KQCAJQVMHMI.1 size=601064 2024-09-12T17:41:56.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.747+0000 7f330fbcc780 1 < canceled multipart upload key=AGM33OK1W7A6 upload=6KQCAJQVMHMI tag=V1T1KLP9KFET type=write size=2698216 2024-09-12T17:41:56.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.748+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=LODE4KW5MM5J type=del size=3611638 2024-09-12T17:41:56.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.749+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~EVSQ273WCZTW.0 size=1048576 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.750+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~EVSQ273WCZTW.1 size=729326 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.752+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=EVSQ273WCZTW tag=LGVDKXQ9M47Q type=write size=2826478 2024-09-12T17:41:56.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.754+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~07CO4MSY0Y5K.0 size=1048576 2024-09-12T17:41:56.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.755+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~07CO4MSY0Y5K.1 size=352223 2024-09-12T17:41:56.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.755+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=07CO4MSY0Y5K tag=7BNQVLP3567I type=write size=2449375 2024-09-12T17:41:56.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.756+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=Z4C1SE12H2LV type=del 2024-09-12T17:41:56.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.757+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=ZN2KIT7C6Q7K type=del size=2894314 2024-09-12T17:41:56.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.758+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~E4Q2DV74G1WA.0 size=1048576 2024-09-12T17:41:56.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.759+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~E4Q2DV74G1WA.1 size=753271 2024-09-12T17:41:56.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.761+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=E4Q2DV74G1WA tag=BWYQ4633TEHS type=write size=2850423 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.762+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=EHAKSB5RT8JQ type=del size=3606372 2024-09-12T17:41:56.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.763+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=L1NJ67ZNI5H6 type=write size=989058 2024-09-12T17:41:56.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.765+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~W9B7PCCS6KM3.0 size=1048576 2024-09-12T17:41:56.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.766+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~W9B7PCCS6KM3.1 size=760207 2024-09-12T17:41:56.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.766+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=W9B7PCCS6KM3 tag=HT5HWNCL16HQ type=write size=2857359 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.767+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.0 size=1048576 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.767+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.1 size=1048576 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.768+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~45JVQ0AIEPPZ.2 size=94662 2024-09-12T17:41:56.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.770+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=45JVQ0AIEPPZ tag=VFWHR9FT5ESO type=write size=3240390 2024-09-12T17:41:56.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.771+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=W80HJ8JGO35R type=del size=3196821 2024-09-12T17:41:56.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.772+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~L68QT6ZZI95P.0 size=504623 2024-09-12T17:41:56.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.774+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=L68QT6ZZI95P tag=MYHWB8EEVRQR type=write size=1553199 2024-09-12T17:41:56.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.775+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=DJ681UK3K8X3 type=del size=1620636 2024-09-12T17:41:56.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.776+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=19Q58M0YBKIS type=del 2024-09-12T17:41:56.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.777+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=MEHILL7EM99S type=del size=2294409 2024-09-12T17:41:56.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.779+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~ZOKMWQ68C7B0.0 size=1048576 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.780+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~ZOKMWQ68C7B0.1 size=301966 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.781+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=ZOKMWQ68C7B0 tag=L43FCB619ZMW type=write size=2399118 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.782+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=RHAHZNKA1MZO type=del size=3324094 2024-09-12T17:41:56.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.784+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=CAJ6HJKB5JOQ type=del 2024-09-12T17:41:56.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.785+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=DGOKA0QLM61C type=del size=2773918 2024-09-12T17:41:56.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.786+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=383H2O8TVQ51 type=del 2024-09-12T17:41:56.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.787+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=OYUVEDUP4FDB type=del size=2242271 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.788+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=OD8VI28NUAS6 type=del 2024-09-12T17:41:56.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.789+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=LOVYC4XV7M1Y type=del size=3607592 2024-09-12T17:41:56.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.790+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~D3C0Q37UMF0S.0 size=1048576 2024-09-12T17:41:56.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.791+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~D3C0Q37UMF0S.1 size=1024414 2024-09-12T17:41:56.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.793+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=D3C0Q37UMF0S tag=O7QXBSDYEHRO type=write size=3121566 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.794+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=G7QUKZGHG196 type=del size=618864 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.794+0000 7f330fbcc780 1 < canceled part key=_multipart_3IHGI1UMI1BA.2~J1TL7Q82696D.0 size=270811 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.796+0000 7f330fbcc780 1 < canceled multipart upload key=3IHGI1UMI1BA upload=J1TL7Q82696D tag=6MUR8I5J82NW type=write size=1319387 2024-09-12T17:41:56.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.798+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=DLFPGZE95MVH type=write size=137534 2024-09-12T17:41:56.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.798+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~KJI3QGK5YU3M.0 size=1048576 2024-09-12T17:41:56.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.799+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~KJI3QGK5YU3M.1 size=604942 2024-09-12T17:41:56.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.801+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=KJI3QGK5YU3M tag=LNGYYBH6EG39 type=write size=2702094 2024-09-12T17:41:56.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.802+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=9D6MEOH87JMH type=del size=2559589 2024-09-12T17:41:56.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.803+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=F3212KAQWLXS type=del 2024-09-12T17:41:56.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.805+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.0 size=1048576 2024-09-12T17:41:56.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.806+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.1 size=1048576 2024-09-12T17:41:56.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.807+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.2 size=756557 2024-09-12T17:41:56.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.807+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=IU41A1Z926YO tag=KI6WQHSAB2E8 type=write size=3902285 2024-09-12T17:41:56.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.808+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=LODE4KW5MM5J type=del 2024-09-12T17:41:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.810+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~YIA846MIDM1I.0 size=304134 2024-09-12T17:41:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.810+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=YIA846MIDM1I tag=KN3C08VK7OQR type=write size=1352710 2024-09-12T17:41:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.811+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~07CO4MSY0Y5K.0 size=1048576 2024-09-12T17:41:56.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.812+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~07CO4MSY0Y5K.1 size=352223 2024-09-12T17:41:56.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.814+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=07CO4MSY0Y5K tag=7BNQVLP3567I type=write size=2449375 2024-09-12T17:41:56.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.815+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=GA5MSWYEM56N type=del size=1654772 2024-09-12T17:41:56.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.816+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=ZN2KIT7C6Q7K type=del 2024-09-12T17:41:56.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.818+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~NKEKBLAY10VI.0 size=1048576 2024-09-12T17:41:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.819+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~NKEKBLAY10VI.1 size=879075 2024-09-12T17:41:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.819+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=NKEKBLAY10VI tag=0EWDCZI38IY6 type=write size=2976227 2024-09-12T17:41:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.820+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=EHAKSB5RT8JQ type=del 2024-09-12T17:41:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.821+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=R95PRU8W8RF6 type=del size=120796 2024-09-12T17:41:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.822+0000 7f330fbcc780 1 < canceled part key=_multipart_6MFVO30OX5W1.2~W9B7PCCS6KM3.0 size=1048576 2024-09-12T17:41:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.822+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~W9B7PCCS6KM3.1 size=760207 2024-09-12T17:41:56.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.824+0000 7f330fbcc780 1 < canceled multipart upload key=6MFVO30OX5W1 upload=W9B7PCCS6KM3 tag=HT5HWNCL16HQ type=write size=2857359 2024-09-12T17:41:56.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.825+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=TZMAIGLVER9B type=del size=1959359 2024-09-12T17:41:56.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.826+0000 7f330fbcc780 1 < canceled operation key=3IHGI1UMI1BA tag=W80HJ8JGO35R type=del size=3196821 2024-09-12T17:41:56.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.828+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=VB65L61S1XJ8 type=del size=1106656 2024-09-12T17:41:56.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.829+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=DJ681UK3K8X3 type=del 2024-09-12T17:41:56.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.830+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=BPSJKKDP8M89 type=write size=433351 2024-09-12T17:41:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.831+0000 7f330fbcc780 1 < canceled operation key=50WR6KLF40W7 tag=MEHILL7EM99S type=del size=2294409 2024-09-12T17:41:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.833+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.0 size=1048576 2024-09-12T17:41:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.834+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.1 size=1048576 2024-09-12T17:41:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.835+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.2 size=400032 2024-09-12T17:41:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.835+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=I4GLKGP7NFRF tag=BLKSRXG81G0T type=write size=3545760 2024-09-12T17:41:56.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.836+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=RHAHZNKA1MZO type=del 2024-09-12T17:41:56.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.839+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.0 size=1048576 2024-09-12T17:41:56.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.840+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.1 size=1048576 2024-09-12T17:41:56.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.840+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.2 size=690448 2024-09-12T17:41:56.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.840+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=D0YGEW2OO2GJ tag=XS3Z9SGNERCP type=write size=3836176 2024-09-12T17:41:56.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.841+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=DGOKA0QLM61C type=del 2024-09-12T17:41:56.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.843+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=J7IWBU8FDJ9J type=del size=108272 2024-09-12T17:41:56.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.844+0000 7f330fbcc780 1 < canceled operation key=6MFVO30OX5W1 tag=OYUVEDUP4FDB type=del size=2242271 2024-09-12T17:41:56.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.845+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=57QXEPY15514 type=del size=2205470 2024-09-12T17:41:56.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.847+0000 7f330fbcc780 1 < suggested remove operation key=9IYALJED5G85 tag=LOVYC4XV7M1Y type=del 2024-09-12T17:41:56.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.849+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~3IRIFZ4UY8ZX.0 size=362753 2024-09-12T17:41:56.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.849+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=3IRIFZ4UY8ZX tag=HA2VIPT5OZ0R type=write size=1411329 2024-09-12T17:41:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.851+0000 7f330fbcc780 1 < suggested remove operation key=MQV01X5P8JLG tag=G7QUKZGHG196 type=del 2024-09-12T17:41:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.852+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=52R2H8JYW4MT type=del size=310871 2024-09-12T17:41:56.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.855+0000 7f330fbcc780 1 < suggested remove operation key=HJL73WQD8SD2 tag=DLFPGZE95MVH type=write 2024-09-12T17:41:56.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.856+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~A1WD34LW95WU.0 size=1048576 2024-09-12T17:41:56.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.857+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~A1WD34LW95WU.1 size=621072 2024-09-12T17:41:56.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.857+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=A1WD34LW95WU tag=85C2I9IHD9CN type=write size=2718224 2024-09-12T17:41:56.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.858+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=9D6MEOH87JMH type=del 2024-09-12T17:41:56.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.860+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=MOTVAT5YI1B0 type=del size=3505340 2024-09-12T17:41:56.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.861+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.0 size=1048576 2024-09-12T17:41:56.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.862+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.1 size=1048576 2024-09-12T17:41:56.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.863+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~IU41A1Z926YO.2 size=756557 2024-09-12T17:41:56.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.864+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=IU41A1Z926YO tag=KI6WQHSAB2E8 type=write size=3902285 2024-09-12T17:41:56.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.865+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=L7J54BN7KYRH type=del size=740383 2024-09-12T17:41:56.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.867+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~YIA846MIDM1I.0 size=304134 2024-09-12T17:41:56.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.868+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=YIA846MIDM1I tag=KN3C08VK7OQR type=write size=1352710 2024-09-12T17:41:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.870+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.0 size=1048576 2024-09-12T17:41:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.871+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.1 size=1048576 2024-09-12T17:41:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.872+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.2 size=805632 2024-09-12T17:41:56.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.872+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=T448BLKB9FLC tag=3K881RR4QG1R type=write size=3951360 2024-09-12T17:41:56.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.873+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=GA5MSWYEM56N type=del 2024-09-12T17:41:56.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.874+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=R6YYO6NQIYOC type=write size=181580 2024-09-12T17:41:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.875+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~NKEKBLAY10VI.0 size=1048576 2024-09-12T17:41:56.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.876+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~NKEKBLAY10VI.1 size=879075 2024-09-12T17:41:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.878+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=NKEKBLAY10VI tag=0EWDCZI38IY6 type=write size=2976227 2024-09-12T17:41:56.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.879+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=YFGXEQ3PF79H type=del size=2213438 2024-09-12T17:41:56.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.881+0000 7f330fbcc780 1 < suggested update operation key=AL3ESPG15NO4 tag=R95PRU8W8RF6 type=del size=120796 2024-09-12T17:41:56.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.882+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=KE9TNEA898JX type=del size=3745179 2024-09-12T17:41:56.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.883+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=TZMAIGLVER9B type=del 2024-09-12T17:41:56.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.884+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=ICT7B7CI5L33 type=del size=1033258 2024-09-12T17:41:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.886+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=VB65L61S1XJ8 type=del 2024-09-12T17:41:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.887+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=1O3UO6C36PDH type=del size=906808 2024-09-12T17:41:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.888+0000 7f330fbcc780 1 < completed write operation key=3IHGI1UMI1BA tag=BPSJKKDP8M89 type=write size=433351 2024-09-12T17:41:56.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.890+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~3Z58JTVEOEAA.0 size=809240 2024-09-12T17:41:56.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.890+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=3Z58JTVEOEAA tag=8I1I7KT3KELM type=write size=1857816 2024-09-12T17:41:56.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.891+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.0 size=1048576 2024-09-12T17:41:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.892+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.1 size=1048576 2024-09-12T17:41:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.893+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~I4GLKGP7NFRF.2 size=400032 2024-09-12T17:41:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.895+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=I4GLKGP7NFRF tag=BLKSRXG81G0T type=write size=3545760 2024-09-12T17:41:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.897+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.0 size=1048576 2024-09-12T17:41:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.898+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.1 size=1048576 2024-09-12T17:41:56.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.899+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.2 size=850282 2024-09-12T17:41:56.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.899+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=U5D92TJVY2CN tag=IL23V6FU12B3 type=write size=3996010 2024-09-12T17:41:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.900+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.0 size=1048576 2024-09-12T17:41:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.901+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.1 size=1048576 2024-09-12T17:41:56.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.902+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~D0YGEW2OO2GJ.2 size=690448 2024-09-12T17:41:56.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.904+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=D0YGEW2OO2GJ tag=XS3Z9SGNERCP type=write size=3836176 2024-09-12T17:41:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.906+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.0 size=1048576 2024-09-12T17:41:56.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.907+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.1 size=1048576 2024-09-12T17:41:56.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.908+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.2 size=524349 2024-09-12T17:41:56.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.908+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=YADPA7Q0UMWZ tag=OBIR7HMI9MNN type=write size=3670077 2024-09-12T17:41:56.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.909+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=J7IWBU8FDJ9J type=del 2024-09-12T17:41:56.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.910+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=LASDOOT0DQ16 type=del size=1126388 2024-09-12T17:41:56.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.911+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=57QXEPY15514 type=del 2024-09-12T17:41:56.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.912+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=D281C12T07Z9 type=del size=378438 2024-09-12T17:41:56.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.914+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~3IRIFZ4UY8ZX.0 size=362753 2024-09-12T17:41:56.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.915+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=3IRIFZ4UY8ZX tag=HA2VIPT5OZ0R type=write size=1411329 2024-09-12T17:41:56.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.916+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=KFUCOH2OCZEE type=del size=1637230 2024-09-12T17:41:56.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.918+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=52R2H8JYW4MT type=del 2024-09-12T17:41:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.919+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=FQYTXQBC9UUG type=del size=2501792 2024-09-12T17:41:56.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.920+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~A1WD34LW95WU.0 size=1048576 2024-09-12T17:41:56.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.921+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~A1WD34LW95WU.1 size=621072 2024-09-12T17:41:56.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.923+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=A1WD34LW95WU tag=85C2I9IHD9CN type=write size=2718224 2024-09-12T17:41:56.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.925+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.0 size=1048576 2024-09-12T17:41:56.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.925+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.1 size=1048576 2024-09-12T17:41:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.926+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.2 size=601251 2024-09-12T17:41:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.926+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=17E7YTCSOQL0 tag=45OJQBGREC7M type=write size=3746979 2024-09-12T17:41:56.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.928+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=MOTVAT5YI1B0 type=del size=3505340 2024-09-12T17:41:56.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.930+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~GQ21MT6HGNYB.0 size=85253 2024-09-12T17:41:56.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.930+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=GQ21MT6HGNYB tag=THSUJTTR7FRU type=write size=1133829 2024-09-12T17:41:56.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.932+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=L7J54BN7KYRH type=del 2024-09-12T17:41:56.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.933+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=N2VC5AADOU5H type=del size=3431464 2024-09-12T17:41:56.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.934+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.0 size=1048576 2024-09-12T17:41:56.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.935+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.1 size=1048576 2024-09-12T17:41:56.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.935+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~T448BLKB9FLC.2 size=805632 2024-09-12T17:41:56.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.937+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=T448BLKB9FLC tag=3K881RR4QG1R type=write size=3951360 2024-09-12T17:41:56.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.940+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.0 size=1048576 2024-09-12T17:41:56.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.941+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.1 size=1048576 2024-09-12T17:41:56.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.942+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.2 size=24265 2024-09-12T17:41:56.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.942+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=QTKYLOE29JNQ tag=Y5GHRU9OM1QA type=write size=3169993 2024-09-12T17:41:56.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.943+0000 7f330fbcc780 -1 < failed to complete operation key=7TBNLJDCL4YB tag=R6YYO6NQIYOC type=write size=181580: (22) Invalid argument 2024-09-12T17:41:56.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.945+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.0 size=1048576 2024-09-12T17:41:56.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.945+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.1 size=1048576 2024-09-12T17:41:56.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.946+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.2 size=854722 2024-09-12T17:41:56.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.946+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=G10HDG72P48M tag=J60QPFKNB2OT type=write size=4000450 2024-09-12T17:41:56.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.947+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=YFGXEQ3PF79H type=del 2024-09-12T17:41:56.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.949+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.0 size=1048576 2024-09-12T17:41:56.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.950+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.1 size=1048576 2024-09-12T17:41:56.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.951+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.2 size=644763 2024-09-12T17:41:56.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.951+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=2OCEQW8FYXDL tag=NFG7IXLFI99G type=write size=3790491 2024-09-12T17:41:56.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.953+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=KE9TNEA898JX type=del 2024-09-12T17:41:56.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.954+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=UTKPNTYZRGAL type=del size=835784 2024-09-12T17:41:56.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.955+0000 7f330fbcc780 -1 < failed to complete operation key=9X4FNKQWJCX4 tag=ICT7B7CI5L33 type=del size=1033258: (22) Invalid argument 2024-09-12T17:41:56.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.957+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~7G0JZH1Q5V2Q.0 size=119172 2024-09-12T17:41:56.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.957+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=7G0JZH1Q5V2Q tag=8USLA5FRVESW type=write size=1167748 2024-09-12T17:41:56.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.959+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=1O3UO6C36PDH type=del size=906808 2024-09-12T17:41:56.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.960+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=HXXD9ZF2EZ7B type=write size=832707 2024-09-12T17:41:56.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.961+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~3Z58JTVEOEAA.0 size=809240 2024-09-12T17:41:56.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.963+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=3Z58JTVEOEAA tag=8I1I7KT3KELM type=write size=1857816 2024-09-12T17:41:56.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.965+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~VZSR5JMO7L92.0 size=1048576 2024-09-12T17:41:56.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.966+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~VZSR5JMO7L92.1 size=74346 2024-09-12T17:41:56.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.966+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=VZSR5JMO7L92 tag=TIBQ1ZI44RGO type=write size=2171498 2024-09-12T17:41:56.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.967+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.0 size=1048576 2024-09-12T17:41:56.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.968+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.1 size=1048576 2024-09-12T17:41:56.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.969+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~U5D92TJVY2CN.2 size=850282 2024-09-12T17:41:56.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.971+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=U5D92TJVY2CN tag=IL23V6FU12B3 type=write size=3996010 2024-09-12T17:41:56.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.972+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=2WG19ZQ7680U type=del size=1415423 2024-09-12T17:41:56.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.973+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.0 size=1048576 2024-09-12T17:41:56.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.974+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.1 size=1048576 2024-09-12T17:41:56.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.975+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~YADPA7Q0UMWZ.2 size=524349 2024-09-12T17:41:56.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.976+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=YADPA7Q0UMWZ tag=OBIR7HMI9MNN type=write size=3670077 2024-09-12T17:41:56.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.978+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.0 size=1048576 2024-09-12T17:41:56.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.979+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.1 size=1048576 2024-09-12T17:41:56.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.980+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.2 size=852472 2024-09-12T17:41:56.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.980+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=UDLPEL4P6WNH tag=OAXWPTFD5IQ2 type=write size=3998200 2024-09-12T17:41:56.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.981+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=LASDOOT0DQ16 type=del 2024-09-12T17:41:56.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.982+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=HVI326RJ9WTU type=del size=2417757 2024-09-12T17:41:56.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.985+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=D281C12T07Z9 type=del 2024-09-12T17:41:56.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.986+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=7J1Q9LZLQ686 type=write size=869235 2024-09-12T17:41:56.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.987+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=KFUCOH2OCZEE type=del 2024-09-12T17:41:56.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.988+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=B0PBLYS5PDJ5 type=del size=664740 2024-09-12T17:41:56.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.990+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=FQYTXQBC9UUG type=del 2024-09-12T17:41:56.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.991+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=MDOBHZRHQ3SO type=del size=3470881 2024-09-12T17:41:56.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.991+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.0 size=1048576 2024-09-12T17:41:56.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.992+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.1 size=1048576 2024-09-12T17:41:56.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.993+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~17E7YTCSOQL0.2 size=601251 2024-09-12T17:41:56.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.994+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=17E7YTCSOQL0 tag=45OJQBGREC7M type=write size=3746979 2024-09-12T17:41:56.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.996+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~8R1QI23IO4ZV.0 size=1048576 2024-09-12T17:41:56.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.997+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~8R1QI23IO4ZV.1 size=945392 2024-09-12T17:41:56.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.997+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=8R1QI23IO4ZV tag=T4MOUVS1IE44 type=write size=3042544 2024-09-12T17:41:56.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:56.998+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~GQ21MT6HGNYB.0 size=85253 2024-09-12T17:41:57.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.000+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=GQ21MT6HGNYB tag=THSUJTTR7FRU type=write size=1133829 2024-09-12T17:41:57.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.001+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=K7W34G09LEPY type=del size=2971044 2024-09-12T17:41:57.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.003+0000 7f330fbcc780 1 < canceled operation key=50WR6KLF40W7 tag=N2VC5AADOU5H type=del size=3431464 2024-09-12T17:41:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.004+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=J00F6COL84U3 type=del size=1727156 2024-09-12T17:41:57.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.005+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.0 size=1048576 2024-09-12T17:41:57.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.006+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.1 size=1048576 2024-09-12T17:41:57.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.007+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~QTKYLOE29JNQ.2 size=24265 2024-09-12T17:41:57.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.008+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=QTKYLOE29JNQ tag=Y5GHRU9OM1QA type=write size=3169993 2024-09-12T17:41:57.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.010+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=FZAZX7499JAZ type=del size=1396813 2024-09-12T17:41:57.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.011+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.0 size=1048576 2024-09-12T17:41:57.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.012+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.1 size=1048576 2024-09-12T17:41:57.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.012+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~G10HDG72P48M.2 size=854722 2024-09-12T17:41:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.014+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=G10HDG72P48M tag=J60QPFKNB2OT type=write size=4000450 2024-09-12T17:41:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.016+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~MUZAZ6UTFD6O.0 size=1048576 2024-09-12T17:41:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.017+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~MUZAZ6UTFD6O.1 size=283172 2024-09-12T17:41:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.017+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=MUZAZ6UTFD6O tag=DCMWSPB195RA type=write size=2380324 2024-09-12T17:41:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.018+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.0 size=1048576 2024-09-12T17:41:57.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.019+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.1 size=1048576 2024-09-12T17:41:57.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.020+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~2OCEQW8FYXDL.2 size=644763 2024-09-12T17:41:57.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.022+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=2OCEQW8FYXDL tag=NFG7IXLFI99G type=write size=3790491 2024-09-12T17:41:57.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.023+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=IVVJ1ZMA6A85 type=del size=4125223 2024-09-12T17:41:57.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.024+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=UTKPNTYZRGAL type=del 2024-09-12T17:41:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.027+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~K9LQRCNRB3TE.0 size=1048576 2024-09-12T17:41:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.028+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~K9LQRCNRB3TE.1 size=848027 2024-09-12T17:41:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.028+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=K9LQRCNRB3TE tag=WXL7ABQ3BCWB type=write size=2945179 2024-09-12T17:41:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.029+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~7G0JZH1Q5V2Q.0 size=119172 2024-09-12T17:41:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.030+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=7G0JZH1Q5V2Q tag=8USLA5FRVESW type=write size=1167748 2024-09-12T17:41:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.031+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=ZI2X2Q0IOHCE type=del size=3599212 2024-09-12T17:41:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.034+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=HXXD9ZF2EZ7B type=write 2024-09-12T17:41:57.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.035+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.0 size=1048576 2024-09-12T17:41:57.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.036+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.1 size=1048576 2024-09-12T17:41:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.037+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.2 size=1023739 2024-09-12T17:41:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.037+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=NJAW5OXB521D tag=HROUHMZ3JA54 type=write size=4169467 2024-09-12T17:41:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.038+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~VZSR5JMO7L92.0 size=1048576 2024-09-12T17:41:57.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.040+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~VZSR5JMO7L92.1 size=74346 2024-09-12T17:41:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.042+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=VZSR5JMO7L92 tag=TIBQ1ZI44RGO type=write size=2171498 2024-09-12T17:41:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.043+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=Z25JRN0SBB34 type=del size=313554 2024-09-12T17:41:57.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.044+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=2WG19ZQ7680U type=del 2024-09-12T17:41:57.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.045+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=RX3DL3ELIOTU type=del size=980777 2024-09-12T17:41:57.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.047+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.0 size=1048576 2024-09-12T17:41:57.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.048+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.1 size=1048576 2024-09-12T17:41:57.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.048+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~UDLPEL4P6WNH.2 size=852472 2024-09-12T17:41:57.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.050+0000 7f330fbcc780 1 < canceled multipart upload key=AGM33OK1W7A6 upload=UDLPEL4P6WNH tag=OAXWPTFD5IQ2 type=write size=3998200 2024-09-12T17:41:57.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.052+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.0 size=1048576 2024-09-12T17:41:57.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.053+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.1 size=1048576 2024-09-12T17:41:57.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.054+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.2 size=791024 2024-09-12T17:41:57.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.054+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=CBDI1J98XASY tag=C5B07SZS8ZF6 type=write size=3936752 2024-09-12T17:41:57.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.056+0000 7f330fbcc780 1 < suggested update operation key=6ZDBF249S1L6 tag=HVI326RJ9WTU type=del size=2417757 2024-09-12T17:41:57.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.057+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=CMLZK94LALJD type=del size=680838 2024-09-12T17:41:57.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.058+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=7J1Q9LZLQ686 type=write size=869235 2024-09-12T17:41:57.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.059+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=IL3WPXC0HOLK type=del size=1227556 2024-09-12T17:41:57.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.060+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=B0PBLYS5PDJ5 type=del 2024-09-12T17:41:57.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.063+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.0 size=1048576 2024-09-12T17:41:57.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.064+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.1 size=1048576 2024-09-12T17:41:57.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.065+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.2 size=190068 2024-09-12T17:41:57.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.065+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=7VEW0C8ZCHKM tag=OY4BYHJU2CKJ type=write size=3335796 2024-09-12T17:41:57.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.066+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=MDOBHZRHQ3SO type=del 2024-09-12T17:41:57.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.068+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.0 size=1048576 2024-09-12T17:41:57.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.069+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.1 size=1048576 2024-09-12T17:41:57.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.070+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.2 size=195140 2024-09-12T17:41:57.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.070+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=0WAEGVT99RTF tag=GX8U3IQF4ZA9 type=write size=3340868 2024-09-12T17:41:57.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.070+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~8R1QI23IO4ZV.0 size=1048576 2024-09-12T17:41:57.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.071+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~8R1QI23IO4ZV.1 size=945392 2024-09-12T17:41:57.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.072+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=8R1QI23IO4ZV tag=T4MOUVS1IE44 type=write size=3042544 2024-09-12T17:41:57.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.073+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=ZT0TRDH8NIQE type=del size=569661 2024-09-12T17:41:57.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.076+0000 7f330fbcc780 1 < suggested remove operation key=IEL4VF8ROC72 tag=K7W34G09LEPY type=del 2024-09-12T17:41:57.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.077+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=M0WDTWJYXSFE type=del size=3190157 2024-09-12T17:41:57.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.078+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=J00F6COL84U3 type=del 2024-09-12T17:41:57.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.080+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~OPJ8X7JFXQ8N.0 size=254277 2024-09-12T17:41:57.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.080+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=OPJ8X7JFXQ8N tag=3HXX0GXTFJIY type=write size=1302853 2024-09-12T17:41:57.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.081+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=FZAZX7499JAZ type=del 2024-09-12T17:41:57.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.082+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=XIXYGJQM0V3O type=del size=3611737 2024-09-12T17:41:57.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.083+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~MUZAZ6UTFD6O.0 size=1048576 2024-09-12T17:41:57.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.083+0000 7f330fbcc780 1 < canceled part key=_multipart_FY2BXMZBVMDL.2~MUZAZ6UTFD6O.1 size=283172 2024-09-12T17:41:57.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.086+0000 7f330fbcc780 1 < canceled multipart upload key=FY2BXMZBVMDL upload=MUZAZ6UTFD6O tag=DCMWSPB195RA type=write size=2380324 2024-09-12T17:41:57.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.089+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.0 size=1048576 2024-09-12T17:41:57.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.089+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.1 size=1048576 2024-09-12T17:41:57.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.090+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.2 size=116170 2024-09-12T17:41:57.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.090+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=50VTIUIZLPUZ tag=DA5SIT9FFCIL type=write size=3261898 2024-09-12T17:41:57.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.093+0000 7f330fbcc780 1 < suggested remove operation key=1MJ2W1WMLR85 tag=IVVJ1ZMA6A85 type=del 2024-09-12T17:41:57.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.094+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=7ZJT79CKYRAU type=del size=3071879 2024-09-12T17:41:57.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.095+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~K9LQRCNRB3TE.0 size=1048576 2024-09-12T17:41:57.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.096+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~K9LQRCNRB3TE.1 size=848027 2024-09-12T17:41:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.098+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=K9LQRCNRB3TE tag=WXL7ABQ3BCWB type=write size=2945179 2024-09-12T17:41:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.100+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.0 size=1048576 2024-09-12T17:41:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.101+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.1 size=1048576 2024-09-12T17:41:57.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.102+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.2 size=931200 2024-09-12T17:41:57.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.102+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=RELQY10A6CWJ tag=Q166LMOIJ1A1 type=write size=4076928 2024-09-12T17:41:57.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.103+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=ZI2X2Q0IOHCE type=del 2024-09-12T17:41:57.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.104+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=5G7BV91YJL18 type=del size=2524646 2024-09-12T17:41:57.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.105+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.0 size=1048576 2024-09-12T17:41:57.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.106+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.1 size=1048576 2024-09-12T17:41:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.107+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NJAW5OXB521D.2 size=1023739 2024-09-12T17:41:57.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.109+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=NJAW5OXB521D tag=HROUHMZ3JA54 type=write size=4169467 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.110+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=NWX86SVU8VDH type=del size=1259019 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.112+0000 7f330fbcc780 1 < suggested update operation key=LF4NGY13WYHK tag=Z25JRN0SBB34 type=del size=313554 2024-09-12T17:41:57.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.113+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=X2H1SW8NEC7X type=write size=147065 2024-09-12T17:41:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.116+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=RX3DL3ELIOTU type=del size=980777 2024-09-12T17:41:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.117+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=2XZG0ZGZY0I0 type=del size=2684857 2024-09-12T17:41:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.118+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.0 size=1048576 2024-09-12T17:41:57.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.119+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.1 size=1048576 2024-09-12T17:41:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.119+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~CBDI1J98XASY.2 size=791024 2024-09-12T17:41:57.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.121+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=CBDI1J98XASY tag=C5B07SZS8ZF6 type=write size=3936752 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.122+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=IGERY6ZS9DJQ type=del size=3823245 2024-09-12T17:41:57.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.124+0000 7f330fbcc780 1 < suggested remove operation key=D5ZZ93XAPRAA tag=CMLZK94LALJD type=del 2024-09-12T17:41:57.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.126+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.0 size=1048576 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.127+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.1 size=1048576 2024-09-12T17:41:57.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.128+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.2 size=264289 2024-09-12T17:41:57.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.128+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=87PX96IDG1V8 tag=ZGESC5MKB3TD type=write size=3410017 2024-09-12T17:41:57.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.129+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=IL3WPXC0HOLK type=del 2024-09-12T17:41:57.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.131+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=7PRQ3E9O8CED type=del size=291867 2024-09-12T17:41:57.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.132+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.0 size=1048576 2024-09-12T17:41:57.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.132+0000 7f330fbcc780 1 < canceled part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.1 size=1048576 2024-09-12T17:41:57.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.133+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~7VEW0C8ZCHKM.2 size=190068 2024-09-12T17:41:57.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.135+0000 7f330fbcc780 1 < canceled multipart upload key=LNE0UR6JPWR8 upload=7VEW0C8ZCHKM tag=OY4BYHJU2CKJ type=write size=3335796 2024-09-12T17:41:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.137+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~68T52UKQ3L7I.0 size=30190 2024-09-12T17:41:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.137+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=68T52UKQ3L7I tag=MGW6ITLO456E type=write size=1078766 2024-09-12T17:41:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.138+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.0 size=1048576 2024-09-12T17:41:57.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.139+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.1 size=1048576 2024-09-12T17:41:57.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.140+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~0WAEGVT99RTF.2 size=195140 2024-09-12T17:41:57.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.142+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=0WAEGVT99RTF tag=GX8U3IQF4ZA9 type=write size=3340868 2024-09-12T17:41:57.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.143+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=377B62LX3N1T type=del size=930003 2024-09-12T17:41:57.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.145+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=ZT0TRDH8NIQE type=del 2024-09-12T17:41:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.147+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=VMW7EQQ7NJW9 type=write size=798974 2024-09-12T17:41:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.148+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=M0WDTWJYXSFE type=del 2024-09-12T17:41:57.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.149+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=FWT4K88YLJ9Q type=del size=1750921 2024-09-12T17:41:57.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.150+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~OPJ8X7JFXQ8N.0 size=254277 2024-09-12T17:41:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.152+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=OPJ8X7JFXQ8N tag=3HXX0GXTFJIY type=write size=1302853 2024-09-12T17:41:57.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.154+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~CBB1288SPE9V.0 size=1048576 2024-09-12T17:41:57.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.155+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~CBB1288SPE9V.1 size=806284 2024-09-12T17:41:57.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.155+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=CBB1288SPE9V tag=LLYSSF0SJDV8 type=write size=2903436 2024-09-12T17:41:57.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.156+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=XIXYGJQM0V3O type=del 2024-09-12T17:41:57.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.159+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.0 size=1048576 2024-09-12T17:41:57.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.159+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.1 size=1048576 2024-09-12T17:41:57.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.160+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.2 size=77054 2024-09-12T17:41:57.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.160+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=SZG556A693U6 tag=3SWSKUBDS1ER type=write size=3222782 2024-09-12T17:41:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.162+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.0 size=1048576 2024-09-12T17:41:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.162+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.1 size=1048576 2024-09-12T17:41:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.163+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~50VTIUIZLPUZ.2 size=116170 2024-09-12T17:41:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.165+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=50VTIUIZLPUZ tag=DA5SIT9FFCIL type=write size=3261898 2024-09-12T17:41:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.166+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=7D4MMFPLPPI6 type=del size=1423389 2024-09-12T17:41:57.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.168+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=7ZJT79CKYRAU type=del 2024-09-12T17:41:57.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.170+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.0 size=1048576 2024-09-12T17:41:57.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.171+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.1 size=1048576 2024-09-12T17:41:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.172+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.2 size=965187 2024-09-12T17:41:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.172+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=GRHXVDGWFYV1 tag=F6I8Y9VR41H8 type=write size=4110915 2024-09-12T17:41:57.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.173+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.0 size=1048576 2024-09-12T17:41:57.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.174+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.1 size=1048576 2024-09-12T17:41:57.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.175+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~RELQY10A6CWJ.2 size=931200 2024-09-12T17:41:57.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.177+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=RELQY10A6CWJ tag=Q166LMOIJ1A1 type=write size=4076928 2024-09-12T17:41:57.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.178+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=RG6IMOHX4KI3 type=write size=360098 2024-09-12T17:41:57.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.180+0000 7f330fbcc780 1 < suggested update operation key=QE2QJH2J5QDY tag=5G7BV91YJL18 type=del size=2524646 2024-09-12T17:41:57.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.181+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=8N2I5Z3SBTTE type=del size=2720634 2024-09-12T17:41:57.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.182+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=NWX86SVU8VDH type=del 2024-09-12T17:41:57.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.184+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~Q8GR2ZHS3HF9.0 size=805392 2024-09-12T17:41:57.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.184+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=Q8GR2ZHS3HF9 tag=5UGUSEHIOCT1 type=write size=1853968 2024-09-12T17:41:57.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.186+0000 7f330fbcc780 1 < completed write operation key=TKJOJ17LIWX6 tag=X2H1SW8NEC7X type=write size=147065 2024-09-12T17:41:57.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.187+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=ETFCS0681KED type=del size=3990189 2024-09-12T17:41:57.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.188+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=2XZG0ZGZY0I0 type=del 2024-09-12T17:41:57.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.189+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=SM80UBOQ5Y4J type=del size=3396897 2024-09-12T17:41:57.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.191+0000 7f330fbcc780 1 < suggested update operation key=H1LAU7WDZW6S tag=IGERY6ZS9DJQ type=del size=3823245 2024-09-12T17:41:57.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.193+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HCVH076CSWAC.0 size=1048576 2024-09-12T17:41:57.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.194+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HCVH076CSWAC.1 size=105849 2024-09-12T17:41:57.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.194+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=HCVH076CSWAC tag=NHZJISIN4JX2 type=write size=2203001 2024-09-12T17:41:57.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.195+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.0 size=1048576 2024-09-12T17:41:57.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.196+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.1 size=1048576 2024-09-12T17:41:57.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.197+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~87PX96IDG1V8.2 size=264289 2024-09-12T17:41:57.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.199+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=87PX96IDG1V8 tag=ZGESC5MKB3TD type=write size=3410017 2024-09-12T17:41:57.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.200+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=VBNQB0LOKW46 type=del size=2610904 2024-09-12T17:41:57.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.201+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=7PRQ3E9O8CED type=del 2024-09-12T17:41:57.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.203+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=P7R6A6PJASDB type=del size=4089198 2024-09-12T17:41:57.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.204+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~68T52UKQ3L7I.0 size=30190 2024-09-12T17:41:57.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.206+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=68T52UKQ3L7I tag=MGW6ITLO456E type=write size=1078766 2024-09-12T17:41:57.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.207+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~8183CYF7AN1E.0 size=1048576 2024-09-12T17:41:57.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.208+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~8183CYF7AN1E.1 size=1013402 2024-09-12T17:41:57.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.208+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=8183CYF7AN1E tag=RWC6FU1EWXUJ type=write size=3110554 2024-09-12T17:41:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.209+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=377B62LX3N1T type=del 2024-09-12T17:41:57.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.211+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~Y1N5V4NI3KGY.0 size=1048576 2024-09-12T17:41:57.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.212+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~Y1N5V4NI3KGY.1 size=895989 2024-09-12T17:41:57.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.212+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=Y1N5V4NI3KGY tag=KOHZV6GXGNJ4 type=write size=2993141 2024-09-12T17:41:57.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.213+0000 7f330fbcc780 1 < completed write operation key=2CY67P4QM19H tag=VMW7EQQ7NJW9 type=write size=798974 2024-09-12T17:41:57.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.215+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~PAIR517YONIG.0 size=310132 2024-09-12T17:41:57.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.215+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=PAIR517YONIG tag=HA95BO40EW8E type=write size=1358708 2024-09-12T17:41:57.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.216+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=FWT4K88YLJ9Q type=del 2024-09-12T17:41:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.218+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~L5SZH8HJLAE3.0 size=1048576 2024-09-12T17:41:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.219+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~L5SZH8HJLAE3.1 size=706805 2024-09-12T17:41:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.219+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=L5SZH8HJLAE3 tag=J2JFLE5F79NG type=write size=2803957 2024-09-12T17:41:57.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.221+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~CBB1288SPE9V.0 size=1048576 2024-09-12T17:41:57.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.222+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~CBB1288SPE9V.1 size=806284 2024-09-12T17:41:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.224+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=CBB1288SPE9V tag=LLYSSF0SJDV8 type=write size=2903436 2024-09-12T17:41:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.225+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=D112XUXKDG8G type=del size=750331 2024-09-12T17:41:57.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.226+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.0 size=1048576 2024-09-12T17:41:57.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.227+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.1 size=1048576 2024-09-12T17:41:57.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.228+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~SZG556A693U6.2 size=77054 2024-09-12T17:41:57.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.230+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=SZG556A693U6 tag=3SWSKUBDS1ER type=write size=3222782 2024-09-12T17:41:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.232+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~YHC7AOCX3FN2.0 size=83682 2024-09-12T17:41:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.232+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=YHC7AOCX3FN2 tag=FT5KRMYQGQVH type=write size=1132258 2024-09-12T17:41:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.234+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=7D4MMFPLPPI6 type=del 2024-09-12T17:41:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.236+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~19XDO7Y44A89.0 size=543794 2024-09-12T17:41:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.236+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=19XDO7Y44A89 tag=OT4ZLXR00FEI type=write size=1592370 2024-09-12T17:41:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.237+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.0 size=1048576 2024-09-12T17:41:57.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.238+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.1 size=1048576 2024-09-12T17:41:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.239+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~GRHXVDGWFYV1.2 size=965187 2024-09-12T17:41:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.241+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=GRHXVDGWFYV1 tag=F6I8Y9VR41H8 type=write size=4110915 2024-09-12T17:41:57.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.243+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~8SWEUUGIESK1.0 size=543256 2024-09-12T17:41:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.243+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=8SWEUUGIESK1 tag=2TJDT3OPKN5J type=write size=1591832 2024-09-12T17:41:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.245+0000 7f330fbcc780 1 < suggested update operation key=D5ZZ93XAPRAA tag=RG6IMOHX4KI3 type=write size=360098 2024-09-12T17:41:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.246+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=X09P7278FYRF type=del size=25555 2024-09-12T17:41:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.248+0000 7f330fbcc780 1 < suggested remove operation key=30CIXFQV5VBI tag=8N2I5Z3SBTTE type=del 2024-09-12T17:41:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.249+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=L9BGXGVPAP2Q type=write size=613629 2024-09-12T17:41:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.249+0000 7f330fbcc780 1 < canceled part key=_multipart_IEL4VF8ROC72.2~Q8GR2ZHS3HF9.0 size=805392 2024-09-12T17:41:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.252+0000 7f330fbcc780 1 < canceled multipart upload key=IEL4VF8ROC72 upload=Q8GR2ZHS3HF9 tag=5UGUSEHIOCT1 type=write size=1853968 2024-09-12T17:41:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.254+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~RJWPRR7FVO0F.0 size=1048576 2024-09-12T17:41:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.255+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~RJWPRR7FVO0F.1 size=134682 2024-09-12T17:41:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.255+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=RJWPRR7FVO0F tag=YDI78E3RS9YB type=write size=2231834 2024-09-12T17:41:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.256+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=ETFCS0681KED type=del 2024-09-12T17:41:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.257+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=6VFIIPLCOQWF type=del size=2389128 2024-09-12T17:41:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.258+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=SM80UBOQ5Y4J type=del 2024-09-12T17:41:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.259+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=HIRGC3ALETP6 type=del size=1059269 2024-09-12T17:41:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.260+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HCVH076CSWAC.0 size=1048576 2024-09-12T17:41:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.261+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HCVH076CSWAC.1 size=105849 2024-09-12T17:41:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.263+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=HCVH076CSWAC tag=NHZJISIN4JX2 type=write size=2203001 2024-09-12T17:41:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.265+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~4PWP9T8K8SLA.0 size=562124 2024-09-12T17:41:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.265+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=4PWP9T8K8SLA tag=236JP0SIWWA9 type=write size=1610700 2024-09-12T17:41:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.266+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=VBNQB0LOKW46 type=del 2024-09-12T17:41:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.268+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~X0FMKANN724G.0 size=52594 2024-09-12T17:41:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.268+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=X0FMKANN724G tag=LRI9AL4UH13P type=write size=1101170 2024-09-12T17:41:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.270+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=P7R6A6PJASDB type=del 2024-09-12T17:41:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.271+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=24ZNE0WZXADA type=del size=1989788 2024-09-12T17:41:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.272+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~8183CYF7AN1E.0 size=1048576 2024-09-12T17:41:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.273+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~8183CYF7AN1E.1 size=1013402 2024-09-12T17:41:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.275+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=8183CYF7AN1E tag=RWC6FU1EWXUJ type=write size=3110554 2024-09-12T17:41:57.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.277+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~LN7QBWSXA0WD.0 size=1048576 2024-09-12T17:41:57.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.278+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~LN7QBWSXA0WD.1 size=421454 2024-09-12T17:41:57.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.278+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=LN7QBWSXA0WD tag=76NTTFQGRDA4 type=write size=2518606 2024-09-12T17:41:57.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.279+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~Y1N5V4NI3KGY.0 size=1048576 2024-09-12T17:41:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.280+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~Y1N5V4NI3KGY.1 size=895989 2024-09-12T17:41:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.282+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=Y1N5V4NI3KGY tag=KOHZV6GXGNJ4 type=write size=2993141 2024-09-12T17:41:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.283+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=35WRJIX6TY2E type=write size=919628 2024-09-12T17:41:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.284+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~PAIR517YONIG.0 size=310132 2024-09-12T17:41:57.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.286+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=PAIR517YONIG tag=HA95BO40EW8E type=write size=1358708 2024-09-12T17:41:57.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.287+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=G3B9E51979G5 type=del size=3905078 2024-09-12T17:41:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.288+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~L5SZH8HJLAE3.0 size=1048576 2024-09-12T17:41:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.289+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~L5SZH8HJLAE3.1 size=706805 2024-09-12T17:41:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.291+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=L5SZH8HJLAE3 tag=J2JFLE5F79NG type=write size=2803957 2024-09-12T17:41:57.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.293+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~DLKF4MCX7PUT.0 size=1048576 2024-09-12T17:41:57.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.294+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~DLKF4MCX7PUT.1 size=951722 2024-09-12T17:41:57.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.294+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=DLKF4MCX7PUT tag=EQ08BSAEU2HN type=write size=3048874 2024-09-12T17:41:57.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.296+0000 7f330fbcc780 1 < suggested remove operation key=70COM4KLK2R1 tag=D112XUXKDG8G type=del 2024-09-12T17:41:57.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.297+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=BXR6KX8YCWSE type=del size=2289829 2024-09-12T17:41:57.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.298+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~YHC7AOCX3FN2.0 size=83682 2024-09-12T17:41:57.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.300+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=YHC7AOCX3FN2 tag=FT5KRMYQGQVH type=write size=1132258 2024-09-12T17:41:57.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.301+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=5NEL0Y3LFJ2F type=del size=2602229 2024-09-12T17:41:57.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.301+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~19XDO7Y44A89.0 size=543794 2024-09-12T17:41:57.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.303+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=19XDO7Y44A89 tag=OT4ZLXR00FEI type=write size=1592370 2024-09-12T17:41:57.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.305+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.0 size=1048576 2024-09-12T17:41:57.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.306+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.1 size=1048576 2024-09-12T17:41:57.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.307+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.2 size=42085 2024-09-12T17:41:57.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.307+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=VFYB5KQGHKHR tag=0FFE3OIONSQL type=write size=3187813 2024-09-12T17:41:57.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.308+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~8SWEUUGIESK1.0 size=543256 2024-09-12T17:41:57.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.310+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=8SWEUUGIESK1 tag=2TJDT3OPKN5J type=write size=1591832 2024-09-12T17:41:57.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.311+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=XLKEIEIZJDP0 type=del size=665070 2024-09-12T17:41:57.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.313+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=X09P7278FYRF type=del 2024-09-12T17:41:57.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.314+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=4ADV7RNIV2TT type=del size=1030809 2024-09-12T17:41:57.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.315+0000 7f330fbcc780 1 < completed write operation key=7TBNLJDCL4YB tag=L9BGXGVPAP2Q type=write size=613629 2024-09-12T17:41:57.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.316+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=RPN6HLCGY98X type=del size=4033136 2024-09-12T17:41:57.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.317+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~RJWPRR7FVO0F.0 size=1048576 2024-09-12T17:41:57.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.317+0000 7f330fbcc780 1 < canceled part key=_multipart_5QBSRDY0LJ60.2~RJWPRR7FVO0F.1 size=134682 2024-09-12T17:41:57.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.319+0000 7f330fbcc780 1 < canceled multipart upload key=5QBSRDY0LJ60 upload=RJWPRR7FVO0F tag=YDI78E3RS9YB type=write size=2231834 2024-09-12T17:41:57.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.320+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=1CG5Q34G5T44 type=del size=631314 2024-09-12T17:41:57.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.321+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=6VFIIPLCOQWF type=del 2024-09-12T17:41:57.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.322+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=24AELNL052K6 type=write size=848776 2024-09-12T17:41:57.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.324+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=HIRGC3ALETP6 type=del 2024-09-12T17:41:57.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.325+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=X4IDYBSSEOW0 type=del size=3411171 2024-09-12T17:41:57.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.326+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~4PWP9T8K8SLA.0 size=562124 2024-09-12T17:41:57.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.328+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=4PWP9T8K8SLA tag=236JP0SIWWA9 type=write size=1610700 2024-09-12T17:41:57.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.329+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=YC93UBYK1VS0 type=del size=3127746 2024-09-12T17:41:57.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.330+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~X0FMKANN724G.0 size=52594 2024-09-12T17:41:57.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.332+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=X0FMKANN724G tag=LRI9AL4UH13P type=write size=1101170 2024-09-12T17:41:57.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.333+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=HDPV6R039Y2V type=del size=1082414 2024-09-12T17:41:57.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.334+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=24ZNE0WZXADA type=del 2024-09-12T17:41:57.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.336+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.0 size=1048576 2024-09-12T17:41:57.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.337+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.1 size=1048576 2024-09-12T17:41:57.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.338+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.2 size=390883 2024-09-12T17:41:57.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.338+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=5R8O4MQPXB9B tag=4R2R79GN9SQR type=write size=3536611 2024-09-12T17:41:57.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.339+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~LN7QBWSXA0WD.0 size=1048576 2024-09-12T17:41:57.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.340+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~LN7QBWSXA0WD.1 size=421454 2024-09-12T17:41:57.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.342+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=LN7QBWSXA0WD tag=76NTTFQGRDA4 type=write size=2518606 2024-09-12T17:41:57.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.343+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=BPFBU1ZDW3FS type=del size=3434897 2024-09-12T17:41:57.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.345+0000 7f330fbcc780 1 < canceled operation key=6HBW7077B3MS tag=35WRJIX6TY2E type=write size=919628 2024-09-12T17:41:57.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.346+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=H57T1FM61K14 type=write size=804058 2024-09-12T17:41:57.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.347+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=G3B9E51979G5 type=del 2024-09-12T17:41:57.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.349+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~3LAKXUZRC10W.0 size=1048576 2024-09-12T17:41:57.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.350+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~3LAKXUZRC10W.1 size=939917 2024-09-12T17:41:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.350+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=3LAKXUZRC10W tag=F7FWAWPPCKE9 type=write size=3037069 2024-09-12T17:41:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.350+0000 7f330fbcc780 1 < canceled part key=_multipart_FY2BXMZBVMDL.2~DLKF4MCX7PUT.0 size=1048576 2024-09-12T17:41:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.351+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~DLKF4MCX7PUT.1 size=951722 2024-09-12T17:41:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.353+0000 7f330fbcc780 1 < canceled multipart upload key=FY2BXMZBVMDL upload=DLKF4MCX7PUT tag=EQ08BSAEU2HN type=write size=3048874 2024-09-12T17:41:57.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.354+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=AEUBZNSN1J3V type=del size=965536 2024-09-12T17:41:57.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.355+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=BXR6KX8YCWSE type=del 2024-09-12T17:41:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.358+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~Y1VH4H3QD2FD.0 size=1048576 2024-09-12T17:41:57.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.358+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~Y1VH4H3QD2FD.1 size=677060 2024-09-12T17:41:57.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.358+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=Y1VH4H3QD2FD tag=GNFCYRJXUMRF type=write size=2774212 2024-09-12T17:41:57.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.360+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=5NEL0Y3LFJ2F type=del 2024-09-12T17:41:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.361+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=BKCNAUSB6VYO type=write size=483726 2024-09-12T17:41:57.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.362+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.0 size=1048576 2024-09-12T17:41:57.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.363+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.1 size=1048576 2024-09-12T17:41:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.364+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~VFYB5KQGHKHR.2 size=42085 2024-09-12T17:41:57.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.365+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=VFYB5KQGHKHR tag=0FFE3OIONSQL type=write size=3187813 2024-09-12T17:41:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.367+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~F7CSPL36BAMV.0 size=1048576 2024-09-12T17:41:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.368+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~F7CSPL36BAMV.1 size=984813 2024-09-12T17:41:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.368+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=F7CSPL36BAMV tag=C79BS827F0WQ type=write size=3081965 2024-09-12T17:41:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.369+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=XLKEIEIZJDP0 type=del 2024-09-12T17:41:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.370+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=959S2U2XAJPE type=del size=2756754 2024-09-12T17:41:57.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.371+0000 7f330fbcc780 1 < canceled operation key=IEL4VF8ROC72 tag=4ADV7RNIV2TT type=del size=1030809 2024-09-12T17:41:57.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.373+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=6O92EG1REB2F type=del size=1209261 2024-09-12T17:41:57.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.375+0000 7f330fbcc780 1 < suggested update operation key=50WR6KLF40W7 tag=RPN6HLCGY98X type=del size=4033136 2024-09-12T17:41:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.376+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=QY5YZOWFPCM3 type=del size=242981 2024-09-12T17:41:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.377+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=1CG5Q34G5T44 type=del 2024-09-12T17:41:57.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.378+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=Q2C9LMXZKHYI type=del size=2431481 2024-09-12T17:41:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.381+0000 7f330fbcc780 1 < suggested update operation key=5QBSRDY0LJ60 tag=24AELNL052K6 type=write size=848776 2024-09-12T17:41:57.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.382+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=8S2OGELNHUVJ type=del size=236771 2024-09-12T17:41:57.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.383+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=X4IDYBSSEOW0 type=del 2024-09-12T17:41:57.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.385+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.0 size=1048576 2024-09-12T17:41:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.386+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.1 size=1048576 2024-09-12T17:41:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.387+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.2 size=934713 2024-09-12T17:41:57.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.387+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=4OLJW89ID475 tag=3X9BHVJG8PZR type=write size=4080441 2024-09-12T17:41:57.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.388+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=YC93UBYK1VS0 type=del 2024-09-12T17:41:57.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.389+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=RSWLFFHKUHBQ type=del size=1584341 2024-09-12T17:41:57.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.391+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=HDPV6R039Y2V type=del 2024-09-12T17:41:57.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.393+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=F5UHELJUZS89 type=write size=949690 2024-09-12T17:41:57.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.393+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.0 size=1048576 2024-09-12T17:41:57.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.394+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.1 size=1048576 2024-09-12T17:41:57.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.395+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~5R8O4MQPXB9B.2 size=390883 2024-09-12T17:41:57.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.396+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=5R8O4MQPXB9B tag=4R2R79GN9SQR type=write size=3536611 2024-09-12T17:41:57.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.398+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~6SDPLBETGGXS.0 size=1048576 2024-09-12T17:41:57.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.399+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~6SDPLBETGGXS.1 size=976509 2024-09-12T17:41:57.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.399+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=6SDPLBETGGXS tag=VE4YA85B9QXG type=write size=3073661 2024-09-12T17:41:57.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.400+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=BPFBU1ZDW3FS type=del 2024-09-12T17:41:57.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.401+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=1309SK9LTRIP type=del size=3484854 2024-09-12T17:41:57.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.403+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=H57T1FM61K14 type=write size=804058 2024-09-12T17:41:57.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.405+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~BVGL5K1BZ84N.0 size=815142 2024-09-12T17:41:57.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.405+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=BVGL5K1BZ84N tag=77EIQBZ3KXGJ type=write size=1863718 2024-09-12T17:41:57.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.406+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~3LAKXUZRC10W.0 size=1048576 2024-09-12T17:41:57.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.407+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~3LAKXUZRC10W.1 size=939917 2024-09-12T17:41:57.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.408+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=3LAKXUZRC10W tag=F7FWAWPPCKE9 type=write size=3037069 2024-09-12T17:41:57.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.410+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.0 size=1048576 2024-09-12T17:41:57.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.411+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.1 size=1048576 2024-09-12T17:41:57.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.412+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.2 size=55796 2024-09-12T17:41:57.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.412+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=BF1W9K9YR5GM tag=QS827YKTJ4GD type=write size=3201524 2024-09-12T17:41:57.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.413+0000 7f330fbcc780 -1 < failed to complete operation key=50WR6KLF40W7 tag=AEUBZNSN1J3V type=del size=965536: (22) Invalid argument 2024-09-12T17:41:57.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.414+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=FEUNRIOKTRGL type=del size=501645 2024-09-12T17:41:57.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.415+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~Y1VH4H3QD2FD.0 size=1048576 2024-09-12T17:41:57.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.416+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~Y1VH4H3QD2FD.1 size=677060 2024-09-12T17:41:57.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.418+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=Y1VH4H3QD2FD tag=GNFCYRJXUMRF type=write size=2774212 2024-09-12T17:41:57.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.419+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=9EMDBXUEV3OG type=del size=2366489 2024-09-12T17:41:57.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.421+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=BKCNAUSB6VYO type=write 2024-09-12T17:41:57.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.423+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.0 size=1048576 2024-09-12T17:41:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.424+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.1 size=1048576 2024-09-12T17:41:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.425+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.2 size=259191 2024-09-12T17:41:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.425+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=NWG0H8KAWER6 tag=0FCF25M0UZ8I type=write size=3404919 2024-09-12T17:41:57.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.426+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~F7CSPL36BAMV.0 size=1048576 2024-09-12T17:41:57.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.427+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~F7CSPL36BAMV.1 size=984813 2024-09-12T17:41:57.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.429+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=F7CSPL36BAMV tag=C79BS827F0WQ type=write size=3081965 2024-09-12T17:41:57.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.430+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=ZZUDUB3WOZJO type=del size=2583096 2024-09-12T17:41:57.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.431+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=959S2U2XAJPE type=del 2024-09-12T17:41:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.433+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.0 size=1048576 2024-09-12T17:41:57.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.434+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.1 size=1048576 2024-09-12T17:41:57.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.435+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.2 size=193942 2024-09-12T17:41:57.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.435+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=1MG3KDHSON87 tag=WKZJO3235OZV type=write size=3339670 2024-09-12T17:41:57.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.437+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=6O92EG1REB2F type=del 2024-09-12T17:41:57.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.438+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=QFR6U5EBIA4U type=del size=3605872 2024-09-12T17:41:57.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.439+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=QY5YZOWFPCM3 type=del 2024-09-12T17:41:57.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.440+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=VMJ95UU2NIBQ type=del size=3924410 2024-09-12T17:41:57.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.441+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=Q2C9LMXZKHYI type=del 2024-09-12T17:41:57.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.443+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.0 size=1048576 2024-09-12T17:41:57.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.444+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.1 size=1048576 2024-09-12T17:41:57.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.445+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.2 size=42126 2024-09-12T17:41:57.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.445+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=8OIYNS1TJOZW tag=49UG49PJPUIM type=write size=3187854 2024-09-12T17:41:57.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.447+0000 7f330fbcc780 1 < suggested update operation key=XIW3OJB1STT9 tag=8S2OGELNHUVJ type=del size=236771 2024-09-12T17:41:57.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.448+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=0KBQ3J3GJ2RO type=del size=2149898 2024-09-12T17:41:57.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.449+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.0 size=1048576 2024-09-12T17:41:57.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.449+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.1 size=1048576 2024-09-12T17:41:57.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.450+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~4OLJW89ID475.2 size=934713 2024-09-12T17:41:57.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.452+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=4OLJW89ID475 tag=3X9BHVJG8PZR type=write size=4080441 2024-09-12T17:41:57.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.454+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~14DQYQJ82QJP.0 size=667735 2024-09-12T17:41:57.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.454+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=14DQYQJ82QJP tag=VNWAFXOR67C1 type=write size=1716311 2024-09-12T17:41:57.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.455+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=RSWLFFHKUHBQ type=del 2024-09-12T17:41:57.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.457+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.0 size=1048576 2024-09-12T17:41:57.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.458+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.1 size=1048576 2024-09-12T17:41:57.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.459+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.2 size=513459 2024-09-12T17:41:57.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.459+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=OYC9S44B0364 tag=58M0DQIMW92Q type=write size=3659187 2024-09-12T17:41:57.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.461+0000 7f330fbcc780 1 < canceled operation key=2CY67P4QM19H tag=F5UHELJUZS89 type=write size=949690 2024-09-12T17:41:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.462+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=E9IDZ72YROQX type=del size=1288839 2024-09-12T17:41:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.463+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~6SDPLBETGGXS.0 size=1048576 2024-09-12T17:41:57.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.464+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~6SDPLBETGGXS.1 size=976509 2024-09-12T17:41:57.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.466+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=6SDPLBETGGXS tag=VE4YA85B9QXG type=write size=3073661 2024-09-12T17:41:57.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.467+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=PKR85WDHNI65 type=del size=3730189 2024-09-12T17:41:57.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.468+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=1309SK9LTRIP type=del size=3484854 2024-09-12T17:41:57.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.469+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=MC2WE3XLCYSN type=del size=1718001 2024-09-12T17:41:57.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.470+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~BVGL5K1BZ84N.0 size=815142 2024-09-12T17:41:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.472+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=BVGL5K1BZ84N tag=77EIQBZ3KXGJ type=write size=1863718 2024-09-12T17:41:57.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.474+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~6T3TO5KAQQPT.0 size=425951 2024-09-12T17:41:57.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.474+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=6T3TO5KAQQPT tag=8M1N0PW2EPP1 type=write size=1474527 2024-09-12T17:41:57.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.474+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.0 size=1048576 2024-09-12T17:41:57.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.475+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.1 size=1048576 2024-09-12T17:41:57.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.476+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~BF1W9K9YR5GM.2 size=55796 2024-09-12T17:41:57.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.478+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=BF1W9K9YR5GM tag=QS827YKTJ4GD type=write size=3201524 2024-09-12T17:41:57.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.479+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=030861YTM0O2 type=del size=1377343 2024-09-12T17:41:57.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.480+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=FEUNRIOKTRGL type=del 2024-09-12T17:41:57.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.481+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=KTTY7IPR7PCK type=del size=93747 2024-09-12T17:41:57.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.483+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=9EMDBXUEV3OG type=del 2024-09-12T17:41:57.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.485+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~Q0MGE6XF2RUA.0 size=451319 2024-09-12T17:41:57.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.485+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=Q0MGE6XF2RUA tag=3FJ90KD2D2SX type=write size=1499895 2024-09-12T17:41:57.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.486+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.0 size=1048576 2024-09-12T17:41:57.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.487+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.1 size=1048576 2024-09-12T17:41:57.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.488+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~NWG0H8KAWER6.2 size=259191 2024-09-12T17:41:57.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.489+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=NWG0H8KAWER6 tag=0FCF25M0UZ8I type=write size=3404919 2024-09-12T17:41:57.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.490+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=31613G3SEXCY type=del size=279128 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.491+0000 7f330fbcc780 -1 < failed to complete operation key=XIW3OJB1STT9 tag=ZZUDUB3WOZJO type=del size=2583096: (22) Invalid argument 2024-09-12T17:41:57.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.493+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~TWYTQWMWG4M9.0 size=1048576 2024-09-12T17:41:57.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.494+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~TWYTQWMWG4M9.1 size=938574 2024-09-12T17:41:57.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.494+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=TWYTQWMWG4M9 tag=TC9YEF4BTVP3 type=write size=3035726 2024-09-12T17:41:57.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.496+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.0 size=1048576 2024-09-12T17:41:57.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.497+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.1 size=1048576 2024-09-12T17:41:57.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.498+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~1MG3KDHSON87.2 size=193942 2024-09-12T17:41:57.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.500+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=1MG3KDHSON87 tag=WKZJO3235OZV type=write size=3339670 2024-09-12T17:41:57.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.502+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~JSYP33M8LA68.0 size=928047 2024-09-12T17:41:57.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.502+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=JSYP33M8LA68 tag=X0HW123F0X8O type=write size=1976623 2024-09-12T17:41:57.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.503+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=QFR6U5EBIA4U type=del size=3605872 2024-09-12T17:41:57.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.504+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=CXUS73VH6TNG type=write size=111837 2024-09-12T17:41:57.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.506+0000 7f330fbcc780 1 < suggested remove operation key=XIW3OJB1STT9 tag=VMJ95UU2NIBQ type=del 2024-09-12T17:41:57.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.509+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~F3VBHV80JFDL.0 size=865181 2024-09-12T17:41:57.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.509+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=F3VBHV80JFDL tag=AJ3A1JS2A4ZP type=write size=1913757 2024-09-12T17:41:57.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.510+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.0 size=1048576 2024-09-12T17:41:57.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.511+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.1 size=1048576 2024-09-12T17:41:57.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.512+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~8OIYNS1TJOZW.2 size=42126 2024-09-12T17:41:57.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.514+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=8OIYNS1TJOZW tag=49UG49PJPUIM type=write size=3187854 2024-09-12T17:41:57.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.516+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~Q7MQNXQEPLKI.0 size=1048576 2024-09-12T17:41:57.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.517+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~Q7MQNXQEPLKI.1 size=563089 2024-09-12T17:41:57.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.517+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=Q7MQNXQEPLKI tag=TWQGIHRXJ82F type=write size=2660241 2024-09-12T17:41:57.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.518+0000 7f330fbcc780 1 < canceled operation key=TKJOJ17LIWX6 tag=0KBQ3J3GJ2RO type=del size=2149898 2024-09-12T17:41:57.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.520+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=SAHO6FO7FYMJ type=write size=91011 2024-09-12T17:41:57.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.521+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~14DQYQJ82QJP.0 size=667735 2024-09-12T17:41:57.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.523+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=14DQYQJ82QJP tag=VNWAFXOR67C1 type=write size=1716311 2024-09-12T17:41:57.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.524+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=E9PLSWT6FQUN type=del size=787111 2024-09-12T17:41:57.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.525+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.0 size=1048576 2024-09-12T17:41:57.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.525+0000 7f330fbcc780 1 < canceled part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.1 size=1048576 2024-09-12T17:41:57.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.526+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~OYC9S44B0364.2 size=513459 2024-09-12T17:41:57.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.528+0000 7f330fbcc780 1 < canceled multipart upload key=IEL4VF8ROC72 upload=OYC9S44B0364 tag=58M0DQIMW92Q type=write size=3659187 2024-09-12T17:41:57.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.529+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=JRXQ1290MHLD type=del size=1980284 2024-09-12T17:41:57.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.530+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=E9IDZ72YROQX type=del 2024-09-12T17:41:57.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.531+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=0C7R680T132H type=write size=700993 2024-09-12T17:41:57.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.532+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=PKR85WDHNI65 type=del 2024-09-12T17:41:57.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.534+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~A1TDRK2IH53D.0 size=1048576 2024-09-12T17:41:57.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.535+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~A1TDRK2IH53D.1 size=185086 2024-09-12T17:41:57.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.535+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=A1TDRK2IH53D tag=LM0OPV6QCPAS type=write size=2282238 2024-09-12T17:41:57.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.537+0000 7f330fbcc780 1 < suggested remove operation key=FY2BXMZBVMDL tag=MC2WE3XLCYSN type=del 2024-09-12T17:41:57.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.539+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~56XN20070PS0.0 size=682604 2024-09-12T17:41:57.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.539+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=56XN20070PS0 tag=WFJWY4X643KK type=write size=1731180 2024-09-12T17:41:57.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.540+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~6T3TO5KAQQPT.0 size=425951 2024-09-12T17:41:57.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.542+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=6T3TO5KAQQPT tag=8M1N0PW2EPP1 type=write size=1474527 2024-09-12T17:41:57.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.543+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=YOIIT9YS79QT type=del size=2757839 2024-09-12T17:41:57.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.544+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=030861YTM0O2 type=del 2024-09-12T17:41:57.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.546+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=JSH33RVZGNE6 type=del size=1499147 2024-09-12T17:41:57.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.547+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=KTTY7IPR7PCK type=del 2024-09-12T17:41:57.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.548+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=4W9RUH942HEP type=del size=1922460 2024-09-12T17:41:57.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.549+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~Q0MGE6XF2RUA.0 size=451319 2024-09-12T17:41:57.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.551+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=Q0MGE6XF2RUA tag=3FJ90KD2D2SX type=write size=1499895 2024-09-12T17:41:57.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.552+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=E6K4JZ444BI3 type=del size=574442 2024-09-12T17:41:57.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.553+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=31613G3SEXCY type=del 2024-09-12T17:41:57.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.554+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=OSE6ER9CYYF6 type=del size=986798 2024-09-12T17:41:57.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.556+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~TWYTQWMWG4M9.0 size=1048576 2024-09-12T17:41:57.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.556+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~TWYTQWMWG4M9.1 size=938574 2024-09-12T17:41:57.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.557+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=TWYTQWMWG4M9 tag=TC9YEF4BTVP3 type=write size=3035726 2024-09-12T17:41:57.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.559+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=CCQUPO54LEZW type=del size=1616639 2024-09-12T17:41:57.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.560+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~JSYP33M8LA68.0 size=928047 2024-09-12T17:41:57.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.562+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=JSYP33M8LA68 tag=X0HW123F0X8O type=write size=1976623 2024-09-12T17:41:57.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.563+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=5EI04SYZBVF5 type=write size=241238 2024-09-12T17:41:57.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.564+0000 7f330fbcc780 -1 < failed to complete operation key=XIW3OJB1STT9 tag=CXUS73VH6TNG type=write size=111837: (22) Invalid argument 2024-09-12T17:41:57.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.567+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~K0RBVPNBNR4I.0 size=1048576 2024-09-12T17:41:57.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.568+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~K0RBVPNBNR4I.1 size=318483 2024-09-12T17:41:57.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.568+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=K0RBVPNBNR4I tag=2A3Y09K2D147 type=write size=2415635 2024-09-12T17:41:57.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.569+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~F3VBHV80JFDL.0 size=865181 2024-09-12T17:41:57.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.570+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=F3VBHV80JFDL tag=AJ3A1JS2A4ZP type=write size=1913757 2024-09-12T17:41:57.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.572+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~14UI6338TFY7.0 size=611147 2024-09-12T17:41:57.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.572+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=14UI6338TFY7 tag=C21NTFHTEZPW type=write size=1659723 2024-09-12T17:41:57.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.573+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~Q7MQNXQEPLKI.0 size=1048576 2024-09-12T17:41:57.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.574+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~Q7MQNXQEPLKI.1 size=563089 2024-09-12T17:41:57.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.576+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=Q7MQNXQEPLKI tag=TWQGIHRXJ82F type=write size=2660241 2024-09-12T17:41:57.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.578+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=TAIU3TJN00JC type=del size=409737 2024-09-12T17:41:57.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.579+0000 7f330fbcc780 1 < completed write operation key=50WR6KLF40W7 tag=SAHO6FO7FYMJ type=write size=91011 2024-09-12T17:41:57.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.581+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~JL5XWN9WXF44.0 size=1048576 2024-09-12T17:41:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.582+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~JL5XWN9WXF44.1 size=260810 2024-09-12T17:41:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.582+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=JL5XWN9WXF44 tag=BCODJ3IUJ96B type=write size=2357962 2024-09-12T17:41:57.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.584+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=E9PLSWT6FQUN type=del size=787111 2024-09-12T17:41:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.586+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=IP8L3O45XKCJ type=write size=521646 2024-09-12T17:41:57.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.586+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=FY2BXMZBVMDL tag=JRXQ1290MHLD type=del size=1980284: (2) No such file or directory 2024-09-12T17:41:57.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.587+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=FP6V6KY7Z2OQ type=del size=1971709 2024-09-12T17:41:57.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.589+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=0C7R680T132H type=write size=700993 2024-09-12T17:41:57.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.590+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=87YY1ZMOWJZM type=del size=1468946 2024-09-12T17:41:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.591+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~A1TDRK2IH53D.0 size=1048576 2024-09-12T17:41:57.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.592+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~A1TDRK2IH53D.1 size=185086 2024-09-12T17:41:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.594+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=A1TDRK2IH53D tag=LM0OPV6QCPAS type=write size=2282238 2024-09-12T17:41:57.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.595+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=9MSXP6L13JOX type=del size=3648005 2024-09-12T17:41:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.596+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~56XN20070PS0.0 size=682604 2024-09-12T17:41:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.598+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=56XN20070PS0 tag=WFJWY4X643KK type=write size=1731180 2024-09-12T17:41:57.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.599+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=Y7YAJXF3XH0L type=del size=3614877 2024-09-12T17:41:57.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.600+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=YOIIT9YS79QT type=del 2024-09-12T17:41:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.603+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~AR6BFCBPI2Q9.0 size=1048576 2024-09-12T17:41:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.603+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~AR6BFCBPI2Q9.1 size=476357 2024-09-12T17:41:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.603+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=AR6BFCBPI2Q9 tag=YTU48SART5OW type=write size=2573509 2024-09-12T17:41:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.606+0000 7f330fbcc780 1 < suggested update operation key=SPKBX4WU9A9R tag=JSH33RVZGNE6 type=del size=1499147 2024-09-12T17:41:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.607+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=B88TLHE23F0M type=del size=479018 2024-09-12T17:41:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.608+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=4W9RUH942HEP type=del 2024-09-12T17:41:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.610+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~J66QJCPTOXHR.0 size=1048576 2024-09-12T17:41:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.611+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~J66QJCPTOXHR.1 size=397736 2024-09-12T17:41:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.611+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=J66QJCPTOXHR tag=MYJDOKUB8G2Y type=write size=2494888 2024-09-12T17:41:57.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.613+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=E6K4JZ444BI3 type=del 2024-09-12T17:41:57.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.614+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=UQ9PVGOAS39U type=del size=167038 2024-09-12T17:41:57.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.615+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=OSE6ER9CYYF6 type=del size=986798 2024-09-12T17:41:57.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.616+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=IEOFD99WDD6W type=del size=3564569 2024-09-12T17:41:57.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.618+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=CCQUPO54LEZW type=del 2024-09-12T17:41:57.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.620+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~GAPJ0XEM4R16.0 size=1048576 2024-09-12T17:41:57.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.621+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~GAPJ0XEM4R16.1 size=621057 2024-09-12T17:41:57.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.621+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=GAPJ0XEM4R16 tag=TQRC5RTJ61I5 type=write size=2718209 2024-09-12T17:41:57.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.622+0000 7f330fbcc780 1 < completed write operation key=ZEC2RXNOR3D1 tag=5EI04SYZBVF5 type=write size=241238 2024-09-12T17:41:57.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.623+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=XWEKMMDMEGBD type=write size=387338 2024-09-12T17:41:57.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.623+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~K0RBVPNBNR4I.0 size=1048576 2024-09-12T17:41:57.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.624+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~K0RBVPNBNR4I.1 size=318483 2024-09-12T17:41:57.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.626+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=K0RBVPNBNR4I tag=2A3Y09K2D147 type=write size=2415635 2024-09-12T17:41:57.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.627+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=EPA83GA1FPAH type=write size=851375 2024-09-12T17:41:57.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.628+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~14UI6338TFY7.0 size=611147 2024-09-12T17:41:57.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.630+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=14UI6338TFY7 tag=C21NTFHTEZPW type=write size=1659723 2024-09-12T17:41:57.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.631+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=7BYO58O05E0E type=del size=2938532 2024-09-12T17:41:57.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.632+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=TAIU3TJN00JC type=del 2024-09-12T17:41:57.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.633+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=BN7ECTRCT8QE type=del size=442953 2024-09-12T17:41:57.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.634+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~JL5XWN9WXF44.0 size=1048576 2024-09-12T17:41:57.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.635+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~JL5XWN9WXF44.1 size=260810 2024-09-12T17:41:57.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.637+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=JL5XWN9WXF44 tag=BCODJ3IUJ96B type=write size=2357962 2024-09-12T17:41:57.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.639+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.0 size=1048576 2024-09-12T17:41:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.640+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.1 size=1048576 2024-09-12T17:41:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.641+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.2 size=224793 2024-09-12T17:41:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.641+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=0ZSH5GRORRTD tag=QF4BCWPTPE44 type=write size=3370521 2024-09-12T17:41:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.642+0000 7f330fbcc780 1 < completed write operation key=IEL4VF8ROC72 tag=IP8L3O45XKCJ type=write size=521646 2024-09-12T17:41:57.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.643+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=D4O6RKSVGHF0 type=del size=3979096 2024-09-12T17:41:57.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.644+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=FP6V6KY7Z2OQ type=del 2024-09-12T17:41:57.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.646+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~YW676UOUQABN.0 size=95297 2024-09-12T17:41:57.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.646+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=YW676UOUQABN tag=E9ATYMHSRPDH type=write size=1143873 2024-09-12T17:41:57.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.647+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=87YY1ZMOWJZM type=del 2024-09-12T17:41:57.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.649+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~HGBI222BLAA3.0 size=482501 2024-09-12T17:41:57.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.649+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=HGBI222BLAA3 tag=02OU8JS4VX1E type=write size=1531077 2024-09-12T17:41:57.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.651+0000 7f330fbcc780 1 < suggested update operation key=TKJOJ17LIWX6 tag=9MSXP6L13JOX type=del size=3648005 2024-09-12T17:41:57.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.653+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~5XINPKUAGKW1.0 size=1048576 2024-09-12T17:41:57.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.654+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~5XINPKUAGKW1.1 size=5715 2024-09-12T17:41:57.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.654+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=5XINPKUAGKW1 tag=50D6IILGQ1EH type=write size=2102867 2024-09-12T17:41:57.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.655+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=Y7YAJXF3XH0L type=del 2024-09-12T17:41:57.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.658+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~MI8CAVHCBWTI.0 size=1048576 2024-09-12T17:41:57.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.659+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~MI8CAVHCBWTI.1 size=315145 2024-09-12T17:41:57.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.659+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=MI8CAVHCBWTI tag=P0C6O5ELED8E type=write size=2412297 2024-09-12T17:41:57.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.660+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~AR6BFCBPI2Q9.0 size=1048576 2024-09-12T17:41:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.661+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~AR6BFCBPI2Q9.1 size=476357 2024-09-12T17:41:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.663+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=AR6BFCBPI2Q9 tag=YTU48SART5OW type=write size=2573509 2024-09-12T17:41:57.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.664+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=7ITRDZ0M43J9 type=write size=930613 2024-09-12T17:41:57.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.665+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=B88TLHE23F0M type=del 2024-09-12T17:41:57.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.666+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=0TVB4F0SNF77 type=del size=2628178 2024-09-12T17:41:57.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.667+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~J66QJCPTOXHR.0 size=1048576 2024-09-12T17:41:57.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.668+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~J66QJCPTOXHR.1 size=397736 2024-09-12T17:41:57.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.670+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=J66QJCPTOXHR tag=MYJDOKUB8G2Y type=write size=2494888 2024-09-12T17:41:57.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.673+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.0 size=1048576 2024-09-12T17:41:57.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.674+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.1 size=1048576 2024-09-12T17:41:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.675+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.2 size=1009271 2024-09-12T17:41:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.675+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=3KFQCJ4XVT23 tag=V3OLRPER9PE1 type=write size=4154999 2024-09-12T17:41:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.676+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=UQ9PVGOAS39U type=del 2024-09-12T17:41:57.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.677+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=7C20KJ6FM93U type=write size=326738 2024-09-12T17:41:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.679+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=IEOFD99WDD6W type=del 2024-09-12T17:41:57.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.680+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=BKWQ54SVP3JU type=write size=913200 2024-09-12T17:41:57.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.681+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~GAPJ0XEM4R16.0 size=1048576 2024-09-12T17:41:57.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.682+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~GAPJ0XEM4R16.1 size=621057 2024-09-12T17:41:57.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.684+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=GAPJ0XEM4R16 tag=TQRC5RTJ61I5 type=write size=2718209 2024-09-12T17:41:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.685+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=9QP2PQ4CYWJS type=del size=3257906 2024-09-12T17:41:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.687+0000 7f330fbcc780 1 < suggested remove operation key=3IHGI1UMI1BA tag=XWEKMMDMEGBD type=write 2024-09-12T17:41:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.689+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~OEGZSXBPZXPI.0 size=1048576 2024-09-12T17:41:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.690+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~OEGZSXBPZXPI.1 size=728574 2024-09-12T17:41:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.690+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=OEGZSXBPZXPI tag=UUPDZO8MTGP8 type=write size=2825726 2024-09-12T17:41:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.691+0000 7f330fbcc780 1 < completed write operation key=2CY67P4QM19H tag=EPA83GA1FPAH type=write size=851375 2024-09-12T17:41:57.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.692+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=B2GHK2GFDK76 type=del size=3118580 2024-09-12T17:41:57.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.693+0000 7f330fbcc780 1 < canceled operation key=8UX8W3FAJ3D9 tag=7BYO58O05E0E type=del size=2938532 2024-09-12T17:41:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.695+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.0 size=1048576 2024-09-12T17:41:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.696+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.1 size=1048576 2024-09-12T17:41:57.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.697+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.2 size=24875 2024-09-12T17:41:57.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.697+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=IT8BM64XVWAX tag=E8XI98WMSZJX type=write size=3170603 2024-09-12T17:41:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.699+0000 7f330fbcc780 1 < suggested update operation key=6HBW7077B3MS tag=BN7ECTRCT8QE type=del size=442953 2024-09-12T17:41:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.701+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~NX8IPZTKBIMJ.0 size=1048576 2024-09-12T17:41:57.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.702+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~NX8IPZTKBIMJ.1 size=824320 2024-09-12T17:41:57.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.702+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=NX8IPZTKBIMJ tag=IC72EBPJG4LO type=write size=2921472 2024-09-12T17:41:57.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.703+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.0 size=1048576 2024-09-12T17:41:57.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.704+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.1 size=1048576 2024-09-12T17:41:57.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.704+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~0ZSH5GRORRTD.2 size=224793 2024-09-12T17:41:57.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.706+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=0ZSH5GRORRTD tag=QF4BCWPTPE44 type=write size=3370521 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.708+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~F5OURYQMBR1V.0 size=1048576 2024-09-12T17:41:57.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.709+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~F5OURYQMBR1V.1 size=357495 2024-09-12T17:41:57.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.709+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=F5OURYQMBR1V tag=LXGZDOK3XWBQ type=write size=2454647 2024-09-12T17:41:57.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.710+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=D4O6RKSVGHF0 type=del 2024-09-12T17:41:57.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.712+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~X31VPZCZWIY2.0 size=1048576 2024-09-12T17:41:57.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.713+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~X31VPZCZWIY2.1 size=56465 2024-09-12T17:41:57.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.713+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=X31VPZCZWIY2 tag=SN0ANF4BR9G2 type=write size=2153617 2024-09-12T17:41:57.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.714+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~YW676UOUQABN.0 size=95297 2024-09-12T17:41:57.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.716+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=YW676UOUQABN tag=E9ATYMHSRPDH type=write size=1143873 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.717+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=0SC5NS4RV1KZ type=del size=326837 2024-09-12T17:41:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.718+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~HGBI222BLAA3.0 size=482501 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.720+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=HGBI222BLAA3 tag=02OU8JS4VX1E type=write size=1531077 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.721+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=I993MF4ELR2U type=del size=3902926 2024-09-12T17:41:57.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.723+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~5XINPKUAGKW1.0 size=1048576 2024-09-12T17:41:57.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.724+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~5XINPKUAGKW1.1 size=5715 2024-09-12T17:41:57.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.726+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=5XINPKUAGKW1 tag=50D6IILGQ1EH type=write size=2102867 2024-09-12T17:41:57.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.728+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~OSVFYJYQUFO2.0 size=771822 2024-09-12T17:41:57.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.728+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=OSVFYJYQUFO2 tag=FWX442PSG5MM type=write size=1820398 2024-09-12T17:41:57.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.729+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~MI8CAVHCBWTI.0 size=1048576 2024-09-12T17:41:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.730+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~MI8CAVHCBWTI.1 size=315145 2024-09-12T17:41:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.733+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=MI8CAVHCBWTI tag=P0C6O5ELED8E type=write size=2412297 2024-09-12T17:41:57.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.734+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=CBYHQHQTK3TT type=del size=1097223 2024-09-12T17:41:57.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.735+0000 7f330fbcc780 1 < canceled operation key=6MFVO30OX5W1 tag=7ITRDZ0M43J9 type=write size=930613 2024-09-12T17:41:57.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.736+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=QGOV5XM9PLFE type=del size=3913218 2024-09-12T17:41:57.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.738+0000 7f330fbcc780 1 < canceled operation key=6MFVO30OX5W1 tag=0TVB4F0SNF77 type=del size=2628178 2024-09-12T17:41:57.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.740+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~9G5ZLCJSNFYU.0 size=779516 2024-09-12T17:41:57.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.740+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=9G5ZLCJSNFYU tag=ELRTTT5ZD89J type=write size=1828092 2024-09-12T17:41:57.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.740+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.0 size=1048576 2024-09-12T17:41:57.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.741+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.1 size=1048576 2024-09-12T17:41:57.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.742+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~3KFQCJ4XVT23.2 size=1009271 2024-09-12T17:41:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.744+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=3KFQCJ4XVT23 tag=V3OLRPER9PE1 type=write size=4154999 2024-09-12T17:41:57.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.746+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.0 size=1048576 2024-09-12T17:41:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.746+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.1 size=1048576 2024-09-12T17:41:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.747+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.2 size=100029 2024-09-12T17:41:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.747+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=O6ZVX2KFI3J0 tag=PUMT72W2LZ7G type=write size=3245757 2024-09-12T17:41:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.748+0000 7f330fbcc780 1 < completed write operation key=5QBSRDY0LJ60 tag=7C20KJ6FM93U type=write size=326738 2024-09-12T17:41:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.749+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=YFON9Q1JGMNE type=write size=1010190 2024-09-12T17:41:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.751+0000 7f330fbcc780 1 < canceled operation key=XIW3OJB1STT9 tag=BKWQ54SVP3JU type=write size=913200 2024-09-12T17:41:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.752+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=W2ZXMDQCU2XD type=del size=2762779 2024-09-12T17:41:57.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.754+0000 7f330fbcc780 1 < suggested update operation key=6MFVO30OX5W1 tag=9QP2PQ4CYWJS type=del size=3257906 2024-09-12T17:41:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.755+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=PD0G62EV1OQ9 type=write size=811915 2024-09-12T17:41:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.755+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~OEGZSXBPZXPI.0 size=1048576 2024-09-12T17:41:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.756+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~OEGZSXBPZXPI.1 size=728574 2024-09-12T17:41:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.757+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=OEGZSXBPZXPI tag=UUPDZO8MTGP8 type=write size=2825726 2024-09-12T17:41:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.759+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=DCQPJ4MHWO2J type=del size=1528850 2024-09-12T17:41:57.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.761+0000 7f330fbcc780 1 < suggested remove operation key=LNE0UR6JPWR8 tag=B2GHK2GFDK76 type=del 2024-09-12T17:41:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.762+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=ZPRR1AAVA1JQ type=write size=899112 2024-09-12T17:41:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.763+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.0 size=1048576 2024-09-12T17:41:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.763+0000 7f330fbcc780 1 < canceled part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.1 size=1048576 2024-09-12T17:41:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.764+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~IT8BM64XVWAX.2 size=24875 2024-09-12T17:41:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.766+0000 7f330fbcc780 1 < canceled multipart upload key=IEYJS7X97O1A upload=IT8BM64XVWAX tag=E8XI98WMSZJX type=write size=3170603 2024-09-12T17:41:57.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.767+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=00KGIMQR20KG type=write size=61503 2024-09-12T17:41:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.769+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~NX8IPZTKBIMJ.0 size=1048576 2024-09-12T17:41:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.769+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~NX8IPZTKBIMJ.1 size=824320 2024-09-12T17:41:57.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.771+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=NX8IPZTKBIMJ tag=IC72EBPJG4LO type=write size=2921472 2024-09-12T17:41:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.772+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=UNMCWIF4R96H type=del size=1956102 2024-09-12T17:41:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.774+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~F5OURYQMBR1V.0 size=1048576 2024-09-12T17:41:57.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.774+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~F5OURYQMBR1V.1 size=357495 2024-09-12T17:41:57.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.775+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=F5OURYQMBR1V tag=LXGZDOK3XWBQ type=write size=2454647 2024-09-12T17:41:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.777+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=JD3ORL48YF0Y type=del size=3358951 2024-09-12T17:41:57.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.778+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~X31VPZCZWIY2.0 size=1048576 2024-09-12T17:41:57.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.778+0000 7f330fbcc780 1 < canceled part key=_multipart_30CIXFQV5VBI.2~X31VPZCZWIY2.1 size=56465 2024-09-12T17:41:57.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.780+0000 7f330fbcc780 1 < canceled multipart upload key=30CIXFQV5VBI upload=X31VPZCZWIY2 tag=SN0ANF4BR9G2 type=write size=2153617 2024-09-12T17:41:57.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.782+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.0 size=1048576 2024-09-12T17:41:57.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.783+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.1 size=1048576 2024-09-12T17:41:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.784+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.2 size=533054 2024-09-12T17:41:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.784+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=6245TZWYREYP tag=TOA1JDBEMVAY type=write size=3678782 2024-09-12T17:41:57.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.785+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=0SC5NS4RV1KZ type=del 2024-09-12T17:41:57.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.786+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=43OX8YRAMKBD type=del size=743597 2024-09-12T17:41:57.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.787+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=I993MF4ELR2U type=del 2024-09-12T17:41:57.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.788+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=KGZAFVG5A5GX type=del size=1360519 2024-09-12T17:41:57.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.788+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~OSVFYJYQUFO2.0 size=771822 2024-09-12T17:41:57.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.790+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=OSVFYJYQUFO2 tag=FWX442PSG5MM type=write size=1820398 2024-09-12T17:41:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.792+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.0 size=1048576 2024-09-12T17:41:57.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.793+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.1 size=1048576 2024-09-12T17:41:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.793+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.2 size=850047 2024-09-12T17:41:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.793+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=OVHU2A7NSKH0 tag=4S0GHLV922Q6 type=write size=3995775 2024-09-12T17:41:57.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.795+0000 7f330fbcc780 1 < suggested update operation key=1MJ2W1WMLR85 tag=CBYHQHQTK3TT type=del size=1097223 2024-09-12T17:41:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.796+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=1CYITYOLZWM3 type=del size=3825393 2024-09-12T17:41:57.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.797+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=QGOV5XM9PLFE type=del 2024-09-12T17:41:57.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.799+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~VB2C4A4LABA4.0 size=29707 2024-09-12T17:41:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.799+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=VB2C4A4LABA4 tag=B9SVS93WMKJ7 type=write size=1078283 2024-09-12T17:41:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.801+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~9G5ZLCJSNFYU.0 size=779516 2024-09-12T17:41:57.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.802+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=9G5ZLCJSNFYU tag=ELRTTT5ZD89J type=write size=1828092 2024-09-12T17:41:57.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.804+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=IRWVYTNN80HU type=del size=150044 2024-09-12T17:41:57.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.804+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.0 size=1048576 2024-09-12T17:41:57.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.805+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.1 size=1048576 2024-09-12T17:41:57.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.806+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~O6ZVX2KFI3J0.2 size=100029 2024-09-12T17:41:57.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.808+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=O6ZVX2KFI3J0 tag=PUMT72W2LZ7G type=write size=3245757 2024-09-12T17:41:57.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.810+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~ABA324MOS70G.0 size=1048576 2024-09-12T17:41:57.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.812+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~ABA324MOS70G.1 size=613321 2024-09-12T17:41:57.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.812+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=ABA324MOS70G tag=IWNO3BL232X6 type=write size=2710473 2024-09-12T17:41:57.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.813+0000 7f330fbcc780 1 < completed write operation key=3IHGI1UMI1BA tag=YFON9Q1JGMNE type=write size=1010190 2024-09-12T17:41:57.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.814+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=1XKJR1ASE33Q type=write size=97651 2024-09-12T17:41:57.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.816+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=W2ZXMDQCU2XD type=del 2024-09-12T17:41:57.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.817+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=2JZDB1DR0YH7 type=del size=450735 2024-09-12T17:41:57.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.818+0000 7f330fbcc780 1 < completed write operation key=QE2QJH2J5QDY tag=PD0G62EV1OQ9 type=write size=811915 2024-09-12T17:41:57.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.820+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.0 size=1048576 2024-09-12T17:41:57.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.821+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.1 size=1048576 2024-09-12T17:41:57.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.822+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.2 size=852242 2024-09-12T17:41:57.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.822+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=HK6XTCVL5T3I tag=QU06BYW7VOL7 type=write size=3997970 2024-09-12T17:41:57.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.823+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=DCQPJ4MHWO2J type=del 2024-09-12T17:41:57.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.824+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=FG4ZA08AROIG type=del size=778637 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.826+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=ZPRR1AAVA1JQ type=write size=899112 2024-09-12T17:41:57.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.827+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=7E9ZWB2SHRCG type=del size=3747012 2024-09-12T17:41:57.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.828+0000 7f330fbcc780 1 < completed write operation key=D5ZZ93XAPRAA tag=00KGIMQR20KG type=write size=61503 2024-09-12T17:41:57.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.831+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.0 size=1048576 2024-09-12T17:41:57.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.832+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.1 size=1048576 2024-09-12T17:41:57.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.833+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.2 size=287036 2024-09-12T17:41:57.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.833+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=5IBO7RZ0L9M7 tag=P5DJP4U8T3YB type=write size=3432764 2024-09-12T17:41:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.834+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=UNMCWIF4R96H type=del 2024-09-12T17:41:57.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.836+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~3K4USKOH519X.0 size=1048576 2024-09-12T17:41:57.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.837+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~3K4USKOH519X.1 size=18035 2024-09-12T17:41:57.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.837+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=3K4USKOH519X tag=W1KCOIYNJMH4 type=write size=2115187 2024-09-12T17:41:57.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.839+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=JD3ORL48YF0Y type=del 2024-09-12T17:41:57.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.841+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=YGVFXJ3DNE7X type=del size=1226276 2024-09-12T17:41:57.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.842+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.0 size=1048576 2024-09-12T17:41:57.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.843+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.1 size=1048576 2024-09-12T17:41:57.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.844+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~6245TZWYREYP.2 size=533054 2024-09-12T17:41:57.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.846+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=6245TZWYREYP tag=TOA1JDBEMVAY type=write size=3678782 2024-09-12T17:41:57.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.847+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=8NKOYXQJZL38 type=del size=2761596 2024-09-12T17:41:57.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.848+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=43OX8YRAMKBD type=del 2024-09-12T17:41:57.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.849+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=F323NB0J1H9R type=del size=3254777 2024-09-12T17:41:57.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.851+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=KGZAFVG5A5GX type=del 2024-09-12T17:41:57.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.852+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=7RLPIN7B7L4J type=del size=1766604 2024-09-12T17:41:57.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.853+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.0 size=1048576 2024-09-12T17:41:57.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.854+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.1 size=1048576 2024-09-12T17:41:57.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.855+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~OVHU2A7NSKH0.2 size=850047 2024-09-12T17:41:57.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.857+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=OVHU2A7NSKH0 tag=4S0GHLV922Q6 type=write size=3995775 2024-09-12T17:41:57.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.860+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~JVJ0B0DIP9KZ.0 size=1048576 2024-09-12T17:41:57.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.860+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~JVJ0B0DIP9KZ.1 size=849107 2024-09-12T17:41:57.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.860+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=JVJ0B0DIP9KZ tag=SRESAS37QLJP type=write size=2946259 2024-09-12T17:41:57.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.862+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=1CYITYOLZWM3 type=del 2024-09-12T17:41:57.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.864+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~TKQZ52A6WL3M.0 size=1048576 2024-09-12T17:41:57.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.865+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~TKQZ52A6WL3M.1 size=52762 2024-09-12T17:41:57.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.865+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=TKQZ52A6WL3M tag=EB9LA9QZ6G3A type=write size=2149914 2024-09-12T17:41:57.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.865+0000 7f330fbcc780 1 < canceled part key=_multipart_FY2BXMZBVMDL.2~VB2C4A4LABA4.0 size=29707 2024-09-12T17:41:57.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.867+0000 7f330fbcc780 1 < canceled multipart upload key=FY2BXMZBVMDL upload=VB2C4A4LABA4 tag=B9SVS93WMKJ7 type=write size=1078283 2024-09-12T17:41:57.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.868+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=L5IMZ4HAVEXZ type=del size=2353614 2024-09-12T17:41:57.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.869+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=IRWVYTNN80HU type=del 2024-09-12T17:41:57.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.871+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.0 size=1048576 2024-09-12T17:41:57.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.872+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.1 size=1048576 2024-09-12T17:41:57.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.873+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.2 size=34525 2024-09-12T17:41:57.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.873+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=UH02DUTLWDCQ tag=JRPJ5XNA8OKW type=write size=3180253 2024-09-12T17:41:57.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.874+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~ABA324MOS70G.0 size=1048576 2024-09-12T17:41:57.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.875+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~ABA324MOS70G.1 size=613321 2024-09-12T17:41:57.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.877+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=ABA324MOS70G tag=IWNO3BL232X6 type=write size=2710473 2024-09-12T17:41:57.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.878+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=F0GPYRVXW29C type=write size=633010 2024-09-12T17:41:57.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.879+0000 7f330fbcc780 1 < completed write operation key=6ZDBF249S1L6 tag=1XKJR1ASE33Q type=write size=97651 2024-09-12T17:41:57.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.880+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=68ZDX6MWKFMC type=del size=1773323 2024-09-12T17:41:57.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.881+0000 7f330fbcc780 1 < canceled operation key=30CIXFQV5VBI tag=2JZDB1DR0YH7 type=del size=450735 2024-09-12T17:41:57.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.882+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=1ORGP31J3CK5 type=del size=3571505 2024-09-12T17:41:57.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.883+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.0 size=1048576 2024-09-12T17:41:57.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.884+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.1 size=1048576 2024-09-12T17:41:57.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.886+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HK6XTCVL5T3I.2 size=852242 2024-09-12T17:41:57.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.888+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=HK6XTCVL5T3I tag=QU06BYW7VOL7 type=write size=3997970 2024-09-12T17:41:57.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.889+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=90D8OSXYS0B3 type=del size=1022284 2024-09-12T17:41:57.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.890+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=FG4ZA08AROIG type=del 2024-09-12T17:41:57.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.891+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=KBXD91DPUTUU type=write size=312691 2024-09-12T17:41:57.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.892+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=7E9ZWB2SHRCG type=del 2024-09-12T17:41:57.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.893+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=4FDEWPW45MWH type=del size=2175209 2024-09-12T17:41:57.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.894+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.0 size=1048576 2024-09-12T17:41:57.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.895+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.1 size=1048576 2024-09-12T17:41:57.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.896+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~5IBO7RZ0L9M7.2 size=287036 2024-09-12T17:41:57.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.898+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=5IBO7RZ0L9M7 tag=P5DJP4U8T3YB type=write size=3432764 2024-09-12T17:41:57.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.900+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.0 size=1048576 2024-09-12T17:41:57.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.901+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.1 size=1048576 2024-09-12T17:41:57.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.902+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.2 size=792119 2024-09-12T17:41:57.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.902+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=VYVJLZY19FAK tag=CQVQ22LX2RO6 type=write size=3937847 2024-09-12T17:41:57.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.903+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~3K4USKOH519X.0 size=1048576 2024-09-12T17:41:57.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.904+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~3K4USKOH519X.1 size=18035 2024-09-12T17:41:57.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.906+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=3K4USKOH519X tag=W1KCOIYNJMH4 type=write size=2115187 2024-09-12T17:41:57.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.908+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.0 size=1048576 2024-09-12T17:41:57.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.909+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.1 size=1048576 2024-09-12T17:41:57.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.909+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.2 size=1018881 2024-09-12T17:41:57.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.909+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=XP84H9S742WE tag=7BK36NINE0XP type=write size=4164609 2024-09-12T17:41:57.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.910+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=YGVFXJ3DNE7X type=del 2024-09-12T17:41:57.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.912+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.0 size=1048576 2024-09-12T17:41:57.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.913+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.1 size=1048576 2024-09-12T17:41:57.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.914+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.2 size=334520 2024-09-12T17:41:57.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.914+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=BHUZ4LI3L2AQ tag=YUAR3E5ZA8PR type=write size=3480248 2024-09-12T17:41:57.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.915+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=8NKOYXQJZL38 type=del 2024-09-12T17:41:57.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.916+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=KNS3510LZ7DE type=del size=3905354 2024-09-12T17:41:57.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.917+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=F323NB0J1H9R type=del 2024-09-12T17:41:57.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.918+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=58PHZK8X43V0 type=del size=1358711 2024-09-12T17:41:57.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.920+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=7RLPIN7B7L4J type=del 2024-09-12T17:41:57.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.921+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=HNI454FR7Y3D type=del size=3368761 2024-09-12T17:41:57.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.922+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~JVJ0B0DIP9KZ.0 size=1048576 2024-09-12T17:41:57.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.923+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~JVJ0B0DIP9KZ.1 size=849107 2024-09-12T17:41:57.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.925+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=JVJ0B0DIP9KZ tag=SRESAS37QLJP type=write size=2946259 2024-09-12T17:41:57.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.926+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=CU3I4FNWR2R9 type=del size=597256 2024-09-12T17:41:57.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.927+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~TKQZ52A6WL3M.0 size=1048576 2024-09-12T17:41:57.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.928+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~TKQZ52A6WL3M.1 size=52762 2024-09-12T17:41:57.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.930+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=TKQZ52A6WL3M tag=EB9LA9QZ6G3A type=write size=2149914 2024-09-12T17:41:57.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.931+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=K2CGB91BIQW9 type=write size=564427 2024-09-12T17:41:57.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.934+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=L5IMZ4HAVEXZ type=del 2024-09-12T17:41:57.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.936+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.0 size=1048576 2024-09-12T17:41:57.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.937+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.1 size=1048576 2024-09-12T17:41:57.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.938+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.2 size=91297 2024-09-12T17:41:57.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.938+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=5NJ1O1B6PKJP tag=P76F6HSM65BL type=write size=3237025 2024-09-12T17:41:57.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.940+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.0 size=1048576 2024-09-12T17:41:57.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.941+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.1 size=1048576 2024-09-12T17:41:57.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.942+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~UH02DUTLWDCQ.2 size=34525 2024-09-12T17:41:57.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.944+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=UH02DUTLWDCQ tag=JRPJ5XNA8OKW type=write size=3180253 2024-09-12T17:41:57.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.945+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=8CZSUQUTGZNK type=write size=859796 2024-09-12T17:41:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.946+0000 7f330fbcc780 1 < completed write operation key=50WR6KLF40W7 tag=F0GPYRVXW29C type=write size=633010 2024-09-12T17:41:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.948+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=3OFYATWZUYT8 type=write size=623949 2024-09-12T17:41:57.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.949+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=68ZDX6MWKFMC type=del 2024-09-12T17:41:57.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.950+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=I14TMDA9UJW2 type=del size=1459564 2024-09-12T17:41:57.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.953+0000 7f330fbcc780 1 < suggested update operation key=6MFVO30OX5W1 tag=1ORGP31J3CK5 type=del size=3571505 2024-09-12T17:41:57.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.955+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~VANHPFU350BZ.0 size=1048576 2024-09-12T17:41:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.956+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~VANHPFU350BZ.1 size=81793 2024-09-12T17:41:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.956+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=VANHPFU350BZ tag=DP0XX2JOTRZY type=write size=2178945 2024-09-12T17:41:57.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.958+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=90D8OSXYS0B3 type=del size=1022284 2024-09-12T17:41:57.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.959+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=SIYE513IH3WE type=write size=775086 2024-09-12T17:41:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.961+0000 7f330fbcc780 1 < completed write operation key=9IYALJED5G85 tag=KBXD91DPUTUU type=write size=312691 2024-09-12T17:41:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.962+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=KCSW14NI10UD type=del size=795206 2024-09-12T17:41:57.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.964+0000 7f330fbcc780 1 < suggested remove operation key=D5ZZ93XAPRAA tag=4FDEWPW45MWH type=del 2024-09-12T17:41:57.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.966+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~4714K0P1V1WA.0 size=314352 2024-09-12T17:41:57.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.966+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=4714K0P1V1WA tag=GL755RO0J28A type=write size=1362928 2024-09-12T17:41:57.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.967+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.0 size=1048576 2024-09-12T17:41:57.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.968+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.1 size=1048576 2024-09-12T17:41:57.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.969+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~VYVJLZY19FAK.2 size=792119 2024-09-12T17:41:57.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.971+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=VYVJLZY19FAK tag=CQVQ22LX2RO6 type=write size=3937847 2024-09-12T17:41:57.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.972+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=5FJB38IKGPMO type=del size=2574984 2024-09-12T17:41:57.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.972+0000 7f330fbcc780 1 < canceled part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.0 size=1048576 2024-09-12T17:41:57.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.973+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.1 size=1048576 2024-09-12T17:41:57.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.974+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~XP84H9S742WE.2 size=1018881 2024-09-12T17:41:57.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.976+0000 7f330fbcc780 1 < canceled multipart upload key=9IYALJED5G85 upload=XP84H9S742WE tag=7BK36NINE0XP type=write size=4164609 2024-09-12T17:41:57.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.977+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=CC1Z46IUCME2 type=del size=345438 2024-09-12T17:41:57.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.979+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.0 size=1048576 2024-09-12T17:41:57.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.979+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.1 size=1048576 2024-09-12T17:41:57.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.980+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~BHUZ4LI3L2AQ.2 size=334520 2024-09-12T17:41:57.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.982+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=BHUZ4LI3L2AQ tag=YUAR3E5ZA8PR type=write size=3480248 2024-09-12T17:41:57.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.983+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=3AHK7IZH0V80 type=del size=1160315 2024-09-12T17:41:57.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.984+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=KNS3510LZ7DE type=del 2024-09-12T17:41:57.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.986+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.0 size=1048576 2024-09-12T17:41:57.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.987+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.1 size=1048576 2024-09-12T17:41:57.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.988+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.2 size=820929 2024-09-12T17:41:57.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.988+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=6RJ00ACO06H7 tag=OV4XWN7BAGL2 type=write size=3966657 2024-09-12T17:41:57.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.989+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=58PHZK8X43V0 type=del 2024-09-12T17:41:57.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.991+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=BDGZ724HU8YT type=del size=1146344 2024-09-12T17:41:57.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.992+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=HNI454FR7Y3D type=del 2024-09-12T17:41:57.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.995+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.0 size=1048576 2024-09-12T17:41:57.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.995+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.1 size=1048576 2024-09-12T17:41:57.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.996+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.2 size=1018733 2024-09-12T17:41:57.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.996+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=HU5L52NPNJU7 tag=KRYUKAOQNKCN type=write size=4164461 2024-09-12T17:41:57.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.998+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=CU3I4FNWR2R9 type=del 2024-09-12T17:41:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:57.999+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=937OYPVDKTB4 type=write size=882090 2024-09-12T17:41:58.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.000+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=K2CGB91BIQW9 type=write size=564427 2024-09-12T17:41:58.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.002+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.0 size=1048576 2024-09-12T17:41:58.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.003+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.1 size=1048576 2024-09-12T17:41:58.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.004+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.2 size=652469 2024-09-12T17:41:58.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.004+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=RCR6CDTBTEJR tag=347WQPJWNMHV type=write size=3798197 2024-09-12T17:41:58.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.004+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.0 size=1048576 2024-09-12T17:41:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.005+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.1 size=1048576 2024-09-12T17:41:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.006+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~5NJ1O1B6PKJP.2 size=91297 2024-09-12T17:41:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.008+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=5NJ1O1B6PKJP tag=P76F6HSM65BL type=write size=3237025 2024-09-12T17:41:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.010+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.0 size=1048576 2024-09-12T17:41:58.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.010+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.1 size=1048576 2024-09-12T17:41:58.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.011+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.2 size=176102 2024-09-12T17:41:58.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.011+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=491Y3W1B52CB tag=VB165Y6VEY8D type=write size=3321830 2024-09-12T17:41:58.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.012+0000 7f330fbcc780 1 < completed write operation key=7TBNLJDCL4YB tag=8CZSUQUTGZNK type=write size=859796 2024-09-12T17:41:58.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.014+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=5MXSAH725TZI type=del size=1860400 2024-09-12T17:41:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.016+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=3OFYATWZUYT8 type=write 2024-09-12T17:41:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.017+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=WX7YJGD9D2BN type=del size=3192393 2024-09-12T17:41:58.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.019+0000 7f330fbcc780 1 < suggested remove operation key=SPKBX4WU9A9R tag=I14TMDA9UJW2 type=del 2024-09-12T17:41:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.021+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~SO5TBRF025XX.0 size=70747 2024-09-12T17:41:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.021+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=SO5TBRF025XX tag=WKFPHLMV3SQJ type=write size=1119323 2024-09-12T17:41:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.022+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~VANHPFU350BZ.0 size=1048576 2024-09-12T17:41:58.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.023+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~VANHPFU350BZ.1 size=81793 2024-09-12T17:41:58.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.025+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=VANHPFU350BZ tag=DP0XX2JOTRZY type=write size=2178945 2024-09-12T17:41:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.026+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=RN7P6P8NJ5HN type=del size=1502738 2024-09-12T17:41:58.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.027+0000 7f330fbcc780 1 < completed write operation key=QE2QJH2J5QDY tag=SIYE513IH3WE type=write size=775086 2024-09-12T17:41:58.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.028+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=SX0NYG44QXHK type=del size=1036284 2024-09-12T17:41:58.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.029+0000 7f330fbcc780 -1 < failed to complete operation key=SPKBX4WU9A9R tag=KCSW14NI10UD type=del size=795206: (22) Invalid argument 2024-09-12T17:41:58.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.030+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=R6TZM37UQPD5 type=del size=1819031 2024-09-12T17:41:58.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.031+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~4714K0P1V1WA.0 size=314352 2024-09-12T17:41:58.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.033+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=4714K0P1V1WA tag=GL755RO0J28A type=write size=1362928 2024-09-12T17:41:58.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.034+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=33CGQMAVPFTB type=del size=452336 2024-09-12T17:41:58.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.035+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=5FJB38IKGPMO type=del size=2574984 2024-09-12T17:41:58.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.036+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=EC99T929AAFO type=del size=1770550 2024-09-12T17:41:58.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.037+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=CC1Z46IUCME2 type=del 2024-09-12T17:41:58.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.038+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=XACIFW4Q7RNS type=del size=3995955 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.040+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=3AHK7IZH0V80 type=del 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.042+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~ITI5OJ1678RH.0 size=25920 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.042+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=ITI5OJ1678RH tag=3QHDN3QOVWM8 type=write size=1074496 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.043+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.0 size=1048576 2024-09-12T17:41:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.043+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.1 size=1048576 2024-09-12T17:41:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.043+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~6RJ00ACO06H7.2 size=820929 2024-09-12T17:41:58.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.045+0000 7f330fbcc780 1 < canceled multipart upload key=AGM33OK1W7A6 upload=6RJ00ACO06H7 tag=OV4XWN7BAGL2 type=write size=3966657 2024-09-12T17:41:58.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.046+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~5U98JPLCCWSJ.0 size=417477 2024-09-12T17:41:58.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.046+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=5U98JPLCCWSJ tag=MU9THNLKYWJE type=write size=1466053 2024-09-12T17:41:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.049+0000 7f330fbcc780 1 < suggested update operation key=MQV01X5P8JLG tag=BDGZ724HU8YT type=del size=1146344 2024-09-12T17:41:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.050+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=RPWCL2TH6IO4 type=del size=1206325 2024-09-12T17:41:58.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.051+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.0 size=1048576 2024-09-12T17:41:58.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.052+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.1 size=1048576 2024-09-12T17:41:58.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.052+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~HU5L52NPNJU7.2 size=1018733 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.054+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=HU5L52NPNJU7 tag=KRYUKAOQNKCN type=write size=4164461 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.055+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=6R07RTCJ5OXA type=del size=2365691 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.057+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=937OYPVDKTB4 type=write size=882090 2024-09-12T17:41:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.059+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~LZ4YXOW0DDUX.0 size=436751 2024-09-12T17:41:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.059+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=LZ4YXOW0DDUX tag=69JDXFZ98BGO type=write size=1485327 2024-09-12T17:41:58.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.060+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.0 size=1048576 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.061+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.1 size=1048576 2024-09-12T17:41:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.062+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~RCR6CDTBTEJR.2 size=652469 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.064+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=RCR6CDTBTEJR tag=347WQPJWNMHV type=write size=3798197 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.067+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~F2JR1BARHL8X.0 size=1048576 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.068+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~F2JR1BARHL8X.1 size=835797 2024-09-12T17:41:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.068+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=F2JR1BARHL8X tag=KYO4HLSIQEDF type=write size=2932949 2024-09-12T17:41:58.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.069+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.0 size=1048576 2024-09-12T17:41:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.070+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.1 size=1048576 2024-09-12T17:41:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.070+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~491Y3W1B52CB.2 size=176102 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.072+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=491Y3W1B52CB tag=VB165Y6VEY8D type=write size=3321830 2024-09-12T17:41:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.074+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.0 size=1048576 2024-09-12T17:41:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.075+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.1 size=1048576 2024-09-12T17:41:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.076+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.2 size=706801 2024-09-12T17:41:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.076+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=ACS3CM4V730A tag=5S2YFUEJFJQ3 type=write size=3852529 2024-09-12T17:41:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.077+0000 7f330fbcc780 -1 < failed to complete operation key=SPKBX4WU9A9R tag=5MXSAH725TZI type=del size=1860400: (22) Invalid argument 2024-09-12T17:41:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.079+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~94IO7UAITMPU.0 size=857208 2024-09-12T17:41:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.079+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=94IO7UAITMPU tag=FHDLMMSFCK97 type=write size=1905784 2024-09-12T17:41:58.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.080+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=WX7YJGD9D2BN type=del 2024-09-12T17:41:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.081+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=7NQZ0QR5O778 type=write size=161543 2024-09-12T17:41:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.081+0000 7f330fbcc780 1 < canceled part key=_multipart_3IHGI1UMI1BA.2~SO5TBRF025XX.0 size=70747 2024-09-12T17:41:58.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.083+0000 7f330fbcc780 1 < canceled multipart upload key=3IHGI1UMI1BA upload=SO5TBRF025XX tag=WKFPHLMV3SQJ type=write size=1119323 2024-09-12T17:41:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.084+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=P3TYTXXJDSBP type=del size=538060 2024-09-12T17:41:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.085+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=RN7P6P8NJ5HN type=del 2024-09-12T17:41:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.086+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=JBP54O4EYSM1 type=del size=469892 2024-09-12T17:41:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.089+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=SX0NYG44QXHK type=del 2024-09-12T17:41:58.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.090+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=OOVR0011EJMO type=del size=48036 2024-09-12T17:41:58.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.092+0000 7f330fbcc780 1 < suggested update operation key=HJL73WQD8SD2 tag=R6TZM37UQPD5 type=del size=1819031 2024-09-12T17:41:58.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.093+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=6NXH3BCY6IA5 type=write size=518818 2024-09-12T17:41:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.094+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=33CGQMAVPFTB type=del 2024-09-12T17:41:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.095+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=SHD9LC6N8WVD type=write size=183863 2024-09-12T17:41:58.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.097+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=EC99T929AAFO type=del 2024-09-12T17:41:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.099+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=8ETMAKPZ0IR6 type=del size=1761574 2024-09-12T17:41:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.100+0000 7f330fbcc780 -1 < failed to complete operation key=MQV01X5P8JLG tag=XACIFW4Q7RNS type=del size=3995955: (22) Invalid argument 2024-09-12T17:41:58.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.101+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=7I71S00DYB6G type=del size=4076947 2024-09-12T17:41:58.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.102+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~ITI5OJ1678RH.0 size=25920 2024-09-12T17:41:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.104+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=ITI5OJ1678RH tag=3QHDN3QOVWM8 type=write size=1074496 2024-09-12T17:41:58.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.105+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=1P4JZH3MT79H type=write size=1024240 2024-09-12T17:41:58.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.106+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~5U98JPLCCWSJ.0 size=417477 2024-09-12T17:41:58.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.108+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=5U98JPLCCWSJ tag=MU9THNLKYWJE type=write size=1466053 2024-09-12T17:41:58.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.110+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=1JGTYP70TAIR type=del size=1204824 2024-09-12T17:41:58.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.111+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=RPWCL2TH6IO4 type=del 2024-09-12T17:41:58.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.113+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~XL25IBHNL6EB.0 size=765647 2024-09-12T17:41:58.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.113+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=XL25IBHNL6EB tag=WVS7MU4DIV2D type=write size=1814223 2024-09-12T17:41:58.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.114+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=6R07RTCJ5OXA type=del 2024-09-12T17:41:58.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.116+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.0 size=1048576 2024-09-12T17:41:58.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.117+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.1 size=1048576 2024-09-12T17:41:58.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.118+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.2 size=506057 2024-09-12T17:41:58.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.118+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=632ZYI9L21HQ tag=4WJXHPEGK25M type=write size=3651785 2024-09-12T17:41:58.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.120+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~LZ4YXOW0DDUX.0 size=436751 2024-09-12T17:41:58.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.121+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=LZ4YXOW0DDUX tag=69JDXFZ98BGO type=write size=1485327 2024-09-12T17:41:58.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.122+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=Q3RLHB9QS5AC type=del size=901429 2024-09-12T17:41:58.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.123+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~F2JR1BARHL8X.0 size=1048576 2024-09-12T17:41:58.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.123+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~F2JR1BARHL8X.1 size=835797 2024-09-12T17:41:58.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.124+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=F2JR1BARHL8X tag=KYO4HLSIQEDF type=write size=2932949 2024-09-12T17:41:58.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.126+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~M6IN72G3XPPE.0 size=986504 2024-09-12T17:41:58.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.126+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=M6IN72G3XPPE tag=25R4F80ZD2L9 type=write size=2035080 2024-09-12T17:41:58.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.127+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.0 size=1048576 2024-09-12T17:41:58.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.128+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.1 size=1048576 2024-09-12T17:41:58.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.129+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~ACS3CM4V730A.2 size=706801 2024-09-12T17:41:58.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.131+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=ACS3CM4V730A tag=5S2YFUEJFJQ3 type=write size=3852529 2024-09-12T17:41:58.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.132+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=05SJRFHIOYV2 type=del size=2014960 2024-09-12T17:41:58.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.133+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~94IO7UAITMPU.0 size=857208 2024-09-12T17:41:58.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.135+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=94IO7UAITMPU tag=FHDLMMSFCK97 type=write size=1905784 2024-09-12T17:41:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.137+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.0 size=1048576 2024-09-12T17:41:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.137+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.1 size=1048576 2024-09-12T17:41:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.138+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.2 size=929889 2024-09-12T17:41:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.138+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=UW2N9YQ01KZ2 tag=S3OYTJ0DW56L type=write size=4075617 2024-09-12T17:41:58.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.139+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=7NQZ0QR5O778 type=write size=161543 2024-09-12T17:41:58.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.140+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=2LWNEYVKFNY2 type=del size=3024022 2024-09-12T17:41:58.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.142+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=P3TYTXXJDSBP type=del 2024-09-12T17:41:58.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.143+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=OCAL2TBP9GE0 type=del size=1452547 2024-09-12T17:41:58.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.145+0000 7f330fbcc780 1 < suggested update operation key=30CIXFQV5VBI tag=JBP54O4EYSM1 type=del size=469892 2024-09-12T17:41:58.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.146+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=D6QRZTMMQXKT type=del size=1783497 2024-09-12T17:41:58.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.147+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=OOVR0011EJMO type=del 2024-09-12T17:41:58.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.148+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=8OC3K6SO3JN8 type=del size=2927369 2024-09-12T17:41:58.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.149+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=6NXH3BCY6IA5 type=write size=518818 2024-09-12T17:41:58.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.151+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.0 size=1048576 2024-09-12T17:41:58.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.152+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.1 size=1048576 2024-09-12T17:41:58.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.153+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.2 size=673669 2024-09-12T17:41:58.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.153+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=8VOZG11IPBPT tag=DZCZVT4YOV5J type=write size=3819397 2024-09-12T17:41:58.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.154+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=SHD9LC6N8WVD type=write size=183863 2024-09-12T17:41:58.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.155+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=S3SRN70QBWA1 type=del size=2328847 2024-09-12T17:41:58.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.157+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=8ETMAKPZ0IR6 type=del 2024-09-12T17:41:58.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.158+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=R60DVYUA6WZU type=del size=3396934 2024-09-12T17:41:58.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.160+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=7I71S00DYB6G type=del 2024-09-12T17:41:58.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.162+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.0 size=1048576 2024-09-12T17:41:58.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.163+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.1 size=1048576 2024-09-12T17:41:58.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.164+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.2 size=822327 2024-09-12T17:41:58.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.164+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=A2ZC0IQBRQK2 tag=6PYO70LOLISB type=write size=3968055 2024-09-12T17:41:58.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.165+0000 7f330fbcc780 1 < completed write operation key=9IYALJED5G85 tag=1P4JZH3MT79H type=write size=1024240 2024-09-12T17:41:58.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.167+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~GH9AOXKMVXUM.0 size=1048576 2024-09-12T17:41:58.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.168+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~GH9AOXKMVXUM.1 size=34879 2024-09-12T17:41:58.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.168+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=GH9AOXKMVXUM tag=3ZG53ITGHE3L type=write size=2132031 2024-09-12T17:41:58.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.170+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=1JGTYP70TAIR type=del 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.171+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~Y4P31AN175PS.0 size=244085 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.171+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=Y4P31AN175PS tag=ENKY82YTY9JD type=write size=1292661 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.172+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~XL25IBHNL6EB.0 size=765647 2024-09-12T17:41:58.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.174+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=XL25IBHNL6EB tag=WVS7MU4DIV2D type=write size=1814223 2024-09-12T17:41:58.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.176+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=WRGN6J6O2KWZ type=del size=1014505 2024-09-12T17:41:58.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.177+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.0 size=1048576 2024-09-12T17:41:58.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.178+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.1 size=1048576 2024-09-12T17:41:58.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.179+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~632ZYI9L21HQ.2 size=506057 2024-09-12T17:41:58.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.181+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=632ZYI9L21HQ tag=4WJXHPEGK25M type=write size=3651785 2024-09-12T17:41:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.182+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=0BZAXW6GZZ73 type=del size=231668 2024-09-12T17:41:58.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.183+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=Q3RLHB9QS5AC type=del 2024-09-12T17:41:58.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.184+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=USCD36OURFCK type=del size=2620870 2024-09-12T17:41:58.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.185+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~M6IN72G3XPPE.0 size=986504 2024-09-12T17:41:58.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.187+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=M6IN72G3XPPE tag=25R4F80ZD2L9 type=write size=2035080 2024-09-12T17:41:58.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.188+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=I5Y0MTA6OWB9 type=write size=962268 2024-09-12T17:41:58.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.189+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=05SJRFHIOYV2 type=del 2024-09-12T17:41:58.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.191+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~MG6UL4GRO7N9.0 size=122619 2024-09-12T17:41:58.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.191+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=MG6UL4GRO7N9 tag=JPQWJXID26H1 type=write size=1171195 2024-09-12T17:41:58.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.192+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.0 size=1048576 2024-09-12T17:41:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.193+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.1 size=1048576 2024-09-12T17:41:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.194+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~UW2N9YQ01KZ2.2 size=929889 2024-09-12T17:41:58.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.196+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=UW2N9YQ01KZ2 tag=S3OYTJ0DW56L type=write size=4075617 2024-09-12T17:41:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.197+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=E368HDX1RN3V type=del size=2595885 2024-09-12T17:41:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.199+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=2LWNEYVKFNY2 type=del 2024-09-12T17:41:58.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.201+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~765Y9OVDW1S0.0 size=884689 2024-09-12T17:41:58.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.201+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=765Y9OVDW1S0 tag=EX445V9VIAZD type=write size=1933265 2024-09-12T17:41:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.203+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=OCAL2TBP9GE0 type=del 2024-09-12T17:41:58.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.205+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.0 size=1048576 2024-09-12T17:41:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.206+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.1 size=1048576 2024-09-12T17:41:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.207+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.2 size=350908 2024-09-12T17:41:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.207+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=OOW67J73H5VB tag=RKOGA6OQ6NAE type=write size=3496636 2024-09-12T17:41:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.208+0000 7f330fbcc780 1 < canceled operation key=3BU8T85GXCX4 tag=D6QRZTMMQXKT type=del size=1783497 2024-09-12T17:41:58.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.209+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=6Y5GKZ023M42 type=write size=786876 2024-09-12T17:41:58.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.210+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=8OC3K6SO3JN8 type=del 2024-09-12T17:41:58.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.212+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~NE2PIGWK4FD9.0 size=1048576 2024-09-12T17:41:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.213+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~NE2PIGWK4FD9.1 size=53009 2024-09-12T17:41:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.213+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=NE2PIGWK4FD9 tag=VH4KW6D8PVV0 type=write size=2150161 2024-09-12T17:41:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.214+0000 7f330fbcc780 1 < canceled part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.0 size=1048576 2024-09-12T17:41:58.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.214+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.1 size=1048576 2024-09-12T17:41:58.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.215+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~8VOZG11IPBPT.2 size=673669 2024-09-12T17:41:58.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.217+0000 7f330fbcc780 1 < canceled multipart upload key=5QBSRDY0LJ60 upload=8VOZG11IPBPT tag=DZCZVT4YOV5J type=write size=3819397 2024-09-12T17:41:58.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.218+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=XVLSLHB0F5SG type=write size=424893 2024-09-12T17:41:58.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.221+0000 7f330fbcc780 1 < suggested remove operation key=D5ZZ93XAPRAA tag=S3SRN70QBWA1 type=del 2024-09-12T17:41:58.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.222+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=68ETVN1HJBPT type=del size=2075879 2024-09-12T17:41:58.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.223+0000 7f330fbcc780 1 < canceled operation key=TKJOJ17LIWX6 tag=R60DVYUA6WZU type=del size=3396934 2024-09-12T17:41:58.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.224+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=360O9T7X1O5D type=write size=863320 2024-09-12T17:41:58.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.225+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.0 size=1048576 2024-09-12T17:41:58.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.226+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.1 size=1048576 2024-09-12T17:41:58.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.226+0000 7f330fbcc780 1 < canceled part key=_multipart_5QBSRDY0LJ60.2~A2ZC0IQBRQK2.2 size=822327 2024-09-12T17:41:58.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.228+0000 7f330fbcc780 1 < canceled multipart upload key=5QBSRDY0LJ60 upload=A2ZC0IQBRQK2 tag=6PYO70LOLISB type=write size=3968055 2024-09-12T17:41:58.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.230+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~0Q89PT433QQ9.0 size=1048576 2024-09-12T17:41:58.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.231+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~0Q89PT433QQ9.1 size=557380 2024-09-12T17:41:58.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.231+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=0Q89PT433QQ9 tag=O18PC94OL8VH type=write size=2654532 2024-09-12T17:41:58.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.232+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~GH9AOXKMVXUM.0 size=1048576 2024-09-12T17:41:58.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.233+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~GH9AOXKMVXUM.1 size=34879 2024-09-12T17:41:58.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.235+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=GH9AOXKMVXUM tag=3ZG53ITGHE3L type=write size=2132031 2024-09-12T17:41:58.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.236+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=DV0TP29MXRLJ type=del size=75981 2024-09-12T17:41:58.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.238+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~Y4P31AN175PS.0 size=244085 2024-09-12T17:41:58.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.240+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=Y4P31AN175PS tag=ENKY82YTY9JD type=write size=1292661 2024-09-12T17:41:58.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.241+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=TXPYG8E7W9TZ type=del size=4167410 2024-09-12T17:41:58.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.242+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=WRGN6J6O2KWZ type=del 2024-09-12T17:41:58.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.243+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=XP048NM0MQS5 type=del size=1370509 2024-09-12T17:41:58.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.244+0000 7f330fbcc780 1 < canceled operation key=MQV01X5P8JLG tag=0BZAXW6GZZ73 type=del size=231668 2024-09-12T17:41:58.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.245+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=NL9AI0TJUW7M type=del size=831840 2024-09-12T17:41:58.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.246+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=USCD36OURFCK type=del 2024-09-12T17:41:58.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.248+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.0 size=1048576 2024-09-12T17:41:58.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.249+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.1 size=1048576 2024-09-12T17:41:58.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.250+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.2 size=448313 2024-09-12T17:41:58.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.250+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=WTE3AXB12315 tag=0GJO4Q2RSG7Q type=write size=3594041 2024-09-12T17:41:58.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.251+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=I5Y0MTA6OWB9 type=write size=962268 2024-09-12T17:41:58.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.253+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~M1RWO004V3D8.0 size=199742 2024-09-12T17:41:58.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.253+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=M1RWO004V3D8 tag=S1N6UO4Q3PF5 type=write size=1248318 2024-09-12T17:41:58.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.254+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~MG6UL4GRO7N9.0 size=122619 2024-09-12T17:41:58.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.256+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=MG6UL4GRO7N9 tag=JPQWJXID26H1 type=write size=1171195 2024-09-12T17:41:58.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.257+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=6DKXA03W91OB type=del size=94132 2024-09-12T17:41:58.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.258+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=E368HDX1RN3V type=del 2024-09-12T17:41:58.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.261+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.0 size=1048576 2024-09-12T17:41:58.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.261+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.1 size=1048576 2024-09-12T17:41:58.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.262+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.2 size=443197 2024-09-12T17:41:58.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.262+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=SY7AIJDWBYJX tag=E7ZPEKNTQ818 type=write size=3588925 2024-09-12T17:41:58.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.263+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~765Y9OVDW1S0.0 size=884689 2024-09-12T17:41:58.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.264+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=765Y9OVDW1S0 tag=EX445V9VIAZD type=write size=1933265 2024-09-12T17:41:58.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.266+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.0 size=1048576 2024-09-12T17:41:58.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.267+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.1 size=1048576 2024-09-12T17:41:58.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.268+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.2 size=711406 2024-09-12T17:41:58.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.268+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=EI7BP5JGL4R5 tag=3YA03CP897LY type=write size=3857134 2024-09-12T17:41:58.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.270+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.0 size=1048576 2024-09-12T17:41:58.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.271+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.1 size=1048576 2024-09-12T17:41:58.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.272+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~OOW67J73H5VB.2 size=350908 2024-09-12T17:41:58.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.274+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=OOW67J73H5VB tag=RKOGA6OQ6NAE type=write size=3496636 2024-09-12T17:41:58.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.276+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.0 size=1048576 2024-09-12T17:41:58.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.277+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.1 size=1048576 2024-09-12T17:41:58.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.277+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.2 size=687565 2024-09-12T17:41:58.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.277+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=2WHWT355QNLX tag=0H1859ZZ9IUJ type=write size=3833293 2024-09-12T17:41:58.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.279+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=6Y5GKZ023M42 type=write size=786876 2024-09-12T17:41:58.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.280+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=E1KXNGUN5AIJ type=write size=368654 2024-09-12T17:41:58.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.281+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~NE2PIGWK4FD9.0 size=1048576 2024-09-12T17:41:58.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.282+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~NE2PIGWK4FD9.1 size=53009 2024-09-12T17:41:58.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.284+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=NE2PIGWK4FD9 tag=VH4KW6D8PVV0 type=write size=2150161 2024-09-12T17:41:58.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.286+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.0 size=1048576 2024-09-12T17:41:58.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.287+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.1 size=1048576 2024-09-12T17:41:58.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.287+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.2 size=754490 2024-09-12T17:41:58.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.287+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=IVQS224DNFF5 tag=H1G3AHNIECZ3 type=write size=3900218 2024-09-12T17:41:58.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.289+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=XVLSLHB0F5SG type=write size=424893 2024-09-12T17:41:58.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.291+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~IGK708Q1GPS1.0 size=1048576 2024-09-12T17:41:58.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.291+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~IGK708Q1GPS1.1 size=686265 2024-09-12T17:41:58.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.291+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=IGK708Q1GPS1 tag=14SCW51IDDX4 type=write size=2783417 2024-09-12T17:41:58.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.293+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=68ETVN1HJBPT type=del 2024-09-12T17:41:58.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.294+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=SCFA42NS59AE type=del size=2509350 2024-09-12T17:41:58.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.295+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=360O9T7X1O5D type=write size=863320 2024-09-12T17:41:58.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.296+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=UCNF00P96RLD type=del size=1977051 2024-09-12T17:41:58.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.297+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~0Q89PT433QQ9.0 size=1048576 2024-09-12T17:41:58.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.298+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~0Q89PT433QQ9.1 size=557380 2024-09-12T17:41:58.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.300+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=0Q89PT433QQ9 tag=O18PC94OL8VH type=write size=2654532 2024-09-12T17:41:58.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.302+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~ZOAIOJ6CADKB.0 size=407169 2024-09-12T17:41:58.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.302+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=ZOAIOJ6CADKB tag=6LLIO9FZJL01 type=write size=1455745 2024-09-12T17:41:58.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.303+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=DV0TP29MXRLJ type=del 2024-09-12T17:41:58.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.305+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~RFZXVF9RSSOU.0 size=1048576 2024-09-12T17:41:58.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.307+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~RFZXVF9RSSOU.1 size=702802 2024-09-12T17:41:58.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.307+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=RFZXVF9RSSOU tag=7AELQOFZP3KJ type=write size=2799954 2024-09-12T17:41:58.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.308+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=TXPYG8E7W9TZ type=del 2024-09-12T17:41:58.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.309+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=1IKVL53YFT46 type=del size=678468 2024-09-12T17:41:58.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.310+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=XP048NM0MQS5 type=del 2024-09-12T17:41:58.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.312+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=P1993BA9S8S1 type=write size=53599 2024-09-12T17:41:58.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.313+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=NL9AI0TJUW7M type=del 2024-09-12T17:41:58.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.314+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=I00MIQWEDCF7 type=del size=3331112 2024-09-12T17:41:58.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.314+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.0 size=1048576 2024-09-12T17:41:58.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.314+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.1 size=1048576 2024-09-12T17:41:58.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.315+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~WTE3AXB12315.2 size=448313 2024-09-12T17:41:58.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.317+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=WTE3AXB12315 tag=0GJO4Q2RSG7Q type=write size=3594041 2024-09-12T17:41:58.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.318+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=32FXGS2I0HWL type=del size=1289813 2024-09-12T17:41:58.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.319+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~M1RWO004V3D8.0 size=199742 2024-09-12T17:41:58.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.321+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=M1RWO004V3D8 tag=S1N6UO4Q3PF5 type=write size=1248318 2024-09-12T17:41:58.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.322+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=820PL5Z09YF8 type=del size=1951595 2024-09-12T17:41:58.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.323+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=6DKXA03W91OB type=del 2024-09-12T17:41:58.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.325+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~EZOMF7Y3WH67.0 size=1006349 2024-09-12T17:41:58.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.325+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=EZOMF7Y3WH67 tag=Y1CDIZDMRQOG type=write size=2054925 2024-09-12T17:41:58.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.326+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.0 size=1048576 2024-09-12T17:41:58.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.327+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.1 size=1048576 2024-09-12T17:41:58.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.328+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~SY7AIJDWBYJX.2 size=443197 2024-09-12T17:41:58.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.330+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=SY7AIJDWBYJX tag=E7ZPEKNTQ818 type=write size=3588925 2024-09-12T17:41:58.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.331+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=49DMDT5WIEPG type=del size=1960249 2024-09-12T17:41:58.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.332+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.0 size=1048576 2024-09-12T17:41:58.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.333+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.1 size=1048576 2024-09-12T17:41:58.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.334+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~EI7BP5JGL4R5.2 size=711406 2024-09-12T17:41:58.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.336+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=EI7BP5JGL4R5 tag=3YA03CP897LY type=write size=3857134 2024-09-12T17:41:58.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.338+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.0 size=1048576 2024-09-12T17:41:58.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.339+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.1 size=1048576 2024-09-12T17:41:58.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.340+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.2 size=244319 2024-09-12T17:41:58.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.340+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=HB9EACH9BWGI tag=XEX6E8WKNYUN type=write size=3390047 2024-09-12T17:41:58.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.341+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.0 size=1048576 2024-09-12T17:41:58.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.342+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.1 size=1048576 2024-09-12T17:41:58.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.343+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~2WHWT355QNLX.2 size=687565 2024-09-12T17:41:58.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.345+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=2WHWT355QNLX tag=0H1859ZZ9IUJ type=write size=3833293 2024-09-12T17:41:58.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.348+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C7Y9E4Q9KK1Y.0 size=1048576 2024-09-12T17:41:58.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.348+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C7Y9E4Q9KK1Y.1 size=542640 2024-09-12T17:41:58.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.348+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=C7Y9E4Q9KK1Y tag=CKDUCHAHJYFL type=write size=2639792 2024-09-12T17:41:58.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.351+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=E1KXNGUN5AIJ type=write 2024-09-12T17:41:58.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.352+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=O4ZY90NJK7UT type=del size=670995 2024-09-12T17:41:58.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.353+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.0 size=1048576 2024-09-12T17:41:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.354+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.1 size=1048576 2024-09-12T17:41:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.355+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~IVQS224DNFF5.2 size=754490 2024-09-12T17:41:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.357+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=IVQS224DNFF5 tag=H1G3AHNIECZ3 type=write size=3900218 2024-09-12T17:41:58.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.358+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=SBZOVAZT2W1Q type=write size=272855 2024-09-12T17:41:58.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.359+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~IGK708Q1GPS1.0 size=1048576 2024-09-12T17:41:58.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.360+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~IGK708Q1GPS1.1 size=686265 2024-09-12T17:41:58.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.362+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=IGK708Q1GPS1 tag=14SCW51IDDX4 type=write size=2783417 2024-09-12T17:41:58.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.365+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~AY6W1Z1GHZH1.0 size=1048576 2024-09-12T17:41:58.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.365+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~AY6W1Z1GHZH1.1 size=37204 2024-09-12T17:41:58.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.365+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=AY6W1Z1GHZH1 tag=JWSH50GMRFYI type=write size=2134356 2024-09-12T17:41:58.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.367+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=SCFA42NS59AE type=del 2024-09-12T17:41:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.368+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=HL3PVNKGFD2S type=del size=1249713 2024-09-12T17:41:58.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.369+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=UCNF00P96RLD type=del 2024-09-12T17:41:58.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.370+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=F7071GF7CRR2 type=del size=2724174 2024-09-12T17:41:58.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.371+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~ZOAIOJ6CADKB.0 size=407169 2024-09-12T17:41:58.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.373+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=ZOAIOJ6CADKB tag=6LLIO9FZJL01 type=write size=1455745 2024-09-12T17:41:58.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.376+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~L0ERTT9VEBSL.0 size=890371 2024-09-12T17:41:58.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.376+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=L0ERTT9VEBSL tag=I7DSEP86ED1X type=write size=1938947 2024-09-12T17:41:58.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.377+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~RFZXVF9RSSOU.0 size=1048576 2024-09-12T17:41:58.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.378+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~RFZXVF9RSSOU.1 size=702802 2024-09-12T17:41:58.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.380+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=RFZXVF9RSSOU tag=7AELQOFZP3KJ type=write size=2799954 2024-09-12T17:41:58.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.381+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=ZZ3WL7XVL2W5 type=del size=1385077 2024-09-12T17:41:58.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.382+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=1IKVL53YFT46 type=del 2024-09-12T17:41:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.383+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=NASXZ4OSM0KW type=del size=3976886 2024-09-12T17:41:58.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.384+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=P1993BA9S8S1 type=write size=53599 2024-09-12T17:41:58.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.386+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=DZ36ZLGUVL2H type=del size=2816255 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.387+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=I00MIQWEDCF7 type=del 2024-09-12T17:41:58.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.389+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.0 size=1048576 2024-09-12T17:41:58.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.390+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.1 size=1048576 2024-09-12T17:41:58.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.391+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.2 size=459205 2024-09-12T17:41:58.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.391+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=OCCOUM1W6V71 tag=XWDO3GVQU38K type=write size=3604933 2024-09-12T17:41:58.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.393+0000 7f330fbcc780 1 < suggested update operation key=D5ZZ93XAPRAA tag=32FXGS2I0HWL type=del size=1289813 2024-09-12T17:41:58.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.394+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=FD0CSX3H7JM5 type=write size=180862 2024-09-12T17:41:58.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.395+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=820PL5Z09YF8 type=del 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.397+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=JPW8Y394ANE2 type=del size=4130016 2024-09-12T17:41:58.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.397+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~EZOMF7Y3WH67.0 size=1006349 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.399+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=EZOMF7Y3WH67 tag=Y1CDIZDMRQOG type=write size=2054925 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.400+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=V7Q257RAQ0UQ type=del size=4029923 2024-09-12T17:41:58.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.401+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=49DMDT5WIEPG type=del 2024-09-12T17:41:58.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.403+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~GJ72VDVT2TD5.0 size=1048576 2024-09-12T17:41:58.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.404+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~GJ72VDVT2TD5.1 size=572960 2024-09-12T17:41:58.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.404+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=GJ72VDVT2TD5 tag=O0WMAT5V8BTR type=write size=2670112 2024-09-12T17:41:58.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.405+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.0 size=1048576 2024-09-12T17:41:58.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.406+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.1 size=1048576 2024-09-12T17:41:58.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.407+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~HB9EACH9BWGI.2 size=244319 2024-09-12T17:41:58.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.409+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=HB9EACH9BWGI tag=XEX6E8WKNYUN type=write size=3390047 2024-09-12T17:41:58.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.410+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=D7051UUBTO7I type=del size=1527464 2024-09-12T17:41:58.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.412+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~C7Y9E4Q9KK1Y.0 size=1048576 2024-09-12T17:41:58.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.412+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~C7Y9E4Q9KK1Y.1 size=542640 2024-09-12T17:41:58.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.415+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=C7Y9E4Q9KK1Y tag=CKDUCHAHJYFL type=write size=2639792 2024-09-12T17:41:58.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.417+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=FNNLWX4CKLDJ type=del size=3688876 2024-09-12T17:41:58.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.418+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=O4ZY90NJK7UT type=del 2024-09-12T17:41:58.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.419+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=5TBF8683GYG0 type=write size=95483 2024-09-12T17:41:58.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.420+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=SBZOVAZT2W1Q type=write size=272855 2024-09-12T17:41:58.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.422+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.0 size=1048576 2024-09-12T17:41:58.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.423+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.1 size=1048576 2024-09-12T17:41:58.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.424+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.2 size=749788 2024-09-12T17:41:58.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.424+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=B2U6MHCI7FMU tag=G8L3DH752DW3 type=write size=3895516 2024-09-12T17:41:58.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.425+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~AY6W1Z1GHZH1.0 size=1048576 2024-09-12T17:41:58.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.426+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~AY6W1Z1GHZH1.1 size=37204 2024-09-12T17:41:58.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.428+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=AY6W1Z1GHZH1 tag=JWSH50GMRFYI type=write size=2134356 2024-09-12T17:41:58.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.429+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=NVYVJUVFS02Q type=write size=805221 2024-09-12T17:41:58.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.431+0000 7f330fbcc780 1 < suggested remove operation key=30CIXFQV5VBI tag=HL3PVNKGFD2S type=del 2024-09-12T17:41:58.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.432+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=IGDNV597GSVY type=del size=2400383 2024-09-12T17:41:58.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.433+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=F7071GF7CRR2 type=del 2024-09-12T17:41:58.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.435+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~F9H370IDEAO7.0 size=583576 2024-09-12T17:41:58.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.435+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=F9H370IDEAO7 tag=1ZVGU0GPY3PW type=write size=1632152 2024-09-12T17:41:58.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.436+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~L0ERTT9VEBSL.0 size=890371 2024-09-12T17:41:58.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.438+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=L0ERTT9VEBSL tag=I7DSEP86ED1X type=write size=1938947 2024-09-12T17:41:58.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.440+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.0 size=1048576 2024-09-12T17:41:58.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.441+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.1 size=1048576 2024-09-12T17:41:58.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.442+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.2 size=897446 2024-09-12T17:41:58.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.442+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=7W59RIKBDSTX tag=9X2RUTSB4C91 type=write size=4043174 2024-09-12T17:41:58.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.443+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=ZZ3WL7XVL2W5 type=del 2024-09-12T17:41:58.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.444+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=G681J1ROFBJH type=del size=1909033 2024-09-12T17:41:58.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.445+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=NASXZ4OSM0KW type=del 2024-09-12T17:41:58.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.447+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~GVR749UH063Y.0 size=1048576 2024-09-12T17:41:58.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.448+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~GVR749UH063Y.1 size=372933 2024-09-12T17:41:58.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.448+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=GVR749UH063Y tag=E3KF9HF04Y4O type=write size=2470085 2024-09-12T17:41:58.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.449+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=DZ36ZLGUVL2H type=del 2024-09-12T17:41:58.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.451+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.0 size=1048576 2024-09-12T17:41:58.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.452+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.1 size=1048576 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.453+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.2 size=376436 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.453+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=MNIWSK8QK7E8 tag=BTEVLS1H2X7C type=write size=3522164 2024-09-12T17:41:58.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.453+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.0 size=1048576 2024-09-12T17:41:58.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.454+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.1 size=1048576 2024-09-12T17:41:58.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.455+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~OCCOUM1W6V71.2 size=459205 2024-09-12T17:41:58.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.457+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=OCCOUM1W6V71 tag=XWDO3GVQU38K type=write size=3604933 2024-09-12T17:41:58.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.458+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=LF25CHWP54BV type=del size=697949 2024-09-12T17:41:58.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.460+0000 7f330fbcc780 1 < suggested remove operation key=H1LAU7WDZW6S tag=FD0CSX3H7JM5 type=write 2024-09-12T17:41:58.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.462+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~QN00FASJ2J3I.0 size=1048576 2024-09-12T17:41:58.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.462+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~QN00FASJ2J3I.1 size=559426 2024-09-12T17:41:58.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.462+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=QN00FASJ2J3I tag=A7V5YA1GQS8B type=write size=2656578 2024-09-12T17:41:58.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.464+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=JPW8Y394ANE2 type=del 2024-09-12T17:41:58.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.465+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=AIQOA0M0QQID type=del size=2801841 2024-09-12T17:41:58.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.466+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=V7Q257RAQ0UQ type=del 2024-09-12T17:41:58.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.468+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~M2CD2KX612J9.0 size=1048576 2024-09-12T17:41:58.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.469+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~M2CD2KX612J9.1 size=1040003 2024-09-12T17:41:58.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.469+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=M2CD2KX612J9 tag=PD9OT2LML85Y type=write size=3137155 2024-09-12T17:41:58.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.470+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~GJ72VDVT2TD5.0 size=1048576 2024-09-12T17:41:58.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.471+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~GJ72VDVT2TD5.1 size=572960 2024-09-12T17:41:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.473+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=GJ72VDVT2TD5 tag=O0WMAT5V8BTR type=write size=2670112 2024-09-12T17:41:58.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.474+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=SOEWMA7844WS type=write size=258109 2024-09-12T17:41:58.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.476+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=D7051UUBTO7I type=del 2024-09-12T17:41:58.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.477+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=H5C2THJTI5LY type=del size=1238170 2024-09-12T17:41:58.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.478+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=FNNLWX4CKLDJ type=del 2024-09-12T17:41:58.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.480+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=CZ1BPCUJ4W6M type=write size=261790 2024-09-12T17:41:58.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.481+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=5TBF8683GYG0 type=write size=95483 2024-09-12T17:41:58.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.483+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~PH7BU4VM2RD2.0 size=614450 2024-09-12T17:41:58.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.483+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=PH7BU4VM2RD2 tag=1ZVWPW9213UJ type=write size=1663026 2024-09-12T17:41:58.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.484+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.0 size=1048576 2024-09-12T17:41:58.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.485+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.1 size=1048576 2024-09-12T17:41:58.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.486+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~B2U6MHCI7FMU.2 size=749788 2024-09-12T17:41:58.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.488+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=B2U6MHCI7FMU tag=G8L3DH752DW3 type=write size=3895516 2024-09-12T17:41:58.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.489+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=0JPIKG4V7PSF type=del size=2453042 2024-09-12T17:41:58.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.490+0000 7f330fbcc780 1 < completed write operation key=6ZDBF249S1L6 tag=NVYVJUVFS02Q type=write size=805221 2024-09-12T17:41:58.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.491+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=CHXXI5331E3F type=del size=400742 2024-09-12T17:41:58.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.493+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=IGDNV597GSVY type=del 2024-09-12T17:41:58.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.494+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=BVL21SKXOPV9 type=del size=3114492 2024-09-12T17:41:58.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.495+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~F9H370IDEAO7.0 size=583576 2024-09-12T17:41:58.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.497+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=F9H370IDEAO7 tag=1ZVGU0GPY3PW type=write size=1632152 2024-09-12T17:41:58.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.498+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=AVST65PZR8NR type=del size=3749363 2024-09-12T17:41:58.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.499+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.0 size=1048576 2024-09-12T17:41:58.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.500+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.1 size=1048576 2024-09-12T17:41:58.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.500+0000 7f330fbcc780 1 < canceled part key=_multipart_SPKBX4WU9A9R.2~7W59RIKBDSTX.2 size=897446 2024-09-12T17:41:58.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.502+0000 7f330fbcc780 1 < canceled multipart upload key=SPKBX4WU9A9R upload=7W59RIKBDSTX tag=9X2RUTSB4C91 type=write size=4043174 2024-09-12T17:41:58.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.504+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~4TQ395T988UE.0 size=319003 2024-09-12T17:41:58.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.504+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=4TQ395T988UE tag=82YSCT28WNON type=write size=1367579 2024-09-12T17:41:58.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.505+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=G681J1ROFBJH type=del 2024-09-12T17:41:58.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.507+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=8LWIL34VERY3 type=del size=3770608 2024-09-12T17:41:58.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.508+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~GVR749UH063Y.0 size=1048576 2024-09-12T17:41:58.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.509+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~GVR749UH063Y.1 size=372933 2024-09-12T17:41:58.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.511+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=GVR749UH063Y tag=E3KF9HF04Y4O type=write size=2470085 2024-09-12T17:41:58.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.513+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~627O8URY5MNP.0 size=1048576 2024-09-12T17:41:58.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.513+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~627O8URY5MNP.1 size=905579 2024-09-12T17:41:58.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.513+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=627O8URY5MNP tag=YUDKFNKF990J type=write size=3002731 2024-09-12T17:41:58.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.515+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.0 size=1048576 2024-09-12T17:41:58.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.516+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.1 size=1048576 2024-09-12T17:41:58.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.516+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~MNIWSK8QK7E8.2 size=376436 2024-09-12T17:41:58.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.519+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=MNIWSK8QK7E8 tag=BTEVLS1H2X7C type=write size=3522164 2024-09-12T17:41:58.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.521+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~DD2HFL45AC5F.0 size=1048576 2024-09-12T17:41:58.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.523+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~DD2HFL45AC5F.1 size=191474 2024-09-12T17:41:58.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.523+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=DD2HFL45AC5F tag=NXB48RV3J9ST type=write size=2288626 2024-09-12T17:41:58.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.524+0000 7f330fbcc780 -1 < failed to complete operation key=6HBW7077B3MS tag=LF25CHWP54BV type=del size=697949: (22) Invalid argument 2024-09-12T17:41:58.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.525+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=6EA95CYP37YU type=del size=1583986 2024-09-12T17:41:58.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.526+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~QN00FASJ2J3I.0 size=1048576 2024-09-12T17:41:58.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.527+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~QN00FASJ2J3I.1 size=559426 2024-09-12T17:41:58.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.528+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=QN00FASJ2J3I tag=A7V5YA1GQS8B type=write size=2656578 2024-09-12T17:41:58.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.529+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=JTYYHSZMVSAE type=write size=722318 2024-09-12T17:41:58.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.531+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=AIQOA0M0QQID type=del 2024-09-12T17:41:58.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.532+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=3INZ92Y0KQOQ type=del size=34851 2024-09-12T17:41:58.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.533+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~M2CD2KX612J9.0 size=1048576 2024-09-12T17:41:58.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.534+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~M2CD2KX612J9.1 size=1040003 2024-09-12T17:41:58.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.535+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=M2CD2KX612J9 tag=PD9OT2LML85Y type=write size=3137155 2024-09-12T17:41:58.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.536+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=SYL8YJ3HT8EB type=del size=3500569 2024-09-12T17:41:58.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.538+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=SOEWMA7844WS type=write size=258109 2024-09-12T17:41:58.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.539+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=KPY1N4UATHDJ type=del size=1757454 2024-09-12T17:41:58.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.540+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=H5C2THJTI5LY type=del 2024-09-12T17:41:58.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.541+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=FX2SCRY60LUD type=del size=1156334 2024-09-12T17:41:58.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.542+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=CZ1BPCUJ4W6M type=write size=261790 2024-09-12T17:41:58.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.544+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~OICQO9XYAIVQ.0 size=1048576 2024-09-12T17:41:58.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.545+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~OICQO9XYAIVQ.1 size=315689 2024-09-12T17:41:58.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.545+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=OICQO9XYAIVQ tag=K63H53A3Z1QF type=write size=2412841 2024-09-12T17:41:58.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.546+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~PH7BU4VM2RD2.0 size=614450 2024-09-12T17:41:58.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.547+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=PH7BU4VM2RD2 tag=1ZVWPW9213UJ type=write size=1663026 2024-09-12T17:41:58.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.549+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~GIFG61L5HSSZ.0 size=1048576 2024-09-12T17:41:58.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.550+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~GIFG61L5HSSZ.1 size=305188 2024-09-12T17:41:58.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.550+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=GIFG61L5HSSZ tag=KVGZOGXUE9NK type=write size=2402340 2024-09-12T17:41:58.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.551+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=0JPIKG4V7PSF type=del 2024-09-12T17:41:58.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.553+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.0 size=1048576 2024-09-12T17:41:58.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.554+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.1 size=1048576 2024-09-12T17:41:58.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.555+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.2 size=397103 2024-09-12T17:41:58.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.555+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=OEWS5GPRSU3G tag=KRP6I7421GOB type=write size=3542831 2024-09-12T17:41:58.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.556+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=CHXXI5331E3F type=del 2024-09-12T17:41:58.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.557+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~O3WVTGFK981V.0 size=1048576 2024-09-12T17:41:58.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.558+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~O3WVTGFK981V.1 size=702877 2024-09-12T17:41:58.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.558+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=O3WVTGFK981V tag=713N0XD7FWTE type=write size=2800029 2024-09-12T17:41:58.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.559+0000 7f330fbcc780 1 < canceled operation key=6MFVO30OX5W1 tag=BVL21SKXOPV9 type=del size=3114492 2024-09-12T17:41:58.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.560+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=HBSX742J7GM8 type=del size=515339 2024-09-12T17:41:58.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.561+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=AVST65PZR8NR type=del 2024-09-12T17:41:58.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.563+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~6TMIQ9WKI30K.0 size=550762 2024-09-12T17:41:58.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.563+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=6TMIQ9WKI30K tag=LX4OS86XP17X type=write size=1599338 2024-09-12T17:41:58.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.565+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~4TQ395T988UE.0 size=319003 2024-09-12T17:41:58.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.566+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=4TQ395T988UE tag=82YSCT28WNON type=write size=1367579 2024-09-12T17:41:58.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.567+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=L3VC0ACD9A0U type=del size=196083 2024-09-12T17:41:58.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.569+0000 7f330fbcc780 1 < suggested update operation key=LNE0UR6JPWR8 tag=8LWIL34VERY3 type=del size=3770608 2024-09-12T17:41:58.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.570+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=2EHQERA6Q2GP type=write size=102721 2024-09-12T17:41:58.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.572+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~627O8URY5MNP.0 size=1048576 2024-09-12T17:41:58.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.572+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~627O8URY5MNP.1 size=905579 2024-09-12T17:41:58.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.573+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=627O8URY5MNP tag=YUDKFNKF990J type=write size=3002731 2024-09-12T17:41:58.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.575+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=I8WYJ1TJHOWH type=del size=711012 2024-09-12T17:41:58.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.576+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~DD2HFL45AC5F.0 size=1048576 2024-09-12T17:41:58.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.576+0000 7f330fbcc780 1 < canceled part key=_multipart_6ZDBF249S1L6.2~DD2HFL45AC5F.1 size=191474 2024-09-12T17:41:58.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.578+0000 7f330fbcc780 1 < canceled multipart upload key=6ZDBF249S1L6 upload=DD2HFL45AC5F tag=NXB48RV3J9ST type=write size=2288626 2024-09-12T17:41:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.579+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~C9D0G6UM52GH.0 size=417130 2024-09-12T17:41:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.579+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=C9D0G6UM52GH tag=A0U0QC046P9E type=write size=1465706 2024-09-12T17:41:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.581+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=6EA95CYP37YU type=del 2024-09-12T17:41:58.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.582+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~EUS7UABR2CMV.0 size=736300 2024-09-12T17:41:58.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.582+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=EUS7UABR2CMV tag=JMB2IZJEEJIM type=write size=1784876 2024-09-12T17:41:58.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.584+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=JTYYHSZMVSAE type=write 2024-09-12T17:41:58.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.586+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~BZY9918DBUR1.0 size=1048576 2024-09-12T17:41:58.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.587+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~BZY9918DBUR1.1 size=625898 2024-09-12T17:41:58.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.587+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=BZY9918DBUR1 tag=RYO4QP6JBJC3 type=write size=2723050 2024-09-12T17:41:58.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.589+0000 7f330fbcc780 1 < suggested remove operation key=9X4FNKQWJCX4 tag=3INZ92Y0KQOQ type=del 2024-09-12T17:41:58.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.590+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=26CGD8SUVVIY type=del size=2618674 2024-09-12T17:41:58.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.591+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=SYL8YJ3HT8EB type=del 2024-09-12T17:41:58.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.593+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~L22FTBGLW8EZ.0 size=1048576 2024-09-12T17:41:58.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.594+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~L22FTBGLW8EZ.1 size=104340 2024-09-12T17:41:58.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.594+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=L22FTBGLW8EZ tag=X9HGBVG9CHHB type=write size=2201492 2024-09-12T17:41:58.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.595+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=KPY1N4UATHDJ type=del 2024-09-12T17:41:58.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.597+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.0 size=1048576 2024-09-12T17:41:58.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.598+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.1 size=1048576 2024-09-12T17:41:58.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.599+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.2 size=971793 2024-09-12T17:41:58.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.599+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=J8Y0EES3FG0B tag=EGPUB48JEDNE type=write size=4117521 2024-09-12T17:41:58.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.600+0000 7f330fbcc780 1 < canceled operation key=4KNGMX117Z7G tag=FX2SCRY60LUD type=del size=1156334 2024-09-12T17:41:58.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.601+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=SXPZ7BCI8RQW type=del size=1776357 2024-09-12T17:41:58.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.602+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~OICQO9XYAIVQ.0 size=1048576 2024-09-12T17:41:58.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.603+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~OICQO9XYAIVQ.1 size=315689 2024-09-12T17:41:58.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.605+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=OICQO9XYAIVQ tag=K63H53A3Z1QF type=write size=2412841 2024-09-12T17:41:58.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.607+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~Q7BG5AHU6A5U.0 size=1048576 2024-09-12T17:41:58.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.607+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~Q7BG5AHU6A5U.1 size=159479 2024-09-12T17:41:58.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.607+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=Q7BG5AHU6A5U tag=ABNBCE2QSXNW type=write size=2256631 2024-09-12T17:41:58.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.608+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~GIFG61L5HSSZ.0 size=1048576 2024-09-12T17:41:58.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.609+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~GIFG61L5HSSZ.1 size=305188 2024-09-12T17:41:58.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.611+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=GIFG61L5HSSZ tag=KVGZOGXUE9NK type=write size=2402340 2024-09-12T17:41:58.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.612+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=3VGZBAII3RD6 type=del size=1952257 2024-09-12T17:41:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.613+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.0 size=1048576 2024-09-12T17:41:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.614+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.1 size=1048576 2024-09-12T17:41:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.615+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~OEWS5GPRSU3G.2 size=397103 2024-09-12T17:41:58.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.617+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=OEWS5GPRSU3G tag=KRP6I7421GOB type=write size=3542831 2024-09-12T17:41:58.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.618+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=IUZZ4Y2CPW1I type=del size=1642380 2024-09-12T17:41:58.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.620+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~O3WVTGFK981V.0 size=1048576 2024-09-12T17:41:58.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.620+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~O3WVTGFK981V.1 size=702877 2024-09-12T17:41:58.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.622+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=O3WVTGFK981V tag=713N0XD7FWTE type=write size=2800029 2024-09-12T17:41:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.623+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=B88BKQ02J8Y0 type=del size=3940912 2024-09-12T17:41:58.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.624+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=HBSX742J7GM8 type=del 2024-09-12T17:41:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.626+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.0 size=1048576 2024-09-12T17:41:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.627+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.1 size=1048576 2024-09-12T17:41:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.628+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.2 size=974120 2024-09-12T17:41:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.628+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=G28L0Q58R0MS tag=IHHD1ELSWDPV type=write size=4119848 2024-09-12T17:41:58.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.629+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~6TMIQ9WKI30K.0 size=550762 2024-09-12T17:41:58.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.631+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=6TMIQ9WKI30K tag=LX4OS86XP17X type=write size=1599338 2024-09-12T17:41:58.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.632+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~AJXGMZ4RPZ7V.0 size=472955 2024-09-12T17:41:58.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.632+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=AJXGMZ4RPZ7V tag=Q5J3COP95QE1 type=write size=1521531 2024-09-12T17:41:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.633+0000 7f330fbcc780 1 < canceled operation key=D5ZZ93XAPRAA tag=L3VC0ACD9A0U type=del size=196083 2024-09-12T17:41:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.635+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=C71OBGVH3EWM type=del size=535330 2024-09-12T17:41:58.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.636+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=2EHQERA6Q2GP type=write size=102721 2024-09-12T17:41:58.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.637+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=BKAA5T9B0EEA type=del size=3749193 2024-09-12T17:41:58.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.638+0000 7f330fbcc780 1 < canceled operation key=50WR6KLF40W7 tag=I8WYJ1TJHOWH type=del size=711012 2024-09-12T17:41:58.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.640+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~06C6CRKCIH79.0 size=1048576 2024-09-12T17:41:58.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.640+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~06C6CRKCIH79.1 size=549710 2024-09-12T17:41:58.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.640+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=06C6CRKCIH79 tag=5N95BOZJBQ2O type=write size=2646862 2024-09-12T17:41:58.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.642+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~C9D0G6UM52GH.0 size=417130 2024-09-12T17:41:58.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.643+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=C9D0G6UM52GH tag=A0U0QC046P9E type=write size=1465706 2024-09-12T17:41:58.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.644+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=BZSPMO118L9P type=write size=644374 2024-09-12T17:41:58.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.645+0000 7f330fbcc780 1 < canceled part key=_multipart_70COM4KLK2R1.2~EUS7UABR2CMV.0 size=736300 2024-09-12T17:41:58.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.646+0000 7f330fbcc780 1 < canceled multipart upload key=70COM4KLK2R1 upload=EUS7UABR2CMV tag=JMB2IZJEEJIM type=write size=1784876 2024-09-12T17:41:58.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.648+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~AF0KV3ALELYM.0 size=373352 2024-09-12T17:41:58.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.648+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=AF0KV3ALELYM tag=7UH8709JEVH7 type=write size=1421928 2024-09-12T17:41:58.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.649+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~BZY9918DBUR1.0 size=1048576 2024-09-12T17:41:58.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.650+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~BZY9918DBUR1.1 size=625898 2024-09-12T17:41:58.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.652+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=BZY9918DBUR1 tag=RYO4QP6JBJC3 type=write size=2723050 2024-09-12T17:41:58.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.653+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=H2K3P992VFID type=del size=65532 2024-09-12T17:41:58.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.654+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=26CGD8SUVVIY type=del size=2618674 2024-09-12T17:41:58.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.655+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=1CP38Q1C17R8 type=del size=395747 2024-09-12T17:41:58.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.656+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~L22FTBGLW8EZ.0 size=1048576 2024-09-12T17:41:58.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.657+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~L22FTBGLW8EZ.1 size=104340 2024-09-12T17:41:58.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.660+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=L22FTBGLW8EZ tag=X9HGBVG9CHHB type=write size=2201492 2024-09-12T17:41:58.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.662+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.0 size=1048576 2024-09-12T17:41:58.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.663+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.1 size=1048576 2024-09-12T17:41:58.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.664+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.2 size=286264 2024-09-12T17:41:58.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.664+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=S794A05SQY8G tag=NEZZHXMQVO3T type=write size=3431992 2024-09-12T17:41:58.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.665+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.0 size=1048576 2024-09-12T17:41:58.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.666+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.1 size=1048576 2024-09-12T17:41:58.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.667+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~J8Y0EES3FG0B.2 size=971793 2024-09-12T17:41:58.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.670+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=J8Y0EES3FG0B tag=EGPUB48JEDNE type=write size=4117521 2024-09-12T17:41:58.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.671+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=1W2Q1I0EUN95 type=del size=3877651 2024-09-12T17:41:58.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.672+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=SXPZ7BCI8RQW type=del 2024-09-12T17:41:58.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.674+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~WBSLJEN065JK.0 size=484187 2024-09-12T17:41:58.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.674+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=WBSLJEN065JK tag=V8UMZ2EBENCV type=write size=1532763 2024-09-12T17:41:58.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.676+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~Q7BG5AHU6A5U.0 size=1048576 2024-09-12T17:41:58.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.676+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~Q7BG5AHU6A5U.1 size=159479 2024-09-12T17:41:58.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.677+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=Q7BG5AHU6A5U tag=ABNBCE2QSXNW type=write size=2256631 2024-09-12T17:41:58.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.678+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=G2TCJX54VN0Z type=write size=120687 2024-09-12T17:41:58.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.679+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=3VGZBAII3RD6 type=del 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.681+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~VDAC1PGAK3TF.0 size=52930 2024-09-12T17:41:58.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.681+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=VDAC1PGAK3TF tag=4UCYBTSF08HT type=write size=1101506 2024-09-12T17:41:58.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.684+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=IUZZ4Y2CPW1I type=del 2024-09-12T17:41:58.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.685+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=3CQI0G2EXX52 type=del size=2091640 2024-09-12T17:41:58.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.686+0000 7f330fbcc780 1 < canceled operation key=70COM4KLK2R1 tag=B88BKQ02J8Y0 type=del size=3940912 2024-09-12T17:41:58.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.687+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=ID4PJLNFT2O9 type=del size=2181394 2024-09-12T17:41:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.688+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.0 size=1048576 2024-09-12T17:41:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.689+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.1 size=1048576 2024-09-12T17:41:58.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.690+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~G28L0Q58R0MS.2 size=974120 2024-09-12T17:41:58.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.692+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=G28L0Q58R0MS tag=IHHD1ELSWDPV type=write size=4119848 2024-09-12T17:41:58.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.694+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=HIY4VSANYKGM type=del size=1007934 2024-09-12T17:41:58.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.694+0000 7f330fbcc780 1 < canceled part key=_multipart_6ZDBF249S1L6.2~AJXGMZ4RPZ7V.0 size=472955 2024-09-12T17:41:58.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.696+0000 7f330fbcc780 1 < canceled multipart upload key=6ZDBF249S1L6 upload=AJXGMZ4RPZ7V tag=Q5J3COP95QE1 type=write size=1521531 2024-09-12T17:41:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.698+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.0 size=1048576 2024-09-12T17:41:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.699+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.1 size=1048576 2024-09-12T17:41:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.700+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.2 size=278510 2024-09-12T17:41:58.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.700+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=0A5WHEO812ED tag=2JHOY71NW515 type=write size=3424238 2024-09-12T17:41:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.701+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=C71OBGVH3EWM type=del 2024-09-12T17:41:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.703+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~8IBGV2Q7VKE1.0 size=1048576 2024-09-12T17:41:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.704+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~8IBGV2Q7VKE1.1 size=174684 2024-09-12T17:41:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.704+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=8IBGV2Q7VKE1 tag=PRP4W28QLMWC type=write size=2271836 2024-09-12T17:41:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.705+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=BKAA5T9B0EEA type=del 2024-09-12T17:41:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.706+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=1UJBWPJQ6VMQ type=del size=620175 2024-09-12T17:41:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.707+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~06C6CRKCIH79.0 size=1048576 2024-09-12T17:41:58.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.708+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~06C6CRKCIH79.1 size=549710 2024-09-12T17:41:58.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.710+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=06C6CRKCIH79 tag=5N95BOZJBQ2O type=write size=2646862 2024-09-12T17:41:58.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.711+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=DJ3VMZXJWBJB type=del size=456337 2024-09-12T17:41:58.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.712+0000 7f330fbcc780 1 < canceled operation key=IEL4VF8ROC72 tag=BZSPMO118L9P type=write size=644374 2024-09-12T17:41:58.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.714+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~F88C9JI5AQTP.0 size=1048576 2024-09-12T17:41:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.715+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~F88C9JI5AQTP.1 size=561500 2024-09-12T17:41:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.715+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=F88C9JI5AQTP tag=NVSCK0PNRQGA type=write size=2658652 2024-09-12T17:41:58.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.716+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~AF0KV3ALELYM.0 size=373352 2024-09-12T17:41:58.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.718+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=AF0KV3ALELYM tag=7UH8709JEVH7 type=write size=1421928 2024-09-12T17:41:58.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.720+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=R4DQLFDLT0QX type=del size=1332258 2024-09-12T17:41:58.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.721+0000 7f330fbcc780 1 < canceled operation key=6HBW7077B3MS tag=H2K3P992VFID type=del size=65532 2024-09-12T17:41:58.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.722+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=1R82YVCMPNZO type=del size=871982 2024-09-12T17:41:58.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.724+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=1CP38Q1C17R8 type=del 2024-09-12T17:41:58.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.726+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~N4KG9AAX74I6.0 size=511259 2024-09-12T17:41:58.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.726+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=N4KG9AAX74I6 tag=VTPA4HNV2SDY type=write size=1559835 2024-09-12T17:41:58.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.727+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.0 size=1048576 2024-09-12T17:41:58.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.728+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.1 size=1048576 2024-09-12T17:41:58.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.729+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S794A05SQY8G.2 size=286264 2024-09-12T17:41:58.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.731+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=S794A05SQY8G tag=NEZZHXMQVO3T type=write size=3431992 2024-09-12T17:41:58.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.732+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=9HTO7WC4IB9Y type=write size=356675 2024-09-12T17:41:58.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.733+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=1W2Q1I0EUN95 type=del 2024-09-12T17:41:58.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.734+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=4Z840K5GAGNK type=write size=356043 2024-09-12T17:41:58.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.735+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~WBSLJEN065JK.0 size=484187 2024-09-12T17:41:58.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.737+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=WBSLJEN065JK tag=V8UMZ2EBENCV type=write size=1532763 2024-09-12T17:41:58.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.738+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=1JCXD5VSDUW3 type=del size=862451 2024-09-12T17:41:58.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.740+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=G2TCJX54VN0Z type=write size=120687 2024-09-12T17:41:58.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.741+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=KML4TET0D12V type=del size=3004618 2024-09-12T17:41:58.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.742+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~VDAC1PGAK3TF.0 size=52930 2024-09-12T17:41:58.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.744+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=VDAC1PGAK3TF tag=4UCYBTSF08HT type=write size=1101506 2024-09-12T17:41:58.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.745+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=MFWR68086M4H type=del size=218189 2024-09-12T17:41:58.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.746+0000 7f330fbcc780 -1 < failed to complete operation key=AGM33OK1W7A6 tag=3CQI0G2EXX52 type=del size=2091640: (22) Invalid argument 2024-09-12T17:41:58.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.748+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~TQ7NQ6NSW8RL.0 size=1048576 2024-09-12T17:41:58.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.749+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~TQ7NQ6NSW8RL.1 size=765975 2024-09-12T17:41:58.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.749+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=TQ7NQ6NSW8RL tag=EZZBJQSH09UJ type=write size=2863127 2024-09-12T17:41:58.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.750+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=ID4PJLNFT2O9 type=del 2024-09-12T17:41:58.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.752+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.0 size=1048576 2024-09-12T17:41:58.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.753+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.1 size=1048576 2024-09-12T17:41:58.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.754+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.2 size=727901 2024-09-12T17:41:58.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.754+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=96BAUZE0G5W7 tag=DFVFNL9H968H type=write size=3873629 2024-09-12T17:41:58.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.755+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=HIY4VSANYKGM type=del 2024-09-12T17:41:58.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.757+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~7DFR5D0XI8TU.0 size=611310 2024-09-12T17:41:58.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.757+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=7DFR5D0XI8TU tag=KYTMMH17DUR9 type=write size=1659886 2024-09-12T17:41:58.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.758+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.0 size=1048576 2024-09-12T17:41:58.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.759+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.1 size=1048576 2024-09-12T17:41:58.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.760+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~0A5WHEO812ED.2 size=278510 2024-09-12T17:41:58.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.761+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=0A5WHEO812ED tag=2JHOY71NW515 type=write size=3424238 2024-09-12T17:41:58.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.762+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=8C5JMATEIU8C type=del size=2218930 2024-09-12T17:41:58.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.764+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~8IBGV2Q7VKE1.0 size=1048576 2024-09-12T17:41:58.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.764+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~8IBGV2Q7VKE1.1 size=174684 2024-09-12T17:41:58.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.766+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=8IBGV2Q7VKE1 tag=PRP4W28QLMWC type=write size=2271836 2024-09-12T17:41:58.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.767+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=WNJV7ADT29F2 type=del size=3579629 2024-09-12T17:41:58.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.768+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=1UJBWPJQ6VMQ type=del 2024-09-12T17:41:58.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.770+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.0 size=1048576 2024-09-12T17:41:58.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.771+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.1 size=1048576 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.772+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.2 size=778451 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.772+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=06LAKCOOCOJ0 tag=I1WIPIHA5NKH type=write size=3924179 2024-09-12T17:41:58.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.773+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=DJ3VMZXJWBJB type=del 2024-09-12T17:41:58.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.775+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~SY7SIUSP0HKY.0 size=1048576 2024-09-12T17:41:58.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.776+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~SY7SIUSP0HKY.1 size=232708 2024-09-12T17:41:58.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.776+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=SY7SIUSP0HKY tag=MQUQ8021LA50 type=write size=2329860 2024-09-12T17:41:58.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.777+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~F88C9JI5AQTP.0 size=1048576 2024-09-12T17:41:58.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.778+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~F88C9JI5AQTP.1 size=561500 2024-09-12T17:41:58.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.780+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=F88C9JI5AQTP tag=NVSCK0PNRQGA type=write size=2658652 2024-09-12T17:41:58.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.781+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=HGFRUI16B9XK type=del size=2139872 2024-09-12T17:41:58.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.782+0000 7f330fbcc780 -1 < failed to complete operation key=ZEC2RXNOR3D1 tag=R4DQLFDLT0QX type=del size=1332258: (22) Invalid argument 2024-09-12T17:41:58.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.784+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=ZPN1JJLT6M7E type=write size=234829 2024-09-12T17:41:58.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.786+0000 7f330fbcc780 1 < suggested update operation key=IEYJS7X97O1A tag=1R82YVCMPNZO type=del size=871982 2024-09-12T17:41:58.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.788+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.0 size=1048576 2024-09-12T17:41:58.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.789+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.1 size=1048576 2024-09-12T17:41:58.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.789+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.2 size=560135 2024-09-12T17:41:58.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.789+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=M24F6G6LVQO7 tag=4U3I5MQZCR52 type=write size=3705863 2024-09-12T17:41:58.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.791+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~N4KG9AAX74I6.0 size=511259 2024-09-12T17:41:58.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.792+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=N4KG9AAX74I6 tag=VTPA4HNV2SDY type=write size=1559835 2024-09-12T17:41:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.794+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=EFS3AWMTO7GF type=del size=1248439 2024-09-12T17:41:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.795+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=9HTO7WC4IB9Y type=write size=356675 2024-09-12T17:41:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.796+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=YLSY1SXVCFHE type=del size=2715541 2024-09-12T17:41:58.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.798+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=4Z840K5GAGNK type=write size=356043 2024-09-12T17:41:58.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.800+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~VRAC2C1KBUHH.0 size=842625 2024-09-12T17:41:58.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.800+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=VRAC2C1KBUHH tag=0MLLJHP4N4BZ type=write size=1891201 2024-09-12T17:41:58.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.801+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=1JCXD5VSDUW3 type=del 2024-09-12T17:41:58.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.802+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=TKZ13J01SDTB type=del size=2713006 2024-09-12T17:41:58.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.804+0000 7f330fbcc780 1 < canceled operation key=QE2QJH2J5QDY tag=KML4TET0D12V type=del size=3004618 2024-09-12T17:41:58.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.805+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~CQAVSZUSU34M.0 size=220650 2024-09-12T17:41:58.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.805+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=CQAVSZUSU34M tag=DUOV1MHV9DUL type=write size=1269226 2024-09-12T17:41:58.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.807+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=MFWR68086M4H type=del 2024-09-12T17:41:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.808+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=ZR5FIB0W0GN7 type=del size=2658685 2024-09-12T17:41:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.809+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~TQ7NQ6NSW8RL.0 size=1048576 2024-09-12T17:41:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.810+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~TQ7NQ6NSW8RL.1 size=765975 2024-09-12T17:41:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.811+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=TQ7NQ6NSW8RL tag=EZZBJQSH09UJ type=write size=2863127 2024-09-12T17:41:58.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.814+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~W94QWF30B0I8.0 size=1048576 2024-09-12T17:41:58.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.814+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~W94QWF30B0I8.1 size=422103 2024-09-12T17:41:58.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.814+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=W94QWF30B0I8 tag=XCVV5QNPFOKF type=write size=2519255 2024-09-12T17:41:58.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.815+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.0 size=1048576 2024-09-12T17:41:58.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.816+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.1 size=1048576 2024-09-12T17:41:58.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.817+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~96BAUZE0G5W7.2 size=727901 2024-09-12T17:41:58.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.819+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=96BAUZE0G5W7 tag=DFVFNL9H968H type=write size=3873629 2024-09-12T17:41:58.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.822+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=V6CHT7S1Q4ED type=del size=2420000 2024-09-12T17:41:58.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.823+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~7DFR5D0XI8TU.0 size=611310 2024-09-12T17:41:58.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.825+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=7DFR5D0XI8TU tag=KYTMMH17DUR9 type=write size=1659886 2024-09-12T17:41:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.826+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=X7Y17Y6J0696 type=del size=1905276 2024-09-12T17:41:58.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.827+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=8C5JMATEIU8C type=del 2024-09-12T17:41:58.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.828+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=0RQVFDTN1ZO4 type=del size=1219798 2024-09-12T17:41:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.829+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=WNJV7ADT29F2 type=del 2024-09-12T17:41:58.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.831+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=LKO89OR2EAC9 type=del size=2909083 2024-09-12T17:41:58.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.832+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.0 size=1048576 2024-09-12T17:41:58.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.833+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.1 size=1048576 2024-09-12T17:41:58.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.834+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~06LAKCOOCOJ0.2 size=778451 2024-09-12T17:41:58.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.836+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=06LAKCOOCOJ0 tag=I1WIPIHA5NKH type=write size=3924179 2024-09-12T17:41:58.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.837+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=KERD2PY1XTKT type=del size=2226300 2024-09-12T17:41:58.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.838+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~SY7SIUSP0HKY.0 size=1048576 2024-09-12T17:41:58.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.839+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~SY7SIUSP0HKY.1 size=232708 2024-09-12T17:41:58.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.841+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=SY7SIUSP0HKY tag=MQUQ8021LA50 type=write size=2329860 2024-09-12T17:41:58.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.843+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=Q4NDZSL8Z7M4 type=write size=442271 2024-09-12T17:41:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.844+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=HGFRUI16B9XK type=del 2024-09-12T17:41:58.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.846+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~V5JA6P216299.0 size=483609 2024-09-12T17:41:58.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.846+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=V5JA6P216299 tag=0OAT6H0HZ21I type=write size=1532185 2024-09-12T17:41:58.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.847+0000 7f330fbcc780 -1 < failed to complete operation key=70COM4KLK2R1 tag=ZPN1JJLT6M7E type=write size=234829: (22) Invalid argument 2024-09-12T17:41:58.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.848+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=LN6WJHU1DCU1 type=del size=857915 2024-09-12T17:41:58.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.848+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.0 size=1048576 2024-09-12T17:41:58.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.849+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.1 size=1048576 2024-09-12T17:41:58.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.850+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~M24F6G6LVQO7.2 size=560135 2024-09-12T17:41:58.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.852+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=M24F6G6LVQO7 tag=4U3I5MQZCR52 type=write size=3705863 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.855+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.0 size=1048576 2024-09-12T17:41:58.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.856+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.1 size=1048576 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.857+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.2 size=933005 2024-09-12T17:41:58.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.857+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=AE827KBGEBLF tag=L78QRPFDRQ4C type=write size=4078733 2024-09-12T17:41:58.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.858+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=EFS3AWMTO7GF type=del 2024-09-12T17:41:58.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.859+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=A4NTJ3OTJ66I type=del size=1296455 2024-09-12T17:41:58.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.860+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=YLSY1SXVCFHE type=del 2024-09-12T17:41:58.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.861+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=KI9P8R4SR5LP type=del size=1978484 2024-09-12T17:41:58.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.863+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~VRAC2C1KBUHH.0 size=842625 2024-09-12T17:41:58.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.864+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=VRAC2C1KBUHH tag=0MLLJHP4N4BZ type=write size=1891201 2024-09-12T17:41:58.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.866+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=0OGYQVYC8XBX type=del size=70986 2024-09-12T17:41:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.867+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=TKZ13J01SDTB type=del 2024-09-12T17:41:58.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.868+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=FCCKPLMO0TUL type=del size=4154447 2024-09-12T17:41:58.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.869+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~CQAVSZUSU34M.0 size=220650 2024-09-12T17:41:58.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.871+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=CQAVSZUSU34M tag=DUOV1MHV9DUL type=write size=1269226 2024-09-12T17:41:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.873+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.0 size=1048576 2024-09-12T17:41:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.874+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.1 size=1048576 2024-09-12T17:41:58.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.875+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.2 size=280055 2024-09-12T17:41:58.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.875+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=JEVY1VPLOWDU tag=J3XXX4UOU4F0 type=write size=3425783 2024-09-12T17:41:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.876+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=ZR5FIB0W0GN7 type=del 2024-09-12T17:41:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.879+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~MWEH0I89F0TU.0 size=748636 2024-09-12T17:41:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.879+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=MWEH0I89F0TU tag=9R4MN800JPB7 type=write size=1797212 2024-09-12T17:41:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.880+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~W94QWF30B0I8.0 size=1048576 2024-09-12T17:41:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.881+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~W94QWF30B0I8.1 size=422103 2024-09-12T17:41:58.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.883+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=W94QWF30B0I8 tag=XCVV5QNPFOKF type=write size=2519255 2024-09-12T17:41:58.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.884+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=BR8OYU4EKC6J type=del size=1782430 2024-09-12T17:41:58.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.885+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=V6CHT7S1Q4ED type=del 2024-09-12T17:41:58.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.886+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=12XIZLWXD323 type=del size=3502070 2024-09-12T17:41:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.887+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=X7Y17Y6J0696 type=del 2024-09-12T17:41:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.889+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=ASH28WIISGME type=del size=1332231 2024-09-12T17:41:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.890+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=0RQVFDTN1ZO4 type=del 2024-09-12T17:41:58.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.891+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=TO2VQN6A81SN type=write size=633719 2024-09-12T17:41:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.892+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=LKO89OR2EAC9 type=del 2024-09-12T17:41:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.894+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~U7CMDE9LWOX0.0 size=1048576 2024-09-12T17:41:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.895+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~U7CMDE9LWOX0.1 size=981789 2024-09-12T17:41:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.895+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=U7CMDE9LWOX0 tag=OOQBYKFP008Z type=write size=3078941 2024-09-12T17:41:58.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.896+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=KERD2PY1XTKT type=del 2024-09-12T17:41:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.898+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.0 size=1048576 2024-09-12T17:41:58.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.899+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.1 size=1048576 2024-09-12T17:41:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.900+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.2 size=1021504 2024-09-12T17:41:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.900+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=QIN5BJF8ROIZ tag=BJ5GWYP3IRV7 type=write size=4167232 2024-09-12T17:41:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.902+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=Q4NDZSL8Z7M4 type=write size=442271 2024-09-12T17:41:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.903+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=CNWA3ZI38Z80 type=del size=2303534 2024-09-12T17:41:58.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.904+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~V5JA6P216299.0 size=483609 2024-09-12T17:41:58.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.906+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=V5JA6P216299 tag=0OAT6H0HZ21I type=write size=1532185 2024-09-12T17:41:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.907+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=5QY0L268NAGZ type=write size=533965 2024-09-12T17:41:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.909+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=LN6WJHU1DCU1 type=del 2024-09-12T17:41:58.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.910+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=86WSEIYSSFJP type=del size=302471 2024-09-12T17:41:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.911+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.0 size=1048576 2024-09-12T17:41:58.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.912+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.1 size=1048576 2024-09-12T17:41:58.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.913+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~AE827KBGEBLF.2 size=933005 2024-09-12T17:41:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.915+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=AE827KBGEBLF tag=L78QRPFDRQ4C type=write size=4078733 2024-09-12T17:41:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.916+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=4AAJNP0Z9H0T type=write size=406353 2024-09-12T17:41:58.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.919+0000 7f330fbcc780 1 < suggested update operation key=LF4NGY13WYHK tag=A4NTJ3OTJ66I type=del size=1296455 2024-09-12T17:41:58.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.921+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~DXTYF34VEX59.0 size=1048576 2024-09-12T17:41:58.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.922+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~DXTYF34VEX59.1 size=845477 2024-09-12T17:41:58.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.922+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=DXTYF34VEX59 tag=BU68209IVQUZ type=write size=2942629 2024-09-12T17:41:58.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.923+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=KI9P8R4SR5LP type=del 2024-09-12T17:41:58.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.925+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~0LO4MJGXU09O.0 size=1033573 2024-09-12T17:41:58.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.925+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=0LO4MJGXU09O tag=XCH69ESJTUWP type=write size=2082149 2024-09-12T17:41:58.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.926+0000 7f330fbcc780 1 < canceled operation key=3BU8T85GXCX4 tag=0OGYQVYC8XBX type=del size=70986 2024-09-12T17:41:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.928+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~SDZ6UZCSHSCF.0 size=1048565 2024-09-12T17:41:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.928+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=SDZ6UZCSHSCF tag=G4A6DOX4OCP6 type=write size=2097141 2024-09-12T17:41:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.929+0000 7f330fbcc780 1 < canceled operation key=4KNGMX117Z7G tag=FCCKPLMO0TUL type=del size=4154447 2024-09-12T17:41:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.930+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=ZC22S61XN5D2 type=write size=990608 2024-09-12T17:41:58.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.933+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.0 size=1048576 2024-09-12T17:41:58.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.934+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.1 size=1048576 2024-09-12T17:41:58.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.935+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~JEVY1VPLOWDU.2 size=280055 2024-09-12T17:41:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.936+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=JEVY1VPLOWDU tag=J3XXX4UOU4F0 type=write size=3425783 2024-09-12T17:41:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.938+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=WIBGB8VXOKTX type=del size=4043140 2024-09-12T17:41:58.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.939+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~MWEH0I89F0TU.0 size=748636 2024-09-12T17:41:58.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.940+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=MWEH0I89F0TU tag=9R4MN800JPB7 type=write size=1797212 2024-09-12T17:41:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.942+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=UF296YYNRO4X type=write size=832662 2024-09-12T17:41:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.943+0000 7f330fbcc780 1 < canceled operation key=1MJ2W1WMLR85 tag=BR8OYU4EKC6J type=del size=1782430 2024-09-12T17:41:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.944+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=WO1OAAN2C93T type=del size=3573239 2024-09-12T17:41:58.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.945+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=12XIZLWXD323 type=del 2024-09-12T17:41:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.947+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~EW5KTK4E7AB0.0 size=737943 2024-09-12T17:41:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.947+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=EW5KTK4E7AB0 tag=2GCHBG5H512G type=write size=1786519 2024-09-12T17:41:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.948+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=ASH28WIISGME type=del 2024-09-12T17:41:58.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.949+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=XTO3RN5O1S8R type=del size=1063663 2024-09-12T17:41:58.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.950+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=TO2VQN6A81SN type=write size=633719 2024-09-12T17:41:58.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.951+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=PSH3BXUAA3TR type=del size=2869830 2024-09-12T17:41:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.952+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~U7CMDE9LWOX0.0 size=1048576 2024-09-12T17:41:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.953+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~U7CMDE9LWOX0.1 size=981789 2024-09-12T17:41:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.955+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=U7CMDE9LWOX0 tag=OOQBYKFP008Z type=write size=3078941 2024-09-12T17:41:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.956+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=JYO82Q4Z06TW type=del size=899832 2024-09-12T17:41:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.957+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.0 size=1048576 2024-09-12T17:41:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.957+0000 7f330fbcc780 1 < canceled part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.1 size=1048576 2024-09-12T17:41:58.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.958+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~QIN5BJF8ROIZ.2 size=1021504 2024-09-12T17:41:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.960+0000 7f330fbcc780 1 < canceled multipart upload key=9IYALJED5G85 upload=QIN5BJF8ROIZ tag=BJ5GWYP3IRV7 type=write size=4167232 2024-09-12T17:41:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.961+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=5ZBTX8TICYD8 type=del size=921803 2024-09-12T17:41:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.962+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=CNWA3ZI38Z80 type=del 2024-09-12T17:41:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.963+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=V3GVT7BOLN4G type=del size=1617927 2024-09-12T17:41:58.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.964+0000 7f330fbcc780 1 < completed write operation key=FY2BXMZBVMDL tag=5QY0L268NAGZ type=write size=533965 2024-09-12T17:41:58.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.966+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.0 size=1048576 2024-09-12T17:41:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.967+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.1 size=1048576 2024-09-12T17:41:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.968+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.2 size=597714 2024-09-12T17:41:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.968+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=VYUR92J04W27 tag=400BL4UVU2AT type=write size=3743442 2024-09-12T17:41:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.969+0000 7f330fbcc780 1 < canceled operation key=QE2QJH2J5QDY tag=86WSEIYSSFJP type=del size=302471 2024-09-12T17:41:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.971+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.0 size=1048576 2024-09-12T17:41:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.972+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.1 size=1048576 2024-09-12T17:41:58.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.972+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.2 size=607286 2024-09-12T17:41:58.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.972+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=WEC198B55VGI tag=0HJ2GLTMD4A1 type=write size=3753014 2024-09-12T17:41:58.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.974+0000 7f330fbcc780 1 < completed write operation key=9IYALJED5G85 tag=4AAJNP0Z9H0T type=write size=406353 2024-09-12T17:41:58.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.975+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=4CMFPTYBUFU2 type=del size=1380396 2024-09-12T17:41:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.976+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~DXTYF34VEX59.0 size=1048576 2024-09-12T17:41:58.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.977+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~DXTYF34VEX59.1 size=845477 2024-09-12T17:41:58.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.978+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=DXTYF34VEX59 tag=BU68209IVQUZ type=write size=2942629 2024-09-12T17:41:58.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.980+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=V2SVAATKYFKZ type=del size=2367983 2024-09-12T17:41:58.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.981+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~0LO4MJGXU09O.0 size=1033573 2024-09-12T17:41:58.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.982+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=0LO4MJGXU09O tag=XCH69ESJTUWP type=write size=2082149 2024-09-12T17:41:58.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.983+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=2HX7RAWSQRTP type=del size=2107672 2024-09-12T17:41:58.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.985+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~SDZ6UZCSHSCF.0 size=1048565 2024-09-12T17:41:58.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.986+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=SDZ6UZCSHSCF tag=G4A6DOX4OCP6 type=write size=2097141 2024-09-12T17:41:58.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.988+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.0 size=1048576 2024-09-12T17:41:58.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.989+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.1 size=1048576 2024-09-12T17:41:58.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.990+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.2 size=495778 2024-09-12T17:41:58.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.990+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=I0663F2AIKSD tag=DD8ZKAR5YD7A type=write size=3641506 2024-09-12T17:41:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.991+0000 7f330fbcc780 1 < completed write operation key=LNE0UR6JPWR8 tag=ZC22S61XN5D2 type=write size=990608 2024-09-12T17:41:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.993+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~WAV2817UMMBY.0 size=1048576 2024-09-12T17:41:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.994+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~WAV2817UMMBY.1 size=448386 2024-09-12T17:41:58.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.994+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=WAV2817UMMBY tag=YE5UXB5PCO04 type=write size=2545538 2024-09-12T17:41:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.995+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=WIBGB8VXOKTX type=del 2024-09-12T17:41:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.996+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=HY5STAIAN7PN type=del size=105477 2024-09-12T17:41:58.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.997+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=UF296YYNRO4X type=write size=832662 2024-09-12T17:41:58.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.998+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=R8SJM6L0OZA4 type=del size=1072719 2024-09-12T17:41:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:58.999+0000 7f330fbcc780 1 < canceled operation key=1MJ2W1WMLR85 tag=WO1OAAN2C93T type=del size=3573239 2024-09-12T17:41:59.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.001+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~C0W13EW8K6WL.0 size=927231 2024-09-12T17:41:59.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.001+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=C0W13EW8K6WL tag=2FDXU0ADSDBC type=write size=1975807 2024-09-12T17:41:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.002+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~EW5KTK4E7AB0.0 size=737943 2024-09-12T17:41:59.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.004+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=EW5KTK4E7AB0 tag=2GCHBG5H512G type=write size=1786519 2024-09-12T17:41:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.005+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=Z4NE6L24OZQP type=del size=1917529 2024-09-12T17:41:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.007+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=XTO3RN5O1S8R type=del 2024-09-12T17:41:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.009+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~KUT27MQB5ZK3.0 size=946973 2024-09-12T17:41:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.009+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=KUT27MQB5ZK3 tag=LZ004WBGOMWA type=write size=1995549 2024-09-12T17:41:59.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.010+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=PSH3BXUAA3TR type=del 2024-09-12T17:41:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.011+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=0ZKMQERC1V1C type=del size=1875342 2024-09-12T17:41:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.012+0000 7f330fbcc780 1 < canceled operation key=SPKBX4WU9A9R tag=JYO82Q4Z06TW type=del size=899832 2024-09-12T17:41:59.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.014+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~G2J063UZJZDI.0 size=1048576 2024-09-12T17:41:59.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.015+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~G2J063UZJZDI.1 size=871866 2024-09-12T17:41:59.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.015+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=G2J063UZJZDI tag=4DHGLXNC1085 type=write size=2969018 2024-09-12T17:41:59.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.017+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=5ZBTX8TICYD8 type=del 2024-09-12T17:41:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.019+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~WU90FCYGL9ES.0 size=672178 2024-09-12T17:41:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.019+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=WU90FCYGL9ES tag=MO8U1CWODYZJ type=write size=1720754 2024-09-12T17:41:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.020+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=V3GVT7BOLN4G type=del 2024-09-12T17:41:59.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.021+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=196UC03SH3ZG type=del size=994640 2024-09-12T17:41:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.022+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.0 size=1048576 2024-09-12T17:41:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.022+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.1 size=1048576 2024-09-12T17:41:59.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.023+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~VYUR92J04W27.2 size=597714 2024-09-12T17:41:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.025+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=VYUR92J04W27 tag=400BL4UVU2AT type=write size=3743442 2024-09-12T17:41:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.027+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~9CB6K93I4UBJ.0 size=1048576 2024-09-12T17:41:59.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.028+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~9CB6K93I4UBJ.1 size=543290 2024-09-12T17:41:59.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.028+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=9CB6K93I4UBJ tag=ONIILBO4GSV0 type=write size=2640442 2024-09-12T17:41:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.030+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.0 size=1048576 2024-09-12T17:41:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.030+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.1 size=1048576 2024-09-12T17:41:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.031+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~WEC198B55VGI.2 size=607286 2024-09-12T17:41:59.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.033+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=WEC198B55VGI tag=0HJ2GLTMD4A1 type=write size=3753014 2024-09-12T17:41:59.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.036+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=BO8PONELDD32 type=del size=4098363 2024-09-12T17:41:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.037+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=4CMFPTYBUFU2 type=del 2024-09-12T17:41:59.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.039+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=UAMIM9GAT9L1 type=write size=978624 2024-09-12T17:41:59.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.040+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=V2SVAATKYFKZ type=del 2024-09-12T17:41:59.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.042+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.0 size=1048576 2024-09-12T17:41:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.043+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.1 size=1048576 2024-09-12T17:41:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.044+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.2 size=349937 2024-09-12T17:41:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.044+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=6H3I1MBY2M7P tag=MT7U991J1TUG type=write size=3495665 2024-09-12T17:41:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.046+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=2HX7RAWSQRTP type=del size=2107672 2024-09-12T17:41:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.049+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~QS4CCA5DTSDB.0 size=1048576 2024-09-12T17:41:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.050+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~QS4CCA5DTSDB.1 size=838422 2024-09-12T17:41:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.050+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=QS4CCA5DTSDB tag=TS84M240QA55 type=write size=2935574 2024-09-12T17:41:59.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.052+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.0 size=1048576 2024-09-12T17:41:59.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.053+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.1 size=1048576 2024-09-12T17:41:59.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.054+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~I0663F2AIKSD.2 size=495778 2024-09-12T17:41:59.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.056+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=I0663F2AIKSD tag=DD8ZKAR5YD7A type=write size=3641506 2024-09-12T17:41:59.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.057+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=2LAI183RIOEV type=del size=2407935 2024-09-12T17:41:59.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.058+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~WAV2817UMMBY.0 size=1048576 2024-09-12T17:41:59.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.059+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~WAV2817UMMBY.1 size=448386 2024-09-12T17:41:59.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.061+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=WAV2817UMMBY tag=YE5UXB5PCO04 type=write size=2545538 2024-09-12T17:41:59.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.063+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~UD6B6L3NGH7I.0 size=351555 2024-09-12T17:41:59.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.063+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=UD6B6L3NGH7I tag=UXMM7RIMG13G type=write size=1400131 2024-09-12T17:41:59.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.064+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=HY5STAIAN7PN type=del 2024-09-12T17:41:59.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.065+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=BNSZ0CLXWAI7 type=del size=1025114 2024-09-12T17:41:59.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.067+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=R8SJM6L0OZA4 type=del 2024-09-12T17:41:59.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.069+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~UH7NZDFI70M3.0 size=1037692 2024-09-12T17:41:59.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.069+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=UH7NZDFI70M3 tag=8S6BOLEKON5T type=write size=2086268 2024-09-12T17:41:59.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.070+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~C0W13EW8K6WL.0 size=927231 2024-09-12T17:41:59.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.072+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=C0W13EW8K6WL tag=2FDXU0ADSDBC type=write size=1975807 2024-09-12T17:41:59.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.074+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.0 size=1048576 2024-09-12T17:41:59.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.075+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.1 size=1048576 2024-09-12T17:41:59.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.076+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.2 size=32542 2024-09-12T17:41:59.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.076+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=7SKN9JRT79I2 tag=M9VST2ILX55E type=write size=3178270 2024-09-12T17:41:59.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.077+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=Z4NE6L24OZQP type=del 2024-09-12T17:41:59.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.079+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.0 size=1048576 2024-09-12T17:41:59.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.080+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.1 size=1048576 2024-09-12T17:41:59.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.081+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.2 size=841035 2024-09-12T17:41:59.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.081+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=GR8RHL8YYTUS tag=RVCXTWUN2TVC type=write size=3986763 2024-09-12T17:41:59.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.082+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~KUT27MQB5ZK3.0 size=946973 2024-09-12T17:41:59.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.084+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=KUT27MQB5ZK3 tag=LZ004WBGOMWA type=write size=1995549 2024-09-12T17:41:59.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.085+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=I6NYIPZNXL44 type=del size=97828 2024-09-12T17:41:59.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.087+0000 7f330fbcc780 1 < suggested remove operation key=1MJ2W1WMLR85 tag=0ZKMQERC1V1C type=del 2024-09-12T17:41:59.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.088+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=DP3E1D310YGG type=del size=2699709 2024-09-12T17:41:59.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.089+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~G2J063UZJZDI.0 size=1048576 2024-09-12T17:41:59.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.090+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~G2J063UZJZDI.1 size=871866 2024-09-12T17:41:59.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.092+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=G2J063UZJZDI tag=4DHGLXNC1085 type=write size=2969018 2024-09-12T17:41:59.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.093+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=W7XPUMZEPFZB type=del size=3834052 2024-09-12T17:41:59.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.094+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~WU90FCYGL9ES.0 size=672178 2024-09-12T17:41:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.096+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=WU90FCYGL9ES tag=MO8U1CWODYZJ type=write size=1720754 2024-09-12T17:41:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.097+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=MG0SW9QVX25G type=write size=879111 2024-09-12T17:41:59.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.098+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=196UC03SH3ZG type=del 2024-09-12T17:41:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.100+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~RLQ7PC3TS3Q2.0 size=455306 2024-09-12T17:41:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.100+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=RLQ7PC3TS3Q2 tag=6KKDV1V6IYQI type=write size=1503882 2024-09-12T17:41:59.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.101+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~9CB6K93I4UBJ.0 size=1048576 2024-09-12T17:41:59.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.102+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~9CB6K93I4UBJ.1 size=543290 2024-09-12T17:41:59.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.104+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=9CB6K93I4UBJ tag=ONIILBO4GSV0 type=write size=2640442 2024-09-12T17:41:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.105+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=BW1P01Q8DVXM type=del size=2791987 2024-09-12T17:41:59.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.106+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=BO8PONELDD32 type=del 2024-09-12T17:41:59.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.107+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=XKHVUTF283AZ type=del size=1959683 2024-09-12T17:41:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.109+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=UAMIM9GAT9L1 type=write size=978624 2024-09-12T17:41:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.110+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=M0OO5UF7BMZG type=write size=708638 2024-09-12T17:41:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.110+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.0 size=1048576 2024-09-12T17:41:59.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.111+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.1 size=1048576 2024-09-12T17:41:59.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.112+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~6H3I1MBY2M7P.2 size=349937 2024-09-12T17:41:59.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.114+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=6H3I1MBY2M7P tag=MT7U991J1TUG type=write size=3495665 2024-09-12T17:41:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.115+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=P6AFDY31GQZT type=del size=2303702 2024-09-12T17:41:59.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.116+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~QS4CCA5DTSDB.0 size=1048576 2024-09-12T17:41:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.117+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~QS4CCA5DTSDB.1 size=838422 2024-09-12T17:41:59.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.119+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=QS4CCA5DTSDB tag=TS84M240QA55 type=write size=2935574 2024-09-12T17:41:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.120+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=02GB7U9JDJQS type=del size=19096 2024-09-12T17:41:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.121+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=2LAI183RIOEV type=del 2024-09-12T17:41:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.122+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=LDLD02QRIEUE type=del size=2441433 2024-09-12T17:41:59.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.124+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~UD6B6L3NGH7I.0 size=351555 2024-09-12T17:41:59.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.125+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=UD6B6L3NGH7I tag=UXMM7RIMG13G type=write size=1400131 2024-09-12T17:41:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.127+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=CR46BI3XJJMQ type=del size=2940053 2024-09-12T17:41:59.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.128+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=BNSZ0CLXWAI7 type=del size=1025114 2024-09-12T17:41:59.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.130+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~VLNO4BV18EQW.0 size=1048576 2024-09-12T17:41:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.131+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~VLNO4BV18EQW.1 size=157153 2024-09-12T17:41:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.131+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=VLNO4BV18EQW tag=EVJDS6W2TQC1 type=write size=2254305 2024-09-12T17:41:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.132+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~UH7NZDFI70M3.0 size=1037692 2024-09-12T17:41:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.134+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=UH7NZDFI70M3 tag=8S6BOLEKON5T type=write size=2086268 2024-09-12T17:41:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.135+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=NFFVA36U7JHW type=write size=194347 2024-09-12T17:41:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.136+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.0 size=1048576 2024-09-12T17:41:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.137+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.1 size=1048576 2024-09-12T17:41:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.138+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~7SKN9JRT79I2.2 size=32542 2024-09-12T17:41:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.140+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=7SKN9JRT79I2 tag=M9VST2ILX55E type=write size=3178270 2024-09-12T17:41:59.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.141+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=Q139N3J58Y5B type=del size=574548 2024-09-12T17:41:59.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.143+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.0 size=1048576 2024-09-12T17:41:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.144+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.1 size=1048576 2024-09-12T17:41:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.145+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~GR8RHL8YYTUS.2 size=841035 2024-09-12T17:41:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.147+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=GR8RHL8YYTUS tag=RVCXTWUN2TVC type=write size=3986763 2024-09-12T17:41:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.149+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~I0OX02Y5Y6J6.0 size=1036438 2024-09-12T17:41:59.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.149+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=I0OX02Y5Y6J6 tag=SG2F59FN0ZJ4 type=write size=2085014 2024-09-12T17:41:59.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.150+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=I6NYIPZNXL44 type=del 2024-09-12T17:41:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.151+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=7AXFO16R1EHQ type=del size=57343 2024-09-12T17:41:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.152+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=DP3E1D310YGG type=del 2024-09-12T17:41:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.153+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=ZIAE8JZ9MS60 type=write size=350443 2024-09-12T17:41:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.155+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=W7XPUMZEPFZB type=del 2024-09-12T17:41:59.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.156+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=F1HHEOCFX199 type=del size=2439190 2024-09-12T17:41:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.157+0000 7f330fbcc780 1 < completed write operation key=MQV01X5P8JLG tag=MG0SW9QVX25G type=write size=879111 2024-09-12T17:41:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.158+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=Z5FSXOM4KGAO type=del size=2754938 2024-09-12T17:41:59.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.159+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~RLQ7PC3TS3Q2.0 size=455306 2024-09-12T17:41:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.161+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=RLQ7PC3TS3Q2 tag=6KKDV1V6IYQI type=write size=1503882 2024-09-12T17:41:59.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.163+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~VSQ0746TCGNS.0 size=1048576 2024-09-12T17:41:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.164+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~VSQ0746TCGNS.1 size=317751 2024-09-12T17:41:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.164+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=VSQ0746TCGNS tag=7ASSCQJL0AJI type=write size=2414903 2024-09-12T17:41:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.165+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=BW1P01Q8DVXM type=del 2024-09-12T17:41:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.167+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~CKD4ZEMLYJPF.0 size=75474 2024-09-12T17:41:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.167+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=CKD4ZEMLYJPF tag=YOK0GG93Q1UH type=write size=1124050 2024-09-12T17:41:59.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.168+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=XKHVUTF283AZ type=del 2024-09-12T17:41:59.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.170+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.0 size=1048576 2024-09-12T17:41:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.171+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.1 size=1048576 2024-09-12T17:41:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.172+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.2 size=121479 2024-09-12T17:41:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.172+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=E7KQJH8TZTAG tag=9VR4ND7M4P0O type=write size=3267207 2024-09-12T17:41:59.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.174+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=M0OO5UF7BMZG type=write size=708638 2024-09-12T17:41:59.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.175+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=LHIRSWFEJ3D2 type=del size=2993622 2024-09-12T17:41:59.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.176+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=P6AFDY31GQZT type=del 2024-09-12T17:41:59.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.177+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=T5NPZ7J21VVL type=del size=3595665 2024-09-12T17:41:59.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.179+0000 7f330fbcc780 1 < canceled operation key=XIW3OJB1STT9 tag=02GB7U9JDJQS type=del size=19096 2024-09-12T17:41:59.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.180+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=E6L3UFS3F5XZ type=del size=2545393 2024-09-12T17:41:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.181+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=LDLD02QRIEUE type=del 2024-09-12T17:41:59.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.182+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=1XFO6GBA6MRA type=write size=211483 2024-09-12T17:41:59.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.184+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=CR46BI3XJJMQ type=del 2024-09-12T17:41:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.185+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=0YTXBP9X8ZL7 type=del size=1595848 2024-09-12T17:41:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.186+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~VLNO4BV18EQW.0 size=1048576 2024-09-12T17:41:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.187+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~VLNO4BV18EQW.1 size=157153 2024-09-12T17:41:59.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.189+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=VLNO4BV18EQW tag=EVJDS6W2TQC1 type=write size=2254305 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.190+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=WLKT18DQ51SW type=del size=1100931 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.191+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=NFFVA36U7JHW type=write size=194347 2024-09-12T17:41:59.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.192+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=AQRJGUXHTVIM type=del size=2333260 2024-09-12T17:41:59.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.193+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=Q139N3J58Y5B type=del 2024-09-12T17:41:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.195+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=67KKSOPUG7ZE type=write size=154952 2024-09-12T17:41:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.196+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~I0OX02Y5Y6J6.0 size=1036438 2024-09-12T17:41:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.198+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=I0OX02Y5Y6J6 tag=SG2F59FN0ZJ4 type=write size=2085014 2024-09-12T17:41:59.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.199+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=UJYWSTVI0GM8 type=write size=167274 2024-09-12T17:41:59.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.200+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=7AXFO16R1EHQ type=del 2024-09-12T17:41:59.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.202+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~J8NNYZEC4QEI.0 size=477079 2024-09-12T17:41:59.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.202+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=J8NNYZEC4QEI tag=NPNS61UVODCD type=write size=1525655 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.203+0000 7f330fbcc780 1 < completed write operation key=50WR6KLF40W7 tag=ZIAE8JZ9MS60 type=write size=350443 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.205+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=HSWS78AVITR9 type=del size=2090 2024-09-12T17:41:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.206+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=F1HHEOCFX199 type=del 2024-09-12T17:41:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.208+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~GEDKP455A0CP.0 size=288179 2024-09-12T17:41:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.208+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=GEDKP455A0CP tag=B4KJ26HN3V7Z type=write size=1336755 2024-09-12T17:41:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.209+0000 7f330fbcc780 1 < canceled operation key=D5ZZ93XAPRAA tag=Z5FSXOM4KGAO type=del size=2754938 2024-09-12T17:41:59.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.211+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~SMRQKDBG8KKP.0 size=1048576 2024-09-12T17:41:59.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.212+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~SMRQKDBG8KKP.1 size=589749 2024-09-12T17:41:59.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.212+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=SMRQKDBG8KKP tag=W4MRQGVWQQBP type=write size=2686901 2024-09-12T17:41:59.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.213+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~VSQ0746TCGNS.0 size=1048576 2024-09-12T17:41:59.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.214+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~VSQ0746TCGNS.1 size=317751 2024-09-12T17:41:59.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.216+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=VSQ0746TCGNS tag=7ASSCQJL0AJI type=write size=2414903 2024-09-12T17:41:59.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.217+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=HGWRWG4PGGQC type=write size=673004 2024-09-12T17:41:59.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.218+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~CKD4ZEMLYJPF.0 size=75474 2024-09-12T17:41:59.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.220+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=CKD4ZEMLYJPF tag=YOK0GG93Q1UH type=write size=1124050 2024-09-12T17:41:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.221+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=065XJJI0W4RP type=del size=922195 2024-09-12T17:41:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.222+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.0 size=1048576 2024-09-12T17:41:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.223+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.1 size=1048576 2024-09-12T17:41:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.224+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~E7KQJH8TZTAG.2 size=121479 2024-09-12T17:41:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.226+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=E7KQJH8TZTAG tag=9VR4ND7M4P0O type=write size=3267207 2024-09-12T17:41:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.227+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=QC5ZEK1FN38T type=del size=2724291 2024-09-12T17:41:59.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.229+0000 7f330fbcc780 1 < suggested update operation key=AL3ESPG15NO4 tag=LHIRSWFEJ3D2 type=del size=2993622 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.230+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=594NQ2CSBV4W type=del size=3706015 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.231+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=T5NPZ7J21VVL type=del 2024-09-12T17:41:59.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.232+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=448NKBSG3N31 type=write size=436487 2024-09-12T17:41:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.234+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=E6L3UFS3F5XZ type=del 2024-09-12T17:41:59.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.235+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=HK22TE8RVR1X type=del size=1911477 2024-09-12T17:41:59.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.236+0000 7f330fbcc780 -1 < failed to complete operation key=AL3ESPG15NO4 tag=1XFO6GBA6MRA type=write size=211483: (22) Invalid argument 2024-09-12T17:41:59.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.237+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=27HCZ46OWY5H type=del size=2408286 2024-09-12T17:41:59.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.238+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=0YTXBP9X8ZL7 type=del 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.240+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=BPT0FUP1K2SQ type=del size=1161909 2024-09-12T17:41:59.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.241+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=WLKT18DQ51SW type=del 2024-09-12T17:41:59.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.243+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~DAXPVA09IOU2.0 size=637609 2024-09-12T17:41:59.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.243+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=DAXPVA09IOU2 tag=GLGWTAP6FPXA type=write size=1686185 2024-09-12T17:41:59.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.244+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=AQRJGUXHTVIM type=del 2024-09-12T17:41:59.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.245+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=NNA1TVRGEO3L type=del size=988212 2024-09-12T17:41:59.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.247+0000 7f330fbcc780 1 < suggested update operation key=TKJOJ17LIWX6 tag=67KKSOPUG7ZE type=write size=154952 2024-09-12T17:41:59.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.248+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=U0TSJ1BAP7JS type=del size=549776 2024-09-12T17:41:59.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.250+0000 7f330fbcc780 1 < completed write operation key=1MJ2W1WMLR85 tag=UJYWSTVI0GM8 type=write size=167274 2024-09-12T17:41:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.253+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.0 size=1048576 2024-09-12T17:41:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.253+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.1 size=1048576 2024-09-12T17:41:59.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.254+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.2 size=172459 2024-09-12T17:41:59.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.254+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=NB5LAJ5H5SG1 tag=TJI55JRBWJHR type=write size=3318187 2024-09-12T17:41:59.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.255+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~J8NNYZEC4QEI.0 size=477079 2024-09-12T17:41:59.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.257+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=J8NNYZEC4QEI tag=NPNS61UVODCD type=write size=1525655 2024-09-12T17:41:59.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.259+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~Y9K2GXW60Y7V.0 size=1048576 2024-09-12T17:41:59.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.260+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~Y9K2GXW60Y7V.1 size=609892 2024-09-12T17:41:59.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.260+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=Y9K2GXW60Y7V tag=UATWZYJRPEDN type=write size=2707044 2024-09-12T17:41:59.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.263+0000 7f330fbcc780 1 < suggested remove operation key=XIW3OJB1STT9 tag=HSWS78AVITR9 type=del 2024-09-12T17:41:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.264+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=9I734YY6F8KS type=del size=719931 2024-09-12T17:41:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.265+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~GEDKP455A0CP.0 size=288179 2024-09-12T17:41:59.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.267+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=GEDKP455A0CP tag=B4KJ26HN3V7Z type=write size=1336755 2024-09-12T17:41:59.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.268+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=C6281XEI155C type=del size=530886 2024-09-12T17:41:59.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.269+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~SMRQKDBG8KKP.0 size=1048576 2024-09-12T17:41:59.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.270+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~SMRQKDBG8KKP.1 size=589749 2024-09-12T17:41:59.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.272+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=SMRQKDBG8KKP tag=W4MRQGVWQQBP type=write size=2686901 2024-09-12T17:41:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.274+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~3EF7V94QKJAK.0 size=1048576 2024-09-12T17:41:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.275+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~3EF7V94QKJAK.1 size=848593 2024-09-12T17:41:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.275+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=3EF7V94QKJAK tag=Z3E0FRNDZ37C type=write size=2945745 2024-09-12T17:41:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.276+0000 7f330fbcc780 1 < completed write operation key=ZEC2RXNOR3D1 tag=HGWRWG4PGGQC type=write size=673004 2024-09-12T17:41:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.277+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=F9X1ZWER1ZNE type=write size=5070 2024-09-12T17:41:59.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.279+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=065XJJI0W4RP type=del 2024-09-12T17:41:59.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.281+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=9TA0272EBOSI type=del size=2911884 2024-09-12T17:41:59.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.282+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=QC5ZEK1FN38T type=del 2024-09-12T17:41:59.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.283+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=EGNBD77U3HLS type=del size=3297612 2024-09-12T17:41:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.284+0000 7f330fbcc780 1 < canceled operation key=9IYALJED5G85 tag=594NQ2CSBV4W type=del size=3706015 2024-09-12T17:41:59.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.286+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~1YUZC0YHMJ1A.0 size=1048576 2024-09-12T17:41:59.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.287+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~1YUZC0YHMJ1A.1 size=678355 2024-09-12T17:41:59.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.287+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=1YUZC0YHMJ1A tag=HQCCY5Q6VU4T type=write size=2775507 2024-09-12T17:41:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.288+0000 7f330fbcc780 1 < canceled operation key=8UX8W3FAJ3D9 tag=448NKBSG3N31 type=write size=436487 2024-09-12T17:41:59.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.289+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=8YELGEIQGZ68 type=del size=1662200 2024-09-12T17:41:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.290+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=HK22TE8RVR1X type=del 2024-09-12T17:41:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.292+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~XP301DA704G4.0 size=1048576 2024-09-12T17:41:59.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.293+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~XP301DA704G4.1 size=176501 2024-09-12T17:41:59.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.293+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=XP301DA704G4 tag=55NKVBOWS74Z type=write size=2273653 2024-09-12T17:41:59.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.294+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=27HCZ46OWY5H type=del 2024-09-12T17:41:59.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.296+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=0NN7HBTVDX96 type=write size=622830 2024-09-12T17:41:59.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.297+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=BPT0FUP1K2SQ type=del 2024-09-12T17:41:59.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.298+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=TWEFHGA612MB type=del size=125261 2024-09-12T17:41:59.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.300+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~DAXPVA09IOU2.0 size=637609 2024-09-12T17:41:59.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.302+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=DAXPVA09IOU2 tag=GLGWTAP6FPXA type=write size=1686185 2024-09-12T17:41:59.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.303+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=SIMYE94OT1O1 type=del size=2832919 2024-09-12T17:41:59.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.304+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=NNA1TVRGEO3L type=del 2024-09-12T17:41:59.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.306+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~X17OTKR8V4ST.0 size=1048576 2024-09-12T17:41:59.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.307+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~X17OTKR8V4ST.1 size=757669 2024-09-12T17:41:59.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.307+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=X17OTKR8V4ST tag=EMHVG63ZR3TM type=write size=2854821 2024-09-12T17:41:59.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.310+0000 7f330fbcc780 1 < suggested remove operation key=AGM33OK1W7A6 tag=U0TSJ1BAP7JS type=del 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.311+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=JGK6EXF53JS8 type=del size=3886987 2024-09-12T17:41:59.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.312+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.0 size=1048576 2024-09-12T17:41:59.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.313+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.1 size=1048576 2024-09-12T17:41:59.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.314+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~NB5LAJ5H5SG1.2 size=172459 2024-09-12T17:41:59.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.316+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=NB5LAJ5H5SG1 tag=TJI55JRBWJHR type=write size=3318187 2024-09-12T17:41:59.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.317+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=Y3U1G0EV7S2C type=del size=916864 2024-09-12T17:41:59.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.319+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~Y9K2GXW60Y7V.0 size=1048576 2024-09-12T17:41:59.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.320+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~Y9K2GXW60Y7V.1 size=609892 2024-09-12T17:41:59.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.321+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=Y9K2GXW60Y7V tag=UATWZYJRPEDN type=write size=2707044 2024-09-12T17:41:59.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.323+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=RED3PU6CO2ID type=write size=688557 2024-09-12T17:41:59.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.324+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=9I734YY6F8KS type=del 2024-09-12T17:41:59.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.325+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=3C0877ALWGYQ type=del size=1365434 2024-09-12T17:41:59.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.326+0000 7f330fbcc780 -1 < failed to complete operation key=AGM33OK1W7A6 tag=C6281XEI155C type=del size=530886: (22) Invalid argument 2024-09-12T17:41:59.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.327+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=D106S1Z99N2C type=del size=151759 2024-09-12T17:41:59.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.328+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~3EF7V94QKJAK.0 size=1048576 2024-09-12T17:41:59.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.329+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~3EF7V94QKJAK.1 size=848593 2024-09-12T17:41:59.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.331+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=3EF7V94QKJAK tag=Z3E0FRNDZ37C type=write size=2945745 2024-09-12T17:41:59.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.332+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=E260334QDXHR type=write size=846665 2024-09-12T17:41:59.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.334+0000 7f330fbcc780 1 < canceled operation key=3IHGI1UMI1BA tag=F9X1ZWER1ZNE type=write size=5070 2024-09-12T17:41:59.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.335+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=X8JCONV538G1 type=write size=497053 2024-09-12T17:41:59.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.336+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=9TA0272EBOSI type=del 2024-09-12T17:41:59.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.338+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~60W5FFE8CJ77.0 size=680695 2024-09-12T17:41:59.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.338+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=60W5FFE8CJ77 tag=5SQYTFUL3SAY type=write size=1729271 2024-09-12T17:41:59.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.339+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=EGNBD77U3HLS type=del 2024-09-12T17:41:59.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.340+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=THX8SN1T002W type=del size=637482 2024-09-12T17:41:59.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.342+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~1YUZC0YHMJ1A.0 size=1048576 2024-09-12T17:41:59.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.343+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~1YUZC0YHMJ1A.1 size=678355 2024-09-12T17:41:59.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.345+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=1YUZC0YHMJ1A tag=HQCCY5Q6VU4T type=write size=2775507 2024-09-12T17:41:59.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.346+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=EAX8CJO5G4NI type=write size=644083 2024-09-12T17:41:59.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.347+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=8YELGEIQGZ68 type=del 2024-09-12T17:41:59.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.348+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=P12KCXQ2G1X5 type=del size=2734590 2024-09-12T17:41:59.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.349+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~XP301DA704G4.0 size=1048576 2024-09-12T17:41:59.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.350+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~XP301DA704G4.1 size=176501 2024-09-12T17:41:59.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.352+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=XP301DA704G4 tag=55NKVBOWS74Z type=write size=2273653 2024-09-12T17:41:59.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.353+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=WP62NTEOKYBY type=del size=3275571 2024-09-12T17:41:59.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.354+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=0NN7HBTVDX96 type=write size=622830 2024-09-12T17:41:59.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.356+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=UOY7XAHFYKJF type=del size=1576979 2024-09-12T17:41:59.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.357+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=TWEFHGA612MB type=del 2024-09-12T17:41:59.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.358+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=3OUX0BL9GE4Q type=write size=325609 2024-09-12T17:41:59.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.360+0000 7f330fbcc780 1 < suggested update operation key=IEL4VF8ROC72 tag=SIMYE94OT1O1 type=del size=2832919 2024-09-12T17:41:59.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.363+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=OPUTZEATF0UL type=del size=63656 2024-09-12T17:41:59.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.364+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~X17OTKR8V4ST.0 size=1048576 2024-09-12T17:41:59.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.365+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~X17OTKR8V4ST.1 size=757669 2024-09-12T17:41:59.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.367+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=X17OTKR8V4ST tag=EMHVG63ZR3TM type=write size=2854821 2024-09-12T17:41:59.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.368+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=7S1OREUCKYZ9 type=del size=3017080 2024-09-12T17:41:59.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.370+0000 7f330fbcc780 1 < suggested update operation key=HJL73WQD8SD2 tag=JGK6EXF53JS8 type=del size=3886987 2024-09-12T17:41:59.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.371+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=EH707274HEHC type=write size=991792 2024-09-12T17:41:59.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.372+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=Y3U1G0EV7S2C type=del 2024-09-12T17:41:59.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.373+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=GRXU6F97FJXK type=del size=1981949 2024-09-12T17:41:59.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.374+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=RED3PU6CO2ID type=write size=688557 2024-09-12T17:41:59.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.375+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=R7A8HT7EXULG type=write size=632723 2024-09-12T17:41:59.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.377+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=3C0877ALWGYQ type=del 2024-09-12T17:41:59.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.379+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~R1OO3HPM99JC.0 size=293267 2024-09-12T17:41:59.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.379+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=R1OO3HPM99JC tag=0P8G1E4NZVFZ type=write size=1341843 2024-09-12T17:41:59.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.380+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=D106S1Z99N2C type=del 2024-09-12T17:41:59.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.381+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=OIZD6ZZHXD5Z type=del size=4190306 2024-09-12T17:41:59.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.383+0000 7f330fbcc780 1 < suggested update operation key=5QBSRDY0LJ60 tag=E260334QDXHR type=write size=846665 2024-09-12T17:41:59.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.384+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=PRRPNMR6KLJO type=del size=3562665 2024-09-12T17:41:59.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.385+0000 7f330fbcc780 1 < canceled operation key=FY2BXMZBVMDL tag=X8JCONV538G1 type=write size=497053 2024-09-12T17:41:59.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.386+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=PY9UK1MBLPYZ type=del size=357437 2024-09-12T17:41:59.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.388+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~60W5FFE8CJ77.0 size=680695 2024-09-12T17:41:59.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.389+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=60W5FFE8CJ77 tag=5SQYTFUL3SAY type=write size=1729271 2024-09-12T17:41:59.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.390+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=UF0CURRV7DYG type=write size=736212 2024-09-12T17:41:59.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.392+0000 7f330fbcc780 -1 < failed to complete operation key=HJL73WQD8SD2 tag=THX8SN1T002W type=del size=637482: (22) Invalid argument 2024-09-12T17:41:59.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.393+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=X7KKTQO42TV1 type=del size=1348586 2024-09-12T17:41:59.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.394+0000 7f330fbcc780 1 < completed write operation key=FY2BXMZBVMDL tag=EAX8CJO5G4NI type=write size=644083 2024-09-12T17:41:59.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.395+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=4QM80HFJMOAS type=write size=709217 2024-09-12T17:41:59.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.396+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=P12KCXQ2G1X5 type=del 2024-09-12T17:41:59.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.398+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~IIMV2RL2UN6G.0 size=409656 2024-09-12T17:41:59.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.398+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=IIMV2RL2UN6G tag=326YZ7BPJM41 type=write size=1458232 2024-09-12T17:41:59.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.399+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=WP62NTEOKYBY type=del 2024-09-12T17:41:59.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.401+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~IIUY9DIKP9YI.0 size=1048576 2024-09-12T17:41:59.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.402+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~IIUY9DIKP9YI.1 size=579813 2024-09-12T17:41:59.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.402+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=IIUY9DIKP9YI tag=T7UVFBDXVI9A type=write size=2676965 2024-09-12T17:41:59.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.403+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=UOY7XAHFYKJF type=del 2024-09-12T17:41:59.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.404+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=TVYICM9015JX type=del size=2033931 2024-09-12T17:41:59.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.406+0000 7f330fbcc780 1 < suggested remove operation key=LF4NGY13WYHK tag=3OUX0BL9GE4Q type=write 2024-09-12T17:41:59.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.408+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~LVZ385GOWDNS.0 size=129146 2024-09-12T17:41:59.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.408+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=LVZ385GOWDNS tag=FXL0PI3FTA2F type=write size=1177722 2024-09-12T17:41:59.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.410+0000 7f330fbcc780 1 < canceled operation key=FY2BXMZBVMDL tag=OPUTZEATF0UL type=del size=63656 2024-09-12T17:41:59.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.412+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~OIQVBML7N4NA.0 size=1048576 2024-09-12T17:41:59.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.413+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~OIQVBML7N4NA.1 size=634975 2024-09-12T17:41:59.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.413+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=OIQVBML7N4NA tag=A0ECM4OWHO62 type=write size=2732127 2024-09-12T17:41:59.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.414+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=7S1OREUCKYZ9 type=del 2024-09-12T17:41:59.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.415+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=Q9I55MWVQNEV type=del size=1943780 2024-09-12T17:41:59.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.416+0000 7f330fbcc780 1 < completed write operation key=SPKBX4WU9A9R tag=EH707274HEHC type=write size=991792 2024-09-12T17:41:59.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.418+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~7ZV981VQ3PE6.0 size=1048576 2024-09-12T17:41:59.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.419+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~7ZV981VQ3PE6.1 size=774582 2024-09-12T17:41:59.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.419+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=7ZV981VQ3PE6 tag=7KR9S9765MQ7 type=write size=2871734 2024-09-12T17:41:59.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.420+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=GRXU6F97FJXK type=del 2024-09-12T17:41:59.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.422+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.0 size=1048576 2024-09-12T17:41:59.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.423+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.1 size=1048576 2024-09-12T17:41:59.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.424+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.2 size=675018 2024-09-12T17:41:59.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.424+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=DRSNX6VVZR2G tag=D2DFDAM1545N type=write size=3820746 2024-09-12T17:41:59.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.426+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=R7A8HT7EXULG type=write 2024-09-12T17:41:59.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.428+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~LF8VXUTQ3OLG.0 size=272885 2024-09-12T17:41:59.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.428+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=LF8VXUTQ3OLG tag=V236QY4UQK5S type=write size=1321461 2024-09-12T17:41:59.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.429+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~R1OO3HPM99JC.0 size=293267 2024-09-12T17:41:59.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.431+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=R1OO3HPM99JC tag=0P8G1E4NZVFZ type=write size=1341843 2024-09-12T17:41:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.433+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~OWDGS99PSI3L.0 size=1048576 2024-09-12T17:41:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.434+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~OWDGS99PSI3L.1 size=963055 2024-09-12T17:41:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.434+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=OWDGS99PSI3L tag=W9YR4KYK5WD5 type=write size=3060207 2024-09-12T17:41:59.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.436+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=OIZD6ZZHXD5Z type=del 2024-09-12T17:41:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.438+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.0 size=1048576 2024-09-12T17:41:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.439+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.1 size=1048576 2024-09-12T17:41:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.440+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.2 size=931738 2024-09-12T17:41:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.440+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=GFVW5HBKHETE tag=XJZYB2VG2YYD type=write size=4077466 2024-09-12T17:41:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.441+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=PRRPNMR6KLJO type=del 2024-09-12T17:41:59.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.442+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=BT71C2RABJF9 type=del size=2663226 2024-09-12T17:41:59.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.443+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=PY9UK1MBLPYZ type=del 2024-09-12T17:41:59.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.444+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=X3RVUU83ZS60 type=del size=2808052 2024-09-12T17:41:59.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.446+0000 7f330fbcc780 1 < suggested update operation key=MQV01X5P8JLG tag=UF0CURRV7DYG type=write size=736212 2024-09-12T17:41:59.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.448+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=0LBIMSHC1VZB type=del size=197796 2024-09-12T17:41:59.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.449+0000 7f330fbcc780 1 < canceled operation key=4KNGMX117Z7G tag=X7KKTQO42TV1 type=del size=1348586 2024-09-12T17:41:59.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.450+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=KOYDRL42V2PS type=write size=206237 2024-09-12T17:41:59.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.451+0000 7f330fbcc780 -1 < failed to complete operation key=MQV01X5P8JLG tag=4QM80HFJMOAS type=write size=709217: (22) Invalid argument 2024-09-12T17:41:59.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.452+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=DDSJRC5LAOL3 type=write size=825286 2024-09-12T17:41:59.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.453+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~IIMV2RL2UN6G.0 size=409656 2024-09-12T17:41:59.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.455+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=IIMV2RL2UN6G tag=326YZ7BPJM41 type=write size=1458232 2024-09-12T17:41:59.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.456+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=KLMSD4RLEFUO type=del size=500192 2024-09-12T17:41:59.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.457+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~IIUY9DIKP9YI.0 size=1048576 2024-09-12T17:41:59.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.458+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~IIUY9DIKP9YI.1 size=579813 2024-09-12T17:41:59.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.460+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=IIUY9DIKP9YI tag=T7UVFBDXVI9A type=write size=2676965 2024-09-12T17:41:59.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.462+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=91MUCML4JJJT type=del size=3936013 2024-09-12T17:41:59.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.464+0000 7f330fbcc780 1 < suggested update operation key=6ZDBF249S1L6 tag=TVYICM9015JX type=del size=2033931 2024-09-12T17:41:59.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.465+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=MJTWYUMBKRP2 type=del size=2241298 2024-09-12T17:41:59.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.466+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~LVZ385GOWDNS.0 size=129146 2024-09-12T17:41:59.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.468+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=LVZ385GOWDNS tag=FXL0PI3FTA2F type=write size=1177722 2024-09-12T17:41:59.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.471+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=22J9620WFU85 type=del size=3463577 2024-09-12T17:41:59.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.472+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~OIQVBML7N4NA.0 size=1048576 2024-09-12T17:41:59.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.473+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~OIQVBML7N4NA.1 size=634975 2024-09-12T17:41:59.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.475+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=OIQVBML7N4NA tag=A0ECM4OWHO62 type=write size=2732127 2024-09-12T17:41:59.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.476+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=5HP555WVO131 type=del size=1831039 2024-09-12T17:41:59.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.477+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=Q9I55MWVQNEV type=del 2024-09-12T17:41:59.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.478+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=KS902OG4RW4E type=write size=162238 2024-09-12T17:41:59.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.479+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~7ZV981VQ3PE6.0 size=1048576 2024-09-12T17:41:59.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.480+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~7ZV981VQ3PE6.1 size=774582 2024-09-12T17:41:59.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.482+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=7ZV981VQ3PE6 tag=7KR9S9765MQ7 type=write size=2871734 2024-09-12T17:41:59.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.484+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~K0AR0WYICT3C.0 size=1048576 2024-09-12T17:41:59.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.485+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~K0AR0WYICT3C.1 size=103040 2024-09-12T17:41:59.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.485+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=K0AR0WYICT3C tag=SENO8FKE1TDW type=write size=2200192 2024-09-12T17:41:59.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.487+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.0 size=1048576 2024-09-12T17:41:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.487+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.1 size=1048576 2024-09-12T17:41:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.487+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~DRSNX6VVZR2G.2 size=675018 2024-09-12T17:41:59.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.488+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=DRSNX6VVZR2G tag=D2DFDAM1545N type=write size=3820746 2024-09-12T17:41:59.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.490+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=DZTRKV4TRXHR type=del size=3688662 2024-09-12T17:41:59.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.491+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~LF8VXUTQ3OLG.0 size=272885 2024-09-12T17:41:59.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.493+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=LF8VXUTQ3OLG tag=V236QY4UQK5S type=write size=1321461 2024-09-12T17:41:59.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.494+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=VXBZCM9LO3O2 type=write size=26381 2024-09-12T17:41:59.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.495+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~OWDGS99PSI3L.0 size=1048576 2024-09-12T17:41:59.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.496+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~OWDGS99PSI3L.1 size=963055 2024-09-12T17:41:59.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.498+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=OWDGS99PSI3L tag=W9YR4KYK5WD5 type=write size=3060207 2024-09-12T17:41:59.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.499+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=PPS6UQLCUIBC type=del size=3641529 2024-09-12T17:41:59.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.500+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.0 size=1048576 2024-09-12T17:41:59.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.501+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.1 size=1048576 2024-09-12T17:41:59.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.502+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~GFVW5HBKHETE.2 size=931738 2024-09-12T17:41:59.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.504+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=GFVW5HBKHETE tag=XJZYB2VG2YYD type=write size=4077466 2024-09-12T17:41:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.505+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=R6W02ZKYEADW type=write size=177101 2024-09-12T17:41:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.507+0000 7f330fbcc780 1 < suggested remove operation key=1MJ2W1WMLR85 tag=BT71C2RABJF9 type=del 2024-09-12T17:41:59.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.508+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=ZR3DC5LNCTZV type=del size=2466828 2024-09-12T17:41:59.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.510+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=X3RVUU83ZS60 type=del 2024-09-12T17:41:59.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.511+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=GX95RLDGUHZB type=del size=4054999 2024-09-12T17:41:59.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.512+0000 7f330fbcc780 1 < canceled operation key=HJL73WQD8SD2 tag=0LBIMSHC1VZB type=del size=197796 2024-09-12T17:41:59.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.513+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=QUZCSKQ7AF7X type=del size=3465340 2024-09-12T17:41:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.514+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=KOYDRL42V2PS type=write size=206237 2024-09-12T17:41:59.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.516+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~G5XD6M0VTOHT.0 size=872772 2024-09-12T17:41:59.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.516+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=G5XD6M0VTOHT tag=7JAJ66HXGY3P type=write size=1921348 2024-09-12T17:41:59.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.518+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=DDSJRC5LAOL3 type=write size=825286 2024-09-12T17:41:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.520+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~2AXMH0CN1KIB.0 size=8405 2024-09-12T17:41:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.520+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=2AXMH0CN1KIB tag=C6RBXDQ4Z15H type=write size=1056981 2024-09-12T17:41:59.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.522+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=KLMSD4RLEFUO type=del size=500192 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.524+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.0 size=1048576 2024-09-12T17:41:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.525+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.1 size=1048576 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.526+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.2 size=345336 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.526+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=EVYDCNNZ813P tag=L11XY1MRH6TM type=write size=3491064 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.527+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=91MUCML4JJJT type=del 2024-09-12T17:41:59.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.528+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=JBX4GYB41VOT type=del size=1283456 2024-09-12T17:41:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.530+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=MJTWYUMBKRP2 type=del 2024-09-12T17:41:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.531+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=UU2B3NSWOT08 type=del size=1106113 2024-09-12T17:41:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.532+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=22J9620WFU85 type=del 2024-09-12T17:41:59.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.534+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.0 size=1048576 2024-09-12T17:41:59.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.535+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.1 size=1048576 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.536+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.2 size=293710 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.536+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=1U9SGKOW1E9J tag=T5SGRCBP8GCC type=write size=3439438 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.538+0000 7f330fbcc780 1 < suggested remove operation key=6ZDBF249S1L6 tag=5HP555WVO131 type=del 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.540+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~1TT1LE3AQIY0.0 size=702026 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.540+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=1TT1LE3AQIY0 tag=XPQSVECIGAS7 type=write size=1750602 2024-09-12T17:41:59.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.542+0000 7f330fbcc780 1 < suggested update operation key=QE2QJH2J5QDY tag=KS902OG4RW4E type=write size=162238 2024-09-12T17:41:59.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.543+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=G8I77SO5QOC0 type=del size=1595159 2024-09-12T17:41:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.545+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~K0AR0WYICT3C.0 size=1048576 2024-09-12T17:41:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.545+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~K0AR0WYICT3C.1 size=103040 2024-09-12T17:41:59.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.547+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=K0AR0WYICT3C tag=SENO8FKE1TDW type=write size=2200192 2024-09-12T17:41:59.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.549+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~SGWLATFZQJ46.0 size=1048576 2024-09-12T17:41:59.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.550+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~SGWLATFZQJ46.1 size=290831 2024-09-12T17:41:59.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.550+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=SGWLATFZQJ46 tag=E2X568XZUIVR type=write size=2387983 2024-09-12T17:41:59.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.553+0000 7f330fbcc780 1 < suggested update operation key=LNE0UR6JPWR8 tag=DZTRKV4TRXHR type=del size=3688662 2024-09-12T17:41:59.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.554+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=Q1M0MJNFMQQO type=del size=2626411 2024-09-12T17:41:59.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.555+0000 7f330fbcc780 1 < completed write operation key=D5ZZ93XAPRAA tag=VXBZCM9LO3O2 type=write size=26381 2024-09-12T17:41:59.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.557+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~ACC9Q7I3RTNU.0 size=1048576 2024-09-12T17:41:59.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.558+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~ACC9Q7I3RTNU.1 size=60234 2024-09-12T17:41:59.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.558+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=ACC9Q7I3RTNU tag=JORND3948JKJ type=write size=2157386 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.560+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=PPS6UQLCUIBC type=del 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.561+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=0913CH5640HS type=del size=2206769 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.562+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=R6W02ZKYEADW type=write size=177101 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.564+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=LIG6Q5AZIC6N type=del size=3226372 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.566+0000 7f330fbcc780 1 < suggested update operation key=SPKBX4WU9A9R tag=ZR3DC5LNCTZV type=del size=2466828 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.567+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=49YWLE3EEV7F type=write size=110982 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.568+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=GX95RLDGUHZB type=del 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.569+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=GEUZNLGH6LQ4 type=del size=3229075 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.570+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=QUZCSKQ7AF7X type=del 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.572+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=E6FI25E3Z5S4 type=del size=957656 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.573+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~G5XD6M0VTOHT.0 size=872772 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.574+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=G5XD6M0VTOHT tag=7JAJ66HXGY3P type=write size=1921348 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.576+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=ECZQO8ZLT88U type=del size=1110382 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.577+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~2AXMH0CN1KIB.0 size=8405 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.580+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=2AXMH0CN1KIB tag=C6RBXDQ4Z15H type=write size=1056981 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.581+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=QJH8ZB5N6ULJ type=del size=2079042 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.582+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.0 size=1048576 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.583+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.1 size=1048576 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.584+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~EVYDCNNZ813P.2 size=345336 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.586+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=EVYDCNNZ813P tag=L11XY1MRH6TM type=write size=3491064 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.588+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.0 size=1048576 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.589+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.1 size=1048576 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.590+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.2 size=957974 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.590+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=DWD2QNNC32NP tag=SH9W30SIKB1P type=write size=4103702 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.591+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=JBX4GYB41VOT type=del 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.593+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~ZPL05UAT4MW3.0 size=1048576 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.594+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~ZPL05UAT4MW3.1 size=167671 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.594+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=ZPL05UAT4MW3 tag=032W8ZX1LGTI type=write size=2264823 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.595+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=UU2B3NSWOT08 type=del 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.597+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~ZWRRKJHW4MNK.0 size=1048576 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.598+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~ZWRRKJHW4MNK.1 size=911363 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.598+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=ZWRRKJHW4MNK tag=TXNGYSDU1WXM type=write size=3008515 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.599+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.0 size=1048576 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.600+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.1 size=1048576 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.601+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~1U9SGKOW1E9J.2 size=293710 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.603+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=1U9SGKOW1E9J tag=T5SGRCBP8GCC type=write size=3439438 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.604+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=H5LP9REBB47J type=del size=4182540 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.605+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~1TT1LE3AQIY0.0 size=702026 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.607+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=1TT1LE3AQIY0 tag=XPQSVECIGAS7 type=write size=1750602 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.608+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=1Y73E6DCZZ6N type=write size=764130 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.609+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=G8I77SO5QOC0 type=del 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.610+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=G5GY9MA0B78J type=write size=871996 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.611+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~SGWLATFZQJ46.0 size=1048576 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.612+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~SGWLATFZQJ46.1 size=290831 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.614+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=SGWLATFZQJ46 tag=E2X568XZUIVR type=write size=2387983 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.616+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~9UD1GHG0E0O7.0 size=1048576 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.617+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~9UD1GHG0E0O7.1 size=995348 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.617+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=9UD1GHG0E0O7 tag=JURF72R34Q88 type=write size=3092500 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.618+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=Q1M0MJNFMQQO type=del 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.619+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=Y3K2ODQC18RS type=del size=2634623 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.620+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~ACC9Q7I3RTNU.0 size=1048576 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.621+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~ACC9Q7I3RTNU.1 size=60234 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.623+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=ACC9Q7I3RTNU tag=JORND3948JKJ type=write size=2157386 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.625+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~54SICWS3I29Q.0 size=860378 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.625+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=54SICWS3I29Q tag=MO54X12M53JQ type=write size=1908954 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.626+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=0913CH5640HS type=del 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.628+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.0 size=1048576 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.629+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.1 size=1048576 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.630+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.2 size=374808 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.630+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=KQ92W5480543 tag=CYWGR490L4C4 type=write size=3520536 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.631+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=LIG6Q5AZIC6N type=del 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.633+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=I1ZSA2TCZNYE type=write size=756419 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.635+0000 7f330fbcc780 1 < suggested update operation key=6MFVO30OX5W1 tag=49YWLE3EEV7F type=write size=110982 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.636+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=N1KGK2QP5B8J type=del size=2790346 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.637+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=GEUZNLGH6LQ4 type=del 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.638+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=TAASGCBTD2W5 type=del size=3031624 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.640+0000 7f330fbcc780 1 < suggested remove operation key=50WR6KLF40W7 tag=E6FI25E3Z5S4 type=del 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.642+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=6OHOC9I0AGF1 type=del size=1834907 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.644+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=ECZQO8ZLT88U type=del 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.646+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=IKP230I0TBYU type=del size=4091008 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.647+0000 7f330fbcc780 1 < canceled operation key=IEL4VF8ROC72 tag=QJH8ZB5N6ULJ type=del size=2079042 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.649+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~CVQJ9I27BWFZ.0 size=1048576 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.650+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~CVQJ9I27BWFZ.1 size=991028 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.650+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=CVQJ9I27BWFZ tag=0JO8I1T4UQGI type=write size=3088180 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.651+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.0 size=1048576 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.652+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.1 size=1048576 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.653+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~DWD2QNNC32NP.2 size=957974 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.655+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=DWD2QNNC32NP tag=SH9W30SIKB1P type=write size=4103702 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.657+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~NE4XTT8TM56G.0 size=1048576 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.658+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~NE4XTT8TM56G.1 size=820970 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.658+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=NE4XTT8TM56G tag=IW94INIZ6TLM type=write size=2918122 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.659+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~ZPL05UAT4MW3.0 size=1048576 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.660+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~ZPL05UAT4MW3.1 size=167671 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.662+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=ZPL05UAT4MW3 tag=032W8ZX1LGTI type=write size=2264823 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.663+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=239AOVLJ8XL1 type=del size=2511308 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.664+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~ZWRRKJHW4MNK.0 size=1048576 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.665+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~ZWRRKJHW4MNK.1 size=911363 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.667+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=ZWRRKJHW4MNK tag=TXNGYSDU1WXM type=write size=3008515 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.668+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=YN3YKPOD9FYB type=del size=106239 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.669+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=H5LP9REBB47J type=del 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.671+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.0 size=1048576 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.672+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.1 size=1048576 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.673+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.2 size=771939 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.673+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=RWBD3VOI1HZ8 tag=OSXIM2B3LCOY type=write size=3917667 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.675+0000 7f330fbcc780 1 < completed write operation key=5QBSRDY0LJ60 tag=1Y73E6DCZZ6N type=write size=764130 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.676+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=5TBOPKEW9LL1 type=del size=1573729 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.677+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=G5GY9MA0B78J type=write size=871996 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.678+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=XAC4IX6K1Y54 type=write size=438104 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.678+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~9UD1GHG0E0O7.0 size=1048576 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.679+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~9UD1GHG0E0O7.1 size=995348 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.681+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=9UD1GHG0E0O7 tag=JURF72R34Q88 type=write size=3092500 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.683+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~W0MK65TTH3BU.0 size=1048576 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.685+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~W0MK65TTH3BU.1 size=984856 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.685+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=W0MK65TTH3BU tag=S08EJ969PTVO type=write size=3082008 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.686+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=Y3K2ODQC18RS type=del 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.688+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~KVNZYRW639GY.0 size=1048576 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.689+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~KVNZYRW639GY.1 size=700163 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.689+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=KVNZYRW639GY tag=4I16OJJYSWLG type=write size=2797315 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.690+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~54SICWS3I29Q.0 size=860378 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.692+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=54SICWS3I29Q tag=MO54X12M53JQ type=write size=1908954 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.693+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=VHS295J2EXJ4 type=del size=3854522 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.694+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.0 size=1048576 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.694+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.1 size=1048576 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.695+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~KQ92W5480543.2 size=374808 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.697+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=KQ92W5480543 tag=CYWGR490L4C4 type=write size=3520536 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.698+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=E4H5CKJZYQVE type=del size=2135255 2024-09-12T17:41:59.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.699+0000 7f330fbcc780 1 < completed write operation key=QE2QJH2J5QDY tag=I1ZSA2TCZNYE type=write size=756419 2024-09-12T17:41:59.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.701+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~X8XDZ764AWJ6.0 size=1048576 2024-09-12T17:41:59.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.702+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~X8XDZ764AWJ6.1 size=346513 2024-09-12T17:41:59.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.702+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=X8XDZ764AWJ6 tag=ERCXJWN4T5SQ type=write size=2443665 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.703+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=N1KGK2QP5B8J type=del 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.704+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=ZXHWQ88FQUQ1 type=del size=1304910 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.705+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=TAASGCBTD2W5 type=del 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.706+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=JDQW0G06VUR3 type=write size=624251 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.707+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=6OHOC9I0AGF1 type=del 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.709+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~8UTFF3JCQI8T.0 size=1048576 2024-09-12T17:41:59.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.710+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~8UTFF3JCQI8T.1 size=253436 2024-09-12T17:41:59.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.710+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=8UTFF3JCQI8T tag=GH087LUW93DD type=write size=2350588 2024-09-12T17:41:59.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.711+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=IKP230I0TBYU type=del 2024-09-12T17:41:59.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.712+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=ZZ7NXCLHQ5G7 type=del size=2046329 2024-09-12T17:41:59.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.713+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~CVQJ9I27BWFZ.0 size=1048576 2024-09-12T17:41:59.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.714+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~CVQJ9I27BWFZ.1 size=991028 2024-09-12T17:41:59.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.716+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=CVQJ9I27BWFZ tag=0JO8I1T4UQGI type=write size=3088180 2024-09-12T17:41:59.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.717+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=ZB21L0H3Y3SZ type=del size=1168159 2024-09-12T17:41:59.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.718+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~NE4XTT8TM56G.0 size=1048576 2024-09-12T17:41:59.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.719+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~NE4XTT8TM56G.1 size=820970 2024-09-12T17:41:59.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.721+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=NE4XTT8TM56G tag=IW94INIZ6TLM type=write size=2918122 2024-09-12T17:41:59.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.722+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=08SHWO56Z092 type=del size=261432 2024-09-12T17:41:59.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.723+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=239AOVLJ8XL1 type=del 2024-09-12T17:41:59.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.724+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=DKU3LILGKNDH type=write size=159806 2024-09-12T17:41:59.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.726+0000 7f330fbcc780 1 < suggested update operation key=LNE0UR6JPWR8 tag=YN3YKPOD9FYB type=del size=106239 2024-09-12T17:41:59.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.728+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=HR3XFWQ5NKRX type=del size=2023461 2024-09-12T17:41:59.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.729+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.0 size=1048576 2024-09-12T17:41:59.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.730+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.1 size=1048576 2024-09-12T17:41:59.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.730+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~RWBD3VOI1HZ8.2 size=771939 2024-09-12T17:41:59.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.732+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=RWBD3VOI1HZ8 tag=OSXIM2B3LCOY type=write size=3917667 2024-09-12T17:41:59.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.734+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~SSQULGNKUKQF.0 size=908468 2024-09-12T17:41:59.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.734+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=SSQULGNKUKQF tag=6VHIM8FIT4PO type=write size=1957044 2024-09-12T17:41:59.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.735+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=5TBOPKEW9LL1 type=del 2024-09-12T17:41:59.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.737+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.0 size=1048576 2024-09-12T17:41:59.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.738+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.1 size=1048576 2024-09-12T17:41:59.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.739+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.2 size=69929 2024-09-12T17:41:59.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.739+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=7RE9YEJLHCSC tag=C2WGQT039YQ1 type=write size=3215657 2024-09-12T17:41:59.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.741+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=XAC4IX6K1Y54 type=write 2024-09-12T17:41:59.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.743+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.0 size=1048576 2024-09-12T17:41:59.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.744+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.1 size=1048576 2024-09-12T17:41:59.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.745+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.2 size=817016 2024-09-12T17:41:59.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.745+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=XWN488RPLVUA tag=71Q5W3SON6PQ type=write size=3962744 2024-09-12T17:41:59.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.746+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~W0MK65TTH3BU.0 size=1048576 2024-09-12T17:41:59.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.747+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~W0MK65TTH3BU.1 size=984856 2024-09-12T17:41:59.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.749+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=W0MK65TTH3BU tag=S08EJ969PTVO type=write size=3082008 2024-09-12T17:41:59.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.750+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=8EG5WA7QU0I9 type=del size=194911 2024-09-12T17:41:59.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.751+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~KVNZYRW639GY.0 size=1048576 2024-09-12T17:41:59.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.752+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~KVNZYRW639GY.1 size=700163 2024-09-12T17:41:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.754+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=KVNZYRW639GY tag=4I16OJJYSWLG type=write size=2797315 2024-09-12T17:41:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.755+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=FLGAYLYZAFQT type=write size=321987 2024-09-12T17:41:59.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.756+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=VHS295J2EXJ4 type=del 2024-09-12T17:41:59.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.757+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=M60MQ54PO8CH type=del size=2517651 2024-09-12T17:41:59.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.758+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=E4H5CKJZYQVE type=del 2024-09-12T17:41:59.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.759+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=7LNPQWP9DF9O type=del size=3720139 2024-09-12T17:41:59.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.760+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~X8XDZ764AWJ6.0 size=1048576 2024-09-12T17:41:59.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.761+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~X8XDZ764AWJ6.1 size=346513 2024-09-12T17:41:59.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.763+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=X8XDZ764AWJ6 tag=ERCXJWN4T5SQ type=write size=2443665 2024-09-12T17:41:59.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.765+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~J4IXD6A1DHDB.0 size=1048576 2024-09-12T17:41:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.766+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~J4IXD6A1DHDB.1 size=372340 2024-09-12T17:41:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.766+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=J4IXD6A1DHDB tag=REE0ZWIYEE9B type=write size=2469492 2024-09-12T17:41:59.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.768+0000 7f330fbcc780 1 < suggested update operation key=XIW3OJB1STT9 tag=ZXHWQ88FQUQ1 type=del size=1304910 2024-09-12T17:41:59.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.769+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=PPHWLUM5S7FR type=del size=692003 2024-09-12T17:41:59.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.770+0000 7f330fbcc780 1 < completed write operation key=TKJOJ17LIWX6 tag=JDQW0G06VUR3 type=write size=624251 2024-09-12T17:41:59.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.772+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~HGCY0O0RKH5S.0 size=1048576 2024-09-12T17:41:59.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.773+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~HGCY0O0RKH5S.1 size=441652 2024-09-12T17:41:59.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.773+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=HGCY0O0RKH5S tag=ITNVUTM40ZMO type=write size=2538804 2024-09-12T17:41:59.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.774+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~8UTFF3JCQI8T.0 size=1048576 2024-09-12T17:41:59.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.775+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~8UTFF3JCQI8T.1 size=253436 2024-09-12T17:41:59.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.777+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=8UTFF3JCQI8T tag=GH087LUW93DD type=write size=2350588 2024-09-12T17:41:59.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.779+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=4CJCXG3ED6W4 type=del size=1912483 2024-09-12T17:41:59.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.780+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=ZZ7NXCLHQ5G7 type=del 2024-09-12T17:41:59.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.781+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=SGAYRNLBKPSZ type=del size=1785257 2024-09-12T17:41:59.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.782+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=ZB21L0H3Y3SZ type=del 2024-09-12T17:41:59.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.784+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~42QATUU5J7XC.0 size=919741 2024-09-12T17:41:59.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.784+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=42QATUU5J7XC tag=J0X2BMLZC9Z5 type=write size=1968317 2024-09-12T17:41:59.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.785+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=08SHWO56Z092 type=del 2024-09-12T17:41:59.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.788+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=3DXGATA5NPUW type=del size=1771001 2024-09-12T17:41:59.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.789+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=DKU3LILGKNDH type=write size=159806 2024-09-12T17:41:59.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.791+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~NXS2H6TRCBNQ.0 size=412248 2024-09-12T17:41:59.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.791+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=NXS2H6TRCBNQ tag=8A4K3NWL8ABX type=write size=1460824 2024-09-12T17:41:59.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.793+0000 7f330fbcc780 1 < suggested remove operation key=6MFVO30OX5W1 tag=HR3XFWQ5NKRX type=del 2024-09-12T17:41:59.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.794+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=A2G7VKOP7HJ7 type=del size=3757268 2024-09-12T17:41:59.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.796+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~SSQULGNKUKQF.0 size=908468 2024-09-12T17:41:59.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.797+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=SSQULGNKUKQF tag=6VHIM8FIT4PO type=write size=1957044 2024-09-12T17:41:59.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.799+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=XBMR65HG3EG7 type=del size=2119127 2024-09-12T17:41:59.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.800+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.0 size=1048576 2024-09-12T17:41:59.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.801+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.1 size=1048576 2024-09-12T17:41:59.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.802+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~7RE9YEJLHCSC.2 size=69929 2024-09-12T17:41:59.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.803+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=7RE9YEJLHCSC tag=C2WGQT039YQ1 type=write size=3215657 2024-09-12T17:41:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.805+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=A4HPO9HG74H5 type=del size=2989129 2024-09-12T17:41:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.806+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.0 size=1048576 2024-09-12T17:41:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.807+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.1 size=1048576 2024-09-12T17:41:59.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.808+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~XWN488RPLVUA.2 size=817016 2024-09-12T17:41:59.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.810+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=XWN488RPLVUA tag=71Q5W3SON6PQ type=write size=3962744 2024-09-12T17:41:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.811+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=HIQK27Z7AZZG type=write size=1027603 2024-09-12T17:41:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.812+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=8EG5WA7QU0I9 type=del 2024-09-12T17:41:59.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.813+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=ERV55AOVIQ3P type=write size=85433 2024-09-12T17:41:59.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.814+0000 7f330fbcc780 1 < completed write operation key=MQV01X5P8JLG tag=FLGAYLYZAFQT type=write size=321987 2024-09-12T17:41:59.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.815+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=32FST0LRF25D type=del size=1234570 2024-09-12T17:41:59.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.816+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=M60MQ54PO8CH type=del 2024-09-12T17:41:59.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.818+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=XCO01PGOGO1I type=del size=3799594 2024-09-12T17:41:59.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.819+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=7LNPQWP9DF9O type=del 2024-09-12T17:41:59.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.820+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=778TKDFVSZZI type=write size=483222 2024-09-12T17:41:59.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.821+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~J4IXD6A1DHDB.0 size=1048576 2024-09-12T17:41:59.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.821+0000 7f330fbcc780 1 < canceled part key=_multipart_AL3ESPG15NO4.2~J4IXD6A1DHDB.1 size=372340 2024-09-12T17:41:59.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.823+0000 7f330fbcc780 1 < canceled multipart upload key=AL3ESPG15NO4 upload=J4IXD6A1DHDB tag=REE0ZWIYEE9B type=write size=2469492 2024-09-12T17:41:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.824+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=TC5CQ1309O2W type=write size=560908 2024-09-12T17:41:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.826+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=PPHWLUM5S7FR type=del 2024-09-12T17:41:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.828+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~PCEFLLN6UBHW.0 size=744628 2024-09-12T17:41:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.828+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=PCEFLLN6UBHW tag=BQN2UVGR5M7F type=write size=1793204 2024-09-12T17:41:59.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.830+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~HGCY0O0RKH5S.0 size=1048576 2024-09-12T17:41:59.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.830+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~HGCY0O0RKH5S.1 size=441652 2024-09-12T17:41:59.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.832+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=HGCY0O0RKH5S tag=ITNVUTM40ZMO type=write size=2538804 2024-09-12T17:41:59.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.833+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=2ZW6O2Q6MIPD type=del size=3949928 2024-09-12T17:41:59.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.834+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=4CJCXG3ED6W4 type=del 2024-09-12T17:41:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.835+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=1V856B7XTA3Z type=del size=897931 2024-09-12T17:41:59.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.836+0000 7f330fbcc780 1 < canceled operation key=9X4FNKQWJCX4 tag=SGAYRNLBKPSZ type=del size=1785257 2024-09-12T17:41:59.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.837+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=1B22O08EVFSU type=del size=3156885 2024-09-12T17:41:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.838+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~42QATUU5J7XC.0 size=919741 2024-09-12T17:41:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.840+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=42QATUU5J7XC tag=J0X2BMLZC9Z5 type=write size=1968317 2024-09-12T17:41:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.842+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=X2YZC810EZQ7 type=del size=3912758 2024-09-12T17:41:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.842+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=6MFVO30OX5W1 tag=3DXGATA5NPUW type=del size=1771001: (2) No such file or directory 2024-09-12T17:41:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.844+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~99FUJS0U6ZL1.0 size=467468 2024-09-12T17:41:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.844+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=99FUJS0U6ZL1 tag=HWQA32VOM6YQ type=write size=1516044 2024-09-12T17:41:59.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.844+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~NXS2H6TRCBNQ.0 size=412248 2024-09-12T17:41:59.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.846+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=NXS2H6TRCBNQ tag=8A4K3NWL8ABX type=write size=1460824 2024-09-12T17:41:59.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.848+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.0 size=1048576 2024-09-12T17:41:59.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.849+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.1 size=1048576 2024-09-12T17:41:59.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.850+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.2 size=931532 2024-09-12T17:41:59.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.850+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=8QY9K1VIXDHE tag=ZUURXK2SJOXU type=write size=4077260 2024-09-12T17:41:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.851+0000 7f330fbcc780 1 < canceled operation key=XIW3OJB1STT9 tag=A2G7VKOP7HJ7 type=del size=3757268 2024-09-12T17:41:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.852+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=6PZMDEWJWR0K type=del size=2694847 2024-09-12T17:41:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.853+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=XBMR65HG3EG7 type=del 2024-09-12T17:41:59.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.855+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.0 size=1048576 2024-09-12T17:41:59.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.856+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.1 size=1048576 2024-09-12T17:41:59.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.857+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.2 size=918066 2024-09-12T17:41:59.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.857+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=N8HC2DKKHGJP tag=SN6NG4DL6ZYJ type=write size=4063794 2024-09-12T17:41:59.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.859+0000 7f330fbcc780 1 < suggested remove operation key=6ZDBF249S1L6 tag=A4HPO9HG74H5 type=del 2024-09-12T17:41:59.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.861+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=ANEPLDBL0RKW type=del size=2907538 2024-09-12T17:41:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.862+0000 7f330fbcc780 1 < canceled operation key=3IHGI1UMI1BA tag=HIQK27Z7AZZG type=write size=1027603 2024-09-12T17:41:59.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.863+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=FYT9J1MGCO5G type=del size=3946633 2024-09-12T17:41:59.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.864+0000 7f330fbcc780 -1 < failed to complete operation key=AL3ESPG15NO4 tag=ERV55AOVIQ3P type=write size=85433: (22) Invalid argument 2024-09-12T17:41:59.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.865+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=78ODWLKMG1SA type=write size=264947 2024-09-12T17:41:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.867+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=32FST0LRF25D type=del 2024-09-12T17:41:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.869+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~B72GOJCH0X5L.0 size=817079 2024-09-12T17:41:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.869+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=B72GOJCH0X5L tag=5SSU8PAQ9784 type=write size=1865655 2024-09-12T17:41:59.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.871+0000 7f330fbcc780 1 < suggested remove operation key=H1LAU7WDZW6S tag=XCO01PGOGO1I type=del 2024-09-12T17:41:59.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.872+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=IU23LNVZPM4Y type=del size=1377197 2024-09-12T17:41:59.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.873+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=778TKDFVSZZI type=write size=483222 2024-09-12T17:41:59.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.874+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=CTBMRZDM37AO type=del size=3040101 2024-09-12T17:41:59.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.876+0000 7f330fbcc780 1 < suggested update operation key=MQV01X5P8JLG tag=TC5CQ1309O2W type=write size=560908 2024-09-12T17:41:59.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.879+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~LYQQKR4746WW.0 size=1048576 2024-09-12T17:41:59.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.879+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~LYQQKR4746WW.1 size=537994 2024-09-12T17:41:59.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.879+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=LYQQKR4746WW tag=3MHYFWUAFJNV type=write size=2635146 2024-09-12T17:41:59.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.880+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~PCEFLLN6UBHW.0 size=744628 2024-09-12T17:41:59.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.882+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=PCEFLLN6UBHW tag=BQN2UVGR5M7F type=write size=1793204 2024-09-12T17:41:59.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.884+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.0 size=1048576 2024-09-12T17:41:59.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.885+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.1 size=1048576 2024-09-12T17:41:59.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.886+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.2 size=81322 2024-09-12T17:41:59.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.886+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=HK93KOSINQDL tag=3GIK8R4AJLOB type=write size=3227050 2024-09-12T17:41:59.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.887+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=2ZW6O2Q6MIPD type=del 2024-09-12T17:41:59.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.889+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~EX825G32ZAWB.0 size=1048576 2024-09-12T17:41:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.890+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~EX825G32ZAWB.1 size=96316 2024-09-12T17:41:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.890+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=EX825G32ZAWB tag=FUK53RTPF60H type=write size=2193468 2024-09-12T17:41:59.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.892+0000 7f330fbcc780 1 < suggested remove operation key=2CY67P4QM19H tag=1V856B7XTA3Z type=del 2024-09-12T17:41:59.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.893+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=QEK3DGS4HBAK type=del size=640074 2024-09-12T17:41:59.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.895+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=1B22O08EVFSU type=del 2024-09-12T17:41:59.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.898+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~UQM7WEXHN2SA.0 size=649004 2024-09-12T17:41:59.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.898+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=UQM7WEXHN2SA tag=QKQ3SQNCA0C3 type=write size=1697580 2024-09-12T17:41:59.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.899+0000 7f330fbcc780 1 < canceled operation key=IEL4VF8ROC72 tag=X2YZC810EZQ7 type=del size=3912758 2024-09-12T17:41:59.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.901+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8OPMW04A2DY2.0 size=1048576 2024-09-12T17:41:59.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.902+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8OPMW04A2DY2.1 size=485159 2024-09-12T17:41:59.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.902+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=8OPMW04A2DY2 tag=98AXUR600UHH type=write size=2582311 2024-09-12T17:41:59.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.903+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~99FUJS0U6ZL1.0 size=467468 2024-09-12T17:41:59.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.905+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=99FUJS0U6ZL1 tag=HWQA32VOM6YQ type=write size=1516044 2024-09-12T17:41:59.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.906+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=3C0AJUE46JBK type=del size=951037 2024-09-12T17:41:59.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.907+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.0 size=1048576 2024-09-12T17:41:59.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.908+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.1 size=1048576 2024-09-12T17:41:59.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.909+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~8QY9K1VIXDHE.2 size=931532 2024-09-12T17:41:59.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.911+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=8QY9K1VIXDHE tag=ZUURXK2SJOXU type=write size=4077260 2024-09-12T17:41:59.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.912+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=IIKCPV8YN935 type=del size=2588535 2024-09-12T17:41:59.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.914+0000 7f330fbcc780 1 < suggested remove operation key=XIW3OJB1STT9 tag=6PZMDEWJWR0K type=del 2024-09-12T17:41:59.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.915+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=FJFY8OHXOWMR type=write size=540783 2024-09-12T17:41:59.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.916+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.0 size=1048576 2024-09-12T17:41:59.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.917+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.1 size=1048576 2024-09-12T17:41:59.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.918+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~N8HC2DKKHGJP.2 size=918066 2024-09-12T17:41:59.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.920+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=N8HC2DKKHGJP tag=SN6NG4DL6ZYJ type=write size=4063794 2024-09-12T17:41:59.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.921+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=38JE6XS00B3R type=del size=840873 2024-09-12T17:41:59.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.922+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=ANEPLDBL0RKW type=del 2024-09-12T17:41:59.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.925+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.0 size=1048576 2024-09-12T17:41:59.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.925+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.1 size=1048576 2024-09-12T17:41:59.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.926+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.2 size=40593 2024-09-12T17:41:59.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.926+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=I505Z5SNVHR9 tag=NEFQ4SA4TNVB type=write size=3186321 2024-09-12T17:41:59.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.927+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=FYT9J1MGCO5G type=del 2024-09-12T17:41:59.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.928+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=328D5ZOEBT1J type=del size=86436 2024-09-12T17:41:59.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.929+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=78ODWLKMG1SA type=write size=264947 2024-09-12T17:41:59.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.931+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~E4EU1F5FE0EJ.0 size=1048576 2024-09-12T17:41:59.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.932+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~E4EU1F5FE0EJ.1 size=232474 2024-09-12T17:41:59.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.932+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=E4EU1F5FE0EJ tag=7PFKA727YK06 type=write size=2329626 2024-09-12T17:41:59.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.933+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~B72GOJCH0X5L.0 size=817079 2024-09-12T17:41:59.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.935+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=B72GOJCH0X5L tag=5SSU8PAQ9784 type=write size=1865655 2024-09-12T17:41:59.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.937+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~Y0J5YRRWWVCS.0 size=705094 2024-09-12T17:41:59.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.937+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=Y0J5YRRWWVCS tag=U343P7Q43QRB type=write size=1753670 2024-09-12T17:41:59.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.938+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=IU23LNVZPM4Y type=del 2024-09-12T17:41:59.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.939+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=869WSEH93UQY type=del size=492651 2024-09-12T17:41:59.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.941+0000 7f330fbcc780 1 < suggested remove operation key=3BU8T85GXCX4 tag=CTBMRZDM37AO type=del 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.943+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~L2AX9T7WSIHU.0 size=1048576 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.944+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~L2AX9T7WSIHU.1 size=148230 2024-09-12T17:41:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.944+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=L2AX9T7WSIHU tag=M3OO7RM7H0RD type=write size=2245382 2024-09-12T17:41:59.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.945+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~LYQQKR4746WW.0 size=1048576 2024-09-12T17:41:59.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.945+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~LYQQKR4746WW.1 size=537994 2024-09-12T17:41:59.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.947+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=LYQQKR4746WW tag=3MHYFWUAFJNV type=write size=2635146 2024-09-12T17:41:59.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.949+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~4AXR4O7WZCNF.0 size=1048576 2024-09-12T17:41:59.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.950+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~4AXR4O7WZCNF.1 size=592219 2024-09-12T17:41:59.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.950+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=4AXR4O7WZCNF tag=OB2DR54UQD3C type=write size=2689371 2024-09-12T17:41:59.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.951+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.0 size=1048576 2024-09-12T17:41:59.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.952+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.1 size=1048576 2024-09-12T17:41:59.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.953+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~HK93KOSINQDL.2 size=81322 2024-09-12T17:41:59.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.955+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=HK93KOSINQDL tag=3GIK8R4AJLOB type=write size=3227050 2024-09-12T17:41:59.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.956+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=OC4E9OVTYKL8 type=del size=2028518 2024-09-12T17:41:59.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.957+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~EX825G32ZAWB.0 size=1048576 2024-09-12T17:41:59.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.958+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~EX825G32ZAWB.1 size=96316 2024-09-12T17:41:59.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.960+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=EX825G32ZAWB tag=FUK53RTPF60H type=write size=2193468 2024-09-12T17:41:59.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.963+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.0 size=1048576 2024-09-12T17:41:59.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.963+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.1 size=1048576 2024-09-12T17:41:59.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.964+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.2 size=158042 2024-09-12T17:41:59.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.964+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=UG1EXAMUJ3R6 tag=5JG3G97P6LO2 type=write size=3303770 2024-09-12T17:41:59.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.965+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=QEK3DGS4HBAK type=del 2024-09-12T17:41:59.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.967+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=ZJVWM6W02OO0 type=write size=763561 2024-09-12T17:41:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.968+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~UQM7WEXHN2SA.0 size=649004 2024-09-12T17:41:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.970+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=UQM7WEXHN2SA tag=QKQ3SQNCA0C3 type=write size=1697580 2024-09-12T17:41:59.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.972+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~Y4F0NBNBZ4F4.0 size=116126 2024-09-12T17:41:59.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.972+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=Y4F0NBNBZ4F4 tag=6WNWGFSUZHN2 type=write size=1164702 2024-09-12T17:41:59.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.973+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8OPMW04A2DY2.0 size=1048576 2024-09-12T17:41:59.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.974+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8OPMW04A2DY2.1 size=485159 2024-09-12T17:41:59.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.975+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=8OPMW04A2DY2 tag=98AXUR600UHH type=write size=2582311 2024-09-12T17:41:59.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.977+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~2TVZK0RXXD5R.0 size=805640 2024-09-12T17:41:59.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.977+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=2TVZK0RXXD5R tag=OH2DFFQHVERX type=write size=1854216 2024-09-12T17:41:59.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.979+0000 7f330fbcc780 -1 < failed to complete operation key=3BU8T85GXCX4 tag=3C0AJUE46JBK type=del size=951037: (22) Invalid argument 2024-09-12T17:41:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.981+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~T9UAXV6XECAN.0 size=46300 2024-09-12T17:41:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.981+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=T9UAXV6XECAN tag=JLBQW82QMG2F type=write size=1094876 2024-09-12T17:41:59.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.982+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=IIKCPV8YN935 type=del 2024-09-12T17:41:59.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.983+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=UW2FTKDNVOL0 type=del size=1713696 2024-09-12T17:41:59.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.984+0000 7f330fbcc780 1 < completed write operation key=QE2QJH2J5QDY tag=FJFY8OHXOWMR type=write size=540783 2024-09-12T17:41:59.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.985+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=X6DHBBDVFVE2 type=write size=226803 2024-09-12T17:41:59.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.987+0000 7f330fbcc780 1 < canceled operation key=SPKBX4WU9A9R tag=38JE6XS00B3R type=del size=840873 2024-09-12T17:41:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.989+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~136W90AUYS2J.0 size=678187 2024-09-12T17:41:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.989+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=136W90AUYS2J tag=380VCN1Z7KSB type=write size=1726763 2024-09-12T17:41:59.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.990+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.0 size=1048576 2024-09-12T17:41:59.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.991+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.1 size=1048576 2024-09-12T17:41:59.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.992+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~I505Z5SNVHR9.2 size=40593 2024-09-12T17:41:59.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.994+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=I505Z5SNVHR9 tag=NEFQ4SA4TNVB type=write size=3186321 2024-09-12T17:41:59.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.996+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~E3RVKI44VBYX.0 size=1048576 2024-09-12T17:41:59.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.998+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~E3RVKI44VBYX.1 size=1036231 2024-09-12T17:41:59.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:41:59.998+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=E3RVKI44VBYX tag=F1WPUTAY3LBF type=write size=3133383 2024-09-12T17:42:00.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.000+0000 7f330fbcc780 1 < suggested remove operation key=30CIXFQV5VBI tag=328D5ZOEBT1J type=del 2024-09-12T17:42:00.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.001+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=ISBATC19R6PP type=del size=883372 2024-09-12T17:42:00.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.002+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~E4EU1F5FE0EJ.0 size=1048576 2024-09-12T17:42:00.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.003+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~E4EU1F5FE0EJ.1 size=232474 2024-09-12T17:42:00.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.005+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=E4EU1F5FE0EJ tag=7PFKA727YK06 type=write size=2329626 2024-09-12T17:42:00.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.007+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.0 size=1048576 2024-09-12T17:42:00.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.008+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.1 size=1048576 2024-09-12T17:42:00.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.009+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.2 size=16582 2024-09-12T17:42:00.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.009+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=SHSD3UQOCR51 tag=13I2R6VBJFZ3 type=write size=3162310 2024-09-12T17:42:00.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.010+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~Y0J5YRRWWVCS.0 size=705094 2024-09-12T17:42:00.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.011+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=Y0J5YRRWWVCS tag=U343P7Q43QRB type=write size=1753670 2024-09-12T17:42:00.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.013+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.0 size=1048576 2024-09-12T17:42:00.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.014+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.1 size=1048576 2024-09-12T17:42:00.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.015+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.2 size=1025842 2024-09-12T17:42:00.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.015+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=E11CLRWFA90E tag=XROY338L5UB9 type=write size=4171570 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.017+0000 7f330fbcc780 1 < suggested remove operation key=AGM33OK1W7A6 tag=869WSEH93UQY type=del 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.020+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~M85L96MH4MVO.0 size=1048576 2024-09-12T17:42:00.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.020+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~M85L96MH4MVO.1 size=854684 2024-09-12T17:42:00.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.020+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=M85L96MH4MVO tag=MAE6NE8342PC type=write size=2951836 2024-09-12T17:42:00.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.022+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~L2AX9T7WSIHU.0 size=1048576 2024-09-12T17:42:00.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.022+0000 7f330fbcc780 1 < canceled part key=_multipart_3IHGI1UMI1BA.2~L2AX9T7WSIHU.1 size=148230 2024-09-12T17:42:00.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.023+0000 7f330fbcc780 1 < canceled multipart upload key=3IHGI1UMI1BA upload=L2AX9T7WSIHU tag=M3OO7RM7H0RD type=write size=2245382 2024-09-12T17:42:00.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.025+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~E6MNFJH0GCYM.0 size=672620 2024-09-12T17:42:00.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.025+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=E6MNFJH0GCYM tag=YM4IJEP3Z8VQ type=write size=1721196 2024-09-12T17:42:00.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.027+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~4AXR4O7WZCNF.0 size=1048576 2024-09-12T17:42:00.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.027+0000 7f330fbcc780 1 < canceled part key=_multipart_MQV01X5P8JLG.2~4AXR4O7WZCNF.1 size=592219 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.028+0000 7f330fbcc780 1 < canceled multipart upload key=MQV01X5P8JLG upload=4AXR4O7WZCNF tag=OB2DR54UQD3C type=write size=2689371 2024-09-12T17:42:00.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.030+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~3OEQCAGBJW1A.0 size=1048576 2024-09-12T17:42:00.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.031+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~3OEQCAGBJW1A.1 size=115150 2024-09-12T17:42:00.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.031+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=3OEQCAGBJW1A tag=4Z3NZXRO0IHD type=write size=2212302 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.032+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=OC4E9OVTYKL8 type=del 2024-09-12T17:42:00.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.033+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=QT1DCVGWH4BG type=del size=1899730 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.035+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.0 size=1048576 2024-09-12T17:42:00.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.036+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.1 size=1048576 2024-09-12T17:42:00.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.036+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~UG1EXAMUJ3R6.2 size=158042 2024-09-12T17:42:00.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.038+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=UG1EXAMUJ3R6 tag=5JG3G97P6LO2 type=write size=3303770 2024-09-12T17:42:00.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.039+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=76182M8N8UOU type=del size=1857275 2024-09-12T17:42:00.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.040+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=ZJVWM6W02OO0 type=write size=763561 2024-09-12T17:42:00.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.041+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=QFFC482Y8YI4 type=del size=3329264 2024-09-12T17:42:00.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.042+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~Y4F0NBNBZ4F4.0 size=116126 2024-09-12T17:42:00.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.044+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=Y4F0NBNBZ4F4 tag=6WNWGFSUZHN2 type=write size=1164702 2024-09-12T17:42:00.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.046+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~MU9T4WBS788G.0 size=1048576 2024-09-12T17:42:00.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.047+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~MU9T4WBS788G.1 size=877516 2024-09-12T17:42:00.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.047+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=MU9T4WBS788G tag=EZUVTXQSL1XK type=write size=2974668 2024-09-12T17:42:00.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.048+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~2TVZK0RXXD5R.0 size=805640 2024-09-12T17:42:00.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.050+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=2TVZK0RXXD5R tag=OH2DFFQHVERX type=write size=1854216 2024-09-12T17:42:00.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.051+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~FY0X04KKE628.0 size=293632 2024-09-12T17:42:00.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.051+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=FY0X04KKE628 tag=M9TO9M2GK1C0 type=write size=1342208 2024-09-12T17:42:00.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.053+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~T9UAXV6XECAN.0 size=46300 2024-09-12T17:42:00.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.054+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=T9UAXV6XECAN tag=JLBQW82QMG2F type=write size=1094876 2024-09-12T17:42:00.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.056+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.0 size=1048576 2024-09-12T17:42:00.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.057+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.1 size=1048576 2024-09-12T17:42:00.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.058+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.2 size=855257 2024-09-12T17:42:00.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.058+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=3VLU1OR9J62R tag=L0BFPKQZT4N8 type=write size=4000985 2024-09-12T17:42:00.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.059+0000 7f330fbcc780 1 < canceled operation key=ZEC2RXNOR3D1 tag=UW2FTKDNVOL0 type=del size=1713696 2024-09-12T17:42:00.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.061+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.0 size=1048576 2024-09-12T17:42:00.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.062+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.1 size=1048576 2024-09-12T17:42:00.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.063+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.2 size=452030 2024-09-12T17:42:00.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.063+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=2QNEKPM60UDP tag=RJJJP80B6KO3 type=write size=3597758 2024-09-12T17:42:00.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.064+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=X6DHBBDVFVE2 type=write size=226803 2024-09-12T17:42:00.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.066+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~FFIFDKAD64BQ.0 size=608178 2024-09-12T17:42:00.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.066+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=FFIFDKAD64BQ tag=F4XTJTWTAGGG type=write size=1656754 2024-09-12T17:42:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.067+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~136W90AUYS2J.0 size=678187 2024-09-12T17:42:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.069+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=136W90AUYS2J tag=380VCN1Z7KSB type=write size=1726763 2024-09-12T17:42:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.071+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~5ZF7K700X9CL.0 size=54007 2024-09-12T17:42:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.071+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=5ZF7K700X9CL tag=AP4SHRPE0MOA type=write size=1102583 2024-09-12T17:42:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.072+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~E3RVKI44VBYX.0 size=1048576 2024-09-12T17:42:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.072+0000 7f330fbcc780 1 < canceled part key=_multipart_SPKBX4WU9A9R.2~E3RVKI44VBYX.1 size=1036231 2024-09-12T17:42:00.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.074+0000 7f330fbcc780 1 < canceled multipart upload key=SPKBX4WU9A9R upload=E3RVKI44VBYX tag=F1WPUTAY3LBF type=write size=3133383 2024-09-12T17:42:00.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.076+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.0 size=1048576 2024-09-12T17:42:00.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.077+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.1 size=1048576 2024-09-12T17:42:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.078+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.2 size=351738 2024-09-12T17:42:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.078+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=DU5H812GV9GA tag=F6CTFFQ3FT8X type=write size=3497466 2024-09-12T17:42:00.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.079+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=ISBATC19R6PP type=del 2024-09-12T17:42:00.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.081+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=ENNHBE32ZFIZ type=del size=2630587 2024-09-12T17:42:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.082+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.0 size=1048576 2024-09-12T17:42:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.083+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.1 size=1048576 2024-09-12T17:42:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.083+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~SHSD3UQOCR51.2 size=16582 2024-09-12T17:42:00.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.085+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=SHSD3UQOCR51 tag=13I2R6VBJFZ3 type=write size=3162310 2024-09-12T17:42:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.087+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~COWQ9JDV213J.0 size=221066 2024-09-12T17:42:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.087+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=COWQ9JDV213J tag=DZU11SKOND0L type=write size=1269642 2024-09-12T17:42:00.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.088+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.0 size=1048576 2024-09-12T17:42:00.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.089+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.1 size=1048576 2024-09-12T17:42:00.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.090+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~E11CLRWFA90E.2 size=1025842 2024-09-12T17:42:00.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.092+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=E11CLRWFA90E tag=XROY338L5UB9 type=write size=4171570 2024-09-12T17:42:00.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.093+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=ZMTIFP7U2HBY type=del size=3161048 2024-09-12T17:42:00.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.094+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~M85L96MH4MVO.0 size=1048576 2024-09-12T17:42:00.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.095+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~M85L96MH4MVO.1 size=854684 2024-09-12T17:42:00.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.097+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=M85L96MH4MVO tag=MAE6NE8342PC type=write size=2951836 2024-09-12T17:42:00.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.099+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=J1C0DPIXOMES type=del size=819706 2024-09-12T17:42:00.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.100+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~E6MNFJH0GCYM.0 size=672620 2024-09-12T17:42:00.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.102+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=E6MNFJH0GCYM tag=YM4IJEP3Z8VQ type=write size=1721196 2024-09-12T17:42:00.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.103+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=JQX566LUH5AG type=del size=2643607 2024-09-12T17:42:00.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.104+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~3OEQCAGBJW1A.0 size=1048576 2024-09-12T17:42:00.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.105+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~3OEQCAGBJW1A.1 size=115150 2024-09-12T17:42:00.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.107+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=3OEQCAGBJW1A tag=4Z3NZXRO0IHD type=write size=2212302 2024-09-12T17:42:00.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.108+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=I5M1H27I4920 type=del size=56424 2024-09-12T17:42:00.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.109+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=QT1DCVGWH4BG type=del 2024-09-12T17:42:00.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.111+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=SBZG1GJYHYIZ type=del size=4092551 2024-09-12T17:42:00.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.113+0000 7f330fbcc780 1 < suggested remove operation key=6MFVO30OX5W1 tag=76182M8N8UOU type=del 2024-09-12T17:42:00.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.115+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~BNV7YTBBQKVH.0 size=702265 2024-09-12T17:42:00.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.115+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=BNV7YTBBQKVH tag=UUU9DNUX0EY2 type=write size=1750841 2024-09-12T17:42:00.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.116+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=QFFC482Y8YI4 type=del size=3329264 2024-09-12T17:42:00.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.117+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=3OO69RER2NR7 type=del size=1097820 2024-09-12T17:42:00.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.118+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~MU9T4WBS788G.0 size=1048576 2024-09-12T17:42:00.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.119+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~MU9T4WBS788G.1 size=877516 2024-09-12T17:42:00.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.121+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=MU9T4WBS788G tag=EZUVTXQSL1XK type=write size=2974668 2024-09-12T17:42:00.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.122+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=0TENQS85OZXS type=del size=162272 2024-09-12T17:42:00.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.123+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~FY0X04KKE628.0 size=293632 2024-09-12T17:42:00.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.125+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=FY0X04KKE628 tag=M9TO9M2GK1C0 type=write size=1342208 2024-09-12T17:42:00.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.126+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=HEVNZ7WJ2TKO type=del size=3293231 2024-09-12T17:42:00.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.128+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.0 size=1048576 2024-09-12T17:42:00.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.129+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.1 size=1048576 2024-09-12T17:42:00.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.130+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~3VLU1OR9J62R.2 size=855257 2024-09-12T17:42:00.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.132+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=3VLU1OR9J62R tag=L0BFPKQZT4N8 type=write size=4000985 2024-09-12T17:42:00.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.133+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=KE1UX67T7ZJ7 type=del size=2830772 2024-09-12T17:42:00.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.133+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.0 size=1048576 2024-09-12T17:42:00.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.134+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.1 size=1048576 2024-09-12T17:42:00.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.135+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~2QNEKPM60UDP.2 size=452030 2024-09-12T17:42:00.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.137+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=2QNEKPM60UDP tag=RJJJP80B6KO3 type=write size=3597758 2024-09-12T17:42:00.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.138+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=MOGATSCUPXBJ type=del size=477346 2024-09-12T17:42:00.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.138+0000 7f330fbcc780 1 < canceled part key=_multipart_30CIXFQV5VBI.2~FFIFDKAD64BQ.0 size=608178 2024-09-12T17:42:00.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.140+0000 7f330fbcc780 1 < canceled multipart upload key=30CIXFQV5VBI upload=FFIFDKAD64BQ tag=F4XTJTWTAGGG type=write size=1656754 2024-09-12T17:42:00.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.143+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~8JGTALWI1HEI.0 size=1048576 2024-09-12T17:42:00.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.143+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~8JGTALWI1HEI.1 size=662679 2024-09-12T17:42:00.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.143+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=8JGTALWI1HEI tag=HINO9XMN59OK type=write size=2759831 2024-09-12T17:42:00.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.145+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~5ZF7K700X9CL.0 size=54007 2024-09-12T17:42:00.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.147+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=5ZF7K700X9CL tag=AP4SHRPE0MOA type=write size=1102583 2024-09-12T17:42:00.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.149+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.0 size=1048576 2024-09-12T17:42:00.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.150+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.1 size=1048576 2024-09-12T17:42:00.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.151+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.2 size=784974 2024-09-12T17:42:00.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.151+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=RELWH0QQSYJ7 tag=6NS7CRGWKI03 type=write size=3930702 2024-09-12T17:42:00.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.152+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.0 size=1048576 2024-09-12T17:42:00.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.153+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.1 size=1048576 2024-09-12T17:42:00.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.154+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~DU5H812GV9GA.2 size=351738 2024-09-12T17:42:00.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.156+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=DU5H812GV9GA tag=F6CTFFQ3FT8X type=write size=3497466 2024-09-12T17:42:00.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.157+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=LEA8RWLJGHGH type=del size=69042 2024-09-12T17:42:00.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.160+0000 7f330fbcc780 1 < suggested update operation key=HJL73WQD8SD2 tag=ENNHBE32ZFIZ type=del size=2630587 2024-09-12T17:42:00.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.162+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~UK595ZJMCH8I.0 size=504450 2024-09-12T17:42:00.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.162+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=UK595ZJMCH8I tag=UB9W93BB8SN9 type=write size=1553026 2024-09-12T17:42:00.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.163+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~COWQ9JDV213J.0 size=221066 2024-09-12T17:42:00.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.165+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=COWQ9JDV213J tag=DZU11SKOND0L type=write size=1269642 2024-09-12T17:42:00.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.167+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~J69KYFWILK0A.0 size=1048576 2024-09-12T17:42:00.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.168+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~J69KYFWILK0A.1 size=792322 2024-09-12T17:42:00.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.168+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=J69KYFWILK0A tag=S149XJL9OIA8 type=write size=2889474 2024-09-12T17:42:00.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.170+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=ZMTIFP7U2HBY type=del 2024-09-12T17:42:00.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.171+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=E0BPVPD6NF45 type=del size=2690547 2024-09-12T17:42:00.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.173+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=J1C0DPIXOMES type=del 2024-09-12T17:42:00.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.175+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=SG72GD750CFN type=del size=3300736 2024-09-12T17:42:00.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.176+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=JQX566LUH5AG type=del 2024-09-12T17:42:00.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.177+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=31KBZZ3MJILE type=write size=797186 2024-09-12T17:42:00.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.180+0000 7f330fbcc780 1 < suggested update operation key=QE2QJH2J5QDY tag=I5M1H27I4920 type=del size=56424 2024-09-12T17:42:00.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.181+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=2WAH7FD3NTZX type=del size=2977054 2024-09-12T17:42:00.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.182+0000 7f330fbcc780 1 < canceled operation key=9X4FNKQWJCX4 tag=SBZG1GJYHYIZ type=del size=4092551 2024-09-12T17:42:00.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.183+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=LPXK1DV0O6KS type=del size=1499490 2024-09-12T17:42:00.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.185+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~BNV7YTBBQKVH.0 size=702265 2024-09-12T17:42:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.187+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=BNV7YTBBQKVH tag=UUU9DNUX0EY2 type=write size=1750841 2024-09-12T17:42:00.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.188+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=K4UARMV3F2Z2 type=write size=279655 2024-09-12T17:42:00.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.189+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=3OO69RER2NR7 type=del 2024-09-12T17:42:00.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.190+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=LZTZWBZ86E6X type=del size=187529 2024-09-12T17:42:00.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.192+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=0TENQS85OZXS type=del 2024-09-12T17:42:00.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.194+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~XKKLKQRRVLOX.0 size=736321 2024-09-12T17:42:00.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.194+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=XKKLKQRRVLOX tag=UX4A9T9QM17N type=write size=1784897 2024-09-12T17:42:00.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.196+0000 7f330fbcc780 1 < suggested remove operation key=1MJ2W1WMLR85 tag=HEVNZ7WJ2TKO type=del 2024-09-12T17:42:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.198+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=GAUE3Y0VPFR2 type=del size=2372931 2024-09-12T17:42:00.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.199+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=KE1UX67T7ZJ7 type=del size=2830772 2024-09-12T17:42:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.200+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=ISUNQ11X3R2L type=del size=2679824 2024-09-12T17:42:00.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.201+0000 7f330fbcc780 -1 < failed to complete operation key=8UX8W3FAJ3D9 tag=MOGATSCUPXBJ type=del size=477346: (22) Invalid argument 2024-09-12T17:42:00.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.203+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.0 size=1048576 2024-09-12T17:42:00.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.204+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.1 size=1048576 2024-09-12T17:42:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.205+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.2 size=312596 2024-09-12T17:42:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.205+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=JHZDOYOSYETZ tag=C0UWCUR6M41L type=write size=3458324 2024-09-12T17:42:00.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.206+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~8JGTALWI1HEI.0 size=1048576 2024-09-12T17:42:00.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.207+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~8JGTALWI1HEI.1 size=662679 2024-09-12T17:42:00.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.210+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=8JGTALWI1HEI tag=HINO9XMN59OK type=write size=2759831 2024-09-12T17:42:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.212+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.0 size=1048576 2024-09-12T17:42:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.213+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.1 size=1048576 2024-09-12T17:42:00.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.214+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.2 size=763137 2024-09-12T17:42:00.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.214+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=PO3DIBAE8TMW tag=54S3G37YH6IM type=write size=3908865 2024-09-12T17:42:00.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.215+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.0 size=1048576 2024-09-12T17:42:00.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.216+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.1 size=1048576 2024-09-12T17:42:00.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.217+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~RELWH0QQSYJ7.2 size=784974 2024-09-12T17:42:00.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.219+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=RELWH0QQSYJ7 tag=6NS7CRGWKI03 type=write size=3930702 2024-09-12T17:42:00.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.220+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=AYOI38JI2SHN type=del size=2607746 2024-09-12T17:42:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.222+0000 7f330fbcc780 1 < canceled operation key=70COM4KLK2R1 tag=LEA8RWLJGHGH type=del size=69042 2024-09-12T17:42:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.223+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=UKTTDBFC1J3P type=write size=277398 2024-09-12T17:42:00.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.224+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~UK595ZJMCH8I.0 size=504450 2024-09-12T17:42:00.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.226+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=UK595ZJMCH8I tag=UB9W93BB8SN9 type=write size=1553026 2024-09-12T17:42:00.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.227+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=EJ7JKKJM2YU3 type=write size=24121 2024-09-12T17:42:00.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.228+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~J69KYFWILK0A.0 size=1048576 2024-09-12T17:42:00.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.229+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~J69KYFWILK0A.1 size=792322 2024-09-12T17:42:00.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.231+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=J69KYFWILK0A tag=S149XJL9OIA8 type=write size=2889474 2024-09-12T17:42:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.232+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=PQ5UTUT743KG type=write size=299792 2024-09-12T17:42:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.233+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=E0BPVPD6NF45 type=del 2024-09-12T17:42:00.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.235+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.0 size=1048576 2024-09-12T17:42:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.236+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.1 size=1048576 2024-09-12T17:42:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.236+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.2 size=711292 2024-09-12T17:42:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.236+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=5OR4XGDXKJKI tag=LHFETSRBYI6Y type=write size=3857020 2024-09-12T17:42:00.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.239+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=SG72GD750CFN type=del 2024-09-12T17:42:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.240+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=OIA7KVBLIV7L type=write size=990995 2024-09-12T17:42:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.242+0000 7f330fbcc780 1 < suggested remove operation key=30CIXFQV5VBI tag=31KBZZ3MJILE type=write 2024-09-12T17:42:00.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.243+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=T8VNUGNHCRWZ type=del size=199991 2024-09-12T17:42:00.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.244+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=2WAH7FD3NTZX type=del 2024-09-12T17:42:00.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.245+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=A8JBVUC0QQSH type=del size=2113131 2024-09-12T17:42:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.246+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=LPXK1DV0O6KS type=del 2024-09-12T17:42:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.248+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=IA00ONYMCBM4 type=del size=2292173 2024-09-12T17:42:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.249+0000 7f330fbcc780 1 < canceled operation key=50WR6KLF40W7 tag=K4UARMV3F2Z2 type=write size=279655 2024-09-12T17:42:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.251+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~VGQLO1CWD8DI.0 size=737346 2024-09-12T17:42:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.251+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=VGQLO1CWD8DI tag=A4QK3BF2X2IN type=write size=1785922 2024-09-12T17:42:00.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.252+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=LZTZWBZ86E6X type=del 2024-09-12T17:42:00.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.253+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=0RRTW1QYMGGJ type=write size=916567 2024-09-12T17:42:00.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.254+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~XKKLKQRRVLOX.0 size=736321 2024-09-12T17:42:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.256+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=XKKLKQRRVLOX tag=UX4A9T9QM17N type=write size=1784897 2024-09-12T17:42:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.258+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=WZBM8CATU5RJ type=del size=3676346 2024-09-12T17:42:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.259+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=GAUE3Y0VPFR2 type=del 2024-09-12T17:42:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.260+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=N0YLPVJJZ34C type=del size=4150059 2024-09-12T17:42:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.262+0000 7f330fbcc780 1 < suggested remove operation key=MQV01X5P8JLG tag=ISUNQ11X3R2L type=del 2024-09-12T17:42:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.264+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~3579OC5R80GH.0 size=1048576 2024-09-12T17:42:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.265+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~3579OC5R80GH.1 size=49420 2024-09-12T17:42:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.265+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=3579OC5R80GH tag=A2L33U5PGEGG type=write size=2146572 2024-09-12T17:42:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.266+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.0 size=1048576 2024-09-12T17:42:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.266+0000 7f330fbcc780 1 < canceled part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.1 size=1048576 2024-09-12T17:42:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.267+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~JHZDOYOSYETZ.2 size=312596 2024-09-12T17:42:00.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.269+0000 7f330fbcc780 1 < canceled multipart upload key=LF4NGY13WYHK upload=JHZDOYOSYETZ tag=C0UWCUR6M41L type=write size=3458324 2024-09-12T17:42:00.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.270+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=0EQ5XTQF7JX3 type=write size=466529 2024-09-12T17:42:00.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.271+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.0 size=1048576 2024-09-12T17:42:00.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.273+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.1 size=1048576 2024-09-12T17:42:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.274+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PO3DIBAE8TMW.2 size=763137 2024-09-12T17:42:00.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.276+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=PO3DIBAE8TMW tag=54S3G37YH6IM type=write size=3908865 2024-09-12T17:42:00.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.278+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~RV3STN7EJMDC.0 size=1048576 2024-09-12T17:42:00.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.279+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~RV3STN7EJMDC.1 size=286335 2024-09-12T17:42:00.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.279+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=RV3STN7EJMDC tag=0ML3M3OMVCY7 type=write size=2383487 2024-09-12T17:42:00.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.280+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=TKJOJ17LIWX6 tag=AYOI38JI2SHN type=del size=2607746: (2) No such file or directory 2024-09-12T17:42:00.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.282+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~4OCVVX359MKH.0 size=118323 2024-09-12T17:42:00.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.282+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=4OCVVX359MKH tag=KGRI577V6VJ7 type=write size=1166899 2024-09-12T17:42:00.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.283+0000 7f330fbcc780 1 < completed write operation key=IEL4VF8ROC72 tag=UKTTDBFC1J3P type=write size=277398 2024-09-12T17:42:00.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.284+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=90VWHD4YWLZJ type=del size=1661815 2024-09-12T17:42:00.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.285+0000 7f330fbcc780 1 < canceled operation key=2CY67P4QM19H tag=EJ7JKKJM2YU3 type=write size=24121 2024-09-12T17:42:00.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.287+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~RR3IXFTUKFK9.0 size=22855 2024-09-12T17:42:00.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.287+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=RR3IXFTUKFK9 tag=WXS57G0R5Z3S type=write size=1071431 2024-09-12T17:42:00.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.289+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=PQ5UTUT743KG type=write size=299792 2024-09-12T17:42:00.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.291+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~96C0O2WHI3PE.0 size=363197 2024-09-12T17:42:00.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.291+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=96C0O2WHI3PE tag=SO9QPP8EUWEO type=write size=1411773 2024-09-12T17:42:00.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.291+0000 7f330fbcc780 1 < canceled part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.0 size=1048576 2024-09-12T17:42:00.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.292+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.1 size=1048576 2024-09-12T17:42:00.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.293+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~5OR4XGDXKJKI.2 size=711292 2024-09-12T17:42:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.295+0000 7f330fbcc780 1 < canceled multipart upload key=H1LAU7WDZW6S upload=5OR4XGDXKJKI tag=LHFETSRBYI6Y type=write size=3857020 2024-09-12T17:42:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.297+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~A8M3VYM11YA8.0 size=1048576 2024-09-12T17:42:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.298+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~A8M3VYM11YA8.1 size=117075 2024-09-12T17:42:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.298+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=A8M3VYM11YA8 tag=FSNO5I6RMZRT type=write size=2214227 2024-09-12T17:42:00.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.300+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=OIA7KVBLIV7L type=write 2024-09-12T17:42:00.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.301+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=IYXXSLT3DXXU type=del size=3884325 2024-09-12T17:42:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.302+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=T8VNUGNHCRWZ type=del 2024-09-12T17:42:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.304+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~WBJLT7BJH61W.0 size=1048576 2024-09-12T17:42:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.305+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~WBJLT7BJH61W.1 size=461212 2024-09-12T17:42:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.305+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=WBJLT7BJH61W tag=7UCW0699MLIY type=write size=2558364 2024-09-12T17:42:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.306+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=A8JBVUC0QQSH type=del 2024-09-12T17:42:00.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.307+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=UBCQN7PJU1EF type=del size=3342322 2024-09-12T17:42:00.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.309+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=IA00ONYMCBM4 type=del 2024-09-12T17:42:00.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.310+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=BTID7CEUJ86S type=write size=88588 2024-09-12T17:42:00.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.311+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~VGQLO1CWD8DI.0 size=737346 2024-09-12T17:42:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.313+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=VGQLO1CWD8DI tag=A4QK3BF2X2IN type=write size=1785922 2024-09-12T17:42:00.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.314+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=7NG9OH27SWCM type=del size=3502830 2024-09-12T17:42:00.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.315+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=0RRTW1QYMGGJ type=write size=916567 2024-09-12T17:42:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.316+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=5G4VC5PKB1J2 type=del size=594066 2024-09-12T17:42:00.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.318+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=WZBM8CATU5RJ type=del 2024-09-12T17:42:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.319+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=VOIKC3G50GHB type=del size=84514 2024-09-12T17:42:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.320+0000 7f330fbcc780 -1 < failed to complete operation key=MQV01X5P8JLG tag=N0YLPVJJZ34C type=del size=4150059: (22) Invalid argument 2024-09-12T17:42:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.322+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.0 size=1048576 2024-09-12T17:42:00.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.323+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.1 size=1048576 2024-09-12T17:42:00.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.324+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.2 size=538586 2024-09-12T17:42:00.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.324+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=SN1RXRJBGTLG tag=EHYCT3YZX0VZ type=write size=3684314 2024-09-12T17:42:00.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.325+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~3579OC5R80GH.0 size=1048576 2024-09-12T17:42:00.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.326+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~3579OC5R80GH.1 size=49420 2024-09-12T17:42:00.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.327+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=3579OC5R80GH tag=A2L33U5PGEGG type=write size=2146572 2024-09-12T17:42:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.329+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~MP9R8CFS909X.0 size=682777 2024-09-12T17:42:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.329+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=MP9R8CFS909X tag=GQY4WL4Q4T9J type=write size=1731353 2024-09-12T17:42:00.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.332+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=0EQ5XTQF7JX3 type=write size=466529 2024-09-12T17:42:00.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.334+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~WY9LV1B0PMUW.0 size=47742 2024-09-12T17:42:00.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.334+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=WY9LV1B0PMUW tag=TSUXTX17NKRQ type=write size=1096318 2024-09-12T17:42:00.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.335+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~RV3STN7EJMDC.0 size=1048576 2024-09-12T17:42:00.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.336+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~RV3STN7EJMDC.1 size=286335 2024-09-12T17:42:00.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.337+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=RV3STN7EJMDC tag=0ML3M3OMVCY7 type=write size=2383487 2024-09-12T17:42:00.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.339+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~FL1CC20EFMST.0 size=1048576 2024-09-12T17:42:00.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.340+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~FL1CC20EFMST.1 size=467511 2024-09-12T17:42:00.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.340+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=FL1CC20EFMST tag=OD6Z22CB2K55 type=write size=2564663 2024-09-12T17:42:00.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.341+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~4OCVVX359MKH.0 size=118323 2024-09-12T17:42:00.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.343+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=4OCVVX359MKH tag=KGRI577V6VJ7 type=write size=1166899 2024-09-12T17:42:00.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.344+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=S63P34WTAX26 type=del size=3559890 2024-09-12T17:42:00.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.345+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=90VWHD4YWLZJ type=del 2024-09-12T17:42:00.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.347+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=S84482QYSA3X type=del size=3258969 2024-09-12T17:42:00.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.348+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~RR3IXFTUKFK9.0 size=22855 2024-09-12T17:42:00.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.350+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=RR3IXFTUKFK9 tag=WXS57G0R5Z3S type=write size=1071431 2024-09-12T17:42:00.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.352+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~KL5K6BYC5BMM.0 size=1048576 2024-09-12T17:42:00.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.352+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~KL5K6BYC5BMM.1 size=573698 2024-09-12T17:42:00.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.352+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=KL5K6BYC5BMM tag=UBANWANNML59 type=write size=2670850 2024-09-12T17:42:00.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.354+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~96C0O2WHI3PE.0 size=363197 2024-09-12T17:42:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.355+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=96C0O2WHI3PE tag=SO9QPP8EUWEO type=write size=1411773 2024-09-12T17:42:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.357+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~IFGPD3R88F6X.0 size=575047 2024-09-12T17:42:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.357+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=IFGPD3R88F6X tag=WHAJNYETOGSO type=write size=1623623 2024-09-12T17:42:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.359+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~A8M3VYM11YA8.0 size=1048576 2024-09-12T17:42:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.359+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~A8M3VYM11YA8.1 size=117075 2024-09-12T17:42:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.361+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=A8M3VYM11YA8 tag=FSNO5I6RMZRT type=write size=2214227 2024-09-12T17:42:00.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.362+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=3GOEP4I8096T type=del size=1432984 2024-09-12T17:42:00.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.364+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=IYXXSLT3DXXU type=del 2024-09-12T17:42:00.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.366+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~BUO62QLGADEV.0 size=359251 2024-09-12T17:42:00.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.366+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=BUO62QLGADEV tag=5J1YOV6RMOLR type=write size=1407827 2024-09-12T17:42:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.367+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~WBJLT7BJH61W.0 size=1048576 2024-09-12T17:42:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.368+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~WBJLT7BJH61W.1 size=461212 2024-09-12T17:42:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.369+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=WBJLT7BJH61W tag=7UCW0699MLIY type=write size=2558364 2024-09-12T17:42:00.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.370+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=LQ8YMJIEHIJD type=del size=43686 2024-09-12T17:42:00.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.372+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=UBCQN7PJU1EF type=del 2024-09-12T17:42:00.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.373+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=4MZKUP0XGPUX type=write size=319394 2024-09-12T17:42:00.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.374+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=BTID7CEUJ86S type=write size=88588 2024-09-12T17:42:00.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.375+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=M7HOTZQ4GGY6 type=write size=982154 2024-09-12T17:42:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.376+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=7NG9OH27SWCM type=del 2024-09-12T17:42:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.377+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=CAQKKXP038U8 type=del size=2565091 2024-09-12T17:42:00.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.378+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=5G4VC5PKB1J2 type=del 2024-09-12T17:42:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.380+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=56RAO38NYQE2 type=del size=726006 2024-09-12T17:42:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.381+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=VOIKC3G50GHB type=del 2024-09-12T17:42:00.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.382+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=3RPEHTGL8F2S type=write size=416902 2024-09-12T17:42:00.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.383+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.0 size=1048576 2024-09-12T17:42:00.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.384+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.1 size=1048576 2024-09-12T17:42:00.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.385+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~SN1RXRJBGTLG.2 size=538586 2024-09-12T17:42:00.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.387+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=SN1RXRJBGTLG tag=EHYCT3YZX0VZ type=write size=3684314 2024-09-12T17:42:00.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.389+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~UGQ9G0S5IWWM.0 size=499839 2024-09-12T17:42:00.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.389+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=UGQ9G0S5IWWM tag=3B1GWH26R2FA type=write size=1548415 2024-09-12T17:42:00.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.390+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~MP9R8CFS909X.0 size=682777 2024-09-12T17:42:00.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.392+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=MP9R8CFS909X tag=GQY4WL4Q4T9J type=write size=1731353 2024-09-12T17:42:00.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.394+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.0 size=1048576 2024-09-12T17:42:00.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.395+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.1 size=1048576 2024-09-12T17:42:00.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.396+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.2 size=8351 2024-09-12T17:42:00.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.396+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=ZD2VA7JE0XMS tag=HOQ2HQUARRT5 type=write size=3154079 2024-09-12T17:42:00.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.396+0000 7f330fbcc780 1 < canceled part key=_multipart_H1LAU7WDZW6S.2~WY9LV1B0PMUW.0 size=47742 2024-09-12T17:42:00.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.398+0000 7f330fbcc780 1 < canceled multipart upload key=H1LAU7WDZW6S upload=WY9LV1B0PMUW tag=TSUXTX17NKRQ type=write size=1096318 2024-09-12T17:42:00.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.399+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=MDX0DLBPECIH type=del size=3112864 2024-09-12T17:42:00.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.401+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~FL1CC20EFMST.0 size=1048576 2024-09-12T17:42:00.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.401+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~FL1CC20EFMST.1 size=467511 2024-09-12T17:42:00.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.403+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=FL1CC20EFMST tag=OD6Z22CB2K55 type=write size=2564663 2024-09-12T17:42:00.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.405+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.0 size=1048576 2024-09-12T17:42:00.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.406+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.1 size=1048576 2024-09-12T17:42:00.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.407+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.2 size=934465 2024-09-12T17:42:00.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.407+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=FG2U6AKW35G6 tag=VEWXTKZEPQJC type=write size=4080193 2024-09-12T17:42:00.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.408+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=S63P34WTAX26 type=del 2024-09-12T17:42:00.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.410+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=8PZWTWEPZ1VI type=del size=157191 2024-09-12T17:42:00.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.411+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=S84482QYSA3X type=del 2024-09-12T17:42:00.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.412+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=5NFJ9JYY18ZA type=del size=2569923 2024-09-12T17:42:00.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.413+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~KL5K6BYC5BMM.0 size=1048576 2024-09-12T17:42:00.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.414+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~KL5K6BYC5BMM.1 size=573698 2024-09-12T17:42:00.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.416+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=KL5K6BYC5BMM tag=UBANWANNML59 type=write size=2670850 2024-09-12T17:42:00.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.417+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=M8BN2I9FB9VJ type=del size=3146513 2024-09-12T17:42:00.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.418+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~IFGPD3R88F6X.0 size=575047 2024-09-12T17:42:00.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.421+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=IFGPD3R88F6X tag=WHAJNYETOGSO type=write size=1623623 2024-09-12T17:42:00.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.423+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=0WKV61UJS9Q0 type=del size=2969703 2024-09-12T17:42:00.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.424+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=3GOEP4I8096T type=del 2024-09-12T17:42:00.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.425+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=U55Y43614IPY type=write size=856182 2024-09-12T17:42:00.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.426+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~BUO62QLGADEV.0 size=359251 2024-09-12T17:42:00.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.428+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=BUO62QLGADEV tag=5J1YOV6RMOLR type=write size=1407827 2024-09-12T17:42:00.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.429+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=0QIDN7J2S8DN type=del size=3422497 2024-09-12T17:42:00.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.431+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=LQ8YMJIEHIJD type=del 2024-09-12T17:42:00.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.432+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=KJRT423XR0S5 type=del size=1984137 2024-09-12T17:42:00.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.434+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=4MZKUP0XGPUX type=write size=319394 2024-09-12T17:42:00.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.436+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=5R9FPXAJS657 type=write size=686893 2024-09-12T17:42:00.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.437+0000 7f330fbcc780 1 < canceled operation key=MQV01X5P8JLG tag=M7HOTZQ4GGY6 type=write size=982154 2024-09-12T17:42:00.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.438+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=W485NQON0KEV type=del size=1501538 2024-09-12T17:42:00.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.439+0000 7f330fbcc780 1 < canceled operation key=QE2QJH2J5QDY tag=CAQKKXP038U8 type=del size=2565091 2024-09-12T17:42:00.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.440+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=QASIGQWHND1J type=del size=1779352 2024-09-12T17:42:00.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.442+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=56RAO38NYQE2 type=del size=726006 2024-09-12T17:42:00.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.444+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=1VIKXWE5BP87 type=del size=2290766 2024-09-12T17:42:00.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.445+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=3RPEHTGL8F2S type=write size=416902 2024-09-12T17:42:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.447+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~LPPTVGZGQV9G.0 size=797293 2024-09-12T17:42:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.447+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=LPPTVGZGQV9G tag=1S2OHLH4PKKU type=write size=1845869 2024-09-12T17:42:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.448+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~UGQ9G0S5IWWM.0 size=499839 2024-09-12T17:42:00.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.450+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=UGQ9G0S5IWWM tag=3B1GWH26R2FA type=write size=1548415 2024-09-12T17:42:00.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.451+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=MDVTFQFRCU88 type=del size=1910225 2024-09-12T17:42:00.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.452+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.0 size=1048576 2024-09-12T17:42:00.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.453+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.1 size=1048576 2024-09-12T17:42:00.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.454+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~ZD2VA7JE0XMS.2 size=8351 2024-09-12T17:42:00.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.456+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=ZD2VA7JE0XMS tag=HOQ2HQUARRT5 type=write size=3154079 2024-09-12T17:42:00.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.457+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=7SEOO62W2SRD type=del size=4000260 2024-09-12T17:42:00.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.459+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=MDX0DLBPECIH type=del size=3112864 2024-09-12T17:42:00.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.461+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=S86MS534PDH0 type=del size=1001834 2024-09-12T17:42:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.462+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.0 size=1048576 2024-09-12T17:42:00.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.463+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.1 size=1048576 2024-09-12T17:42:00.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.464+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~FG2U6AKW35G6.2 size=934465 2024-09-12T17:42:00.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.466+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=FG2U6AKW35G6 tag=VEWXTKZEPQJC type=write size=4080193 2024-09-12T17:42:00.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.468+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.0 size=1048576 2024-09-12T17:42:00.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.469+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.1 size=1048576 2024-09-12T17:42:00.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.470+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.2 size=256240 2024-09-12T17:42:00.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.470+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=HFK0C3P1OV7E tag=SSDK9KR3YTQS type=write size=3401968 2024-09-12T17:42:00.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.471+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=8PZWTWEPZ1VI type=del 2024-09-12T17:42:00.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.473+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~F7ARV25ERS3U.0 size=187250 2024-09-12T17:42:00.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.473+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=F7ARV25ERS3U tag=88NMVNBO326X type=write size=1235826 2024-09-12T17:42:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.474+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=5NFJ9JYY18ZA type=del 2024-09-12T17:42:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.476+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~5J81G2Y8GL1M.0 size=259083 2024-09-12T17:42:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.476+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=5J81G2Y8GL1M tag=QGF63OZBZY0N type=write size=1307659 2024-09-12T17:42:00.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.477+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=M8BN2I9FB9VJ type=del 2024-09-12T17:42:00.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.480+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.0 size=1048576 2024-09-12T17:42:00.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.480+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.1 size=1048576 2024-09-12T17:42:00.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.481+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.2 size=436770 2024-09-12T17:42:00.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.481+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=NFYBZWIV5C58 tag=Q73RZ5XVP76S type=write size=3582498 2024-09-12T17:42:00.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.483+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=0WKV61UJS9Q0 type=del 2024-09-12T17:42:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.484+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=HIR94OS1DVRR type=del size=3557695 2024-09-12T17:42:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.486+0000 7f330fbcc780 1 < suggested update operation key=AL3ESPG15NO4 tag=U55Y43614IPY type=write size=856182 2024-09-12T17:42:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.488+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~14REVVC0Z12B.0 size=461296 2024-09-12T17:42:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.488+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=14REVVC0Z12B tag=Z5UOVAWNEV9L type=write size=1509872 2024-09-12T17:42:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.489+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=0QIDN7J2S8DN type=del 2024-09-12T17:42:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.490+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=8RYTNEWUAFOY type=del size=1938388 2024-09-12T17:42:00.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.492+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=KJRT423XR0S5 type=del size=1984137 2024-09-12T17:42:00.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.494+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=6JYKT9RQUD54 type=del size=1378381 2024-09-12T17:42:00.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.495+0000 7f330fbcc780 1 < completed write operation key=MQV01X5P8JLG tag=5R9FPXAJS657 type=write size=686893 2024-09-12T17:42:00.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.496+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=HXOPF9IXK50Q type=del size=475324 2024-09-12T17:42:00.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.498+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=W485NQON0KEV type=del 2024-09-12T17:42:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.499+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=4JJTMZH6H6QQ type=del size=2289347 2024-09-12T17:42:00.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.500+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=QASIGQWHND1J type=del 2024-09-12T17:42:00.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.501+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=H2RS1HVS56FZ type=del size=992530 2024-09-12T17:42:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.502+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=1VIKXWE5BP87 type=del 2024-09-12T17:42:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.503+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=JPIZ8FRYJN1H type=del size=3954965 2024-09-12T17:42:00.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.504+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~LPPTVGZGQV9G.0 size=797293 2024-09-12T17:42:00.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.506+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=LPPTVGZGQV9G tag=1S2OHLH4PKKU type=write size=1845869 2024-09-12T17:42:00.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.507+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=6709WPL434WF type=del size=3192567 2024-09-12T17:42:00.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.509+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=MDVTFQFRCU88 type=del 2024-09-12T17:42:00.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.511+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~OKMRWEIW139K.0 size=1048576 2024-09-12T17:42:00.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.512+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~OKMRWEIW139K.1 size=554439 2024-09-12T17:42:00.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.512+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=OKMRWEIW139K tag=PLDGB79G35VI type=write size=2651591 2024-09-12T17:42:00.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.513+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=7SEOO62W2SRD type=del 2024-09-12T17:42:00.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.514+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=2NWO0WNCOOD6 type=write size=826449 2024-09-12T17:42:00.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.516+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=S86MS534PDH0 type=del size=1001834 2024-09-12T17:42:00.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.518+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~KZNNO59C3DHM.0 size=1048576 2024-09-12T17:42:00.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.519+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~KZNNO59C3DHM.1 size=582609 2024-09-12T17:42:00.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.519+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=KZNNO59C3DHM tag=31XM0W5H7L7G type=write size=2679761 2024-09-12T17:42:00.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.519+0000 7f330fbcc780 1 < canceled part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.0 size=1048576 2024-09-12T17:42:00.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.520+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.1 size=1048576 2024-09-12T17:42:00.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.521+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~HFK0C3P1OV7E.2 size=256240 2024-09-12T17:42:00.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.523+0000 7f330fbcc780 1 < canceled multipart upload key=70COM4KLK2R1 upload=HFK0C3P1OV7E tag=SSDK9KR3YTQS type=write size=3401968 2024-09-12T17:42:00.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.525+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.0 size=1048576 2024-09-12T17:42:00.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.526+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.1 size=1048576 2024-09-12T17:42:00.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.527+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.2 size=996159 2024-09-12T17:42:00.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.527+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=LQGQ831TS1QG tag=68ZRQ9DX2YFE type=write size=4141887 2024-09-12T17:42:00.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.529+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~F7ARV25ERS3U.0 size=187250 2024-09-12T17:42:00.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.531+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=F7ARV25ERS3U tag=88NMVNBO326X type=write size=1235826 2024-09-12T17:42:00.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.533+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~2VQOBSU0AW3N.0 size=393387 2024-09-12T17:42:00.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.533+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=2VQOBSU0AW3N tag=BDCB1I0LE0U7 type=write size=1441963 2024-09-12T17:42:00.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.535+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~5J81G2Y8GL1M.0 size=259083 2024-09-12T17:42:00.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.536+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=5J81G2Y8GL1M tag=QGF63OZBZY0N type=write size=1307659 2024-09-12T17:42:00.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.539+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~TCLI9L1O41PO.0 size=1048576 2024-09-12T17:42:00.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.540+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~TCLI9L1O41PO.1 size=992959 2024-09-12T17:42:00.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.540+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=TCLI9L1O41PO tag=VJLAJ33QOC7B type=write size=3090111 2024-09-12T17:42:00.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.541+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.0 size=1048576 2024-09-12T17:42:00.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.542+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.1 size=1048576 2024-09-12T17:42:00.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.543+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~NFYBZWIV5C58.2 size=436770 2024-09-12T17:42:00.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.545+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=NFYBZWIV5C58 tag=Q73RZ5XVP76S type=write size=3582498 2024-09-12T17:42:00.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.546+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=98ZYGB3QMB3A type=del size=520572 2024-09-12T17:42:00.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.548+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=HIR94OS1DVRR type=del 2024-09-12T17:42:00.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.550+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~ZWLT3I8RT75Q.0 size=1048576 2024-09-12T17:42:00.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.551+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~ZWLT3I8RT75Q.1 size=236445 2024-09-12T17:42:00.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.551+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=ZWLT3I8RT75Q tag=267W440ZM9OL type=write size=2333597 2024-09-12T17:42:00.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.552+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~14REVVC0Z12B.0 size=461296 2024-09-12T17:42:00.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.554+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=14REVVC0Z12B tag=Z5UOVAWNEV9L type=write size=1509872 2024-09-12T17:42:00.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.555+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=QFEKM3KX3V15 type=del size=2062371 2024-09-12T17:42:00.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.556+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=8RYTNEWUAFOY type=del 2024-09-12T17:42:00.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.558+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=XOGAWB22UB50 type=del size=3102531 2024-09-12T17:42:00.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.559+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=6JYKT9RQUD54 type=del 2024-09-12T17:42:00.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.560+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=XV9JAM5J3YB6 type=del size=3380484 2024-09-12T17:42:00.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.561+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=HXOPF9IXK50Q type=del 2024-09-12T17:42:00.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.562+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=O85O3ZCDLXSO type=del size=451053 2024-09-12T17:42:00.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.563+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=4JJTMZH6H6QQ type=del 2024-09-12T17:42:00.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.565+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=NEMN2NBMOXW1 type=del size=2927501 2024-09-12T17:42:00.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.566+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=H2RS1HVS56FZ type=del 2024-09-12T17:42:00.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.568+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~WLBYAA5ET543.0 size=1048576 2024-09-12T17:42:00.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.569+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~WLBYAA5ET543.1 size=35882 2024-09-12T17:42:00.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.569+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=WLBYAA5ET543 tag=JTA0720Y1WH5 type=write size=2133034 2024-09-12T17:42:00.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.570+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=JPIZ8FRYJN1H type=del 2024-09-12T17:42:00.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.571+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=WH1GWW97XF4F type=write size=462199 2024-09-12T17:42:00.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.573+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=6709WPL434WF type=del 2024-09-12T17:42:00.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.575+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~GDB7XLK6M9EG.0 size=484137 2024-09-12T17:42:00.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.575+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=GDB7XLK6M9EG tag=I0A2M9X8EOFM type=write size=1532713 2024-09-12T17:42:00.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.576+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~OKMRWEIW139K.0 size=1048576 2024-09-12T17:42:00.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.577+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~OKMRWEIW139K.1 size=554439 2024-09-12T17:42:00.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.579+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=OKMRWEIW139K tag=PLDGB79G35VI type=write size=2651591 2024-09-12T17:42:00.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.581+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.0 size=1048576 2024-09-12T17:42:00.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.582+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.1 size=1048576 2024-09-12T17:42:00.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.583+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.2 size=804162 2024-09-12T17:42:00.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.583+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=2G2ZTL3V0ZAP tag=YSERJITADE8Z type=write size=3949890 2024-09-12T17:42:00.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.584+0000 7f330fbcc780 1 < completed write operation key=4KNGMX117Z7G tag=2NWO0WNCOOD6 type=write size=826449 2024-09-12T17:42:00.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.585+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=KT95WG4DS3MZ type=del size=1407906 2024-09-12T17:42:00.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.586+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~KZNNO59C3DHM.0 size=1048576 2024-09-12T17:42:00.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.587+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~KZNNO59C3DHM.1 size=582609 2024-09-12T17:42:00.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.589+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=KZNNO59C3DHM tag=31XM0W5H7L7G type=write size=2679761 2024-09-12T17:42:00.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.590+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=N3LRTM73ELT9 type=del size=3783070 2024-09-12T17:42:00.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.591+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.0 size=1048576 2024-09-12T17:42:00.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.592+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.1 size=1048576 2024-09-12T17:42:00.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.593+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LQGQ831TS1QG.2 size=996159 2024-09-12T17:42:00.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.595+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=LQGQ831TS1QG tag=68ZRQ9DX2YFE type=write size=4141887 2024-09-12T17:42:00.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.596+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=F7QRD3UDA9VV type=del size=3690923 2024-09-12T17:42:00.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.597+0000 7f330fbcc780 1 < canceled part key=_multipart_IEYJS7X97O1A.2~2VQOBSU0AW3N.0 size=393387 2024-09-12T17:42:00.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.599+0000 7f330fbcc780 1 < canceled multipart upload key=IEYJS7X97O1A upload=2VQOBSU0AW3N tag=BDCB1I0LE0U7 type=write size=1441963 2024-09-12T17:42:00.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.600+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=WV1IHY7ZKLXE type=del size=4142062 2024-09-12T17:42:00.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.601+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~TCLI9L1O41PO.0 size=1048576 2024-09-12T17:42:00.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.602+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~TCLI9L1O41PO.1 size=992959 2024-09-12T17:42:00.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.604+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=TCLI9L1O41PO tag=VJLAJ33QOC7B type=write size=3090111 2024-09-12T17:42:00.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.606+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.0 size=1048576 2024-09-12T17:42:00.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.607+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.1 size=1048576 2024-09-12T17:42:00.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.608+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.2 size=801418 2024-09-12T17:42:00.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.608+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=VVB410E09D0P tag=6YFEHZN1EPEE type=write size=3947146 2024-09-12T17:42:00.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.609+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=98ZYGB3QMB3A type=del 2024-09-12T17:42:00.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.611+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~YHZ15LID670G.0 size=1048576 2024-09-12T17:42:00.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.612+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~YHZ15LID670G.1 size=208923 2024-09-12T17:42:00.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.612+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=YHZ15LID670G tag=6LCHO2UIB2OS type=write size=2306075 2024-09-12T17:42:00.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.613+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~ZWLT3I8RT75Q.0 size=1048576 2024-09-12T17:42:00.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.614+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~ZWLT3I8RT75Q.1 size=236445 2024-09-12T17:42:00.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.616+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=ZWLT3I8RT75Q tag=267W440ZM9OL type=write size=2333597 2024-09-12T17:42:00.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.618+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~OW5S8C0G5P2Z.0 size=183566 2024-09-12T17:42:00.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.618+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=OW5S8C0G5P2Z tag=G7CE9DMLS91U type=write size=1232142 2024-09-12T17:42:00.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.619+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=QFEKM3KX3V15 type=del 2024-09-12T17:42:00.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.620+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=0P0VUHXPJN2H type=del size=2249411 2024-09-12T17:42:00.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.622+0000 7f330fbcc780 1 < canceled operation key=AGM33OK1W7A6 tag=XOGAWB22UB50 type=del size=3102531 2024-09-12T17:42:00.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.623+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=T456NM8IMTTX type=del size=4041685 2024-09-12T17:42:00.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.624+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=XV9JAM5J3YB6 type=del 2024-09-12T17:42:00.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.625+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=Z1A1EWG96SOD type=del size=1415917 2024-09-12T17:42:00.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.626+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=O85O3ZCDLXSO type=del 2024-09-12T17:42:00.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.629+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~VUFM2S6TFU8F.0 size=1048576 2024-09-12T17:42:00.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.630+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~VUFM2S6TFU8F.1 size=682424 2024-09-12T17:42:00.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.630+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=VUFM2S6TFU8F tag=9H7HVG8N6RIO type=write size=2779576 2024-09-12T17:42:00.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.633+0000 7f330fbcc780 1 < suggested remove operation key=6MFVO30OX5W1 tag=NEMN2NBMOXW1 type=del 2024-09-12T17:42:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.634+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=JZ0MKP55K8VQ type=write size=562471 2024-09-12T17:42:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.635+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~WLBYAA5ET543.0 size=1048576 2024-09-12T17:42:00.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.636+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~WLBYAA5ET543.1 size=35882 2024-09-12T17:42:00.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.638+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=WLBYAA5ET543 tag=JTA0720Y1WH5 type=write size=2133034 2024-09-12T17:42:00.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.639+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=XLEC7XLPLV82 type=del size=3086580 2024-09-12T17:42:00.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.642+0000 7f330fbcc780 1 < canceled operation key=4KNGMX117Z7G tag=WH1GWW97XF4F type=write size=462199 2024-09-12T17:42:00.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.643+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=MHCNM2GVEZLN type=del size=4075500 2024-09-12T17:42:00.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.643+0000 7f330fbcc780 1 < canceled part key=_multipart_LF4NGY13WYHK.2~GDB7XLK6M9EG.0 size=484137 2024-09-12T17:42:00.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.645+0000 7f330fbcc780 1 < canceled multipart upload key=LF4NGY13WYHK upload=GDB7XLK6M9EG tag=I0A2M9X8EOFM type=write size=1532713 2024-09-12T17:42:00.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.646+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=RZQ8ATV0ZIN7 type=write size=559896 2024-09-12T17:42:00.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.647+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.0 size=1048576 2024-09-12T17:42:00.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.648+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.1 size=1048576 2024-09-12T17:42:00.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.649+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~2G2ZTL3V0ZAP.2 size=804162 2024-09-12T17:42:00.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.651+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=2G2ZTL3V0ZAP tag=YSERJITADE8Z type=write size=3949890 2024-09-12T17:42:00.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.653+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~J40HNBIDREAQ.0 size=1048576 2024-09-12T17:42:00.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.653+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~J40HNBIDREAQ.1 size=113777 2024-09-12T17:42:00.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.653+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=J40HNBIDREAQ tag=UDWX9JLCJZPZ type=write size=2210929 2024-09-12T17:42:00.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.655+0000 7f330fbcc780 1 < suggested update operation key=3IHGI1UMI1BA tag=KT95WG4DS3MZ type=del size=1407906 2024-09-12T17:42:00.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.657+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=5U6HHN8J386Y type=del size=3789152 2024-09-12T17:42:00.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.658+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=N3LRTM73ELT9 type=del 2024-09-12T17:42:00.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.659+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=G072RPQWSBXP type=write size=335934 2024-09-12T17:42:00.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.660+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=F7QRD3UDA9VV type=del 2024-09-12T17:42:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.661+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=42I45KW6JSUF type=write size=61658 2024-09-12T17:42:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.662+0000 7f330fbcc780 -1 < failed to complete operation key=6MFVO30OX5W1 tag=WV1IHY7ZKLXE type=del size=4142062: (22) Invalid argument 2024-09-12T17:42:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.664+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~R0IOYIIBC6NL.0 size=1048576 2024-09-12T17:42:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.665+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~R0IOYIIBC6NL.1 size=684190 2024-09-12T17:42:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.665+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=R0IOYIIBC6NL tag=FI2C10N0ZG8P type=write size=2781342 2024-09-12T17:42:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.666+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.0 size=1048576 2024-09-12T17:42:00.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.667+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.1 size=1048576 2024-09-12T17:42:00.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.668+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~VVB410E09D0P.2 size=801418 2024-09-12T17:42:00.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.670+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=VVB410E09D0P tag=6YFEHZN1EPEE type=write size=3947146 2024-09-12T17:42:00.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.671+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=0ZNMKHKC0BK3 type=del size=441016 2024-09-12T17:42:00.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.672+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~YHZ15LID670G.0 size=1048576 2024-09-12T17:42:00.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.672+0000 7f330fbcc780 1 < canceled part key=_multipart_IEYJS7X97O1A.2~YHZ15LID670G.1 size=208923 2024-09-12T17:42:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.674+0000 7f330fbcc780 1 < canceled multipart upload key=IEYJS7X97O1A upload=YHZ15LID670G tag=6LCHO2UIB2OS type=write size=2306075 2024-09-12T17:42:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.675+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=T04OCA1FL3WH type=del size=1082851 2024-09-12T17:42:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.676+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~OW5S8C0G5P2Z.0 size=183566 2024-09-12T17:42:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.678+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=OW5S8C0G5P2Z tag=G7CE9DMLS91U type=write size=1232142 2024-09-12T17:42:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.679+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=2TZR5JHPJI0C type=del size=2878906 2024-09-12T17:42:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.680+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=0P0VUHXPJN2H type=del 2024-09-12T17:42:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.682+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=3ZAHD8TKYVE2 type=del size=3957256 2024-09-12T17:42:00.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.684+0000 7f330fbcc780 1 < suggested update operation key=50WR6KLF40W7 tag=T456NM8IMTTX type=del size=4041685 2024-09-12T17:42:00.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.685+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=QIN1261YX0HN type=write size=137906 2024-09-12T17:42:00.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.686+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=Z1A1EWG96SOD type=del 2024-09-12T17:42:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.687+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=CSVUE05DUASB type=del size=1955761 2024-09-12T17:42:00.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.688+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~VUFM2S6TFU8F.0 size=1048576 2024-09-12T17:42:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.689+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~VUFM2S6TFU8F.1 size=682424 2024-09-12T17:42:00.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.691+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=VUFM2S6TFU8F tag=9H7HVG8N6RIO type=write size=2779576 2024-09-12T17:42:00.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.692+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=OV17N6NNJNQS type=del size=3392501 2024-09-12T17:42:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.693+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=JZ0MKP55K8VQ type=write size=562471 2024-09-12T17:42:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.694+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=IS1LDRU30SD3 type=del size=293631 2024-09-12T17:42:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.695+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=XLEC7XLPLV82 type=del 2024-09-12T17:42:00.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.697+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=B8ESVKVW8C50 type=write size=849960 2024-09-12T17:42:00.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.699+0000 7f330fbcc780 1 < suggested remove operation key=50WR6KLF40W7 tag=MHCNM2GVEZLN type=del 2024-09-12T17:42:00.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.701+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~W2V53GR8JKBI.0 size=776554 2024-09-12T17:42:00.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.701+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=W2V53GR8JKBI tag=H4G434ZG5FR3 type=write size=1825130 2024-09-12T17:42:00.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.703+0000 7f330fbcc780 1 < suggested update operation key=70COM4KLK2R1 tag=RZQ8ATV0ZIN7 type=write size=559896 2024-09-12T17:42:00.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.704+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=HX14Q4QV7KI7 type=write size=13776 2024-09-12T17:42:00.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.704+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~J40HNBIDREAQ.0 size=1048576 2024-09-12T17:42:00.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.705+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~J40HNBIDREAQ.1 size=113777 2024-09-12T17:42:00.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.707+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=J40HNBIDREAQ tag=UDWX9JLCJZPZ type=write size=2210929 2024-09-12T17:42:00.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.708+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=A4SE3ZYCOZYT type=del size=2276447 2024-09-12T17:42:00.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.710+0000 7f330fbcc780 1 < suggested update operation key=IEYJS7X97O1A tag=5U6HHN8J386Y type=del size=3789152 2024-09-12T17:42:00.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.711+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=514H1WX9XTF8 type=del size=1462115 2024-09-12T17:42:00.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.712+0000 7f330fbcc780 1 < completed write operation key=1MJ2W1WMLR85 tag=G072RPQWSBXP type=write size=335934 2024-09-12T17:42:00.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.713+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=75WHRSGRT8ZK type=del size=1654470 2024-09-12T17:42:00.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.714+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=42I45KW6JSUF type=write size=61658 2024-09-12T17:42:00.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.716+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.0 size=1048576 2024-09-12T17:42:00.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.717+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.1 size=1048576 2024-09-12T17:42:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.718+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.2 size=429448 2024-09-12T17:42:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.718+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=FHIJC1I7IRPG tag=HDZ3L5QG7LFW type=write size=3575176 2024-09-12T17:42:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.719+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~R0IOYIIBC6NL.0 size=1048576 2024-09-12T17:42:00.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.720+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~R0IOYIIBC6NL.1 size=684190 2024-09-12T17:42:00.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.722+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=R0IOYIIBC6NL tag=FI2C10N0ZG8P type=write size=2781342 2024-09-12T17:42:00.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.724+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~933JH3TWEJPB.0 size=1048576 2024-09-12T17:42:00.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.725+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~933JH3TWEJPB.1 size=551519 2024-09-12T17:42:00.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.725+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=933JH3TWEJPB tag=QZ4UCU0GHYYA type=write size=2648671 2024-09-12T17:42:00.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.726+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=0ZNMKHKC0BK3 type=del 2024-09-12T17:42:00.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.728+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=PNP94703L5OL type=write size=777832 2024-09-12T17:42:00.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.729+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=T04OCA1FL3WH type=del 2024-09-12T17:42:00.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.730+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=L88Z7N1PAFDO type=del size=771540 2024-09-12T17:42:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.731+0000 7f330fbcc780 -1 < failed to complete operation key=70COM4KLK2R1 tag=2TZR5JHPJI0C type=del size=2878906: (22) Invalid argument 2024-09-12T17:42:00.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.733+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~1HPLC8Y2HTNP.0 size=93780 2024-09-12T17:42:00.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.733+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=1HPLC8Y2HTNP tag=0HLGTBTDTF12 type=write size=1142356 2024-09-12T17:42:00.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.734+0000 7f330fbcc780 -1 < failed to complete operation key=70COM4KLK2R1 tag=3ZAHD8TKYVE2 type=del size=3957256: (22) Invalid argument 2024-09-12T17:42:00.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.735+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=7A6VD5RZGY73 type=write size=594229 2024-09-12T17:42:00.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.736+0000 7f330fbcc780 1 < completed write operation key=4KNGMX117Z7G tag=QIN1261YX0HN type=write size=137906 2024-09-12T17:42:00.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.738+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=UPXRCMCJ7Q4F type=write size=655309 2024-09-12T17:42:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.739+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=CSVUE05DUASB type=del 2024-09-12T17:42:00.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.741+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~R6SZFQHNSGBQ.0 size=554754 2024-09-12T17:42:00.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.741+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=R6SZFQHNSGBQ tag=MMQTS7SSVEJ2 type=write size=1603330 2024-09-12T17:42:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.743+0000 7f330fbcc780 1 < suggested update operation key=H1LAU7WDZW6S tag=OV17N6NNJNQS type=del size=3392501 2024-09-12T17:42:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.744+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=Y3ON9LOWD13F type=del size=2585526 2024-09-12T17:42:00.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.748+0000 7f330fbcc780 1 < suggested remove operation key=4KNGMX117Z7G tag=IS1LDRU30SD3 type=del 2024-09-12T17:42:00.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.750+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.0 size=1048576 2024-09-12T17:42:00.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.751+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.1 size=1048576 2024-09-12T17:42:00.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.751+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.2 size=497467 2024-09-12T17:42:00.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.751+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=9JRYWM8GAEJM tag=KBW3HIUIBVO3 type=write size=3643195 2024-09-12T17:42:00.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.754+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=B8ESVKVW8C50 type=write size=849960 2024-09-12T17:42:00.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.756+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.0 size=1048576 2024-09-12T17:42:00.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.757+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.1 size=1048576 2024-09-12T17:42:00.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.757+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.2 size=742732 2024-09-12T17:42:00.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.757+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=GX0D65MJTB7I tag=YGSIE9CYQ4X9 type=write size=3888460 2024-09-12T17:42:00.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.758+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~W2V53GR8JKBI.0 size=776554 2024-09-12T17:42:00.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.759+0000 7f330fbcc780 1 < canceled multipart upload key=AGM33OK1W7A6 upload=W2V53GR8JKBI tag=H4G434ZG5FR3 type=write size=1825130 2024-09-12T17:42:00.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.761+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=DT29KXA2YQQU type=del size=2081591 2024-09-12T17:42:00.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.762+0000 7f330fbcc780 1 < completed write operation key=FY2BXMZBVMDL tag=HX14Q4QV7KI7 type=write size=13776 2024-09-12T17:42:00.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.763+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=3AJRFUA0WY5P type=del size=3924499 2024-09-12T17:42:00.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.765+0000 7f330fbcc780 1 < suggested update operation key=1MJ2W1WMLR85 tag=A4SE3ZYCOZYT type=del size=2276447 2024-09-12T17:42:00.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.766+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=J8U7SDYJRNCM type=del size=1141406 2024-09-12T17:42:00.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.767+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=514H1WX9XTF8 type=del 2024-09-12T17:42:00.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.768+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=AANQWTRVXZEG type=del size=2145048 2024-09-12T17:42:00.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.769+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=75WHRSGRT8ZK type=del 2024-09-12T17:42:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.771+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.0 size=1048576 2024-09-12T17:42:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.772+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.1 size=1048576 2024-09-12T17:42:00.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.773+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.2 size=710723 2024-09-12T17:42:00.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.773+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=I393MK88PHVP tag=3LT2K375ZQGI type=write size=3856451 2024-09-12T17:42:00.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.774+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.0 size=1048576 2024-09-12T17:42:00.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.774+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.1 size=1048576 2024-09-12T17:42:00.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.774+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~FHIJC1I7IRPG.2 size=429448 2024-09-12T17:42:00.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.776+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=FHIJC1I7IRPG tag=HDZ3L5QG7LFW type=write size=3575176 2024-09-12T17:42:00.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.777+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=ZHCAYRPEG3PW type=del size=2098051 2024-09-12T17:42:00.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.779+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~933JH3TWEJPB.0 size=1048576 2024-09-12T17:42:00.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.779+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~933JH3TWEJPB.1 size=551519 2024-09-12T17:42:00.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.781+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=933JH3TWEJPB tag=QZ4UCU0GHYYA type=write size=2648671 2024-09-12T17:42:00.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.783+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.0 size=1048576 2024-09-12T17:42:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.784+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.1 size=1048576 2024-09-12T17:42:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.785+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.2 size=928875 2024-09-12T17:42:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.785+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=SRN8V7I8NSUX tag=0PHKWB6TEDFJ type=write size=4074603 2024-09-12T17:42:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.786+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=PNP94703L5OL type=write size=777832 2024-09-12T17:42:00.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.788+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~NE6T5NBWNDMV.0 size=1048576 2024-09-12T17:42:00.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.789+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~NE6T5NBWNDMV.1 size=664121 2024-09-12T17:42:00.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.789+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=NE6T5NBWNDMV tag=C439J3FVTGX6 type=write size=2761273 2024-09-12T17:42:00.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.790+0000 7f330fbcc780 1 < canceled operation key=ZEC2RXNOR3D1 tag=L88Z7N1PAFDO type=del size=771540 2024-09-12T17:42:00.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.791+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=UKO0RVYT982X type=del size=1890969 2024-09-12T17:42:00.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.792+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~1HPLC8Y2HTNP.0 size=93780 2024-09-12T17:42:00.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.794+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=1HPLC8Y2HTNP tag=0HLGTBTDTF12 type=write size=1142356 2024-09-12T17:42:00.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.795+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=AQD7PZZJLIRM type=del size=4126111 2024-09-12T17:42:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.797+0000 7f330fbcc780 1 < completed write operation key=9IYALJED5G85 tag=7A6VD5RZGY73 type=write size=594229 2024-09-12T17:42:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.799+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~TGJ4T1ZK2W4O.0 size=832788 2024-09-12T17:42:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.799+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=TGJ4T1ZK2W4O tag=XEDSINOLVMEX type=write size=1881364 2024-09-12T17:42:00.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.800+0000 7f330fbcc780 1 < canceled operation key=HJL73WQD8SD2 tag=UPXRCMCJ7Q4F type=write size=655309 2024-09-12T17:42:00.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.801+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=4UB9QGX96NEN type=del size=2166629 2024-09-12T17:42:00.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.802+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~R6SZFQHNSGBQ.0 size=554754 2024-09-12T17:42:00.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.804+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=R6SZFQHNSGBQ tag=MMQTS7SSVEJ2 type=write size=1603330 2024-09-12T17:42:00.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.806+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~0DS3VVV3MWNO.0 size=218888 2024-09-12T17:42:00.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.806+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=0DS3VVV3MWNO tag=I6BJLCPMSL2E type=write size=1267464 2024-09-12T17:42:00.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.807+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=Y3ON9LOWD13F type=del 2024-09-12T17:42:00.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.808+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=C75Q4XILVWG8 type=del size=2411405 2024-09-12T17:42:00.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.810+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.0 size=1048576 2024-09-12T17:42:00.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.810+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.1 size=1048576 2024-09-12T17:42:00.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.810+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~9JRYWM8GAEJM.2 size=497467 2024-09-12T17:42:00.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.812+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=9JRYWM8GAEJM tag=KBW3HIUIBVO3 type=write size=3643195 2024-09-12T17:42:00.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.814+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=1ITNON0JGNUO type=del size=1748656 2024-09-12T17:42:00.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.815+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.0 size=1048576 2024-09-12T17:42:00.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.816+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.1 size=1048576 2024-09-12T17:42:00.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.817+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~GX0D65MJTB7I.2 size=742732 2024-09-12T17:42:00.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.819+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=GX0D65MJTB7I tag=YGSIE9CYQ4X9 type=write size=3888460 2024-09-12T17:42:00.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.821+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.0 size=1048576 2024-09-12T17:42:00.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.821+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.1 size=1048576 2024-09-12T17:42:00.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.822+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.2 size=507838 2024-09-12T17:42:00.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.822+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=L0GLJH3F98QS tag=1I5HE3GVR0R4 type=write size=3653566 2024-09-12T17:42:00.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.823+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=DT29KXA2YQQU type=del 2024-09-12T17:42:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.825+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=5IR3JR37XT53 type=del size=3191604 2024-09-12T17:42:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.826+0000 7f330fbcc780 1 < canceled operation key=IEYJS7X97O1A tag=3AJRFUA0WY5P type=del size=3924499 2024-09-12T17:42:00.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.827+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=7FP9D0XXQYDK type=del size=2556183 2024-09-12T17:42:00.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.828+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=J8U7SDYJRNCM type=del 2024-09-12T17:42:00.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.830+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.0 size=1048576 2024-09-12T17:42:00.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.831+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.1 size=1048576 2024-09-12T17:42:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.832+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.2 size=65701 2024-09-12T17:42:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.832+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=IBLK7M5S7C2K tag=7BE3C6UKZAU0 type=write size=3211429 2024-09-12T17:42:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.833+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=AANQWTRVXZEG type=del 2024-09-12T17:42:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.834+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=C31XFSEY4R8G type=del size=1371103 2024-09-12T17:42:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.835+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.0 size=1048576 2024-09-12T17:42:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.835+0000 7f330fbcc780 1 < canceled part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.1 size=1048576 2024-09-12T17:42:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.836+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~I393MK88PHVP.2 size=710723 2024-09-12T17:42:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.838+0000 7f330fbcc780 1 < canceled multipart upload key=AGM33OK1W7A6 upload=I393MK88PHVP tag=3LT2K375ZQGI type=write size=3856451 2024-09-12T17:42:00.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.839+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=YU8TQTLUNZU2 type=del size=2914473 2024-09-12T17:42:00.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.841+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=ZHCAYRPEG3PW type=del 2024-09-12T17:42:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.842+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=PBF22D5HMYOK type=del size=1673751 2024-09-12T17:42:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.843+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.0 size=1048576 2024-09-12T17:42:00.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.844+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.1 size=1048576 2024-09-12T17:42:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.845+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~SRN8V7I8NSUX.2 size=928875 2024-09-12T17:42:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.847+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=SRN8V7I8NSUX tag=0PHKWB6TEDFJ type=write size=4074603 2024-09-12T17:42:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.849+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~XCXR71WCUJFY.0 size=1048576 2024-09-12T17:42:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.850+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~XCXR71WCUJFY.1 size=948949 2024-09-12T17:42:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.850+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=XCXR71WCUJFY tag=MBHODMZWPEEL type=write size=3046101 2024-09-12T17:42:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.853+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~NE6T5NBWNDMV.0 size=1048576 2024-09-12T17:42:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.854+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~NE6T5NBWNDMV.1 size=664121 2024-09-12T17:42:00.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.856+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=NE6T5NBWNDMV tag=C439J3FVTGX6 type=write size=2761273 2024-09-12T17:42:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.858+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~3DDY21YM0JPC.0 size=568787 2024-09-12T17:42:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.858+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=3DDY21YM0JPC tag=KZZO4X5AQ1QR type=write size=1617363 2024-09-12T17:42:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.860+0000 7f330fbcc780 1 < suggested remove operation key=5QBSRDY0LJ60 tag=UKO0RVYT982X type=del 2024-09-12T17:42:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.861+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=5HF4LT61UIE0 type=del size=969654 2024-09-12T17:42:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.862+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=AQD7PZZJLIRM type=del 2024-09-12T17:42:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.864+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.0 size=1048576 2024-09-12T17:42:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.865+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.1 size=1048576 2024-09-12T17:42:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.866+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.2 size=100552 2024-09-12T17:42:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.866+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=PQPZ04SJJIHQ tag=YE499HCOHNDP type=write size=3246280 2024-09-12T17:42:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.867+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~TGJ4T1ZK2W4O.0 size=832788 2024-09-12T17:42:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.869+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=TGJ4T1ZK2W4O tag=XEDSINOLVMEX type=write size=1881364 2024-09-12T17:42:00.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.870+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=3WYTMH7J8TFJ type=del size=4104718 2024-09-12T17:42:00.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.871+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=4UB9QGX96NEN type=del 2024-09-12T17:42:00.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.872+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=ENTCLGKXPLX0 type=del size=3420275 2024-09-12T17:42:00.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.874+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~0DS3VVV3MWNO.0 size=218888 2024-09-12T17:42:00.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.875+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=0DS3VVV3MWNO tag=I6BJLCPMSL2E type=write size=1267464 2024-09-12T17:42:00.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.877+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~MP2QGSWN2WH6.0 size=1048576 2024-09-12T17:42:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.878+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~MP2QGSWN2WH6.1 size=86656 2024-09-12T17:42:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.878+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=MP2QGSWN2WH6 tag=91NTLQ3QMSXV type=write size=2183808 2024-09-12T17:42:00.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.879+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=C75Q4XILVWG8 type=del 2024-09-12T17:42:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.880+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=7DGXETI6UDG1 type=del size=3990443 2024-09-12T17:42:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.882+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=1ITNON0JGNUO type=del 2024-09-12T17:42:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.883+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=72LUHPRVA379 type=del size=2502282 2024-09-12T17:42:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.884+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.0 size=1048576 2024-09-12T17:42:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.884+0000 7f330fbcc780 1 < canceled part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.1 size=1048576 2024-09-12T17:42:00.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.885+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~L0GLJH3F98QS.2 size=507838 2024-09-12T17:42:00.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.887+0000 7f330fbcc780 1 < canceled multipart upload key=D5ZZ93XAPRAA upload=L0GLJH3F98QS tag=1I5HE3GVR0R4 type=write size=3653566 2024-09-12T17:42:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.889+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.0 size=1048576 2024-09-12T17:42:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.890+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.1 size=1048576 2024-09-12T17:42:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.891+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.2 size=41431 2024-09-12T17:42:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.891+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=6S4KBITPM2SI tag=T0VL3N4KTP2X type=write size=3187159 2024-09-12T17:42:00.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.892+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=5IR3JR37XT53 type=del 2024-09-12T17:42:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.893+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=EOJLZ51M8I03 type=write size=341323 2024-09-12T17:42:00.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.895+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=7FP9D0XXQYDK type=del size=2556183 2024-09-12T17:42:00.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.896+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=QST00O3J2TE8 type=write size=830445 2024-09-12T17:42:00.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.897+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.0 size=1048576 2024-09-12T17:42:00.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.898+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.1 size=1048576 2024-09-12T17:42:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.899+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~IBLK7M5S7C2K.2 size=65701 2024-09-12T17:42:00.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.901+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=IBLK7M5S7C2K tag=7BE3C6UKZAU0 type=write size=3211429 2024-09-12T17:42:00.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.903+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~UWMUR6YCNR09.0 size=1048576 2024-09-12T17:42:00.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.904+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~UWMUR6YCNR09.1 size=647508 2024-09-12T17:42:00.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.904+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=UWMUR6YCNR09 tag=MMO210W6WP78 type=write size=2744660 2024-09-12T17:42:00.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.905+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=C31XFSEY4R8G type=del 2024-09-12T17:42:00.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.907+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=ERI3AU7G4L02 type=write size=813106 2024-09-12T17:42:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.908+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=YU8TQTLUNZU2 type=del 2024-09-12T17:42:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.910+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~WW554J9RENLN.0 size=1048576 2024-09-12T17:42:00.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.911+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~WW554J9RENLN.1 size=931767 2024-09-12T17:42:00.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.911+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=WW554J9RENLN tag=ONTQDHR6E7QP type=write size=3028919 2024-09-12T17:42:00.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.912+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=PBF22D5HMYOK type=del 2024-09-12T17:42:00.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.914+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~YNAY5OGZ6SWB.0 size=1048576 2024-09-12T17:42:00.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.915+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~YNAY5OGZ6SWB.1 size=295536 2024-09-12T17:42:00.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.915+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=YNAY5OGZ6SWB tag=BM6DXV4MCA3X type=write size=2392688 2024-09-12T17:42:00.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.916+0000 7f330fbcc780 1 < canceled part key=_multipart_70COM4KLK2R1.2~XCXR71WCUJFY.0 size=1048576 2024-09-12T17:42:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.916+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~XCXR71WCUJFY.1 size=948949 2024-09-12T17:42:00.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.918+0000 7f330fbcc780 1 < canceled multipart upload key=70COM4KLK2R1 upload=XCXR71WCUJFY tag=MBHODMZWPEEL type=write size=3046101 2024-09-12T17:42:00.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.920+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=3I434LWMFDFF type=del size=204347 2024-09-12T17:42:00.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.921+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~3DDY21YM0JPC.0 size=568787 2024-09-12T17:42:00.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.922+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=3DDY21YM0JPC tag=KZZO4X5AQ1QR type=write size=1617363 2024-09-12T17:42:00.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.924+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~ZP37ML6JGYWS.0 size=550174 2024-09-12T17:42:00.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.924+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=ZP37ML6JGYWS tag=8CC62NBA22SE type=write size=1598750 2024-09-12T17:42:00.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.926+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=5HF4LT61UIE0 type=del 2024-09-12T17:42:00.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.927+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=CS48UO4ZDZVZ type=write size=557232 2024-09-12T17:42:00.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.928+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.0 size=1048576 2024-09-12T17:42:00.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.929+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.1 size=1048576 2024-09-12T17:42:00.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.930+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~PQPZ04SJJIHQ.2 size=100552 2024-09-12T17:42:00.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.932+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=PQPZ04SJJIHQ tag=YE499HCOHNDP type=write size=3246280 2024-09-12T17:42:00.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.934+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.0 size=1048576 2024-09-12T17:42:00.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.934+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.1 size=1048576 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.935+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.2 size=943715 2024-09-12T17:42:00.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.935+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=OWUZUEUT6NCY tag=69GZ42849WZ0 type=write size=4089443 2024-09-12T17:42:00.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.936+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=3WYTMH7J8TFJ type=del 2024-09-12T17:42:00.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.938+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=NJV2W0KAF0TS type=write size=914779 2024-09-12T17:42:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.939+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=ENTCLGKXPLX0 type=del 2024-09-12T17:42:00.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.941+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.0 size=1048576 2024-09-12T17:42:00.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.942+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.1 size=1048576 2024-09-12T17:42:00.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.942+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.2 size=396551 2024-09-12T17:42:00.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.942+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=J9ZL20L4W0BX tag=222ZZSZ170BY type=write size=3542279 2024-09-12T17:42:00.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.944+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~MP2QGSWN2WH6.0 size=1048576 2024-09-12T17:42:00.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.944+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~MP2QGSWN2WH6.1 size=86656 2024-09-12T17:42:00.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.946+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=MP2QGSWN2WH6 tag=91NTLQ3QMSXV type=write size=2183808 2024-09-12T17:42:00.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.948+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.0 size=1048576 2024-09-12T17:42:00.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.949+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.1 size=1048576 2024-09-12T17:42:00.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.950+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.2 size=410360 2024-09-12T17:42:00.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.950+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=IG1OMF0CLI1A tag=HC9P354V5LFH type=write size=3556088 2024-09-12T17:42:00.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.952+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=7DGXETI6UDG1 type=del 2024-09-12T17:42:00.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.954+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~TAHX0Y36DHJO.0 size=746029 2024-09-12T17:42:00.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.954+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=TAHX0Y36DHJO tag=B08JZOOFQ2W8 type=write size=1794605 2024-09-12T17:42:00.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.956+0000 7f330fbcc780 1 < suggested update operation key=8UX8W3FAJ3D9 tag=72LUHPRVA379 type=del size=2502282 2024-09-12T17:42:00.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.960+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~JD10B5UYY8RH.0 size=520588 2024-09-12T17:42:00.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.960+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=JD10B5UYY8RH tag=GSL7QQFB4325 type=write size=1569164 2024-09-12T17:42:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.961+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.0 size=1048576 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.962+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.1 size=1048576 2024-09-12T17:42:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.962+0000 7f330fbcc780 1 < canceled part key=_multipart_AL3ESPG15NO4.2~6S4KBITPM2SI.2 size=41431 2024-09-12T17:42:00.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.964+0000 7f330fbcc780 1 < canceled multipart upload key=AL3ESPG15NO4 upload=6S4KBITPM2SI tag=T0VL3N4KTP2X type=write size=3187159 2024-09-12T17:42:00.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.966+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.0 size=1048576 2024-09-12T17:42:00.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.967+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.1 size=1048576 2024-09-12T17:42:00.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.967+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.2 size=30756 2024-09-12T17:42:00.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.967+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=SQQ1E1D5HKH2 tag=658TROKNLP0X type=write size=3176484 2024-09-12T17:42:00.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.968+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=EOJLZ51M8I03 type=write size=341323 2024-09-12T17:42:00.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.970+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.0 size=1048576 2024-09-12T17:42:00.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.971+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.1 size=1048576 2024-09-12T17:42:00.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.972+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.2 size=752675 2024-09-12T17:42:00.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.972+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=77FVVUL9J9BM tag=TGNHMXVUKE8U type=write size=3898403 2024-09-12T17:42:00.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.973+0000 7f330fbcc780 1 < completed write operation key=4KNGMX117Z7G tag=QST00O3J2TE8 type=write size=830445 2024-09-12T17:42:00.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.975+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~17AS135AMQ7M.0 size=799157 2024-09-12T17:42:00.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.975+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=17AS135AMQ7M tag=7BLM5ZPQ7T1N type=write size=1847733 2024-09-12T17:42:00.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.977+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~UWMUR6YCNR09.0 size=1048576 2024-09-12T17:42:00.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.977+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~UWMUR6YCNR09.1 size=647508 2024-09-12T17:42:00.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.979+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=UWMUR6YCNR09 tag=MMO210W6WP78 type=write size=2744660 2024-09-12T17:42:00.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.980+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=GVUD2Q7VC235 type=del size=619226 2024-09-12T17:42:00.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.982+0000 7f330fbcc780 1 < completed write operation key=3IHGI1UMI1BA tag=ERI3AU7G4L02 type=write size=813106 2024-09-12T17:42:00.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.983+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=L5ZEOWSRAKIL type=write size=941216 2024-09-12T17:42:00.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.984+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~WW554J9RENLN.0 size=1048576 2024-09-12T17:42:00.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.985+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~WW554J9RENLN.1 size=931767 2024-09-12T17:42:00.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.987+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=WW554J9RENLN tag=ONTQDHR6E7QP type=write size=3028919 2024-09-12T17:42:00.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.988+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=PGGWA5GRWMY5 type=del size=1917658 2024-09-12T17:42:00.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.989+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~YNAY5OGZ6SWB.0 size=1048576 2024-09-12T17:42:00.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.990+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~YNAY5OGZ6SWB.1 size=295536 2024-09-12T17:42:00.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.992+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=YNAY5OGZ6SWB tag=BM6DXV4MCA3X type=write size=2392688 2024-09-12T17:42:00.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.993+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=TKUK1E0PVYF2 type=del size=2598052 2024-09-12T17:42:00.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.994+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=3I434LWMFDFF type=del 2024-09-12T17:42:00.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.995+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=DNF6OTZ6IZYS type=write size=54665 2024-09-12T17:42:00.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.997+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~ZP37ML6JGYWS.0 size=550174 2024-09-12T17:42:00.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:00.999+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=ZP37ML6JGYWS tag=8CC62NBA22SE type=write size=1598750 2024-09-12T17:42:01.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.000+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=L3RNC9DJNSWB type=del size=1589891 2024-09-12T17:42:01.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.001+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=CS48UO4ZDZVZ type=write size=557232 2024-09-12T17:42:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.003+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~GN2AI3P7XVGN.0 size=1048576 2024-09-12T17:42:01.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.004+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~GN2AI3P7XVGN.1 size=22534 2024-09-12T17:42:01.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.004+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=GN2AI3P7XVGN tag=Z4WKI96W3CET type=write size=2119686 2024-09-12T17:42:01.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.005+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.0 size=1048576 2024-09-12T17:42:01.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.006+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.1 size=1048576 2024-09-12T17:42:01.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.006+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~OWUZUEUT6NCY.2 size=943715 2024-09-12T17:42:01.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.008+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=OWUZUEUT6NCY tag=69GZ42849WZ0 type=write size=4089443 2024-09-12T17:42:01.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.010+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~371872AYE0QY.0 size=274142 2024-09-12T17:42:01.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.010+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=371872AYE0QY tag=QIU5TZUZU3BJ type=write size=1322718 2024-09-12T17:42:01.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.011+0000 7f330fbcc780 1 < completed write operation key=6HBW7077B3MS tag=NJV2W0KAF0TS type=write size=914779 2024-09-12T17:42:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.013+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~8U28NXKS3SAM.0 size=412398 2024-09-12T17:42:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.013+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=8U28NXKS3SAM tag=9R0OCUWT92Z3 type=write size=1460974 2024-09-12T17:42:01.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.014+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.0 size=1048576 2024-09-12T17:42:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.015+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.1 size=1048576 2024-09-12T17:42:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.016+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~J9ZL20L4W0BX.2 size=396551 2024-09-12T17:42:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.018+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=J9ZL20L4W0BX tag=222ZZSZ170BY type=write size=3542279 2024-09-12T17:42:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.019+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=NOYOCT6B03DC type=del size=766792 2024-09-12T17:42:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.020+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.0 size=1048576 2024-09-12T17:42:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.021+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.1 size=1048576 2024-09-12T17:42:01.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.022+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~IG1OMF0CLI1A.2 size=410360 2024-09-12T17:42:01.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.024+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=IG1OMF0CLI1A tag=HC9P354V5LFH type=write size=3556088 2024-09-12T17:42:01.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.025+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=YQS5X2G110UD type=del size=1634768 2024-09-12T17:42:01.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.026+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~TAHX0Y36DHJO.0 size=746029 2024-09-12T17:42:01.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.028+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=TAHX0Y36DHJO tag=B08JZOOFQ2W8 type=write size=1794605 2024-09-12T17:42:01.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.030+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~DDYAWR5SBVGN.0 size=1048576 2024-09-12T17:42:01.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.031+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~DDYAWR5SBVGN.1 size=904041 2024-09-12T17:42:01.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.031+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=DDYAWR5SBVGN tag=GNKEJNK2IUGX type=write size=3001193 2024-09-12T17:42:01.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.032+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~JD10B5UYY8RH.0 size=520588 2024-09-12T17:42:01.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.034+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=JD10B5UYY8RH tag=GSL7QQFB4325 type=write size=1569164 2024-09-12T17:42:01.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.035+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=A0FITQ51LIBG type=del size=114873 2024-09-12T17:42:01.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.036+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.0 size=1048576 2024-09-12T17:42:01.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.037+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.1 size=1048576 2024-09-12T17:42:01.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.038+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~SQQ1E1D5HKH2.2 size=30756 2024-09-12T17:42:01.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.040+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=SQQ1E1D5HKH2 tag=658TROKNLP0X type=write size=3176484 2024-09-12T17:42:01.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.041+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=UKSLMCJMTH5S type=del size=487018 2024-09-12T17:42:01.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.042+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.0 size=1048576 2024-09-12T17:42:01.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.043+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.1 size=1048576 2024-09-12T17:42:01.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.044+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~77FVVUL9J9BM.2 size=752675 2024-09-12T17:42:01.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.046+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=77FVVUL9J9BM tag=TGNHMXVUKE8U type=write size=3898403 2024-09-12T17:42:01.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.048+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=09MGJYMLJ2G4 type=del size=4026055 2024-09-12T17:42:01.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.049+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~17AS135AMQ7M.0 size=799157 2024-09-12T17:42:01.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.051+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=17AS135AMQ7M tag=7BLM5ZPQ7T1N type=write size=1847733 2024-09-12T17:42:01.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.052+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=74OUMO7L5CI6 type=del size=3776581 2024-09-12T17:42:01.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.053+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=GVUD2Q7VC235 type=del 2024-09-12T17:42:01.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.054+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=VDLIAG2Z9SVH type=del size=1900889 2024-09-12T17:42:01.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.057+0000 7f330fbcc780 1 < suggested update operation key=1MJ2W1WMLR85 tag=L5ZEOWSRAKIL type=write size=941216 2024-09-12T17:42:01.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.058+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=22M4WOSL0IKW type=del size=2069609 2024-09-12T17:42:01.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.059+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=PGGWA5GRWMY5 type=del 2024-09-12T17:42:01.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.060+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=R872C5O23NO4 type=del size=486318 2024-09-12T17:42:01.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.061+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=TKUK1E0PVYF2 type=del 2024-09-12T17:42:01.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.064+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=XLWRN7MBAG8T type=del size=2341631 2024-09-12T17:42:01.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.065+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=DNF6OTZ6IZYS type=write size=54665 2024-09-12T17:42:01.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.066+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=WSO81J9BEJRX type=del size=1759518 2024-09-12T17:42:01.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.067+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=L3RNC9DJNSWB type=del 2024-09-12T17:42:01.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.069+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=H0IGDJBHJ5L8 type=del size=1603473 2024-09-12T17:42:01.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.070+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~GN2AI3P7XVGN.0 size=1048576 2024-09-12T17:42:01.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.071+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~GN2AI3P7XVGN.1 size=22534 2024-09-12T17:42:01.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.073+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=GN2AI3P7XVGN tag=Z4WKI96W3CET type=write size=2119686 2024-09-12T17:42:01.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.075+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~LG3UW551GR7K.0 size=1048576 2024-09-12T17:42:01.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.076+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~LG3UW551GR7K.1 size=786037 2024-09-12T17:42:01.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.076+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=LG3UW551GR7K tag=FE5K5JFMSHRB type=write size=2883189 2024-09-12T17:42:01.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.077+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~371872AYE0QY.0 size=274142 2024-09-12T17:42:01.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.079+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=371872AYE0QY tag=QIU5TZUZU3BJ type=write size=1322718 2024-09-12T17:42:01.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.080+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=RM5VFJYP924E type=del size=3272211 2024-09-12T17:42:01.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.081+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~8U28NXKS3SAM.0 size=412398 2024-09-12T17:42:01.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.083+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=8U28NXKS3SAM tag=9R0OCUWT92Z3 type=write size=1460974 2024-09-12T17:42:01.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.085+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~WANZ9T9BZD7S.0 size=1048576 2024-09-12T17:42:01.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.086+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~WANZ9T9BZD7S.1 size=562822 2024-09-12T17:42:01.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.086+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=WANZ9T9BZD7S tag=IHMHMMJNWL2H type=write size=2659974 2024-09-12T17:42:01.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.088+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=NOYOCT6B03DC type=del 2024-09-12T17:42:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.089+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=CID0COXZLDE3 type=del size=2840924 2024-09-12T17:42:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.090+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=YQS5X2G110UD type=del 2024-09-12T17:42:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.092+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=RK6A3JAP0SWE type=del size=845859 2024-09-12T17:42:01.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.093+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~DDYAWR5SBVGN.0 size=1048576 2024-09-12T17:42:01.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.094+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~DDYAWR5SBVGN.1 size=904041 2024-09-12T17:42:01.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.096+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=DDYAWR5SBVGN tag=GNKEJNK2IUGX type=write size=3001193 2024-09-12T17:42:01.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.097+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=IKFLQFQ6H2R5 type=del size=2982085 2024-09-12T17:42:01.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.099+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=A0FITQ51LIBG type=del size=114873 2024-09-12T17:42:01.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.101+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.0 size=1048576 2024-09-12T17:42:01.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.102+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.1 size=1048576 2024-09-12T17:42:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.103+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.2 size=663181 2024-09-12T17:42:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.103+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=IO865BM8TDXN tag=KIPT311QWIY0 type=write size=3808909 2024-09-12T17:42:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.104+0000 7f330fbcc780 -1 < failed to complete operation key=9X4FNKQWJCX4 tag=UKSLMCJMTH5S type=del size=487018: (22) Invalid argument 2024-09-12T17:42:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.105+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=D6S5W53QWPXO type=del size=1288623 2024-09-12T17:42:01.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.106+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=09MGJYMLJ2G4 type=del 2024-09-12T17:42:01.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.108+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=XX0SZQBQRI59 type=write size=768117 2024-09-12T17:42:01.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.109+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=74OUMO7L5CI6 type=del 2024-09-12T17:42:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.111+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.0 size=1048576 2024-09-12T17:42:01.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.112+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.1 size=1048576 2024-09-12T17:42:01.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.113+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.2 size=527677 2024-09-12T17:42:01.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.113+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=LWJY059EYJ4U tag=Q35LF11G2RDX type=write size=3673405 2024-09-12T17:42:01.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.114+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=VDLIAG2Z9SVH type=del 2024-09-12T17:42:01.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.116+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.0 size=1048576 2024-09-12T17:42:01.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.117+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.1 size=1048576 2024-09-12T17:42:01.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.118+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.2 size=640727 2024-09-12T17:42:01.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.118+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=WMJ8HVZIDG48 tag=H6OJ3CPK9AK8 type=write size=3786455 2024-09-12T17:42:01.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.119+0000 7f330fbcc780 1 < canceled operation key=2CY67P4QM19H tag=22M4WOSL0IKW type=del size=2069609 2024-09-12T17:42:01.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.120+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=3Z82Q9FU03V0 type=del size=3199668 2024-09-12T17:42:01.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.121+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=R872C5O23NO4 type=del 2024-09-12T17:42:01.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.122+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=DDYOP4LLHGFC type=write size=236212 2024-09-12T17:42:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.123+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=XLWRN7MBAG8T type=del 2024-09-12T17:42:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.125+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~VW47DLPX5JSN.0 size=1048576 2024-09-12T17:42:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.126+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~VW47DLPX5JSN.1 size=487082 2024-09-12T17:42:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.126+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=VW47DLPX5JSN tag=96K6XQ0416WM type=write size=2584234 2024-09-12T17:42:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.127+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=WSO81J9BEJRX type=del size=1759518 2024-09-12T17:42:01.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.128+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=N3D3637SUT9L type=del size=1251979 2024-09-12T17:42:01.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.129+0000 7f330fbcc780 1 < canceled operation key=TKJOJ17LIWX6 tag=H0IGDJBHJ5L8 type=del size=1603473 2024-09-12T17:42:01.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.131+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~TJ30OT83KHBZ.0 size=489567 2024-09-12T17:42:01.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.131+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=TJ30OT83KHBZ tag=M35XIUJGFZEX type=write size=1538143 2024-09-12T17:42:01.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.132+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~LG3UW551GR7K.0 size=1048576 2024-09-12T17:42:01.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.133+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~LG3UW551GR7K.1 size=786037 2024-09-12T17:42:01.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.135+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=LG3UW551GR7K tag=FE5K5JFMSHRB type=write size=2883189 2024-09-12T17:42:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.136+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=234NMY3WC8Y3 type=del size=2297438 2024-09-12T17:42:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.137+0000 7f330fbcc780 1 < canceled operation key=QE2QJH2J5QDY tag=RM5VFJYP924E type=del size=3272211 2024-09-12T17:42:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.138+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=GA2HL59R8LL2 type=del size=1247793 2024-09-12T17:42:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.139+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~WANZ9T9BZD7S.0 size=1048576 2024-09-12T17:42:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.140+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~WANZ9T9BZD7S.1 size=562822 2024-09-12T17:42:01.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.142+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=WANZ9T9BZD7S tag=IHMHMMJNWL2H type=write size=2659974 2024-09-12T17:42:01.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.144+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.0 size=1048576 2024-09-12T17:42:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.145+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.1 size=1048576 2024-09-12T17:42:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.146+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.2 size=742643 2024-09-12T17:42:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.146+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=NFK3S6PS7WJR tag=GVGPYJAK3YSZ type=write size=3888371 2024-09-12T17:42:01.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.147+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=CID0COXZLDE3 type=del 2024-09-12T17:42:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.149+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~AXN7TH36CD7T.0 size=862445 2024-09-12T17:42:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.149+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=AXN7TH36CD7T tag=9IERKXQDHMC2 type=write size=1911021 2024-09-12T17:42:01.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.151+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=RK6A3JAP0SWE type=del 2024-09-12T17:42:01.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.152+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=LNPK6Q92JJP4 type=del size=1396701 2024-09-12T17:42:01.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.153+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=IKFLQFQ6H2R5 type=del 2024-09-12T17:42:01.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.155+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=I4GJVQ9K2I3P type=del size=598860 2024-09-12T17:42:01.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.155+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.0 size=1048576 2024-09-12T17:42:01.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.156+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.1 size=1048576 2024-09-12T17:42:01.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.157+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~IO865BM8TDXN.2 size=663181 2024-09-12T17:42:01.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.159+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=IO865BM8TDXN tag=KIPT311QWIY0 type=write size=3808909 2024-09-12T17:42:01.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.161+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~FG4FQ76EFM9N.0 size=1048576 2024-09-12T17:42:01.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.162+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~FG4FQ76EFM9N.1 size=728532 2024-09-12T17:42:01.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.162+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=FG4FQ76EFM9N tag=R00QM79MG2XE type=write size=2825684 2024-09-12T17:42:01.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.164+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=D6S5W53QWPXO type=del 2024-09-12T17:42:01.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.165+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=S9DQ5TG0AEOL type=del size=181626 2024-09-12T17:42:01.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.166+0000 7f330fbcc780 1 < completed write operation key=SPKBX4WU9A9R tag=XX0SZQBQRI59 type=write size=768117 2024-09-12T17:42:01.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.168+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~GNYK40OWE55R.0 size=1048576 2024-09-12T17:42:01.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.169+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~GNYK40OWE55R.1 size=213698 2024-09-12T17:42:01.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.169+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=GNYK40OWE55R tag=JRZ39KS35IDW type=write size=2310850 2024-09-12T17:42:01.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.170+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.0 size=1048576 2024-09-12T17:42:01.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.172+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.1 size=1048576 2024-09-12T17:42:01.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.173+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~LWJY059EYJ4U.2 size=527677 2024-09-12T17:42:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.175+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=LWJY059EYJ4U tag=Q35LF11G2RDX type=write size=3673405 2024-09-12T17:42:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.177+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.0 size=1048576 2024-09-12T17:42:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.178+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.1 size=1048576 2024-09-12T17:42:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.179+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.2 size=792625 2024-09-12T17:42:01.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.179+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=VDBFNCNBLUGN tag=0Q5HGSTTOTOR type=write size=3938353 2024-09-12T17:42:01.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.180+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.0 size=1048576 2024-09-12T17:42:01.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.180+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.1 size=1048576 2024-09-12T17:42:01.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.181+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~WMJ8HVZIDG48.2 size=640727 2024-09-12T17:42:01.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.183+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=WMJ8HVZIDG48 tag=H6OJ3CPK9AK8 type=write size=3786455 2024-09-12T17:42:01.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.184+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=FWM0VAPXT313 type=del size=48420 2024-09-12T17:42:01.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.186+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=3Z82Q9FU03V0 type=del 2024-09-12T17:42:01.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.188+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~4I3OGP3CGJ9P.0 size=946282 2024-09-12T17:42:01.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.188+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=4I3OGP3CGJ9P tag=RW0Z29GZQUVX type=write size=1994858 2024-09-12T17:42:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.189+0000 7f330fbcc780 1 < completed write operation key=9X4FNKQWJCX4 tag=DDYOP4LLHGFC type=write size=236212 2024-09-12T17:42:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.192+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~LFCO40MR2NG0.0 size=917136 2024-09-12T17:42:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.192+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=LFCO40MR2NG0 tag=VVKPHGHN4IC4 type=write size=1965712 2024-09-12T17:42:01.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.193+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~VW47DLPX5JSN.0 size=1048576 2024-09-12T17:42:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.194+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~VW47DLPX5JSN.1 size=487082 2024-09-12T17:42:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.196+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=VW47DLPX5JSN tag=96K6XQ0416WM type=write size=2584234 2024-09-12T17:42:01.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.197+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=IPZVRHWTOWSR type=del size=1466915 2024-09-12T17:42:01.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.198+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=N3D3637SUT9L type=del 2024-09-12T17:42:01.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.200+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.0 size=1048576 2024-09-12T17:42:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.201+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.1 size=1048576 2024-09-12T17:42:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.202+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.2 size=305749 2024-09-12T17:42:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.202+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=80GXJTW1QTEF tag=SWMGP6FYEMHR type=write size=3451477 2024-09-12T17:42:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.203+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~TJ30OT83KHBZ.0 size=489567 2024-09-12T17:42:01.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.205+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=TJ30OT83KHBZ tag=M35XIUJGFZEX type=write size=1538143 2024-09-12T17:42:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.206+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=5OSZOXPBR0IS type=del size=3557901 2024-09-12T17:42:01.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.207+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=234NMY3WC8Y3 type=del size=2297438 2024-09-12T17:42:01.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.208+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=J0K20BPM71YH type=del size=2814357 2024-09-12T17:42:01.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.209+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=GA2HL59R8LL2 type=del 2024-09-12T17:42:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.210+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=1ZT40L4UFNTQ type=del size=2483895 2024-09-12T17:42:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.212+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.0 size=1048576 2024-09-12T17:42:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.212+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.1 size=1048576 2024-09-12T17:42:01.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.213+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~NFK3S6PS7WJR.2 size=742643 2024-09-12T17:42:01.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.215+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=NFK3S6PS7WJR tag=GVGPYJAK3YSZ type=write size=3888371 2024-09-12T17:42:01.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.216+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=KO5HJAN2LKJJ type=del size=2489530 2024-09-12T17:42:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.217+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~AXN7TH36CD7T.0 size=862445 2024-09-12T17:42:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.219+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=AXN7TH36CD7T tag=9IERKXQDHMC2 type=write size=1911021 2024-09-12T17:42:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.220+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=CK6GUB2TA619 type=del size=3387248 2024-09-12T17:42:01.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.221+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=LNPK6Q92JJP4 type=del 2024-09-12T17:42:01.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.223+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=3BHU73KK7FQD type=del size=4055958 2024-09-12T17:42:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.224+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=I4GJVQ9K2I3P type=del 2024-09-12T17:42:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.225+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=1MPCYETLJ73K type=del size=1320151 2024-09-12T17:42:01.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.226+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~FG4FQ76EFM9N.0 size=1048576 2024-09-12T17:42:01.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.227+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~FG4FQ76EFM9N.1 size=728532 2024-09-12T17:42:01.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.229+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=FG4FQ76EFM9N tag=R00QM79MG2XE type=write size=2825684 2024-09-12T17:42:01.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.230+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=YDTA2EM6QN68 type=del size=3766697 2024-09-12T17:42:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.231+0000 7f330fbcc780 1 < canceled operation key=9X4FNKQWJCX4 tag=S9DQ5TG0AEOL type=del size=181626 2024-09-12T17:42:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.232+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=MTPVY5ZDZYE3 type=del size=3279795 2024-09-12T17:42:01.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.234+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~GNYK40OWE55R.0 size=1048576 2024-09-12T17:42:01.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.234+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~GNYK40OWE55R.1 size=213698 2024-09-12T17:42:01.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.236+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=GNYK40OWE55R tag=JRZ39KS35IDW type=write size=2310850 2024-09-12T17:42:01.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.238+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~10273ZUN9PHR.0 size=1048576 2024-09-12T17:42:01.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.239+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~10273ZUN9PHR.1 size=197156 2024-09-12T17:42:01.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.239+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=10273ZUN9PHR tag=EFEZB0EJNOUO type=write size=2294308 2024-09-12T17:42:01.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.240+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.0 size=1048576 2024-09-12T17:42:01.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.241+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.1 size=1048576 2024-09-12T17:42:01.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.242+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~VDBFNCNBLUGN.2 size=792625 2024-09-12T17:42:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.244+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=VDBFNCNBLUGN tag=0Q5HGSTTOTOR type=write size=3938353 2024-09-12T17:42:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.245+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=4P2LOF9UAII9 type=del size=1416113 2024-09-12T17:42:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.246+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=FWM0VAPXT313 type=del 2024-09-12T17:42:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.247+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=CZFIACEVH89L type=del size=470025 2024-09-12T17:42:01.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.248+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~4I3OGP3CGJ9P.0 size=946282 2024-09-12T17:42:01.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.250+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=4I3OGP3CGJ9P tag=RW0Z29GZQUVX type=write size=1994858 2024-09-12T17:42:01.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.252+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~39RRKA1HE0Z6.0 size=99364 2024-09-12T17:42:01.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.252+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=39RRKA1HE0Z6 tag=RCS4QGKH0MR4 type=write size=1147940 2024-09-12T17:42:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.253+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~LFCO40MR2NG0.0 size=917136 2024-09-12T17:42:01.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.255+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=LFCO40MR2NG0 tag=VVKPHGHN4IC4 type=write size=1965712 2024-09-12T17:42:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.257+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~ATPFKQRMUCRV.0 size=1048576 2024-09-12T17:42:01.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.258+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~ATPFKQRMUCRV.1 size=779327 2024-09-12T17:42:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.258+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=ATPFKQRMUCRV tag=IHZQ4VWL0SDD type=write size=2876479 2024-09-12T17:42:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.259+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=IPZVRHWTOWSR type=del 2024-09-12T17:42:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.260+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=4HMJ582U0DF9 type=del size=2255171 2024-09-12T17:42:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.260+0000 7f330fbcc780 1 < canceled part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.0 size=1048576 2024-09-12T17:42:01.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.261+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.1 size=1048576 2024-09-12T17:42:01.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.262+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~80GXJTW1QTEF.2 size=305749 2024-09-12T17:42:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.264+0000 7f330fbcc780 1 < canceled multipart upload key=5QBSRDY0LJ60 upload=80GXJTW1QTEF tag=SWMGP6FYEMHR type=write size=3451477 2024-09-12T17:42:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.265+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=GJ050J82IYN4 type=del size=2982672 2024-09-12T17:42:01.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.266+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=5OSZOXPBR0IS type=del 2024-09-12T17:42:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.268+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.0 size=1048576 2024-09-12T17:42:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.269+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.1 size=1048576 2024-09-12T17:42:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.270+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.2 size=697764 2024-09-12T17:42:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.270+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=VEC4ZFOWZKBC tag=42OY07UBQ2E2 type=write size=3843492 2024-09-12T17:42:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.272+0000 7f330fbcc780 1 < suggested update operation key=IEYJS7X97O1A tag=J0K20BPM71YH type=del size=2814357 2024-09-12T17:42:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.274+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.0 size=1048576 2024-09-12T17:42:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.276+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.1 size=1048576 2024-09-12T17:42:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.277+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.2 size=941906 2024-09-12T17:42:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.277+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=GBYPNWNC9WP6 tag=EY0VOG8NK26O type=write size=4087634 2024-09-12T17:42:01.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.278+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=1ZT40L4UFNTQ type=del 2024-09-12T17:42:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.279+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=KORJI0FK0TBX type=del size=275976 2024-09-12T17:42:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.281+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=KO5HJAN2LKJJ type=del 2024-09-12T17:42:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.282+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=1TU7YBW8OW71 type=del size=759092 2024-09-12T17:42:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.283+0000 7f330fbcc780 -1 < failed to complete operation key=IEYJS7X97O1A tag=CK6GUB2TA619 type=del size=3387248: (22) Invalid argument 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.286+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~2RGRJQNZOPB4.0 size=528894 2024-09-12T17:42:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.286+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=2RGRJQNZOPB4 tag=RN564CTKSAMR type=write size=1577470 2024-09-12T17:42:01.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.287+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=3BHU73KK7FQD type=del 2024-09-12T17:42:01.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.289+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.0 size=1048576 2024-09-12T17:42:01.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.290+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.1 size=1048576 2024-09-12T17:42:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.291+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.2 size=601978 2024-09-12T17:42:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.291+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=NZMSLOMMFAES tag=1GJ00Q44TYYM type=write size=3747706 2024-09-12T17:42:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.294+0000 7f330fbcc780 1 < suggested update operation key=1MJ2W1WMLR85 tag=1MPCYETLJ73K type=del size=1320151 2024-09-12T17:42:01.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.295+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=3CPLOFE3N0N1 type=del size=110243 2024-09-12T17:42:01.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.296+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=YDTA2EM6QN68 type=del 2024-09-12T17:42:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.297+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=103LKQGJWSIM type=write size=467073 2024-09-12T17:42:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.299+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=MTPVY5ZDZYE3 type=del 2024-09-12T17:42:01.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.300+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~JQHYIDGNVNC7.0 size=1048576 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.301+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~JQHYIDGNVNC7.1 size=1033557 2024-09-12T17:42:01.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.301+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=JQHYIDGNVNC7 tag=W1NCX11AROKS type=write size=3130709 2024-09-12T17:42:01.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.302+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~10273ZUN9PHR.0 size=1048576 2024-09-12T17:42:01.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.303+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~10273ZUN9PHR.1 size=197156 2024-09-12T17:42:01.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.305+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=10273ZUN9PHR tag=EFEZB0EJNOUO type=write size=2294308 2024-09-12T17:42:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.307+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=LIMUW5ZU9WAN type=del size=2911376 2024-09-12T17:42:01.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.308+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=4P2LOF9UAII9 type=del 2024-09-12T17:42:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.309+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=BGP84OA3AO86 type=del size=1132090 2024-09-12T17:42:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.310+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=CZFIACEVH89L type=del 2024-09-12T17:42:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.311+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=6YE57ZTIEQVX type=del size=2378358 2024-09-12T17:42:01.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.312+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~39RRKA1HE0Z6.0 size=99364 2024-09-12T17:42:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.315+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=39RRKA1HE0Z6 tag=RCS4QGKH0MR4 type=write size=1147940 2024-09-12T17:42:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.317+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~0T3WHPKNICYE.0 size=228021 2024-09-12T17:42:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.317+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=0T3WHPKNICYE tag=F7P0S63DQR59 type=write size=1276597 2024-09-12T17:42:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.318+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~ATPFKQRMUCRV.0 size=1048576 2024-09-12T17:42:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.318+0000 7f330fbcc780 1 < canceled part key=_multipart_ZEC2RXNOR3D1.2~ATPFKQRMUCRV.1 size=779327 2024-09-12T17:42:01.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.320+0000 7f330fbcc780 1 < canceled multipart upload key=ZEC2RXNOR3D1 upload=ATPFKQRMUCRV tag=IHZQ4VWL0SDD type=write size=2876479 2024-09-12T17:42:01.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.322+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~FIR8MMVG105Z.0 size=586719 2024-09-12T17:42:01.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.322+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=FIR8MMVG105Z tag=MO4FNMKTM772 type=write size=1635295 2024-09-12T17:42:01.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.323+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=4HMJ582U0DF9 type=del 2024-09-12T17:42:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.325+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~E5GA9C6YFVL7.0 size=1048576 2024-09-12T17:42:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.326+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~E5GA9C6YFVL7.1 size=270898 2024-09-12T17:42:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.326+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=E5GA9C6YFVL7 tag=KXCFWFYC4RRL type=write size=2368050 2024-09-12T17:42:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.327+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=GJ050J82IYN4 type=del 2024-09-12T17:42:01.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.329+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~RJXYGPTHCCZP.0 size=331677 2024-09-12T17:42:01.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.329+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=RJXYGPTHCCZP tag=4ZGY6PDDV5WT type=write size=1380253 2024-09-12T17:42:01.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.329+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.0 size=1048576 2024-09-12T17:42:01.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.330+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.1 size=1048576 2024-09-12T17:42:01.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.331+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~VEC4ZFOWZKBC.2 size=697764 2024-09-12T17:42:01.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.333+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=VEC4ZFOWZKBC tag=42OY07UBQ2E2 type=write size=3843492 2024-09-12T17:42:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.335+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~BVX7JV4JPPL6.0 size=32851 2024-09-12T17:42:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.335+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=BVX7JV4JPPL6 tag=XELFKFE1V1T6 type=write size=1081427 2024-09-12T17:42:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.336+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.0 size=1048576 2024-09-12T17:42:01.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.337+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.1 size=1048576 2024-09-12T17:42:01.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.338+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~GBYPNWNC9WP6.2 size=941906 2024-09-12T17:42:01.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.340+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=GBYPNWNC9WP6 tag=EY0VOG8NK26O type=write size=4087634 2024-09-12T17:42:01.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.341+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=YXZVI5MW678P type=del size=247553 2024-09-12T17:42:01.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.342+0000 7f330fbcc780 1 < canceled operation key=MQV01X5P8JLG tag=KORJI0FK0TBX type=del size=275976 2024-09-12T17:42:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.344+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~HY5LUSWOOYSY.0 size=1048576 2024-09-12T17:42:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.345+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~HY5LUSWOOYSY.1 size=657872 2024-09-12T17:42:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.345+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=HY5LUSWOOYSY tag=YXJH24RLC605 type=write size=2755024 2024-09-12T17:42:01.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.346+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=1TU7YBW8OW71 type=del size=759092 2024-09-12T17:42:01.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.347+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=DWPMN0LZXJJW type=write size=284901 2024-09-12T17:42:01.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.348+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~2RGRJQNZOPB4.0 size=528894 2024-09-12T17:42:01.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.350+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=2RGRJQNZOPB4 tag=RN564CTKSAMR type=write size=1577470 2024-09-12T17:42:01.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.351+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=7UY0K56KE03Y type=del size=3323083 2024-09-12T17:42:01.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.352+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.0 size=1048576 2024-09-12T17:42:01.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.353+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.1 size=1048576 2024-09-12T17:42:01.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.354+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~NZMSLOMMFAES.2 size=601978 2024-09-12T17:42:01.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.356+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=NZMSLOMMFAES tag=1GJ00Q44TYYM type=write size=3747706 2024-09-12T17:42:01.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.358+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~OM7V1FT4FYNI.0 size=1048576 2024-09-12T17:42:01.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.359+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~OM7V1FT4FYNI.1 size=833640 2024-09-12T17:42:01.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.359+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=OM7V1FT4FYNI tag=KD2UH435I48N type=write size=2930792 2024-09-12T17:42:01.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.360+0000 7f330fbcc780 1 < canceled operation key=6ZDBF249S1L6 tag=3CPLOFE3N0N1 type=del size=110243 2024-09-12T17:42:01.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.362+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~U4K0757SLBYM.0 size=966817 2024-09-12T17:42:01.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.362+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=U4K0757SLBYM tag=RIQFF1JMYNH6 type=write size=2015393 2024-09-12T17:42:01.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.364+0000 7f330fbcc780 1 < suggested update operation key=D5ZZ93XAPRAA tag=103LKQGJWSIM type=write size=467073 2024-09-12T17:42:01.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.365+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=WTBUE9ZBIVFO type=del size=1562708 2024-09-12T17:42:01.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.366+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~JQHYIDGNVNC7.0 size=1048576 2024-09-12T17:42:01.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.366+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~JQHYIDGNVNC7.1 size=1033557 2024-09-12T17:42:01.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.368+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=JQHYIDGNVNC7 tag=W1NCX11AROKS type=write size=3130709 2024-09-12T17:42:01.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.369+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=LK4QNWDFBIQ6 type=del size=1272478 2024-09-12T17:42:01.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.370+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=LIMUW5ZU9WAN type=del 2024-09-12T17:42:01.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.372+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=QNA9HJP5AG81 type=del size=1015890 2024-09-12T17:42:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.373+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=BGP84OA3AO86 type=del 2024-09-12T17:42:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.374+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=LJXBMB5767BJ type=del size=380776 2024-09-12T17:42:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.375+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=6YE57ZTIEQVX type=del 2024-09-12T17:42:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.377+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.0 size=1048576 2024-09-12T17:42:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.378+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.1 size=1048576 2024-09-12T17:42:01.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.379+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.2 size=21052 2024-09-12T17:42:01.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.379+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=NB1OMJDZD8LG tag=U3RU9P38XBG0 type=write size=3166780 2024-09-12T17:42:01.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.380+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~0T3WHPKNICYE.0 size=228021 2024-09-12T17:42:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.382+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=0T3WHPKNICYE tag=F7P0S63DQR59 type=write size=1276597 2024-09-12T17:42:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.383+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=WCQMUFT9H210 type=del size=696753 2024-09-12T17:42:01.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.385+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~FIR8MMVG105Z.0 size=586719 2024-09-12T17:42:01.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.386+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=FIR8MMVG105Z tag=MO4FNMKTM772 type=write size=1635295 2024-09-12T17:42:01.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.387+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=LSTN946II1I5 type=del size=415256 2024-09-12T17:42:01.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.388+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~E5GA9C6YFVL7.0 size=1048576 2024-09-12T17:42:01.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.389+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~E5GA9C6YFVL7.1 size=270898 2024-09-12T17:42:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.391+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=E5GA9C6YFVL7 tag=KXCFWFYC4RRL type=write size=2368050 2024-09-12T17:42:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.392+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=WP0KL4S2HGHX type=write size=590785 2024-09-12T17:42:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.393+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~RJXYGPTHCCZP.0 size=331677 2024-09-12T17:42:01.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.395+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=RJXYGPTHCCZP tag=4ZGY6PDDV5WT type=write size=1380253 2024-09-12T17:42:01.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.396+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=UEZ9FQ8TT6NJ type=del size=1451199 2024-09-12T17:42:01.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.397+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~BVX7JV4JPPL6.0 size=32851 2024-09-12T17:42:01.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.399+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=BVX7JV4JPPL6 tag=XELFKFE1V1T6 type=write size=1081427 2024-09-12T17:42:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.400+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=FFO42B9CTZ8R type=del size=1147042 2024-09-12T17:42:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.401+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=YXZVI5MW678P type=del 2024-09-12T17:42:01.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.403+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=IT324ZG7UTUA type=del size=649711 2024-09-12T17:42:01.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.404+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~HY5LUSWOOYSY.0 size=1048576 2024-09-12T17:42:01.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.404+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~HY5LUSWOOYSY.1 size=657872 2024-09-12T17:42:01.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.406+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=HY5LUSWOOYSY tag=YXJH24RLC605 type=write size=2755024 2024-09-12T17:42:01.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.408+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.0 size=1048576 2024-09-12T17:42:01.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.409+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.1 size=1048576 2024-09-12T17:42:01.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.410+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.2 size=540690 2024-09-12T17:42:01.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.410+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=OI75MVQPI9I1 tag=ZYN4YS66GWH2 type=write size=3686418 2024-09-12T17:42:01.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.411+0000 7f330fbcc780 1 < completed write operation key=4KNGMX117Z7G tag=DWPMN0LZXJJW type=write size=284901 2024-09-12T17:42:01.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.412+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=SK7M2YS7FEAF type=write size=308763 2024-09-12T17:42:01.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.413+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=7UY0K56KE03Y type=del 2024-09-12T17:42:01.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.415+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~OASC3EGRDCKH.0 size=1048576 2024-09-12T17:42:01.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.417+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~OASC3EGRDCKH.1 size=59642 2024-09-12T17:42:01.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.417+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=OASC3EGRDCKH tag=8MTJNIBD15ZH type=write size=2156794 2024-09-12T17:42:01.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.418+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~OM7V1FT4FYNI.0 size=1048576 2024-09-12T17:42:01.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.419+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~OM7V1FT4FYNI.1 size=833640 2024-09-12T17:42:01.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.420+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=OM7V1FT4FYNI tag=KD2UH435I48N type=write size=2930792 2024-09-12T17:42:01.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.422+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~VA35QE3VMC0V.0 size=131587 2024-09-12T17:42:01.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.422+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=VA35QE3VMC0V tag=2AH1QGHFAVNL type=write size=1180163 2024-09-12T17:42:01.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.424+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~U4K0757SLBYM.0 size=966817 2024-09-12T17:42:01.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.425+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=U4K0757SLBYM tag=RIQFF1JMYNH6 type=write size=2015393 2024-09-12T17:42:01.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.427+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.0 size=1048576 2024-09-12T17:42:01.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.428+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.1 size=1048576 2024-09-12T17:42:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.429+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.2 size=316065 2024-09-12T17:42:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.429+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=HJC2CEREHFRP tag=T5N5FKKRL1L6 type=write size=3461793 2024-09-12T17:42:01.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.430+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=WTBUE9ZBIVFO type=del 2024-09-12T17:42:01.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.431+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=84FRG2PQ8U8F type=del size=3077647 2024-09-12T17:42:01.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.433+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=LK4QNWDFBIQ6 type=del 2024-09-12T17:42:01.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.434+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=NPNFKF1ARPW3 type=del size=2105879 2024-09-12T17:42:01.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.435+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=QNA9HJP5AG81 type=del 2024-09-12T17:42:01.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.436+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=Z8X5EA0SX1JB type=write size=126380 2024-09-12T17:42:01.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.437+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=LJXBMB5767BJ type=del 2024-09-12T17:42:01.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.439+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~8IFDA6S8A5F4.0 size=1048576 2024-09-12T17:42:01.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.440+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~8IFDA6S8A5F4.1 size=178470 2024-09-12T17:42:01.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.440+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=8IFDA6S8A5F4 tag=Z3DGEM7JK17K type=write size=2275622 2024-09-12T17:42:01.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.441+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.0 size=1048576 2024-09-12T17:42:01.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.442+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.1 size=1048576 2024-09-12T17:42:01.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.443+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~NB1OMJDZD8LG.2 size=21052 2024-09-12T17:42:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.445+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=NB1OMJDZD8LG tag=U3RU9P38XBG0 type=write size=3166780 2024-09-12T17:42:01.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.447+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.0 size=1048576 2024-09-12T17:42:01.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.448+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.1 size=1048576 2024-09-12T17:42:01.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.449+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.2 size=592141 2024-09-12T17:42:01.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.449+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=1QMTFHU4SISQ tag=WG5JLOHGTRSX type=write size=3737869 2024-09-12T17:42:01.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.450+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=WCQMUFT9H210 type=del 2024-09-12T17:42:01.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.451+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=B037Z6D6ZLPU type=del size=802151 2024-09-12T17:42:01.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.452+0000 7f330fbcc780 1 < canceled operation key=XIW3OJB1STT9 tag=LSTN946II1I5 type=del size=415256 2024-09-12T17:42:01.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.454+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~RTAIMV1Z0CJU.0 size=515044 2024-09-12T17:42:01.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.454+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=RTAIMV1Z0CJU tag=3WYOB2MS7B9D type=write size=1563620 2024-09-12T17:42:01.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.456+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=WP0KL4S2HGHX type=write size=590785 2024-09-12T17:42:01.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.458+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~1YPNA7SY4HEE.0 size=1048576 2024-09-12T17:42:01.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.458+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~1YPNA7SY4HEE.1 size=131586 2024-09-12T17:42:01.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.458+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=1YPNA7SY4HEE tag=11789AO2P4CR type=write size=2228738 2024-09-12T17:42:01.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.459+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=UEZ9FQ8TT6NJ type=del 2024-09-12T17:42:01.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.461+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=ETSP4MYPF800 type=del size=976379 2024-09-12T17:42:01.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.462+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=FFO42B9CTZ8R type=del 2024-09-12T17:42:01.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.463+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=HYDJH5VKO1QK type=del size=2346084 2024-09-12T17:42:01.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.464+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=IT324ZG7UTUA type=del 2024-09-12T17:42:01.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.465+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=T7KJJJAFQUO2 type=write size=366144 2024-09-12T17:42:01.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.466+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.0 size=1048576 2024-09-12T17:42:01.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.467+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.1 size=1048576 2024-09-12T17:42:01.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.468+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~OI75MVQPI9I1.2 size=540690 2024-09-12T17:42:01.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.470+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=OI75MVQPI9I1 tag=ZYN4YS66GWH2 type=write size=3686418 2024-09-12T17:42:01.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.472+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~JQRGLFBM6V0N.0 size=967617 2024-09-12T17:42:01.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.472+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=JQRGLFBM6V0N tag=62936QJL8BKS type=write size=2016193 2024-09-12T17:42:01.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.473+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=SK7M2YS7FEAF type=write size=308763 2024-09-12T17:42:01.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.475+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~KXC381VG4VZA.0 size=1048576 2024-09-12T17:42:01.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.475+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~KXC381VG4VZA.1 size=727902 2024-09-12T17:42:01.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.475+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=KXC381VG4VZA tag=A4WXOIFO4905 type=write size=2825054 2024-09-12T17:42:01.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.477+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~OASC3EGRDCKH.0 size=1048576 2024-09-12T17:42:01.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.477+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~OASC3EGRDCKH.1 size=59642 2024-09-12T17:42:01.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.479+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=OASC3EGRDCKH tag=8MTJNIBD15ZH type=write size=2156794 2024-09-12T17:42:01.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.480+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=N60MSTGGQLY3 type=del size=3143049 2024-09-12T17:42:01.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.481+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~VA35QE3VMC0V.0 size=131587 2024-09-12T17:42:01.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.484+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=VA35QE3VMC0V tag=2AH1QGHFAVNL type=write size=1180163 2024-09-12T17:42:01.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.485+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=OO413CXZFT9F type=del size=3356713 2024-09-12T17:42:01.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.486+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.0 size=1048576 2024-09-12T17:42:01.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.487+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.1 size=1048576 2024-09-12T17:42:01.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.488+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~HJC2CEREHFRP.2 size=316065 2024-09-12T17:42:01.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.490+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=HJC2CEREHFRP tag=T5N5FKKRL1L6 type=write size=3461793 2024-09-12T17:42:01.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.491+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=NUXYSL4LUHPE type=del size=3436755 2024-09-12T17:42:01.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.492+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=84FRG2PQ8U8F type=del 2024-09-12T17:42:01.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.493+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=83AXAS82E7KF type=del size=3578011 2024-09-12T17:42:01.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.494+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=NPNFKF1ARPW3 type=del 2024-09-12T17:42:01.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.496+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~LA840CMGJZA1.0 size=1048576 2024-09-12T17:42:01.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.497+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~LA840CMGJZA1.1 size=611027 2024-09-12T17:42:01.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.497+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=LA840CMGJZA1 tag=70RRELGU50HI type=write size=2708179 2024-09-12T17:42:01.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.498+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=Z8X5EA0SX1JB type=write size=126380 2024-09-12T17:42:01.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.499+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=ULXO6OE04MUP type=del size=186633 2024-09-12T17:42:01.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.500+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~8IFDA6S8A5F4.0 size=1048576 2024-09-12T17:42:01.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.501+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~8IFDA6S8A5F4.1 size=178470 2024-09-12T17:42:01.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.502+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=8IFDA6S8A5F4 tag=Z3DGEM7JK17K type=write size=2275622 2024-09-12T17:42:01.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.504+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=FNNUKCU1MGQH type=del size=1146675 2024-09-12T17:42:01.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.505+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.0 size=1048576 2024-09-12T17:42:01.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.506+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.1 size=1048576 2024-09-12T17:42:01.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.506+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~1QMTFHU4SISQ.2 size=592141 2024-09-12T17:42:01.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.508+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=1QMTFHU4SISQ tag=WG5JLOHGTRSX type=write size=3737869 2024-09-12T17:42:01.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.509+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=EXAKG12713D5 type=del size=2670002 2024-09-12T17:42:01.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.510+0000 7f330fbcc780 1 < canceled operation key=1MJ2W1WMLR85 tag=B037Z6D6ZLPU type=del size=802151 2024-09-12T17:42:01.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.512+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.0 size=1048576 2024-09-12T17:42:01.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.513+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.1 size=1048576 2024-09-12T17:42:01.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.514+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.2 size=199706 2024-09-12T17:42:01.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.514+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=MX5CY8VR1L6Z tag=H7PPDMYGS9Q3 type=write size=3345434 2024-09-12T17:42:01.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.515+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~RTAIMV1Z0CJU.0 size=515044 2024-09-12T17:42:01.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.517+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=RTAIMV1Z0CJU tag=3WYOB2MS7B9D type=write size=1563620 2024-09-12T17:42:01.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.518+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=LZ7EFTS0FQ2J type=del size=734386 2024-09-12T17:42:01.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.519+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~1YPNA7SY4HEE.0 size=1048576 2024-09-12T17:42:01.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.520+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~1YPNA7SY4HEE.1 size=131586 2024-09-12T17:42:01.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.521+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=1YPNA7SY4HEE tag=11789AO2P4CR type=write size=2228738 2024-09-12T17:42:01.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.524+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~DNUYL5AKJ4S3.0 size=984051 2024-09-12T17:42:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.524+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=DNUYL5AKJ4S3 tag=BUUHWQFH87M1 type=write size=2032627 2024-09-12T17:42:01.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.525+0000 7f330fbcc780 1 < canceled operation key=9IYALJED5G85 tag=ETSP4MYPF800 type=del size=976379 2024-09-12T17:42:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.526+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=B8SDTIY8KWCV type=del size=815320 2024-09-12T17:42:01.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.528+0000 7f330fbcc780 1 < completed delete operation key=9X4FNKQWJCX4 tag=HYDJH5VKO1QK type=del 2024-09-12T17:42:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.529+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=ZFTVAMDF0M1A type=del size=974558 2024-09-12T17:42:01.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.530+0000 7f330fbcc780 1 < completed write operation key=1MJ2W1WMLR85 tag=T7KJJJAFQUO2 type=write size=366144 2024-09-12T17:42:01.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.531+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=NKENOB5HMCPU type=del size=769901 2024-09-12T17:42:01.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.531+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~JQRGLFBM6V0N.0 size=967617 2024-09-12T17:42:01.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.533+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=JQRGLFBM6V0N tag=62936QJL8BKS type=write size=2016193 2024-09-12T17:42:01.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.535+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~D2Z9NTU2WA69.0 size=1048576 2024-09-12T17:42:01.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.536+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~D2Z9NTU2WA69.1 size=164815 2024-09-12T17:42:01.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.536+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=D2Z9NTU2WA69 tag=DSEKUB6UUH9C type=write size=2261967 2024-09-12T17:42:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.537+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~KXC381VG4VZA.0 size=1048576 2024-09-12T17:42:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.538+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~KXC381VG4VZA.1 size=727902 2024-09-12T17:42:01.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.540+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=KXC381VG4VZA tag=A4WXOIFO4905 type=write size=2825054 2024-09-12T17:42:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.542+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.0 size=1048576 2024-09-12T17:42:01.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.543+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.1 size=1048576 2024-09-12T17:42:01.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.544+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.2 size=302301 2024-09-12T17:42:01.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.544+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=5306IU88UP1N tag=7RU90PXZ95VC type=write size=3448029 2024-09-12T17:42:01.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.545+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=N60MSTGGQLY3 type=del 2024-09-12T17:42:01.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.547+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~FJHN6ZUH5436.0 size=81952 2024-09-12T17:42:01.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.547+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=FJHN6ZUH5436 tag=IACI0OLVD766 type=write size=1130528 2024-09-12T17:42:01.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.549+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=OO413CXZFT9F type=del 2024-09-12T17:42:01.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.551+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=TE7HYXPGNUC5 type=del size=2399847 2024-09-12T17:42:01.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.552+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=NUXYSL4LUHPE type=del 2024-09-12T17:42:01.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.553+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=Y5OVHGQ4IT30 type=del size=966100 2024-09-12T17:42:01.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.554+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=83AXAS82E7KF type=del 2024-09-12T17:42:01.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.555+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=LM53ENOOJ622 type=del size=1850832 2024-09-12T17:42:01.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.556+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~LA840CMGJZA1.0 size=1048576 2024-09-12T17:42:01.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.557+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~LA840CMGJZA1.1 size=611027 2024-09-12T17:42:01.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.559+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=LA840CMGJZA1 tag=70RRELGU50HI type=write size=2708179 2024-09-12T17:42:01.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.561+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.0 size=1048576 2024-09-12T17:42:01.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.562+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.1 size=1048576 2024-09-12T17:42:01.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.563+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.2 size=755163 2024-09-12T17:42:01.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.563+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=28A8N2AZA02S tag=9VABTSXLM2N1 type=write size=3900891 2024-09-12T17:42:01.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.564+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=ULXO6OE04MUP type=del 2024-09-12T17:42:01.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.566+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~OHXAB1CX5J52.0 size=1048576 2024-09-12T17:42:01.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.567+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~OHXAB1CX5J52.1 size=234687 2024-09-12T17:42:01.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.567+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=OHXAB1CX5J52 tag=0X6LZ0W3O3IN type=write size=2331839 2024-09-12T17:42:01.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.568+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=FNNUKCU1MGQH type=del 2024-09-12T17:42:01.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.570+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~73T1GY020600.0 size=668179 2024-09-12T17:42:01.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.570+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=73T1GY020600 tag=GZM9MI0KVHAB type=write size=1716755 2024-09-12T17:42:01.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.571+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=EXAKG12713D5 type=del 2024-09-12T17:42:01.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.573+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~BYN43408YSF2.0 size=721451 2024-09-12T17:42:01.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.573+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=BYN43408YSF2 tag=3X99FH9H0IW2 type=write size=1770027 2024-09-12T17:42:01.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.574+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.0 size=1048576 2024-09-12T17:42:01.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.575+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.1 size=1048576 2024-09-12T17:42:01.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.576+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~MX5CY8VR1L6Z.2 size=199706 2024-09-12T17:42:01.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.578+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=MX5CY8VR1L6Z tag=H7PPDMYGS9Q3 type=write size=3345434 2024-09-12T17:42:01.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.579+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=889LWNAP1OKA type=write size=24016 2024-09-12T17:42:01.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.580+0000 7f330fbcc780 1 < canceled operation key=SPKBX4WU9A9R tag=LZ7EFTS0FQ2J type=del size=734386 2024-09-12T17:42:01.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.582+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.0 size=1048576 2024-09-12T17:42:01.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.583+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.1 size=1048576 2024-09-12T17:42:01.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.584+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.2 size=192947 2024-09-12T17:42:01.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.584+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=19H3H5K16511 tag=H0VTUEL1HKRG type=write size=3338675 2024-09-12T17:42:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.585+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~DNUYL5AKJ4S3.0 size=984051 2024-09-12T17:42:01.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.588+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=DNUYL5AKJ4S3 tag=BUUHWQFH87M1 type=write size=2032627 2024-09-12T17:42:01.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.590+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~JSFA0HGEDLOU.0 size=1048576 2024-09-12T17:42:01.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.591+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~JSFA0HGEDLOU.1 size=226816 2024-09-12T17:42:01.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.591+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=JSFA0HGEDLOU tag=XBK7RGCSMXCO type=write size=2323968 2024-09-12T17:42:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.593+0000 7f330fbcc780 1 < suggested update operation key=30CIXFQV5VBI tag=B8SDTIY8KWCV type=del size=815320 2024-09-12T17:42:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.594+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=UHOAYM5877BU type=del size=814824 2024-09-12T17:42:01.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.595+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=ZFTVAMDF0M1A type=del 2024-09-12T17:42:01.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.597+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.0 size=1048576 2024-09-12T17:42:01.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.598+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.1 size=1048576 2024-09-12T17:42:01.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.599+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.2 size=685215 2024-09-12T17:42:01.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.599+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=FS7E3K2HJIPA tag=1X72RN7B82XD type=write size=3830943 2024-09-12T17:42:01.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.600+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=NKENOB5HMCPU type=del 2024-09-12T17:42:01.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.601+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=F6AY57QPH4IQ type=write size=1047842 2024-09-12T17:42:01.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.602+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~D2Z9NTU2WA69.0 size=1048576 2024-09-12T17:42:01.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.603+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~D2Z9NTU2WA69.1 size=164815 2024-09-12T17:42:01.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.605+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=D2Z9NTU2WA69 tag=DSEKUB6UUH9C type=write size=2261967 2024-09-12T17:42:01.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.606+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=FO6LUG70OWDB type=del size=330425 2024-09-12T17:42:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.607+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.0 size=1048576 2024-09-12T17:42:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.608+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.1 size=1048576 2024-09-12T17:42:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.609+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~5306IU88UP1N.2 size=302301 2024-09-12T17:42:01.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.611+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=5306IU88UP1N tag=7RU90PXZ95VC type=write size=3448029 2024-09-12T17:42:01.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.612+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=CLWVLUOE8PSQ type=del size=3740493 2024-09-12T17:42:01.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.613+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~FJHN6ZUH5436.0 size=81952 2024-09-12T17:42:01.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.615+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=FJHN6ZUH5436 tag=IACI0OLVD766 type=write size=1130528 2024-09-12T17:42:01.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.616+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=6MBJXEGYU9QC type=write size=827839 2024-09-12T17:42:01.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.617+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=TE7HYXPGNUC5 type=del 2024-09-12T17:42:01.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.619+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.0 size=1048576 2024-09-12T17:42:01.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.620+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.1 size=1048576 2024-09-12T17:42:01.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.621+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.2 size=890423 2024-09-12T17:42:01.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.621+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=X20XZWSXNOC3 tag=12YOPNBGHAIU type=write size=4036151 2024-09-12T17:42:01.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.622+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=Y5OVHGQ4IT30 type=del 2024-09-12T17:42:01.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.625+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~YYDABPIIQ7U2.0 size=1021017 2024-09-12T17:42:01.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.625+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=YYDABPIIQ7U2 tag=P14JGYYCQDDI type=write size=2069593 2024-09-12T17:42:01.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.626+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=LM53ENOOJ622 type=del 2024-09-12T17:42:01.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.627+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=XS7301ZFWKF6 type=del size=622081 2024-09-12T17:42:01.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.628+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.0 size=1048576 2024-09-12T17:42:01.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.629+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.1 size=1048576 2024-09-12T17:42:01.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.629+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~28A8N2AZA02S.2 size=755163 2024-09-12T17:42:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.631+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=28A8N2AZA02S tag=9VABTSXLM2N1 type=write size=3900891 2024-09-12T17:42:01.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.633+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.0 size=1048576 2024-09-12T17:42:01.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.634+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.1 size=1048576 2024-09-12T17:42:01.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.635+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.2 size=802240 2024-09-12T17:42:01.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.635+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=DO4QDL4G2ZDP tag=GF9MMQ4AR8IN type=write size=3947968 2024-09-12T17:42:01.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.635+0000 7f330fbcc780 1 < canceled part key=_multipart_30CIXFQV5VBI.2~OHXAB1CX5J52.0 size=1048576 2024-09-12T17:42:01.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.636+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~OHXAB1CX5J52.1 size=234687 2024-09-12T17:42:01.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.638+0000 7f330fbcc780 1 < canceled multipart upload key=30CIXFQV5VBI upload=OHXAB1CX5J52 tag=0X6LZ0W3O3IN type=write size=2331839 2024-09-12T17:42:01.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.640+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~DMU87S3ULL32.0 size=15774 2024-09-12T17:42:01.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.640+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=DMU87S3ULL32 tag=MNHXB69A41PN type=write size=1064350 2024-09-12T17:42:01.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.641+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~73T1GY020600.0 size=668179 2024-09-12T17:42:01.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.643+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=73T1GY020600 tag=GZM9MI0KVHAB type=write size=1716755 2024-09-12T17:42:01.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.645+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~98G1QFWCV0L9.0 size=532926 2024-09-12T17:42:01.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.645+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=98G1QFWCV0L9 tag=KWIHOZUAP0GL type=write size=1581502 2024-09-12T17:42:01.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.646+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~BYN43408YSF2.0 size=721451 2024-09-12T17:42:01.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.648+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=BYN43408YSF2 tag=3X99FH9H0IW2 type=write size=1770027 2024-09-12T17:42:01.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.649+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=3Q2TSLDXCZHX type=del size=2778453 2024-09-12T17:42:01.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.650+0000 7f330fbcc780 1 < completed write operation key=50WR6KLF40W7 tag=889LWNAP1OKA type=write size=24016 2024-09-12T17:42:01.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.651+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=MAW5ZST77W53 type=del size=267393 2024-09-12T17:42:01.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.652+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.0 size=1048576 2024-09-12T17:42:01.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.653+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.1 size=1048576 2024-09-12T17:42:01.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.654+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~19H3H5K16511.2 size=192947 2024-09-12T17:42:01.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.656+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=19H3H5K16511 tag=H0VTUEL1HKRG type=write size=3338675 2024-09-12T17:42:01.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.658+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.0 size=1048576 2024-09-12T17:42:01.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.659+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.1 size=1048576 2024-09-12T17:42:01.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.660+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.2 size=156788 2024-09-12T17:42:01.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.660+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=PB0BID6O2ZGP tag=PME18VU4UBP6 type=write size=3302516 2024-09-12T17:42:01.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.661+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~JSFA0HGEDLOU.0 size=1048576 2024-09-12T17:42:01.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.662+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~JSFA0HGEDLOU.1 size=226816 2024-09-12T17:42:01.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.664+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=JSFA0HGEDLOU tag=XBK7RGCSMXCO type=write size=2323968 2024-09-12T17:42:01.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.666+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~JJ2IX6KSXAXY.0 size=180545 2024-09-12T17:42:01.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.666+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=JJ2IX6KSXAXY tag=FMV013VSP240 type=write size=1229121 2024-09-12T17:42:01.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.667+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=UHOAYM5877BU type=del 2024-09-12T17:42:01.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.669+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=GEI8I8JLJHEM type=del size=3903204 2024-09-12T17:42:01.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.670+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.0 size=1048576 2024-09-12T17:42:01.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.671+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.1 size=1048576 2024-09-12T17:42:01.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.672+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~FS7E3K2HJIPA.2 size=685215 2024-09-12T17:42:01.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.674+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=FS7E3K2HJIPA tag=1X72RN7B82XD type=write size=3830943 2024-09-12T17:42:01.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.675+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=GMHB151NZ7TS type=del size=978350 2024-09-12T17:42:01.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.676+0000 7f330fbcc780 1 < completed write operation key=SPKBX4WU9A9R tag=F6AY57QPH4IQ type=write size=1047842 2024-09-12T17:42:01.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.677+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=67561N3KX2U1 type=write size=168213 2024-09-12T17:42:01.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.678+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=FO6LUG70OWDB type=del 2024-09-12T17:42:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.680+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~BTTIILITKFIV.0 size=1048576 2024-09-12T17:42:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.681+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~BTTIILITKFIV.1 size=229951 2024-09-12T17:42:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.681+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=BTTIILITKFIV tag=UA0X0REKIL3T type=write size=2327103 2024-09-12T17:42:01.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.682+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=CLWVLUOE8PSQ type=del 2024-09-12T17:42:01.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.684+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.0 size=1048576 2024-09-12T17:42:01.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.685+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.1 size=1048576 2024-09-12T17:42:01.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.686+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.2 size=575047 2024-09-12T17:42:01.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.686+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=RJRWI1T9NPGD tag=U21WCAFN3W0W type=write size=3720775 2024-09-12T17:42:01.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.687+0000 7f330fbcc780 1 < completed write operation key=50WR6KLF40W7 tag=6MBJXEGYU9QC type=write size=827839 2024-09-12T17:42:01.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.688+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=W8XQEFDR92IK type=del size=3231931 2024-09-12T17:42:01.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.690+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.0 size=1048576 2024-09-12T17:42:01.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.691+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.1 size=1048576 2024-09-12T17:42:01.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.692+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~X20XZWSXNOC3.2 size=890423 2024-09-12T17:42:01.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.694+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=X20XZWSXNOC3 tag=12YOPNBGHAIU type=write size=4036151 2024-09-12T17:42:01.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.696+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.0 size=1048576 2024-09-12T17:42:01.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.697+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.1 size=1048576 2024-09-12T17:42:01.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.698+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.2 size=593594 2024-09-12T17:42:01.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.698+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=QK8LI2P2LCLI tag=7KV85EM5SKTR type=write size=3739322 2024-09-12T17:42:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.699+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~YYDABPIIQ7U2.0 size=1021017 2024-09-12T17:42:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.701+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=YYDABPIIQ7U2 tag=P14JGYYCQDDI type=write size=2069593 2024-09-12T17:42:01.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.702+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=Z8ERXB346X7U type=del size=1121937 2024-09-12T17:42:01.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.703+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=XS7301ZFWKF6 type=del 2024-09-12T17:42:01.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.705+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~1RFKRGIJFEJN.0 size=1048576 2024-09-12T17:42:01.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.706+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~1RFKRGIJFEJN.1 size=351556 2024-09-12T17:42:01.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.706+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=1RFKRGIJFEJN tag=84D30Z08C372 type=write size=2448708 2024-09-12T17:42:01.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.707+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.0 size=1048576 2024-09-12T17:42:01.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.707+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.1 size=1048576 2024-09-12T17:42:01.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.707+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~DO4QDL4G2ZDP.2 size=802240 2024-09-12T17:42:01.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.709+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=DO4QDL4G2ZDP tag=GF9MMQ4AR8IN type=write size=3947968 2024-09-12T17:42:01.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.711+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=K78YEVSZPP9J type=del size=3073860 2024-09-12T17:42:01.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.712+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~DMU87S3ULL32.0 size=15774 2024-09-12T17:42:01.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.714+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=DMU87S3ULL32 tag=MNHXB69A41PN type=write size=1064350 2024-09-12T17:42:01.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.715+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=4QERMW88L5XJ type=del size=407931 2024-09-12T17:42:01.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.716+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~98G1QFWCV0L9.0 size=532926 2024-09-12T17:42:01.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.718+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=98G1QFWCV0L9 tag=KWIHOZUAP0GL type=write size=1581502 2024-09-12T17:42:01.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.720+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.0 size=1048576 2024-09-12T17:42:01.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.721+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.1 size=1048576 2024-09-12T17:42:01.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.722+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.2 size=586432 2024-09-12T17:42:01.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.722+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=7D205XUYJXKG tag=ZZES1E4QX5Z4 type=write size=3732160 2024-09-12T17:42:01.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.723+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=3Q2TSLDXCZHX type=del 2024-09-12T17:42:01.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.724+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=9O9GS1CU901X type=del size=3804582 2024-09-12T17:42:01.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.725+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=MAW5ZST77W53 type=del 2024-09-12T17:42:01.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.727+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=CCAZWQZ5VED0 type=del size=479015 2024-09-12T17:42:01.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.728+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.0 size=1048576 2024-09-12T17:42:01.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.729+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.1 size=1048576 2024-09-12T17:42:01.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.730+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~PB0BID6O2ZGP.2 size=156788 2024-09-12T17:42:01.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.731+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=PB0BID6O2ZGP tag=PME18VU4UBP6 type=write size=3302516 2024-09-12T17:42:01.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.733+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~0RXL0CBLF42P.0 size=987554 2024-09-12T17:42:01.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.733+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=0RXL0CBLF42P tag=ZYI0IUT9UL48 type=write size=2036130 2024-09-12T17:42:01.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.734+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~JJ2IX6KSXAXY.0 size=180545 2024-09-12T17:42:01.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.735+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=JJ2IX6KSXAXY tag=FMV013VSP240 type=write size=1229121 2024-09-12T17:42:01.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.737+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=NA3X65WX397E type=del size=2806355 2024-09-12T17:42:01.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.738+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=GEI8I8JLJHEM type=del 2024-09-12T17:42:01.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.739+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=AC55GDZKW78U type=write size=591671 2024-09-12T17:42:01.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.741+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=GMHB151NZ7TS type=del 2024-09-12T17:42:01.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.743+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.0 size=1048576 2024-09-12T17:42:01.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.744+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.1 size=1048576 2024-09-12T17:42:01.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.745+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.2 size=377949 2024-09-12T17:42:01.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.745+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=149V55E1ALIZ tag=PASG1Y7W8UC9 type=write size=3523677 2024-09-12T17:42:01.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.747+0000 7f330fbcc780 1 < suggested update operation key=LNE0UR6JPWR8 tag=67561N3KX2U1 type=write size=168213 2024-09-12T17:42:01.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.748+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=CGG2XFZVNLDM type=del size=2257400 2024-09-12T17:42:01.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.750+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~BTTIILITKFIV.0 size=1048576 2024-09-12T17:42:01.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.751+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~BTTIILITKFIV.1 size=229951 2024-09-12T17:42:01.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.752+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=BTTIILITKFIV tag=UA0X0REKIL3T type=write size=2327103 2024-09-12T17:42:01.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.754+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=8MHVA4FIGKGP type=del size=973328 2024-09-12T17:42:01.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.755+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.0 size=1048576 2024-09-12T17:42:01.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.756+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.1 size=1048576 2024-09-12T17:42:01.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.757+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~RJRWI1T9NPGD.2 size=575047 2024-09-12T17:42:01.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.758+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=RJRWI1T9NPGD tag=U21WCAFN3W0W type=write size=3720775 2024-09-12T17:42:01.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.759+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=PT0O84QQUT8X type=del size=284069 2024-09-12T17:42:01.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.760+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=W8XQEFDR92IK type=del size=3231931 2024-09-12T17:42:01.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.762+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=3H6YXKQ30Q5S type=del size=3365077 2024-09-12T17:42:01.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.763+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.0 size=1048576 2024-09-12T17:42:01.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.764+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.1 size=1048576 2024-09-12T17:42:01.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.765+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~QK8LI2P2LCLI.2 size=593594 2024-09-12T17:42:01.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.767+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=QK8LI2P2LCLI tag=7KV85EM5SKTR type=write size=3739322 2024-09-12T17:42:01.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.768+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=P2Z7R1RHW0EH type=del size=789941 2024-09-12T17:42:01.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.770+0000 7f330fbcc780 1 < suggested update operation key=XIW3OJB1STT9 tag=Z8ERXB346X7U type=del size=1121937 2024-09-12T17:42:01.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.772+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=VHA1DIZ9KY7G type=del size=4180016 2024-09-12T17:42:01.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.772+0000 7f330fbcc780 1 < canceled part key=_multipart_IEYJS7X97O1A.2~1RFKRGIJFEJN.0 size=1048576 2024-09-12T17:42:01.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.773+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~1RFKRGIJFEJN.1 size=351556 2024-09-12T17:42:01.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.775+0000 7f330fbcc780 1 < canceled multipart upload key=IEYJS7X97O1A upload=1RFKRGIJFEJN tag=84D30Z08C372 type=write size=2448708 2024-09-12T17:42:01.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.777+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~9IUV051ORKQD.0 size=1048576 2024-09-12T17:42:01.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.778+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~9IUV051ORKQD.1 size=285604 2024-09-12T17:42:01.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.778+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=9IUV051ORKQD tag=MAFX2YGMTD5B type=write size=2382756 2024-09-12T17:42:01.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.781+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=K78YEVSZPP9J type=del 2024-09-12T17:42:01.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.783+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~732LD5ASRI4W.0 size=1048576 2024-09-12T17:42:01.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.784+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~732LD5ASRI4W.1 size=343571 2024-09-12T17:42:01.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.784+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=732LD5ASRI4W tag=I9EXLFW9LG6U type=write size=2440723 2024-09-12T17:42:01.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.787+0000 7f330fbcc780 1 < suggested update operation key=3IHGI1UMI1BA tag=4QERMW88L5XJ type=del size=407931 2024-09-12T17:42:01.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.788+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=1OKYJPM8PLTM type=del size=1027340 2024-09-12T17:42:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.789+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.0 size=1048576 2024-09-12T17:42:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.790+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.1 size=1048576 2024-09-12T17:42:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.791+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~7D205XUYJXKG.2 size=586432 2024-09-12T17:42:01.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.793+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=7D205XUYJXKG tag=ZZES1E4QX5Z4 type=write size=3732160 2024-09-12T17:42:01.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.795+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~J9QZXW34U5PV.0 size=1048576 2024-09-12T17:42:01.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.797+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~J9QZXW34U5PV.1 size=922076 2024-09-12T17:42:01.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.797+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=J9QZXW34U5PV tag=PKN3N129PCC7 type=write size=3019228 2024-09-12T17:42:01.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.798+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=9O9GS1CU901X type=del 2024-09-12T17:42:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.799+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=K4J0XS61LLTX type=del size=935087 2024-09-12T17:42:01.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.800+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=CCAZWQZ5VED0 type=del 2024-09-12T17:42:01.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.802+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=L53H8QKQAYT9 type=del size=3189702 2024-09-12T17:42:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.803+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~0RXL0CBLF42P.0 size=987554 2024-09-12T17:42:01.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.805+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=0RXL0CBLF42P tag=ZYI0IUT9UL48 type=write size=2036130 2024-09-12T17:42:01.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.807+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~G1SWMYEU1WTH.0 size=1048576 2024-09-12T17:42:01.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.808+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~G1SWMYEU1WTH.1 size=788669 2024-09-12T17:42:01.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.808+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=G1SWMYEU1WTH tag=S26VK3NX9396 type=write size=2885821 2024-09-12T17:42:01.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.810+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=NA3X65WX397E type=del size=2806355 2024-09-12T17:42:01.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.812+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=SMYX9BANYXO8 type=del size=4093715 2024-09-12T17:42:01.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.813+0000 7f330fbcc780 -1 < failed to complete operation key=LNE0UR6JPWR8 tag=AC55GDZKW78U type=write size=591671: (22) Invalid argument 2024-09-12T17:42:01.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.815+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.0 size=1048576 2024-09-12T17:42:01.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.816+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.1 size=1048576 2024-09-12T17:42:01.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.817+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.2 size=694720 2024-09-12T17:42:01.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.817+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=M728OVKL975B tag=ZB2A7YHKWC5J type=write size=3840448 2024-09-12T17:42:01.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.817+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.0 size=1048576 2024-09-12T17:42:01.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.818+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.1 size=1048576 2024-09-12T17:42:01.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.819+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~149V55E1ALIZ.2 size=377949 2024-09-12T17:42:01.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.821+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=149V55E1ALIZ tag=PASG1Y7W8UC9 type=write size=3523677 2024-09-12T17:42:01.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.822+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=1C5TMHMX4LKG type=del size=813393 2024-09-12T17:42:01.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.824+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=CGG2XFZVNLDM type=del 2024-09-12T17:42:01.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.825+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=NVV3HD0LF2MM type=del size=516334 2024-09-12T17:42:01.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.826+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=8MHVA4FIGKGP type=del 2024-09-12T17:42:01.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.827+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=3PJPL9T7HW4O type=del size=1017665 2024-09-12T17:42:01.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.829+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=PT0O84QQUT8X type=del 2024-09-12T17:42:01.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.831+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~T48U9NONLO9S.0 size=1048576 2024-09-12T17:42:01.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.832+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~T48U9NONLO9S.1 size=816178 2024-09-12T17:42:01.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.832+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=T48U9NONLO9S tag=IQQXTGS0STSS type=write size=2913330 2024-09-12T17:42:01.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.834+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=3H6YXKQ30Q5S type=del 2024-09-12T17:42:01.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.835+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=C2TMWDH6WR8A type=del size=1193460 2024-09-12T17:42:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.837+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=P2Z7R1RHW0EH type=del 2024-09-12T17:42:01.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.839+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.0 size=1048576 2024-09-12T17:42:01.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.840+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.1 size=1048576 2024-09-12T17:42:01.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.841+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.2 size=503969 2024-09-12T17:42:01.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.841+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=LHI8GRGSI555 tag=WTJWPWPTJFLB type=write size=3649697 2024-09-12T17:42:01.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.843+0000 7f330fbcc780 1 < suggested update operation key=30CIXFQV5VBI tag=VHA1DIZ9KY7G type=del size=4180016 2024-09-12T17:42:01.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.844+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=K0ZFQHIAWYV2 type=write size=459342 2024-09-12T17:42:01.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.844+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~9IUV051ORKQD.0 size=1048576 2024-09-12T17:42:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.845+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~9IUV051ORKQD.1 size=285604 2024-09-12T17:42:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.847+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=9IUV051ORKQD tag=MAFX2YGMTD5B type=write size=2382756 2024-09-12T17:42:01.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.848+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=ZKY73G9M9L8H type=del size=1342054 2024-09-12T17:42:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.850+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~732LD5ASRI4W.0 size=1048576 2024-09-12T17:42:01.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.851+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~732LD5ASRI4W.1 size=343571 2024-09-12T17:42:01.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.852+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=732LD5ASRI4W tag=I9EXLFW9LG6U type=write size=2440723 2024-09-12T17:42:01.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.854+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=23K9DAXV3RX0 type=del size=2390241 2024-09-12T17:42:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.856+0000 7f330fbcc780 1 < suggested remove operation key=30CIXFQV5VBI tag=1OKYJPM8PLTM type=del 2024-09-12T17:42:01.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.857+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=ZSC07Y3FY0I9 type=del size=2196478 2024-09-12T17:42:01.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.858+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~J9QZXW34U5PV.0 size=1048576 2024-09-12T17:42:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.859+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~J9QZXW34U5PV.1 size=922076 2024-09-12T17:42:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.861+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=J9QZXW34U5PV tag=PKN3N129PCC7 type=write size=3019228 2024-09-12T17:42:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.863+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.0 size=1048576 2024-09-12T17:42:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.864+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.1 size=1048576 2024-09-12T17:42:01.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.865+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.2 size=483671 2024-09-12T17:42:01.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.865+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=M8FJ06KR1317 tag=Y5N5I5MOM5M8 type=write size=3629399 2024-09-12T17:42:01.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.866+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=K4J0XS61LLTX type=del 2024-09-12T17:42:01.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.867+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=LRCPXICNGMD5 type=del size=1110251 2024-09-12T17:42:01.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.869+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=L53H8QKQAYT9 type=del size=3189702 2024-09-12T17:42:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.871+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=LHIYFPNOLJK3 type=del size=235858 2024-09-12T17:42:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.872+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~G1SWMYEU1WTH.0 size=1048576 2024-09-12T17:42:01.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.873+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~G1SWMYEU1WTH.1 size=788669 2024-09-12T17:42:01.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.874+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=G1SWMYEU1WTH tag=S26VK3NX9396 type=write size=2885821 2024-09-12T17:42:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.876+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=W2FU164G3VCC type=del size=1692690 2024-09-12T17:42:01.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.877+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=SMYX9BANYXO8 type=del 2024-09-12T17:42:01.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.879+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.0 size=1048576 2024-09-12T17:42:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.880+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.1 size=1048576 2024-09-12T17:42:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.881+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.2 size=758653 2024-09-12T17:42:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.881+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=R9Z8RXD90A4S tag=6PSWM2K12XJQ type=write size=3904381 2024-09-12T17:42:01.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.882+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.0 size=1048576 2024-09-12T17:42:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.883+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.1 size=1048576 2024-09-12T17:42:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.884+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~M728OVKL975B.2 size=694720 2024-09-12T17:42:01.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.885+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=M728OVKL975B tag=ZB2A7YHKWC5J type=write size=3840448 2024-09-12T17:42:01.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.887+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=26NHX4ZIZYVP type=del size=1162678 2024-09-12T17:42:01.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.888+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=1C5TMHMX4LKG type=del 2024-09-12T17:42:01.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.890+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~HL8J5X5WS75W.0 size=944984 2024-09-12T17:42:01.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.890+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=HL8J5X5WS75W tag=1HMO8454OU9J type=write size=1993560 2024-09-12T17:42:01.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.891+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=NVV3HD0LF2MM type=del 2024-09-12T17:42:01.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.892+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=KCXBPUNAYXUS type=del size=1143158 2024-09-12T17:42:01.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.893+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=3PJPL9T7HW4O type=del 2024-09-12T17:42:01.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.894+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=G2KHA6HDXG0Z type=write size=114398 2024-09-12T17:42:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.896+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~T48U9NONLO9S.0 size=1048576 2024-09-12T17:42:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.896+0000 7f330fbcc780 1 < canceled part key=_multipart_H1LAU7WDZW6S.2~T48U9NONLO9S.1 size=816178 2024-09-12T17:42:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.897+0000 7f330fbcc780 1 < canceled multipart upload key=H1LAU7WDZW6S upload=T48U9NONLO9S tag=IQQXTGS0STSS type=write size=2913330 2024-09-12T17:42:01.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.899+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=FEXK5NDOSFUL type=del size=2292282 2024-09-12T17:42:01.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.900+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=C2TMWDH6WR8A type=del 2024-09-12T17:42:01.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.902+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~ALZ4K27KKTFO.0 size=356258 2024-09-12T17:42:01.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.902+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=ALZ4K27KKTFO tag=V3N3OQR6ZBT0 type=write size=1404834 2024-09-12T17:42:01.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.903+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.0 size=1048576 2024-09-12T17:42:01.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.904+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.1 size=1048576 2024-09-12T17:42:01.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.906+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~LHI8GRGSI555.2 size=503969 2024-09-12T17:42:01.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.908+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=LHI8GRGSI555 tag=WTJWPWPTJFLB type=write size=3649697 2024-09-12T17:42:01.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.909+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=6E60UE3Z1C14 type=del size=1722170 2024-09-12T17:42:01.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.910+0000 7f330fbcc780 1 < completed write operation key=LNE0UR6JPWR8 tag=K0ZFQHIAWYV2 type=write size=459342 2024-09-12T17:42:01.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.911+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=M2E73BDAAST6 type=del size=3056790 2024-09-12T17:42:01.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.913+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=ZKY73G9M9L8H type=del 2024-09-12T17:42:01.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.914+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=4QE4A49O0GQL type=del size=1252723 2024-09-12T17:42:01.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.915+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=23K9DAXV3RX0 type=del 2024-09-12T17:42:01.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.916+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=9HFNPTE2M13N type=del size=957868 2024-09-12T17:42:01.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.917+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=ZSC07Y3FY0I9 type=del 2024-09-12T17:42:01.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.918+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=WAFM2JT57KTQ type=write size=502589 2024-09-12T17:42:01.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.919+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.0 size=1048576 2024-09-12T17:42:01.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.920+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.1 size=1048576 2024-09-12T17:42:01.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.921+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~M8FJ06KR1317.2 size=483671 2024-09-12T17:42:01.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.923+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=M8FJ06KR1317 tag=Y5N5I5MOM5M8 type=write size=3629399 2024-09-12T17:42:01.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.924+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=3UWVNGZR2QS4 type=del size=1321268 2024-09-12T17:42:01.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.926+0000 7f330fbcc780 1 < suggested update operation key=8UX8W3FAJ3D9 tag=LRCPXICNGMD5 type=del size=1110251 2024-09-12T17:42:01.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.929+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~BPFZ3XET9JB9.0 size=1048576 2024-09-12T17:42:01.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.929+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~BPFZ3XET9JB9.1 size=897275 2024-09-12T17:42:01.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.929+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=BPFZ3XET9JB9 tag=3GSUETPIUJP4 type=write size=2994427 2024-09-12T17:42:01.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.930+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=LHIYFPNOLJK3 type=del 2024-09-12T17:42:01.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.932+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~NCUFFR34HJX4.0 size=568910 2024-09-12T17:42:01.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.932+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=NCUFFR34HJX4 tag=528D4DDS9XOZ type=write size=1617486 2024-09-12T17:42:01.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.934+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=W2FU164G3VCC type=del 2024-09-12T17:42:01.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.935+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=MOWRL59CGINL type=del size=1835132 2024-09-12T17:42:01.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.936+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.0 size=1048576 2024-09-12T17:42:01.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.937+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.1 size=1048576 2024-09-12T17:42:01.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.938+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~R9Z8RXD90A4S.2 size=758653 2024-09-12T17:42:01.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.939+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=R9Z8RXD90A4S tag=6PSWM2K12XJQ type=write size=3904381 2024-09-12T17:42:01.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.941+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~18UT01A0RJ32.0 size=1048576 2024-09-12T17:42:01.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.942+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~18UT01A0RJ32.1 size=232792 2024-09-12T17:42:01.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.942+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=18UT01A0RJ32 tag=Y2FN0MRL7G4L type=write size=2329944 2024-09-12T17:42:01.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.943+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=26NHX4ZIZYVP type=del size=1162678 2024-09-12T17:42:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.945+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~J9HMR0NBVGHE.0 size=457528 2024-09-12T17:42:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.945+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=J9HMR0NBVGHE tag=WA7CDMEXC1B6 type=write size=1506104 2024-09-12T17:42:01.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.947+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~HL8J5X5WS75W.0 size=944984 2024-09-12T17:42:01.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.948+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=HL8J5X5WS75W tag=1HMO8454OU9J type=write size=1993560 2024-09-12T17:42:01.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.949+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=P58C4WVP1JEW type=del size=3761519 2024-09-12T17:42:01.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.951+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=KCXBPUNAYXUS type=del 2024-09-12T17:42:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.953+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~NJ3IF95BI035.0 size=1048576 2024-09-12T17:42:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.954+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~NJ3IF95BI035.1 size=167878 2024-09-12T17:42:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.954+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=NJ3IF95BI035 tag=48TVX3PQZP7D type=write size=2265030 2024-09-12T17:42:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.955+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=G2KHA6HDXG0Z type=write size=114398 2024-09-12T17:42:01.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.956+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=JTBTD90K67AU type=del size=2613114 2024-09-12T17:42:01.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.957+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=FEXK5NDOSFUL type=del 2024-09-12T17:42:01.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.959+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~ALKWA9WI9BPB.0 size=1048576 2024-09-12T17:42:01.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.960+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~ALKWA9WI9BPB.1 size=507449 2024-09-12T17:42:01.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.960+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=ALKWA9WI9BPB tag=SYL2YOXBZ176 type=write size=2604601 2024-09-12T17:42:01.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.961+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~ALZ4K27KKTFO.0 size=356258 2024-09-12T17:42:01.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.963+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=ALZ4K27KKTFO tag=V3N3OQR6ZBT0 type=write size=1404834 2024-09-12T17:42:01.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.965+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~UXWPMS35L9WS.0 size=738290 2024-09-12T17:42:01.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.965+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=UXWPMS35L9WS tag=8S1UL2FL1RKH type=write size=1786866 2024-09-12T17:42:01.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.967+0000 7f330fbcc780 1 < suggested update operation key=6ZDBF249S1L6 tag=6E60UE3Z1C14 type=del size=1722170 2024-09-12T17:42:01.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.968+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=LVP2U6HVM4WW type=del size=3365271 2024-09-12T17:42:01.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.969+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=M2E73BDAAST6 type=del 2024-09-12T17:42:01.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.972+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~ISGR7XOKBI10.0 size=174979 2024-09-12T17:42:01.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.972+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=ISGR7XOKBI10 tag=VHJX8V81F0N4 type=write size=1223555 2024-09-12T17:42:01.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.973+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=4QE4A49O0GQL type=del 2024-09-12T17:42:01.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.974+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=Z31XFW5N5U6T type=del size=3973550 2024-09-12T17:42:01.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.975+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=9HFNPTE2M13N type=del 2024-09-12T17:42:01.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.977+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~NY3AO2YHTTJ6.0 size=316938 2024-09-12T17:42:01.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.977+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=NY3AO2YHTTJ6 tag=8H48C0B1W6JZ type=write size=1365514 2024-09-12T17:42:01.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.978+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=WAFM2JT57KTQ type=write size=502589 2024-09-12T17:42:01.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.980+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=AUX0T1M3UKJQ type=del size=3283657 2024-09-12T17:42:01.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.982+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=3UWVNGZR2QS4 type=del 2024-09-12T17:42:01.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.983+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=L5KV039DSYXG type=write size=558590 2024-09-12T17:42:01.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.984+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~BPFZ3XET9JB9.0 size=1048576 2024-09-12T17:42:01.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.985+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~BPFZ3XET9JB9.1 size=897275 2024-09-12T17:42:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.987+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=BPFZ3XET9JB9 tag=3GSUETPIUJP4 type=write size=2994427 2024-09-12T17:42:01.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.988+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=SB87SW4P6BDA type=del size=1934468 2024-09-12T17:42:01.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.989+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~NCUFFR34HJX4.0 size=568910 2024-09-12T17:42:01.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.992+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=NCUFFR34HJX4 tag=528D4DDS9XOZ type=write size=1617486 2024-09-12T17:42:01.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.993+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=JU1SIQ1HNT65 type=write size=162429 2024-09-12T17:42:01.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.994+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=MOWRL59CGINL type=del 2024-09-12T17:42:01.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.995+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=ZTOSY3S2V2PQ type=del size=3091789 2024-09-12T17:42:01.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.997+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~18UT01A0RJ32.0 size=1048576 2024-09-12T17:42:01.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:01.998+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~18UT01A0RJ32.1 size=232792 2024-09-12T17:42:02.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.000+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=18UT01A0RJ32 tag=Y2FN0MRL7G4L type=write size=2329944 2024-09-12T17:42:02.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.002+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~KPPJ9ONKC7T0.0 size=1048576 2024-09-12T17:42:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.003+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~KPPJ9ONKC7T0.1 size=1029719 2024-09-12T17:42:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.003+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=KPPJ9ONKC7T0 tag=SBNUFJEDD10N type=write size=3126871 2024-09-12T17:42:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.004+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~J9HMR0NBVGHE.0 size=457528 2024-09-12T17:42:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.006+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=J9HMR0NBVGHE tag=WA7CDMEXC1B6 type=write size=1506104 2024-09-12T17:42:02.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.007+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=BWFYD3ZVPA2A type=del size=2659854 2024-09-12T17:42:02.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.008+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=P58C4WVP1JEW type=del 2024-09-12T17:42:02.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.010+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=DC95F35HRHMZ type=del size=1843193 2024-09-12T17:42:02.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.011+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~NJ3IF95BI035.0 size=1048576 2024-09-12T17:42:02.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.011+0000 7f330fbcc780 1 < canceled part key=_multipart_HJL73WQD8SD2.2~NJ3IF95BI035.1 size=167878 2024-09-12T17:42:02.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.014+0000 7f330fbcc780 1 < canceled multipart upload key=HJL73WQD8SD2 upload=NJ3IF95BI035 tag=48TVX3PQZP7D type=write size=2265030 2024-09-12T17:42:02.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.015+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=ME8QUOOT6M95 type=del size=3794465 2024-09-12T17:42:02.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.018+0000 7f330fbcc780 1 < suggested update operation key=6MFVO30OX5W1 tag=JTBTD90K67AU type=del size=2613114 2024-09-12T17:42:02.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.019+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=6DJHUPT4DQWD type=del size=3944507 2024-09-12T17:42:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.020+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~ALKWA9WI9BPB.0 size=1048576 2024-09-12T17:42:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.021+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~ALKWA9WI9BPB.1 size=507449 2024-09-12T17:42:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.022+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=ALKWA9WI9BPB tag=SYL2YOXBZ176 type=write size=2604601 2024-09-12T17:42:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.024+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=JJILNFNYDN49 type=del size=1532783 2024-09-12T17:42:02.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.024+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~UXWPMS35L9WS.0 size=738290 2024-09-12T17:42:02.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.026+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=UXWPMS35L9WS tag=8S1UL2FL1RKH type=write size=1786866 2024-09-12T17:42:02.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.027+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=ML9QR44ADQQA type=del size=2908400 2024-09-12T17:42:02.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.028+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=LVP2U6HVM4WW type=del 2024-09-12T17:42:02.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.030+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~8LBBJCLYSBL9.0 size=1048576 2024-09-12T17:42:02.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.031+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~8LBBJCLYSBL9.1 size=209681 2024-09-12T17:42:02.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.031+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=8LBBJCLYSBL9 tag=X47FQXVSEXRH type=write size=2306833 2024-09-12T17:42:02.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.032+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~ISGR7XOKBI10.0 size=174979 2024-09-12T17:42:02.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.034+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=ISGR7XOKBI10 tag=VHJX8V81F0N4 type=write size=1223555 2024-09-12T17:42:02.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.036+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.0 size=1048576 2024-09-12T17:42:02.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.037+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.1 size=1048576 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.038+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.2 size=579377 2024-09-12T17:42:02.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.038+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=P8NB9W3I6CQ5 tag=L1320L8U99E0 type=write size=3725105 2024-09-12T17:42:02.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.039+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=Z31XFW5N5U6T type=del 2024-09-12T17:42:02.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.040+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=CVL6CU2QNO4A type=write size=371878 2024-09-12T17:42:02.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.041+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~NY3AO2YHTTJ6.0 size=316938 2024-09-12T17:42:02.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.043+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=NY3AO2YHTTJ6 tag=8H48C0B1W6JZ type=write size=1365514 2024-09-12T17:42:02.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.044+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=109JA3LG5NU1 type=del size=1246609 2024-09-12T17:42:02.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.045+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=AUX0T1M3UKJQ type=del 2024-09-12T17:42:02.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.046+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=9AND39TO0W80 type=write size=779087 2024-09-12T17:42:02.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.047+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=L5KV039DSYXG type=write size=558590 2024-09-12T17:42:02.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.049+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~TZFEAEENHX0M.0 size=1048576 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.050+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~TZFEAEENHX0M.1 size=311236 2024-09-12T17:42:02.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.050+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=TZFEAEENHX0M tag=U55XTC65X6VL type=write size=2408388 2024-09-12T17:42:02.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.051+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=SB87SW4P6BDA type=del 2024-09-12T17:42:02.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.052+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=ATHIMYEM2KX3 type=del size=4113274 2024-09-12T17:42:02.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.054+0000 7f330fbcc780 1 < suggested update operation key=8UX8W3FAJ3D9 tag=JU1SIQ1HNT65 type=write size=162429 2024-09-12T17:42:02.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.055+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=W7HEWLP02BCU type=del size=1781841 2024-09-12T17:42:02.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.056+0000 7f330fbcc780 1 < canceled operation key=IEYJS7X97O1A tag=ZTOSY3S2V2PQ type=del size=3091789 2024-09-12T17:42:02.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.058+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~LPYZ77VSRKI0.0 size=1048576 2024-09-12T17:42:02.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.059+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~LPYZ77VSRKI0.1 size=811425 2024-09-12T17:42:02.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.059+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=LPYZ77VSRKI0 tag=Y02PWPWMYEGM type=write size=2908577 2024-09-12T17:42:02.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.061+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~KPPJ9ONKC7T0.0 size=1048576 2024-09-12T17:42:02.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.061+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~KPPJ9ONKC7T0.1 size=1029719 2024-09-12T17:42:02.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.063+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=KPPJ9ONKC7T0 tag=SBNUFJEDD10N type=write size=3126871 2024-09-12T17:42:02.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.064+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=3LA8NG648DTS type=write size=62099 2024-09-12T17:42:02.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.065+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=BWFYD3ZVPA2A type=del 2024-09-12T17:42:02.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.067+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=JFUC5W2KLWXM type=del size=1845374 2024-09-12T17:42:02.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.069+0000 7f330fbcc780 1 < suggested update operation key=6HBW7077B3MS tag=DC95F35HRHMZ type=del size=1843193 2024-09-12T17:42:02.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.070+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=QP1A7BIC21W8 type=del size=3100641 2024-09-12T17:42:02.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.071+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=ME8QUOOT6M95 type=del 2024-09-12T17:42:02.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.073+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~BU6I0020YDZE.0 size=1048576 2024-09-12T17:42:02.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.074+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~BU6I0020YDZE.1 size=850464 2024-09-12T17:42:02.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.074+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=BU6I0020YDZE tag=ORPNLK0O1H6T type=write size=2947616 2024-09-12T17:42:02.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.075+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=6DJHUPT4DQWD type=del 2024-09-12T17:42:02.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.076+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=74F4BY9Q0ZAX type=del size=640084 2024-09-12T17:42:02.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.077+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=JJILNFNYDN49 type=del 2024-09-12T17:42:02.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.079+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=5HTU74X7F8TH type=del size=3797550 2024-09-12T17:42:02.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.080+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=ML9QR44ADQQA type=del 2024-09-12T17:42:02.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.081+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=WI243A1PRFO5 type=del size=1861205 2024-09-12T17:42:02.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.082+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~8LBBJCLYSBL9.0 size=1048576 2024-09-12T17:42:02.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.083+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~8LBBJCLYSBL9.1 size=209681 2024-09-12T17:42:02.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.085+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=8LBBJCLYSBL9 tag=X47FQXVSEXRH type=write size=2306833 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.087+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~CZIT74QUDHVM.0 size=360392 2024-09-12T17:42:02.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.087+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=CZIT74QUDHVM tag=KNBB3NSJYAIP type=write size=1408968 2024-09-12T17:42:02.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.088+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.0 size=1048576 2024-09-12T17:42:02.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.089+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.1 size=1048576 2024-09-12T17:42:02.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.090+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~P8NB9W3I6CQ5.2 size=579377 2024-09-12T17:42:02.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.092+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=P8NB9W3I6CQ5 tag=L1320L8U99E0 type=write size=3725105 2024-09-12T17:42:02.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.093+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=TAUUL3SASRIZ type=write size=114905 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.094+0000 7f330fbcc780 1 < completed write operation key=FY2BXMZBVMDL tag=CVL6CU2QNO4A type=write size=371878 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.095+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=40X6E61ZLDHV type=del size=3176241 2024-09-12T17:42:02.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.096+0000 7f330fbcc780 1 < completed delete operation key=H1LAU7WDZW6S tag=109JA3LG5NU1 type=del 2024-09-12T17:42:02.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.098+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=JVZ6PHSBNBCS type=del size=2822216 2024-09-12T17:42:02.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.099+0000 7f330fbcc780 1 < completed write operation key=H1LAU7WDZW6S tag=9AND39TO0W80 type=write size=779087 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.101+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~L3A0H61CNO03.0 size=535192 2024-09-12T17:42:02.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.101+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=L3A0H61CNO03 tag=GMQRUI6BHLDQ type=write size=1583768 2024-09-12T17:42:02.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.102+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~TZFEAEENHX0M.0 size=1048576 2024-09-12T17:42:02.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.103+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~TZFEAEENHX0M.1 size=311236 2024-09-12T17:42:02.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.105+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=TZFEAEENHX0M tag=U55XTC65X6VL type=write size=2408388 2024-09-12T17:42:02.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.107+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~V76HWI35PX0I.0 size=1048576 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.108+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~V76HWI35PX0I.1 size=141094 2024-09-12T17:42:02.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.108+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=V76HWI35PX0I tag=JFEEGH84J96J type=write size=2238246 2024-09-12T17:42:02.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.109+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=ATHIMYEM2KX3 type=del 2024-09-12T17:42:02.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.110+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=3LMJERW11K0P type=write size=990739 2024-09-12T17:42:02.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.113+0000 7f330fbcc780 1 < suggested remove operation key=9X4FNKQWJCX4 tag=W7HEWLP02BCU type=del 2024-09-12T17:42:02.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.114+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=UFKE3BQ09IQ9 type=write size=289902 2024-09-12T17:42:02.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.115+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~LPYZ77VSRKI0.0 size=1048576 2024-09-12T17:42:02.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.116+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~LPYZ77VSRKI0.1 size=811425 2024-09-12T17:42:02.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.118+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=LPYZ77VSRKI0 tag=Y02PWPWMYEGM type=write size=2908577 2024-09-12T17:42:02.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.121+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=YZMP09RJH6JM type=del size=2939184 2024-09-12T17:42:02.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.122+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=3LA8NG648DTS type=write size=62099 2024-09-12T17:42:02.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.124+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~QM5NF71645ZK.0 size=1048576 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.125+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~QM5NF71645ZK.1 size=389598 2024-09-12T17:42:02.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.125+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=QM5NF71645ZK tag=Q2NFJBJUGDVH type=write size=2486750 2024-09-12T17:42:02.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.128+0000 7f330fbcc780 1 < suggested update operation key=6HBW7077B3MS tag=JFUC5W2KLWXM type=del size=1845374 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.130+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~66MQF34ESCDV.0 size=1048576 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.131+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~66MQF34ESCDV.1 size=934449 2024-09-12T17:42:02.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.131+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=66MQF34ESCDV tag=AHCRTNALT0YQ type=write size=3031601 2024-09-12T17:42:02.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.133+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=QP1A7BIC21W8 type=del 2024-09-12T17:42:02.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.135+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.0 size=1048576 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.136+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.1 size=1048576 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.136+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.2 size=441789 2024-09-12T17:42:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.136+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=E5LBZKKRS47Z tag=3BE8LL10AQ25 type=write size=3587517 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.138+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~BU6I0020YDZE.0 size=1048576 2024-09-12T17:42:02.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.139+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~BU6I0020YDZE.1 size=850464 2024-09-12T17:42:02.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.140+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=BU6I0020YDZE tag=ORPNLK0O1H6T type=write size=2947616 2024-09-12T17:42:02.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.142+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=U7MMW1JES4PV type=del size=3822187 2024-09-12T17:42:02.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.143+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=74F4BY9Q0ZAX type=del 2024-09-12T17:42:02.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.144+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=G21YXLFQVMWU type=del size=731890 2024-09-12T17:42:02.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.145+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=5HTU74X7F8TH type=del size=3797550 2024-09-12T17:42:02.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.147+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.0 size=1048576 2024-09-12T17:42:02.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.148+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.1 size=1048576 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.149+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.2 size=77252 2024-09-12T17:42:02.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.149+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=ST57AX1CPB0Z tag=BGR6TWT9BA7V type=write size=3222980 2024-09-12T17:42:02.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.150+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=WI243A1PRFO5 type=del 2024-09-12T17:42:02.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.151+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=WAVLAZR9BCZC type=del size=1579556 2024-09-12T17:42:02.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.152+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~CZIT74QUDHVM.0 size=360392 2024-09-12T17:42:02.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.154+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=CZIT74QUDHVM tag=KNBB3NSJYAIP type=write size=1408968 2024-09-12T17:42:02.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.155+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=XHNEKUGNJV8I type=del size=3950408 2024-09-12T17:42:02.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.156+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=TAUUL3SASRIZ type=write size=114905 2024-09-12T17:42:02.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.157+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=LNOUFXHQO5FZ type=write size=450373 2024-09-12T17:42:02.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.159+0000 7f330fbcc780 1 < suggested update operation key=6HBW7077B3MS tag=40X6E61ZLDHV type=del size=3176241 2024-09-12T17:42:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.160+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=ZSKCVUJFHKTC type=del size=1806066 2024-09-12T17:42:02.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.161+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=JVZ6PHSBNBCS type=del 2024-09-12T17:42:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.164+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.0 size=1048576 2024-09-12T17:42:02.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.164+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.1 size=1048576 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.165+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.2 size=484659 2024-09-12T17:42:02.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.165+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=8VGYSA58MFER tag=03P44AUNO748 type=write size=3630387 2024-09-12T17:42:02.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.167+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~L3A0H61CNO03.0 size=535192 2024-09-12T17:42:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.168+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=L3A0H61CNO03 tag=GMQRUI6BHLDQ type=write size=1583768 2024-09-12T17:42:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.170+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=INVCLETLW9BD type=del size=605301 2024-09-12T17:42:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.171+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~V76HWI35PX0I.0 size=1048576 2024-09-12T17:42:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.172+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~V76HWI35PX0I.1 size=141094 2024-09-12T17:42:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.174+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=V76HWI35PX0I tag=JFEEGH84J96J type=write size=2238246 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.176+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~G0UEDFDECC2J.0 size=979858 2024-09-12T17:42:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.176+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=G0UEDFDECC2J tag=0980RVF2VR0U type=write size=2028434 2024-09-12T17:42:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.178+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=3LMJERW11K0P type=write 2024-09-12T17:42:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.179+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=2KKZ923V7MVP type=del size=3632336 2024-09-12T17:42:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.180+0000 7f330fbcc780 1 < completed write operation key=30CIXFQV5VBI tag=UFKE3BQ09IQ9 type=write size=289902 2024-09-12T17:42:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.181+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=SXGZ3CA2OO3V type=del size=2075570 2024-09-12T17:42:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.183+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=YZMP09RJH6JM type=del 2024-09-12T17:42:02.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.184+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=N0A6ELR8OVRA type=write size=712160 2024-09-12T17:42:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.185+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~QM5NF71645ZK.0 size=1048576 2024-09-12T17:42:02.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.186+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~QM5NF71645ZK.1 size=389598 2024-09-12T17:42:02.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.188+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=QM5NF71645ZK tag=Q2NFJBJUGDVH type=write size=2486750 2024-09-12T17:42:02.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.189+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=0KWX2MADSJ1W type=del size=3151025 2024-09-12T17:42:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.190+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~66MQF34ESCDV.0 size=1048576 2024-09-12T17:42:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.191+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~66MQF34ESCDV.1 size=934449 2024-09-12T17:42:02.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.193+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=66MQF34ESCDV tag=AHCRTNALT0YQ type=write size=3031601 2024-09-12T17:42:02.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.195+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.0 size=1048576 2024-09-12T17:42:02.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.196+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.1 size=1048576 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.197+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.2 size=127412 2024-09-12T17:42:02.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.197+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=AOLCETPPAW4A tag=T3YJMO9MF0ZV type=write size=3273140 2024-09-12T17:42:02.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.198+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.0 size=1048576 2024-09-12T17:42:02.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.199+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.1 size=1048576 2024-09-12T17:42:02.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.200+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~E5LBZKKRS47Z.2 size=441789 2024-09-12T17:42:02.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.202+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=E5LBZKKRS47Z tag=3BE8LL10AQ25 type=write size=3587517 2024-09-12T17:42:02.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.203+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=Y7RZPMQFOS58 type=del size=730250 2024-09-12T17:42:02.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.204+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=U7MMW1JES4PV type=del 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.207+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.0 size=1048576 2024-09-12T17:42:02.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.207+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.1 size=1048576 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.208+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.2 size=749530 2024-09-12T17:42:02.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.208+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=TT4I1N9BDNON tag=UQGL4BAVZ3QZ type=write size=3895258 2024-09-12T17:42:02.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.211+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=G21YXLFQVMWU type=del 2024-09-12T17:42:02.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.212+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=4J0MA6UDT3CK type=write size=630907 2024-09-12T17:42:02.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.213+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.0 size=1048576 2024-09-12T17:42:02.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.214+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.1 size=1048576 2024-09-12T17:42:02.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.215+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~ST57AX1CPB0Z.2 size=77252 2024-09-12T17:42:02.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.217+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=ST57AX1CPB0Z tag=BGR6TWT9BA7V type=write size=3222980 2024-09-12T17:42:02.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.219+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.0 size=1048576 2024-09-12T17:42:02.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.220+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.1 size=1048576 2024-09-12T17:42:02.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.221+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.2 size=325272 2024-09-12T17:42:02.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.221+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=O3ZWXD8RQ7C4 tag=W4RQQVGZ6EOC type=write size=3471000 2024-09-12T17:42:02.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.222+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=WAVLAZR9BCZC type=del 2024-09-12T17:42:02.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.224+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~OIEG5A0MLWCQ.0 size=1048576 2024-09-12T17:42:02.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.225+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~OIEG5A0MLWCQ.1 size=838736 2024-09-12T17:42:02.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.225+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=OIEG5A0MLWCQ tag=BZT9NQZ124KJ type=write size=2935888 2024-09-12T17:42:02.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.227+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=XHNEKUGNJV8I type=del 2024-09-12T17:42:02.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.228+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=XKTPHBNII677 type=del size=3264116 2024-09-12T17:42:02.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.229+0000 7f330fbcc780 1 < canceled operation key=FY2BXMZBVMDL tag=LNOUFXHQO5FZ type=write size=450373 2024-09-12T17:42:02.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.230+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=2DU4CIGW8L9Y type=del size=2277416 2024-09-12T17:42:02.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.232+0000 7f330fbcc780 1 < canceled operation key=LNE0UR6JPWR8 tag=ZSKCVUJFHKTC type=del size=1806066 2024-09-12T17:42:02.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.233+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=89J4G1UWTWGZ type=write size=280363 2024-09-12T17:42:02.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.234+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.0 size=1048576 2024-09-12T17:42:02.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.235+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.1 size=1048576 2024-09-12T17:42:02.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.235+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8VGYSA58MFER.2 size=484659 2024-09-12T17:42:02.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.237+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=8VGYSA58MFER tag=03P44AUNO748 type=write size=3630387 2024-09-12T17:42:02.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.239+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~421N9HT70BNL.0 size=585294 2024-09-12T17:42:02.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.239+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=421N9HT70BNL tag=202F205DTJC8 type=write size=1633870 2024-09-12T17:42:02.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.241+0000 7f330fbcc780 1 < suggested remove operation key=XIW3OJB1STT9 tag=INVCLETLW9BD type=del 2024-09-12T17:42:02.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.243+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.0 size=1048576 2024-09-12T17:42:02.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.244+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.1 size=1048576 2024-09-12T17:42:02.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.245+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.2 size=722700 2024-09-12T17:42:02.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.245+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=RJ8XH4RJX9L3 tag=JY6T4E9UNQ81 type=write size=3868428 2024-09-12T17:42:02.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.246+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~G0UEDFDECC2J.0 size=979858 2024-09-12T17:42:02.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.248+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=G0UEDFDECC2J tag=0980RVF2VR0U type=write size=2028434 2024-09-12T17:42:02.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.249+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=3VVIIJYWPNF8 type=write size=344403 2024-09-12T17:42:02.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.251+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=2KKZ923V7MVP type=del 2024-09-12T17:42:02.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.253+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~W2QJ6WCWXV5R.0 size=1048576 2024-09-12T17:42:02.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.253+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~W2QJ6WCWXV5R.1 size=789113 2024-09-12T17:42:02.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.253+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=W2QJ6WCWXV5R tag=EJY41JUEU4UX type=write size=2886265 2024-09-12T17:42:02.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.255+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=SXGZ3CA2OO3V type=del 2024-09-12T17:42:02.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.257+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~18AGJHKJWHEN.0 size=425004 2024-09-12T17:42:02.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.257+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=18AGJHKJWHEN tag=T9EAQN324U0K type=write size=1473580 2024-09-12T17:42:02.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.257+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=6HBW7077B3MS tag=N0A6ELR8OVRA type=write size=712160: (2) No such file or directory 2024-09-12T17:42:02.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.258+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=0PTWHI4JIX4I type=del size=1917471 2024-09-12T17:42:02.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.260+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=0KWX2MADSJ1W type=del 2024-09-12T17:42:02.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.261+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=8BG8CTFBVTFD type=write size=730551 2024-09-12T17:42:02.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.262+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.0 size=1048576 2024-09-12T17:42:02.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.262+0000 7f330fbcc780 1 < canceled part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.1 size=1048576 2024-09-12T17:42:02.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.263+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~AOLCETPPAW4A.2 size=127412 2024-09-12T17:42:02.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.265+0000 7f330fbcc780 1 < canceled multipart upload key=IEYJS7X97O1A upload=AOLCETPPAW4A tag=T3YJMO9MF0ZV type=write size=3273140 2024-09-12T17:42:02.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.266+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=37OP912XRSMK type=del size=3018006 2024-09-12T17:42:02.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.267+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=Y7RZPMQFOS58 type=del 2024-09-12T17:42:02.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.268+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=INLD7P34ZD5K type=del size=4127823 2024-09-12T17:42:02.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.269+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.0 size=1048576 2024-09-12T17:42:02.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.270+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.1 size=1048576 2024-09-12T17:42:02.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.271+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~TT4I1N9BDNON.2 size=749530 2024-09-12T17:42:02.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.273+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=TT4I1N9BDNON tag=UQGL4BAVZ3QZ type=write size=3895258 2024-09-12T17:42:02.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.274+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=13C8LIJOD2VJ type=del size=3501675 2024-09-12T17:42:02.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.276+0000 7f330fbcc780 1 < suggested update operation key=MQV01X5P8JLG tag=4J0MA6UDT3CK type=write size=630907 2024-09-12T17:42:02.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.278+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.0 size=1048576 2024-09-12T17:42:02.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.279+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.1 size=1048576 2024-09-12T17:42:02.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.280+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.2 size=830451 2024-09-12T17:42:02.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.280+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=GSRQHXFXJM80 tag=EF1WU6M9GTNT type=write size=3976179 2024-09-12T17:42:02.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.281+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.0 size=1048576 2024-09-12T17:42:02.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.282+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.1 size=1048576 2024-09-12T17:42:02.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.283+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~O3ZWXD8RQ7C4.2 size=325272 2024-09-12T17:42:02.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.284+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=O3ZWXD8RQ7C4 tag=W4RQQVGZ6EOC type=write size=3471000 2024-09-12T17:42:02.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.286+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=ZL1PZBD46JM0 type=del size=2294556 2024-09-12T17:42:02.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.287+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~OIEG5A0MLWCQ.0 size=1048576 2024-09-12T17:42:02.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.287+0000 7f330fbcc780 1 < canceled part key=_multipart_FY2BXMZBVMDL.2~OIEG5A0MLWCQ.1 size=838736 2024-09-12T17:42:02.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.289+0000 7f330fbcc780 1 < canceled multipart upload key=FY2BXMZBVMDL upload=OIEG5A0MLWCQ tag=BZT9NQZ124KJ type=write size=2935888 2024-09-12T17:42:02.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.290+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=U8Z6YTOCNEZB type=del size=1688213 2024-09-12T17:42:02.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.291+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=XKTPHBNII677 type=del 2024-09-12T17:42:02.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.293+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~R90Q6MM9QN20.0 size=527075 2024-09-12T17:42:02.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.293+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=R90Q6MM9QN20 tag=D5UW4OH3JR2L type=write size=1575651 2024-09-12T17:42:02.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.294+0000 7f330fbcc780 -1 < failed to complete operation key=XIW3OJB1STT9 tag=2DU4CIGW8L9Y type=del size=2277416: (22) Invalid argument 2024-09-12T17:42:02.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.296+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=N6KMM4Y5N2LI type=write size=918971 2024-09-12T17:42:02.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.298+0000 7f330fbcc780 1 < suggested remove operation key=H1LAU7WDZW6S tag=89J4G1UWTWGZ type=write 2024-09-12T17:42:02.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.299+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=SPD9RV2CNOM6 type=del size=2203448 2024-09-12T17:42:02.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.300+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~421N9HT70BNL.0 size=585294 2024-09-12T17:42:02.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.302+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=421N9HT70BNL tag=202F205DTJC8 type=write size=1633870 2024-09-12T17:42:02.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.303+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=QDCWH5QH9AIO type=del size=493512 2024-09-12T17:42:02.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.304+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.0 size=1048576 2024-09-12T17:42:02.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.305+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.1 size=1048576 2024-09-12T17:42:02.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.306+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~RJ8XH4RJX9L3.2 size=722700 2024-09-12T17:42:02.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.308+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=RJ8XH4RJX9L3 tag=JY6T4E9UNQ81 type=write size=3868428 2024-09-12T17:42:02.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.310+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~2247W4PLAYVL.0 size=485619 2024-09-12T17:42:02.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.310+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=2247W4PLAYVL tag=KSJOP92WSYE0 type=write size=1534195 2024-09-12T17:42:02.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.311+0000 7f330fbcc780 -1 < failed to complete operation key=MQV01X5P8JLG tag=3VVIIJYWPNF8 type=write size=344403: (22) Invalid argument 2024-09-12T17:42:02.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.312+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=Y1BWO54ZBWMT type=del size=1819052 2024-09-12T17:42:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.313+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~W2QJ6WCWXV5R.0 size=1048576 2024-09-12T17:42:02.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.314+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~W2QJ6WCWXV5R.1 size=789113 2024-09-12T17:42:02.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.316+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=W2QJ6WCWXV5R tag=EJY41JUEU4UX type=write size=2886265 2024-09-12T17:42:02.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.317+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=TTH4U6LG06B6 type=del size=2040595 2024-09-12T17:42:02.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.318+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~18AGJHKJWHEN.0 size=425004 2024-09-12T17:42:02.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.320+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=18AGJHKJWHEN tag=T9EAQN324U0K type=write size=1473580 2024-09-12T17:42:02.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.323+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~HMAW35IGM3G0.0 size=702548 2024-09-12T17:42:02.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.323+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=HMAW35IGM3G0 tag=MHY96E5AKF17 type=write size=1751124 2024-09-12T17:42:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.325+0000 7f330fbcc780 1 < suggested remove operation key=50WR6KLF40W7 tag=0PTWHI4JIX4I type=del 2024-09-12T17:42:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.327+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~4J1XYYRZQB5M.0 size=1048576 2024-09-12T17:42:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.328+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~4J1XYYRZQB5M.1 size=755015 2024-09-12T17:42:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.328+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=4J1XYYRZQB5M tag=EM6UN9VEB46R type=write size=2852167 2024-09-12T17:42:02.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.329+0000 7f330fbcc780 1 < completed write operation key=D5ZZ93XAPRAA tag=8BG8CTFBVTFD type=write size=730551 2024-09-12T17:42:02.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.333+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~BYQDOAUHGWCF.0 size=1048576 2024-09-12T17:42:02.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.334+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~BYQDOAUHGWCF.1 size=331856 2024-09-12T17:42:02.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.334+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=BYQDOAUHGWCF tag=K1N66YGX0SR6 type=write size=2429008 2024-09-12T17:42:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.336+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=37OP912XRSMK type=del 2024-09-12T17:42:02.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.338+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=P867K1PRKMF3 type=del size=2451356 2024-09-12T17:42:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.339+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=INLD7P34ZD5K type=del 2024-09-12T17:42:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.341+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~X55D8D6C3RYT.0 size=1048576 2024-09-12T17:42:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.342+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~X55D8D6C3RYT.1 size=643567 2024-09-12T17:42:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.342+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=X55D8D6C3RYT tag=E0MMVOWS29UH type=write size=2740719 2024-09-12T17:42:02.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.343+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=13C8LIJOD2VJ type=del 2024-09-12T17:42:02.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.345+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.0 size=1048576 2024-09-12T17:42:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.346+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.1 size=1048576 2024-09-12T17:42:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.347+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.2 size=57275 2024-09-12T17:42:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.347+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=YFH63A25ZE7G tag=O5BL5SBFS5RJ type=write size=3203003 2024-09-12T17:42:02.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.348+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.0 size=1048576 2024-09-12T17:42:02.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.349+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.1 size=1048576 2024-09-12T17:42:02.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.349+0000 7f330fbcc780 1 < canceled part key=_multipart_30CIXFQV5VBI.2~GSRQHXFXJM80.2 size=830451 2024-09-12T17:42:02.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.350+0000 7f330fbcc780 1 < canceled multipart upload key=30CIXFQV5VBI upload=GSRQHXFXJM80 tag=EF1WU6M9GTNT type=write size=3976179 2024-09-12T17:42:02.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.352+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=LVB325CYB193 type=del size=251855 2024-09-12T17:42:02.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.354+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=ZL1PZBD46JM0 type=del 2024-09-12T17:42:02.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.356+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.0 size=1048576 2024-09-12T17:42:02.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.357+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.1 size=1048576 2024-09-12T17:42:02.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.358+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.2 size=206184 2024-09-12T17:42:02.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.358+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=MCLGCIWTKHZP tag=GABYEI7DK1L0 type=write size=3351912 2024-09-12T17:42:02.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.360+0000 7f330fbcc780 1 < suggested remove operation key=D5ZZ93XAPRAA tag=U8Z6YTOCNEZB type=del 2024-09-12T17:42:02.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.361+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=X6PDZCQGRHSA type=del size=2397674 2024-09-12T17:42:02.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.363+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~R90Q6MM9QN20.0 size=527075 2024-09-12T17:42:02.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.364+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=R90Q6MM9QN20 tag=D5UW4OH3JR2L type=write size=1575651 2024-09-12T17:42:02.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.366+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=XS61I90O7IUL type=del size=1245630 2024-09-12T17:42:02.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.367+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=N6KMM4Y5N2LI type=write size=918971 2024-09-12T17:42:02.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.369+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~XGGKE6Q1QHY5.0 size=1048576 2024-09-12T17:42:02.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.369+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~XGGKE6Q1QHY5.1 size=576043 2024-09-12T17:42:02.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.369+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=XGGKE6Q1QHY5 tag=FQOADA7WVP4J type=write size=2673195 2024-09-12T17:42:02.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.371+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=SPD9RV2CNOM6 type=del 2024-09-12T17:42:02.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.372+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=DUZMOHDDIAJD type=del size=2107539 2024-09-12T17:42:02.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.373+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=QDCWH5QH9AIO type=del 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.375+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~Z12L0V7G6409.0 size=1048576 2024-09-12T17:42:02.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.376+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~Z12L0V7G6409.1 size=196690 2024-09-12T17:42:02.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.376+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=Z12L0V7G6409 tag=FP2RCD928ASA type=write size=2293842 2024-09-12T17:42:02.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.377+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~2247W4PLAYVL.0 size=485619 2024-09-12T17:42:02.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.379+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=2247W4PLAYVL tag=KSJOP92WSYE0 type=write size=1534195 2024-09-12T17:42:02.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.380+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=JBXOW2L3QC20 type=del size=3608738 2024-09-12T17:42:02.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.381+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=Y1BWO54ZBWMT type=del 2024-09-12T17:42:02.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.383+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=IY3AR1FACIC7 type=write size=562260 2024-09-12T17:42:02.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.384+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=TTH4U6LG06B6 type=del 2024-09-12T17:42:02.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.385+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=3GEEH1M4ARL1 type=del size=843313 2024-09-12T17:42:02.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.386+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~HMAW35IGM3G0.0 size=702548 2024-09-12T17:42:02.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.388+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=HMAW35IGM3G0 tag=MHY96E5AKF17 type=write size=1751124 2024-09-12T17:42:02.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.390+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=CB8D93ZYQ99M type=del size=2457966 2024-09-12T17:42:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.390+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~4J1XYYRZQB5M.0 size=1048576 2024-09-12T17:42:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.391+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~4J1XYYRZQB5M.1 size=755015 2024-09-12T17:42:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.393+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=4J1XYYRZQB5M tag=EM6UN9VEB46R type=write size=2852167 2024-09-12T17:42:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.394+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=A2F448Z4OYV5 type=del size=1920183 2024-09-12T17:42:02.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.395+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~BYQDOAUHGWCF.0 size=1048576 2024-09-12T17:42:02.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.396+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~BYQDOAUHGWCF.1 size=331856 2024-09-12T17:42:02.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.398+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=BYQDOAUHGWCF tag=K1N66YGX0SR6 type=write size=2429008 2024-09-12T17:42:02.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.399+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=PL7HVZBEAUHF type=del size=1903230 2024-09-12T17:42:02.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.400+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=P867K1PRKMF3 type=del 2024-09-12T17:42:02.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.402+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~453EFFJM6CE3.0 size=147230 2024-09-12T17:42:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.402+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=453EFFJM6CE3 tag=SCC4E9JDK1VL type=write size=1195806 2024-09-12T17:42:02.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.403+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~X55D8D6C3RYT.0 size=1048576 2024-09-12T17:42:02.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.404+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~X55D8D6C3RYT.1 size=643567 2024-09-12T17:42:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.405+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=X55D8D6C3RYT tag=E0MMVOWS29UH type=write size=2740719 2024-09-12T17:42:02.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.406+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=65M1K3QDRYG0 type=del size=3269045 2024-09-12T17:42:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.408+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.0 size=1048576 2024-09-12T17:42:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.408+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.1 size=1048576 2024-09-12T17:42:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.409+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~YFH63A25ZE7G.2 size=57275 2024-09-12T17:42:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.411+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=YFH63A25ZE7G tag=O5BL5SBFS5RJ type=write size=3203003 2024-09-12T17:42:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.412+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=LDVPKMU2XBPR type=del size=1202118 2024-09-12T17:42:02.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.413+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=LVB325CYB193 type=del 2024-09-12T17:42:02.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.414+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=437JE3L3GEMC type=del size=502531 2024-09-12T17:42:02.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.416+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.0 size=1048576 2024-09-12T17:42:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.416+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.1 size=1048576 2024-09-12T17:42:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.417+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~MCLGCIWTKHZP.2 size=206184 2024-09-12T17:42:02.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.419+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=MCLGCIWTKHZP tag=GABYEI7DK1L0 type=write size=3351912 2024-09-12T17:42:02.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.420+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=KVHUP4NZ00G4 type=write size=902232 2024-09-12T17:42:02.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.422+0000 7f330fbcc780 1 < suggested remove operation key=5QBSRDY0LJ60 tag=X6PDZCQGRHSA type=del 2024-09-12T17:42:02.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.424+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~PEAD99BKLI2A.0 size=1048576 2024-09-12T17:42:02.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.425+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~PEAD99BKLI2A.1 size=126834 2024-09-12T17:42:02.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.425+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=PEAD99BKLI2A tag=GD6Q0IXFFLBT type=write size=2223986 2024-09-12T17:42:02.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.426+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=XS61I90O7IUL type=del 2024-09-12T17:42:02.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.427+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=KHPZQ85IL38L type=del size=4032956 2024-09-12T17:42:02.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.429+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~XGGKE6Q1QHY5.0 size=1048576 2024-09-12T17:42:02.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.430+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~XGGKE6Q1QHY5.1 size=576043 2024-09-12T17:42:02.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.432+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=XGGKE6Q1QHY5 tag=FQOADA7WVP4J type=write size=2673195 2024-09-12T17:42:02.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.433+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=19N6WX02DBIC type=del size=2249224 2024-09-12T17:42:02.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.435+0000 7f330fbcc780 1 < suggested remove operation key=50WR6KLF40W7 tag=DUZMOHDDIAJD type=del 2024-09-12T17:42:02.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.436+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=D2GQUBYEXV4Z type=del size=3959157 2024-09-12T17:42:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.439+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~Z12L0V7G6409.0 size=1048576 2024-09-12T17:42:02.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.440+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~Z12L0V7G6409.1 size=196690 2024-09-12T17:42:02.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.442+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=Z12L0V7G6409 tag=FP2RCD928ASA type=write size=2293842 2024-09-12T17:42:02.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.443+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=8ANGQTVHER9M type=write size=897616 2024-09-12T17:42:02.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.445+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=JBXOW2L3QC20 type=del 2024-09-12T17:42:02.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.446+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=HCNLSOD07OMQ type=del size=274052 2024-09-12T17:42:02.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.447+0000 7f330fbcc780 1 < canceled operation key=3IHGI1UMI1BA tag=IY3AR1FACIC7 type=write size=562260 2024-09-12T17:42:02.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.449+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=0VJQIK5PS14L type=del size=1744619 2024-09-12T17:42:02.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.451+0000 7f330fbcc780 1 < suggested remove operation key=6ZDBF249S1L6 tag=3GEEH1M4ARL1 type=del 2024-09-12T17:42:02.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.452+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=VTC5K60WQZIE type=del size=1997185 2024-09-12T17:42:02.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.455+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=CB8D93ZYQ99M type=del 2024-09-12T17:42:02.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.457+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~KEP7KXNTTJOY.0 size=59145 2024-09-12T17:42:02.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.457+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=KEP7KXNTTJOY tag=3RZ14AKOW7J8 type=write size=1107721 2024-09-12T17:42:02.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.458+0000 7f330fbcc780 1 < canceled operation key=30CIXFQV5VBI tag=A2F448Z4OYV5 type=del size=1920183 2024-09-12T17:42:02.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.460+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~K1XZAQ4MINMW.0 size=1048576 2024-09-12T17:42:02.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.461+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~K1XZAQ4MINMW.1 size=939568 2024-09-12T17:42:02.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.461+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=K1XZAQ4MINMW tag=CQOTBH54BKJS type=write size=3036720 2024-09-12T17:42:02.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.462+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=PL7HVZBEAUHF type=del 2024-09-12T17:42:02.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.464+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.0 size=1048576 2024-09-12T17:42:02.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.465+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.1 size=1048576 2024-09-12T17:42:02.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.466+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.2 size=125686 2024-09-12T17:42:02.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.466+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=MXGLIYOXVZYM tag=O2SF6V3RDF89 type=write size=3271414 2024-09-12T17:42:02.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.468+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~453EFFJM6CE3.0 size=147230 2024-09-12T17:42:02.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.470+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=453EFFJM6CE3 tag=SCC4E9JDK1VL type=write size=1195806 2024-09-12T17:42:02.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.471+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=VNC79HS9F0OD type=del size=1353372 2024-09-12T17:42:02.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.472+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=65M1K3QDRYG0 type=del 2024-09-12T17:42:02.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.474+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.0 size=1048576 2024-09-12T17:42:02.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.475+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.1 size=1048576 2024-09-12T17:42:02.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.476+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.2 size=390925 2024-09-12T17:42:02.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.476+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=IAPLK3YMUU0L tag=FNV536ZMGNZL type=write size=3536653 2024-09-12T17:42:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.477+0000 7f330fbcc780 1 < canceled operation key=6HBW7077B3MS tag=LDVPKMU2XBPR type=del size=1202118 2024-09-12T17:42:02.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.478+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=F2PO34LBEZM8 type=del size=1061333 2024-09-12T17:42:02.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.479+0000 7f330fbcc780 -1 < failed to complete operation key=50WR6KLF40W7 tag=437JE3L3GEMC type=del size=502531: (22) Invalid argument 2024-09-12T17:42:02.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.481+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.0 size=1048576 2024-09-12T17:42:02.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.482+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.1 size=1048576 2024-09-12T17:42:02.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.483+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.2 size=938014 2024-09-12T17:42:02.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.483+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=XYOS62XYPC24 tag=H330LVJB1UNV type=write size=4083742 2024-09-12T17:42:02.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.484+0000 7f330fbcc780 1 < canceled operation key=MQV01X5P8JLG tag=KVHUP4NZ00G4 type=write size=902232 2024-09-12T17:42:02.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.486+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=3865LFZL4C7U type=del size=308976 2024-09-12T17:42:02.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.487+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~PEAD99BKLI2A.0 size=1048576 2024-09-12T17:42:02.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.488+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~PEAD99BKLI2A.1 size=126834 2024-09-12T17:42:02.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.489+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=PEAD99BKLI2A tag=GD6Q0IXFFLBT type=write size=2223986 2024-09-12T17:42:02.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.491+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=1SNXF3X4H0E7 type=write size=306080 2024-09-12T17:42:02.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.492+0000 7f330fbcc780 1 < canceled operation key=HJL73WQD8SD2 tag=KHPZQ85IL38L type=del size=4032956 2024-09-12T17:42:02.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.493+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=6VX77ZA1Y63V type=write size=826296 2024-09-12T17:42:02.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.494+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=19N6WX02DBIC type=del 2024-09-12T17:42:02.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.496+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.0 size=1048576 2024-09-12T17:42:02.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.497+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.1 size=1048576 2024-09-12T17:42:02.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.498+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.2 size=685673 2024-09-12T17:42:02.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.498+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=YQJXVJRN4EHU tag=13ORF3DKZS72 type=write size=3831401 2024-09-12T17:42:02.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.499+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=D2GQUBYEXV4Z type=del 2024-09-12T17:42:02.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.500+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=TC3KGJJSL8W2 type=del size=109816 2024-09-12T17:42:02.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.502+0000 7f330fbcc780 1 < suggested update operation key=9X4FNKQWJCX4 tag=8ANGQTVHER9M type=write size=897616 2024-09-12T17:42:02.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.503+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=R00VF3DXR0EL type=del size=1319394 2024-09-12T17:42:02.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.504+0000 7f330fbcc780 -1 < failed to complete operation key=6ZDBF249S1L6 tag=HCNLSOD07OMQ type=del size=274052: (22) Invalid argument 2024-09-12T17:42:02.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.506+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~CEG77X3420MY.0 size=1048576 2024-09-12T17:42:02.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.507+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~CEG77X3420MY.1 size=432362 2024-09-12T17:42:02.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.507+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=CEG77X3420MY tag=JQ0P7IYTYNJE type=write size=2529514 2024-09-12T17:42:02.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.509+0000 7f330fbcc780 1 < suggested remove operation key=3IHGI1UMI1BA tag=0VJQIK5PS14L type=del 2024-09-12T17:42:02.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.511+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.0 size=1048576 2024-09-12T17:42:02.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.512+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.1 size=1048576 2024-09-12T17:42:02.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.513+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.2 size=12785 2024-09-12T17:42:02.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.513+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=QGY4EU518U3I tag=07U1JBXD8IVO type=write size=3158513 2024-09-12T17:42:02.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.514+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=VTC5K60WQZIE type=del 2024-09-12T17:42:02.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.515+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=TJO37Q52VFCE type=del size=2808444 2024-09-12T17:42:02.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.516+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~KEP7KXNTTJOY.0 size=59145 2024-09-12T17:42:02.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.518+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=KEP7KXNTTJOY tag=3RZ14AKOW7J8 type=write size=1107721 2024-09-12T17:42:02.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.520+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~MCEI0CCU06LK.0 size=1048576 2024-09-12T17:42:02.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.521+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~MCEI0CCU06LK.1 size=75104 2024-09-12T17:42:02.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.521+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=MCEI0CCU06LK tag=BE5MYQGA7KAJ type=write size=2172256 2024-09-12T17:42:02.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.522+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~K1XZAQ4MINMW.0 size=1048576 2024-09-12T17:42:02.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.523+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~K1XZAQ4MINMW.1 size=939568 2024-09-12T17:42:02.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.525+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=K1XZAQ4MINMW tag=CQOTBH54BKJS type=write size=3036720 2024-09-12T17:42:02.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.526+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=825XWGW4WV6S type=write size=628657 2024-09-12T17:42:02.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.528+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.0 size=1048576 2024-09-12T17:42:02.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.528+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.1 size=1048576 2024-09-12T17:42:02.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.528+0000 7f330fbcc780 1 < canceled part key=_multipart_7TBNLJDCL4YB.2~MXGLIYOXVZYM.2 size=125686 2024-09-12T17:42:02.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.530+0000 7f330fbcc780 1 < canceled multipart upload key=7TBNLJDCL4YB upload=MXGLIYOXVZYM tag=O2SF6V3RDF89 type=write size=3271414 2024-09-12T17:42:02.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.532+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~8IYZ40FEOGWS.0 size=727562 2024-09-12T17:42:02.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.532+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=8IYZ40FEOGWS tag=JI1RKV4XIMDF type=write size=1776138 2024-09-12T17:42:02.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.535+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=VNC79HS9F0OD type=del 2024-09-12T17:42:02.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.537+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~CDVWH4U8AD3J.0 size=1048576 2024-09-12T17:42:02.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.538+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~CDVWH4U8AD3J.1 size=573331 2024-09-12T17:42:02.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.538+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=CDVWH4U8AD3J tag=406XXBHDTKQT type=write size=2670483 2024-09-12T17:42:02.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.539+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.0 size=1048576 2024-09-12T17:42:02.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.540+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.1 size=1048576 2024-09-12T17:42:02.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.540+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~IAPLK3YMUU0L.2 size=390925 2024-09-12T17:42:02.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.542+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=IAPLK3YMUU0L tag=FNV536ZMGNZL type=write size=3536653 2024-09-12T17:42:02.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.543+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=AB7BO1ENLAWB type=write size=594997 2024-09-12T17:42:02.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.546+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=F2PO34LBEZM8 type=del 2024-09-12T17:42:02.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.547+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=IGGNMV3L6JX5 type=del size=603349 2024-09-12T17:42:02.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.548+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.0 size=1048576 2024-09-12T17:42:02.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.549+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.1 size=1048576 2024-09-12T17:42:02.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.550+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~XYOS62XYPC24.2 size=938014 2024-09-12T17:42:02.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.551+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=XYOS62XYPC24 tag=H330LVJB1UNV type=write size=4083742 2024-09-12T17:42:02.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.553+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~BR5LD1KQ1SC5.0 size=1048576 2024-09-12T17:42:02.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.554+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~BR5LD1KQ1SC5.1 size=446656 2024-09-12T17:42:02.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.554+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=BR5LD1KQ1SC5 tag=VOJV45TPZRWU type=write size=2543808 2024-09-12T17:42:02.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.555+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=3865LFZL4C7U type=del 2024-09-12T17:42:02.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.556+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=IO5PCLOY87DY type=del size=3068034 2024-09-12T17:42:02.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.557+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=1SNXF3X4H0E7 type=write size=306080 2024-09-12T17:42:02.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.559+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~XUFSUMKWKLR4.0 size=1048576 2024-09-12T17:42:02.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.560+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~XUFSUMKWKLR4.1 size=586818 2024-09-12T17:42:02.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.560+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=XUFSUMKWKLR4 tag=GNEBZQQ3VYYA type=write size=2683970 2024-09-12T17:42:02.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.561+0000 7f330fbcc780 1 < completed write operation key=MQV01X5P8JLG tag=6VX77ZA1Y63V type=write size=826296 2024-09-12T17:42:02.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.562+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=0ZN9UL23KX51 type=del size=3157968 2024-09-12T17:42:02.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.564+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.0 size=1048576 2024-09-12T17:42:02.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.564+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.1 size=1048576 2024-09-12T17:42:02.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.564+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~YQJXVJRN4EHU.2 size=685673 2024-09-12T17:42:02.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.566+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=YQJXVJRN4EHU tag=13ORF3DKZS72 type=write size=3831401 2024-09-12T17:42:02.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.568+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LBEOCIXEV3Y9.0 size=1048576 2024-09-12T17:42:02.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.569+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~LBEOCIXEV3Y9.1 size=918633 2024-09-12T17:42:02.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.569+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=LBEOCIXEV3Y9 tag=TQHJKH8RXSXT type=write size=3015785 2024-09-12T17:42:02.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.570+0000 7f330fbcc780 -1 < failed to complete operation key=3IHGI1UMI1BA tag=TC3KGJJSL8W2 type=del size=109816: (22) Invalid argument 2024-09-12T17:42:02.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.571+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=VL6XWLRQ5XRS type=del size=1798810 2024-09-12T17:42:02.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.572+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=R00VF3DXR0EL type=del 2024-09-12T17:42:02.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.574+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=7OZ00CNOCTPF type=del size=3420614 2024-09-12T17:42:02.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.575+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~CEG77X3420MY.0 size=1048576 2024-09-12T17:42:02.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.576+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~CEG77X3420MY.1 size=432362 2024-09-12T17:42:02.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.577+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=CEG77X3420MY tag=JQ0P7IYTYNJE type=write size=2529514 2024-09-12T17:42:02.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.579+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~1V2UP7H94PGE.0 size=30216 2024-09-12T17:42:02.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.579+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=1V2UP7H94PGE tag=09NIUWMV2KMM type=write size=1078792 2024-09-12T17:42:02.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.580+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.0 size=1048576 2024-09-12T17:42:02.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.581+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.1 size=1048576 2024-09-12T17:42:02.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.582+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~QGY4EU518U3I.2 size=12785 2024-09-12T17:42:02.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.584+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=QGY4EU518U3I tag=07U1JBXD8IVO type=write size=3158513 2024-09-12T17:42:02.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.587+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~JP40Z35EGZ25.0 size=379531 2024-09-12T17:42:02.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.587+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=JP40Z35EGZ25 tag=V4Y1PWZ9CDJR type=write size=1428107 2024-09-12T17:42:02.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.588+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=TJO37Q52VFCE type=del 2024-09-12T17:42:02.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.589+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=4HJ3MFPVOPOG type=write size=675025 2024-09-12T17:42:02.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.590+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~MCEI0CCU06LK.0 size=1048576 2024-09-12T17:42:02.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.591+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~MCEI0CCU06LK.1 size=75104 2024-09-12T17:42:02.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.593+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=MCEI0CCU06LK tag=BE5MYQGA7KAJ type=write size=2172256 2024-09-12T17:42:02.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.595+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~8MZQX1G30K5T.0 size=1048576 2024-09-12T17:42:02.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.596+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~8MZQX1G30K5T.1 size=207371 2024-09-12T17:42:02.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.596+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=8MZQX1G30K5T tag=Q1RJNLGAVNU5 type=write size=2304523 2024-09-12T17:42:02.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.597+0000 7f330fbcc780 1 < completed write operation key=AL3ESPG15NO4 tag=825XWGW4WV6S type=write size=628657 2024-09-12T17:42:02.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.598+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=21PF95E9MFA3 type=del size=3254756 2024-09-12T17:42:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.600+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~8IYZ40FEOGWS.0 size=727562 2024-09-12T17:42:02.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.602+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=8IYZ40FEOGWS tag=JI1RKV4XIMDF type=write size=1776138 2024-09-12T17:42:02.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.604+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~OWR06CUM7WKU.0 size=309149 2024-09-12T17:42:02.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.604+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=OWR06CUM7WKU tag=HD3B0A9XU192 type=write size=1357725 2024-09-12T17:42:02.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.605+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~CDVWH4U8AD3J.0 size=1048576 2024-09-12T17:42:02.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.606+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~CDVWH4U8AD3J.1 size=573331 2024-09-12T17:42:02.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.607+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=CDVWH4U8AD3J tag=406XXBHDTKQT type=write size=2670483 2024-09-12T17:42:02.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.609+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=LZ2LL41LY4CH type=write size=32190 2024-09-12T17:42:02.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.610+0000 7f330fbcc780 1 < completed write operation key=IEYJS7X97O1A tag=AB7BO1ENLAWB type=write size=594997 2024-09-12T17:42:02.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.611+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=IG5BNTIPGFN0 type=write size=431634 2024-09-12T17:42:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.613+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=IGGNMV3L6JX5 type=del 2024-09-12T17:42:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.614+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=1OXSM53NA2D9 type=del size=1555088 2024-09-12T17:42:02.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.616+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~BR5LD1KQ1SC5.0 size=1048576 2024-09-12T17:42:02.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.617+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~BR5LD1KQ1SC5.1 size=446656 2024-09-12T17:42:02.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.619+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=BR5LD1KQ1SC5 tag=VOJV45TPZRWU type=write size=2543808 2024-09-12T17:42:02.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.620+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=Y039YUQT2YPD type=del size=1329136 2024-09-12T17:42:02.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.622+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=IO5PCLOY87DY type=del 2024-09-12T17:42:02.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.624+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.0 size=1048576 2024-09-12T17:42:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.625+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.1 size=1048576 2024-09-12T17:42:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.626+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.2 size=537303 2024-09-12T17:42:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.626+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=Y5U3VJ1384BZ tag=XHTZ82X4H36L type=write size=3683031 2024-09-12T17:42:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.627+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~XUFSUMKWKLR4.0 size=1048576 2024-09-12T17:42:02.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.628+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~XUFSUMKWKLR4.1 size=586818 2024-09-12T17:42:02.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.630+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=XUFSUMKWKLR4 tag=GNEBZQQ3VYYA type=write size=2683970 2024-09-12T17:42:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.631+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=I0J8GOKQ14IO type=del size=4085146 2024-09-12T17:42:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.633+0000 7f330fbcc780 1 < completed delete operation key=AL3ESPG15NO4 tag=0ZN9UL23KX51 type=del 2024-09-12T17:42:02.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.635+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~G15GYU058BGT.0 size=668812 2024-09-12T17:42:02.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.635+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=G15GYU058BGT tag=13XYONB7PAND type=write size=1717388 2024-09-12T17:42:02.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.636+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LBEOCIXEV3Y9.0 size=1048576 2024-09-12T17:42:02.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.637+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~LBEOCIXEV3Y9.1 size=918633 2024-09-12T17:42:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.639+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=LBEOCIXEV3Y9 tag=TQHJKH8RXSXT type=write size=3015785 2024-09-12T17:42:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.640+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=DL8CMYY7EISJ type=del size=2185654 2024-09-12T17:42:02.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.641+0000 7f330fbcc780 1 < canceled operation key=LF4NGY13WYHK tag=VL6XWLRQ5XRS type=del size=1798810 2024-09-12T17:42:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.643+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=YC2K2OPIKLK0 type=del size=1880124 2024-09-12T17:42:02.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.645+0000 7f330fbcc780 1 < suggested update operation key=8UX8W3FAJ3D9 tag=7OZ00CNOCTPF type=del size=3420614 2024-09-12T17:42:02.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.646+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=0E7PVXICHN87 type=del size=4087258 2024-09-12T17:42:02.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.646+0000 7f330fbcc780 1 < canceled part key=_multipart_6ZDBF249S1L6.2~1V2UP7H94PGE.0 size=30216 2024-09-12T17:42:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.648+0000 7f330fbcc780 1 < canceled multipart upload key=6ZDBF249S1L6 upload=1V2UP7H94PGE tag=09NIUWMV2KMM type=write size=1078792 2024-09-12T17:42:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.649+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=T2THEXVK9F0X type=del size=2046777 2024-09-12T17:42:02.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.650+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~JP40Z35EGZ25.0 size=379531 2024-09-12T17:42:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.653+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=JP40Z35EGZ25 tag=V4Y1PWZ9CDJR type=write size=1428107 2024-09-12T17:42:02.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.654+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=LBVJXQU8MAZK type=del size=902611 2024-09-12T17:42:02.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.655+0000 7f330fbcc780 1 < completed write operation key=SPKBX4WU9A9R tag=4HJ3MFPVOPOG type=write size=675025 2024-09-12T17:42:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.656+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=JUQT6G9AF52V type=write size=287014 2024-09-12T17:42:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.658+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~8MZQX1G30K5T.0 size=1048576 2024-09-12T17:42:02.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.658+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~8MZQX1G30K5T.1 size=207371 2024-09-12T17:42:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.660+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=8MZQX1G30K5T tag=Q1RJNLGAVNU5 type=write size=2304523 2024-09-12T17:42:02.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.662+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=KDEE1L8QUXME type=del size=2549328 2024-09-12T17:42:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.663+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=21PF95E9MFA3 type=del 2024-09-12T17:42:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.665+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~MJY7WVCSVPX2.0 size=1048576 2024-09-12T17:42:02.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.666+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~MJY7WVCSVPX2.1 size=15458 2024-09-12T17:42:02.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.666+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=MJY7WVCSVPX2 tag=3GTWV5Y5HA6Y type=write size=2112610 2024-09-12T17:42:02.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.667+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~OWR06CUM7WKU.0 size=309149 2024-09-12T17:42:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.669+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=OWR06CUM7WKU tag=HD3B0A9XU192 type=write size=1357725 2024-09-12T17:42:02.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.670+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=B6TVCRGANR46 type=write size=887193 2024-09-12T17:42:02.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.672+0000 7f330fbcc780 1 < suggested update operation key=XIW3OJB1STT9 tag=LZ2LL41LY4CH type=write size=32190 2024-09-12T17:42:02.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.674+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=GH494X7AXDWF type=write size=867471 2024-09-12T17:42:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.676+0000 7f330fbcc780 1 < suggested remove operation key=5QBSRDY0LJ60 tag=IG5BNTIPGFN0 type=write 2024-09-12T17:42:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.678+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~9H0XGCCGMVCZ.0 size=735493 2024-09-12T17:42:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.678+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=9H0XGCCGMVCZ tag=VGXV50ZSU5S7 type=write size=1784069 2024-09-12T17:42:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.679+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=1OXSM53NA2D9 type=del 2024-09-12T17:42:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.680+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=NLHGD8VKCQSV type=del size=1873185 2024-09-12T17:42:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.681+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=Y039YUQT2YPD type=del 2024-09-12T17:42:02.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.683+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=L774JGZPYS1R type=del size=206567 2024-09-12T17:42:02.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.684+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.0 size=1048576 2024-09-12T17:42:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.685+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.1 size=1048576 2024-09-12T17:42:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.686+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~Y5U3VJ1384BZ.2 size=537303 2024-09-12T17:42:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.687+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=Y5U3VJ1384BZ tag=XHTZ82X4H36L type=write size=3683031 2024-09-12T17:42:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.689+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~ET2MYNDZC1VN.0 size=724137 2024-09-12T17:42:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.689+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=ET2MYNDZC1VN tag=20O06R8I0PNX type=write size=1772713 2024-09-12T17:42:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.691+0000 7f330fbcc780 -1 < failed to complete operation key=5QBSRDY0LJ60 tag=I0J8GOKQ14IO type=del size=4085146: (22) Invalid argument 2024-09-12T17:42:02.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.692+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=FTLSBGMBQ8FG type=del size=2375453 2024-09-12T17:42:02.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.692+0000 7f330fbcc780 1 < canceled part key=_multipart_6HBW7077B3MS.2~G15GYU058BGT.0 size=668812 2024-09-12T17:42:02.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.694+0000 7f330fbcc780 1 < canceled multipart upload key=6HBW7077B3MS upload=G15GYU058BGT tag=13XYONB7PAND type=write size=1717388 2024-09-12T17:42:02.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.695+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=TGIXDMAYYR0U type=write size=427112 2024-09-12T17:42:02.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.697+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=DL8CMYY7EISJ type=del size=2185654 2024-09-12T17:42:02.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.698+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=7KLMGP7G8YIG type=del size=3468448 2024-09-12T17:42:02.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.700+0000 7f330fbcc780 1 < suggested remove operation key=LF4NGY13WYHK tag=YC2K2OPIKLK0 type=del 2024-09-12T17:42:02.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.702+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.0 size=1048576 2024-09-12T17:42:02.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.703+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.1 size=1048576 2024-09-12T17:42:02.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.704+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.2 size=462608 2024-09-12T17:42:02.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.704+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=5J0R5D5TW7IU tag=S68YVURKOLT2 type=write size=3608336 2024-09-12T17:42:02.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.705+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=0E7PVXICHN87 type=del 2024-09-12T17:42:02.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.706+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=YDZDESGB33FL type=del size=3530690 2024-09-12T17:42:02.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.709+0000 7f330fbcc780 1 < suggested update operation key=SPKBX4WU9A9R tag=T2THEXVK9F0X type=del size=2046777 2024-09-12T17:42:02.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.710+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~FXT3VTJ2293Q.0 size=973599 2024-09-12T17:42:02.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.710+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=FXT3VTJ2293Q tag=5340OAC8QLDJ type=write size=2022175 2024-09-12T17:42:02.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.713+0000 7f330fbcc780 1 < suggested remove operation key=9X4FNKQWJCX4 tag=LBVJXQU8MAZK type=del 2024-09-12T17:42:02.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.714+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=BQM1VKNF9NHN type=del size=207974 2024-09-12T17:42:02.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.715+0000 7f330fbcc780 1 < completed write operation key=3BU8T85GXCX4 tag=JUQT6G9AF52V type=write size=287014 2024-09-12T17:42:02.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.716+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=WP4HMPH3USBU type=del size=1017642 2024-09-12T17:42:02.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.717+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=KDEE1L8QUXME type=del 2024-09-12T17:42:02.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.718+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=Q3UYUETU9260 type=del size=3755039 2024-09-12T17:42:02.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.719+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~MJY7WVCSVPX2.0 size=1048576 2024-09-12T17:42:02.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.719+0000 7f330fbcc780 1 < canceled part key=_multipart_4KNGMX117Z7G.2~MJY7WVCSVPX2.1 size=15458 2024-09-12T17:42:02.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.721+0000 7f330fbcc780 1 < canceled multipart upload key=4KNGMX117Z7G upload=MJY7WVCSVPX2 tag=3GTWV5Y5HA6Y type=write size=2112610 2024-09-12T17:42:02.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.723+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.0 size=1048576 2024-09-12T17:42:02.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.724+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.1 size=1048576 2024-09-12T17:42:02.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.725+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.2 size=223971 2024-09-12T17:42:02.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.725+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=4QBZENSJNGGU tag=IZZX50XMGPUU type=write size=3369699 2024-09-12T17:42:02.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.726+0000 7f330fbcc780 1 < completed write operation key=3IHGI1UMI1BA tag=B6TVCRGANR46 type=write size=887193 2024-09-12T17:42:02.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.728+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~EM7LN3VZ14JC.0 size=1048576 2024-09-12T17:42:02.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.729+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~EM7LN3VZ14JC.1 size=540582 2024-09-12T17:42:02.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.729+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=EM7LN3VZ14JC tag=GYOSTPUUC0G3 type=write size=2637734 2024-09-12T17:42:02.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.730+0000 7f330fbcc780 1 < canceled operation key=70COM4KLK2R1 tag=GH494X7AXDWF type=write size=867471 2024-09-12T17:42:02.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.731+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=EP5S1OQQQ92X type=del size=1217795 2024-09-12T17:42:02.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.732+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~9H0XGCCGMVCZ.0 size=735493 2024-09-12T17:42:02.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.734+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=9H0XGCCGMVCZ tag=VGXV50ZSU5S7 type=write size=1784069 2024-09-12T17:42:02.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.736+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~OH2Z450Q8IQJ.0 size=1048576 2024-09-12T17:42:02.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.737+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~OH2Z450Q8IQJ.1 size=383131 2024-09-12T17:42:02.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.737+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=OH2Z450Q8IQJ tag=E4CK263B71FA type=write size=2480283 2024-09-12T17:42:02.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.738+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=NLHGD8VKCQSV type=del 2024-09-12T17:42:02.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.739+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=2CUHI3Z17WVT type=del size=3032738 2024-09-12T17:42:02.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.741+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=L774JGZPYS1R type=del 2024-09-12T17:42:02.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.742+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=C8MYQAWAXIYZ type=del size=575172 2024-09-12T17:42:02.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.743+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~ET2MYNDZC1VN.0 size=724137 2024-09-12T17:42:02.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.745+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=ET2MYNDZC1VN tag=20O06R8I0PNX type=write size=1772713 2024-09-12T17:42:02.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.746+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=M052CBI8AVKY type=del size=999444 2024-09-12T17:42:02.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.747+0000 7f330fbcc780 1 < canceled operation key=70COM4KLK2R1 tag=FTLSBGMBQ8FG type=del size=2375453 2024-09-12T17:42:02.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.748+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=WC5KE1L0ARJO type=del size=1039713 2024-09-12T17:42:02.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.750+0000 7f330fbcc780 1 < canceled operation key=AL3ESPG15NO4 tag=TGIXDMAYYR0U type=write size=427112 2024-09-12T17:42:02.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.752+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.0 size=1048576 2024-09-12T17:42:02.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.753+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.1 size=1048576 2024-09-12T17:42:02.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.753+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.2 size=419945 2024-09-12T17:42:02.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.753+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=MAHCCE1MGEB8 tag=3ME5ZF71J1YF type=write size=3565673 2024-09-12T17:42:02.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.756+0000 7f330fbcc780 1 < suggested update operation key=AGM33OK1W7A6 tag=7KLMGP7G8YIG type=del size=3468448 2024-09-12T17:42:02.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.757+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=ZA4IRLWEC4C5 type=del size=1466092 2024-09-12T17:42:02.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.759+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.0 size=1048576 2024-09-12T17:42:02.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.760+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.1 size=1048576 2024-09-12T17:42:02.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.760+0000 7f330fbcc780 1 < canceled part key=_multipart_30CIXFQV5VBI.2~5J0R5D5TW7IU.2 size=462608 2024-09-12T17:42:02.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.762+0000 7f330fbcc780 1 < canceled multipart upload key=30CIXFQV5VBI upload=5J0R5D5TW7IU tag=S68YVURKOLT2 type=write size=3608336 2024-09-12T17:42:02.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.764+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~DJW1JJDE6D5B.0 size=217127 2024-09-12T17:42:02.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.764+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=DJW1JJDE6D5B tag=H96RV8T142T2 type=write size=1265703 2024-09-12T17:42:02.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.765+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=YDZDESGB33FL type=del 2024-09-12T17:42:02.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.766+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=Q4976VQR9CXS type=del size=2763362 2024-09-12T17:42:02.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.767+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~FXT3VTJ2293Q.0 size=973599 2024-09-12T17:42:02.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.769+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=FXT3VTJ2293Q tag=5340OAC8QLDJ type=write size=2022175 2024-09-12T17:42:02.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.771+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~YGBXNKQ1QX81.0 size=1048576 2024-09-12T17:42:02.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.772+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~YGBXNKQ1QX81.1 size=966881 2024-09-12T17:42:02.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.772+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=YGBXNKQ1QX81 tag=5FGAF1Z0X6AD type=write size=3064033 2024-09-12T17:42:02.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.773+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=BQM1VKNF9NHN type=del 2024-09-12T17:42:02.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.774+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=IMSXULVIS56R type=del size=2434916 2024-09-12T17:42:02.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.775+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=WP4HMPH3USBU type=del 2024-09-12T17:42:02.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.777+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=PN5RJMW6K730 type=del size=1010057 2024-09-12T17:42:02.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.778+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=Q3UYUETU9260 type=del 2024-09-12T17:42:02.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.780+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~DWOKITEX9SGE.0 size=1048576 2024-09-12T17:42:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.781+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~DWOKITEX9SGE.1 size=925922 2024-09-12T17:42:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.781+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=DWOKITEX9SGE tag=K6JKNZOJSZP1 type=write size=3023074 2024-09-12T17:42:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.781+0000 7f330fbcc780 1 < canceled part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.0 size=1048576 2024-09-12T17:42:02.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.782+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.1 size=1048576 2024-09-12T17:42:02.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.783+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~4QBZENSJNGGU.2 size=223971 2024-09-12T17:42:02.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.785+0000 7f330fbcc780 1 < canceled multipart upload key=6HBW7077B3MS upload=4QBZENSJNGGU tag=IZZX50XMGPUU type=write size=3369699 2024-09-12T17:42:02.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.786+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=3IZ757HWQZYF type=del size=3111387 2024-09-12T17:42:02.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.787+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~EM7LN3VZ14JC.0 size=1048576 2024-09-12T17:42:02.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.788+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~EM7LN3VZ14JC.1 size=540582 2024-09-12T17:42:02.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.790+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=EM7LN3VZ14JC tag=GYOSTPUUC0G3 type=write size=2637734 2024-09-12T17:42:02.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.791+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=2UM1EFU28NA7 type=del size=2781195 2024-09-12T17:42:02.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.792+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=EP5S1OQQQ92X type=del 2024-09-12T17:42:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.794+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=IM27QGH1SAB3 type=del size=304217 2024-09-12T17:42:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.795+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~OH2Z450Q8IQJ.0 size=1048576 2024-09-12T17:42:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.796+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~OH2Z450Q8IQJ.1 size=383131 2024-09-12T17:42:02.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.797+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=OH2Z450Q8IQJ tag=E4CK263B71FA type=write size=2480283 2024-09-12T17:42:02.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.799+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~DH5SE2P2K1NI.0 size=1048576 2024-09-12T17:42:02.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.800+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~DH5SE2P2K1NI.1 size=809339 2024-09-12T17:42:02.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.800+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=DH5SE2P2K1NI tag=JUZSY16J0LFP type=write size=2906491 2024-09-12T17:42:02.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.802+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=2CUHI3Z17WVT type=del 2024-09-12T17:42:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.803+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=HNV7T3G4UC0X type=write size=565975 2024-09-12T17:42:02.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.804+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=C8MYQAWAXIYZ type=del 2024-09-12T17:42:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.806+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~TL2LDER84S9C.0 size=1048576 2024-09-12T17:42:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.807+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~TL2LDER84S9C.1 size=437137 2024-09-12T17:42:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.807+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=TL2LDER84S9C tag=B2XNZV8NTNDA type=write size=2534289 2024-09-12T17:42:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.809+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=M052CBI8AVKY type=del 2024-09-12T17:42:02.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.811+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.0 size=1048576 2024-09-12T17:42:02.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.812+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.1 size=1048576 2024-09-12T17:42:02.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.813+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.2 size=139050 2024-09-12T17:42:02.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.813+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=XPI37ZY0WYI8 tag=1MO9JL5SO194 type=write size=3284778 2024-09-12T17:42:02.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.814+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=WC5KE1L0ARJO type=del 2024-09-12T17:42:02.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.815+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=XJJF3LZN9454 type=write size=210691 2024-09-12T17:42:02.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.816+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.0 size=1048576 2024-09-12T17:42:02.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.817+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.1 size=1048576 2024-09-12T17:42:02.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.818+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~MAHCCE1MGEB8.2 size=419945 2024-09-12T17:42:02.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.820+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=MAHCCE1MGEB8 tag=3ME5ZF71J1YF type=write size=3565673 2024-09-12T17:42:02.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.822+0000 7f330fbcc780 1 > prepared part key=_multipart_6MFVO30OX5W1.2~PX3P52Z890VS.0 size=972694 2024-09-12T17:42:02.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.822+0000 7f330fbcc780 1 > prepared multipart upload key=6MFVO30OX5W1 upload=PX3P52Z890VS tag=3RGMXG1Y93B5 type=write size=2021270 2024-09-12T17:42:02.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.823+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=ZA4IRLWEC4C5 type=del 2024-09-12T17:42:02.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.825+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.0 size=1048576 2024-09-12T17:42:02.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.825+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.1 size=1048576 2024-09-12T17:42:02.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.826+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.2 size=125401 2024-09-12T17:42:02.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.826+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=AHMEFUSGPRFB tag=1FSBCG8YJVNK type=write size=3271129 2024-09-12T17:42:02.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.827+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~DJW1JJDE6D5B.0 size=217127 2024-09-12T17:42:02.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.829+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=DJW1JJDE6D5B tag=H96RV8T142T2 type=write size=1265703 2024-09-12T17:42:02.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.830+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=9A83YQKOZUA3 type=del size=1634669 2024-09-12T17:42:02.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.831+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=Q4976VQR9CXS type=del 2024-09-12T17:42:02.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.833+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.0 size=1048576 2024-09-12T17:42:02.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.834+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.1 size=1048576 2024-09-12T17:42:02.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.835+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.2 size=528990 2024-09-12T17:42:02.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.835+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=VRA4G0RFNCYM tag=K0DLN773IMU1 type=write size=3674718 2024-09-12T17:42:02.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.836+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~YGBXNKQ1QX81.0 size=1048576 2024-09-12T17:42:02.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.837+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~YGBXNKQ1QX81.1 size=966881 2024-09-12T17:42:02.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.839+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=YGBXNKQ1QX81 tag=5FGAF1Z0X6AD type=write size=3064033 2024-09-12T17:42:02.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.840+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=61D1Y255PX3H type=del size=1213703 2024-09-12T17:42:02.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.841+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=IMSXULVIS56R type=del 2024-09-12T17:42:02.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.842+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=F552YMB5LGVU type=del size=3221284 2024-09-12T17:42:02.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.843+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=PN5RJMW6K730 type=del 2024-09-12T17:42:02.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.844+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=5DNQHV24HKFQ type=del size=1100378 2024-09-12T17:42:02.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.845+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~DWOKITEX9SGE.0 size=1048576 2024-09-12T17:42:02.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.846+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~DWOKITEX9SGE.1 size=925922 2024-09-12T17:42:02.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.848+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=DWOKITEX9SGE tag=K6JKNZOJSZP1 type=write size=3023074 2024-09-12T17:42:02.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.849+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=LLDI8DG8M9MK type=del size=1868359 2024-09-12T17:42:02.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.850+0000 7f330fbcc780 1 < canceled operation key=30CIXFQV5VBI tag=3IZ757HWQZYF type=del size=3111387 2024-09-12T17:42:02.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.852+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.0 size=1048576 2024-09-12T17:42:02.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.853+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.1 size=1048576 2024-09-12T17:42:02.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.854+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.2 size=534200 2024-09-12T17:42:02.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.854+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=9UJT4PLCSOS9 tag=OKJM3J81U5HA type=write size=3679928 2024-09-12T17:42:02.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.855+0000 7f330fbcc780 1 < canceled operation key=7TBNLJDCL4YB tag=2UM1EFU28NA7 type=del size=2781195 2024-09-12T17:42:02.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.856+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=W396VXTKPH8O type=del size=2785625 2024-09-12T17:42:02.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.857+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=IM27QGH1SAB3 type=del 2024-09-12T17:42:02.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.858+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=4EEN2HWF3WO3 type=del size=3164113 2024-09-12T17:42:02.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.860+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~DH5SE2P2K1NI.0 size=1048576 2024-09-12T17:42:02.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.860+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~DH5SE2P2K1NI.1 size=809339 2024-09-12T17:42:02.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.864+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=DH5SE2P2K1NI tag=JUZSY16J0LFP type=write size=2906491 2024-09-12T17:42:02.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.866+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~XJ8UEUZAASBN.0 size=1048576 2024-09-12T17:42:02.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.866+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~XJ8UEUZAASBN.1 size=828778 2024-09-12T17:42:02.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.866+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=XJ8UEUZAASBN tag=W89MMBI36M6S type=write size=2925930 2024-09-12T17:42:02.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.868+0000 7f330fbcc780 1 < completed write operation key=LF4NGY13WYHK tag=HNV7T3G4UC0X type=write size=565975 2024-09-12T17:42:02.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.869+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=XYW7ULQSG9YQ type=del size=3859368 2024-09-12T17:42:02.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.870+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~TL2LDER84S9C.0 size=1048576 2024-09-12T17:42:02.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.871+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~TL2LDER84S9C.1 size=437137 2024-09-12T17:42:02.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.873+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=TL2LDER84S9C tag=B2XNZV8NTNDA type=write size=2534289 2024-09-12T17:42:02.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.874+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.0 size=1048576 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.875+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.1 size=1048576 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.876+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.2 size=100876 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.876+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=BH5Y59PFN6BP tag=9CY9I2CRRQP2 type=write size=3246604 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.876+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.0 size=1048576 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.877+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.1 size=1048576 2024-09-12T17:42:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.877+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~XPI37ZY0WYI8.2 size=139050 2024-09-12T17:42:02.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.879+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=XPI37ZY0WYI8 tag=1MO9JL5SO194 type=write size=3284778 2024-09-12T17:42:02.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.880+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=BGS3K4CU7E0U type=del size=2967203 2024-09-12T17:42:02.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.881+0000 7f330fbcc780 1 < completed write operation key=IEL4VF8ROC72 tag=XJJF3LZN9454 type=write size=210691 2024-09-12T17:42:02.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.883+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.0 size=1048576 2024-09-12T17:42:02.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.884+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.1 size=1048576 2024-09-12T17:42:02.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.885+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.2 size=613395 2024-09-12T17:42:02.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.885+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=VBOHZKKN67V7 tag=P2TUBBEICKQ3 type=write size=3759123 2024-09-12T17:42:02.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.886+0000 7f330fbcc780 1 < completed part key=_multipart_6MFVO30OX5W1.2~PX3P52Z890VS.0 size=972694 2024-09-12T17:42:02.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.888+0000 7f330fbcc780 1 < completed multipart upload key=6MFVO30OX5W1 upload=PX3P52Z890VS tag=3RGMXG1Y93B5 type=write size=2021270 2024-09-12T17:42:02.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.889+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=BX6L0QZFH7PP type=del size=1457940 2024-09-12T17:42:02.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.890+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.0 size=1048576 2024-09-12T17:42:02.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.891+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.1 size=1048576 2024-09-12T17:42:02.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.892+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~AHMEFUSGPRFB.2 size=125401 2024-09-12T17:42:02.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.894+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=AHMEFUSGPRFB tag=1FSBCG8YJVNK type=write size=3271129 2024-09-12T17:42:02.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.895+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=OSGFYQ11SH1T type=del size=3007873 2024-09-12T17:42:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.897+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=9A83YQKOZUA3 type=del 2024-09-12T17:42:02.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.899+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~NZKJFEG829CA.0 size=1048576 2024-09-12T17:42:02.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.899+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~NZKJFEG829CA.1 size=954057 2024-09-12T17:42:02.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.899+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=NZKJFEG829CA tag=D22VTK609M6Q type=write size=3051209 2024-09-12T17:42:02.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.901+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.0 size=1048576 2024-09-12T17:42:02.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.902+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.1 size=1048576 2024-09-12T17:42:02.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.903+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~VRA4G0RFNCYM.2 size=528990 2024-09-12T17:42:02.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.904+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=VRA4G0RFNCYM tag=K0DLN773IMU1 type=write size=3674718 2024-09-12T17:42:02.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.906+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.0 size=1048576 2024-09-12T17:42:02.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.907+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.1 size=1048576 2024-09-12T17:42:02.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.908+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.2 size=224594 2024-09-12T17:42:02.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.908+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=XV27POV9I6XE tag=PZJ9ZO186GLP type=write size=3370322 2024-09-12T17:42:02.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.909+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=61D1Y255PX3H type=del 2024-09-12T17:42:02.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.912+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~NDS1CX94AFRL.0 size=1048576 2024-09-12T17:42:02.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.912+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~NDS1CX94AFRL.1 size=730297 2024-09-12T17:42:02.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.912+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=NDS1CX94AFRL tag=2EWDUYPTAXDX type=write size=2827449 2024-09-12T17:42:02.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.914+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=F552YMB5LGVU type=del 2024-09-12T17:42:02.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.916+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~4EL4LELE8283.0 size=640227 2024-09-12T17:42:02.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.916+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=4EL4LELE8283 tag=WPI6F0EN03WJ type=write size=1688803 2024-09-12T17:42:02.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.917+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=5DNQHV24HKFQ type=del 2024-09-12T17:42:02.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.918+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=BIP5ITUF6TFC type=del size=1981360 2024-09-12T17:42:02.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.919+0000 7f330fbcc780 1 < canceled operation key=TKJOJ17LIWX6 tag=LLDI8DG8M9MK type=del size=1868359 2024-09-12T17:42:02.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.920+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=6GQRVYI0I1PG type=del size=4181767 2024-09-12T17:42:02.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.921+0000 7f330fbcc780 1 < canceled part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.0 size=1048576 2024-09-12T17:42:02.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.921+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.1 size=1048576 2024-09-12T17:42:02.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.922+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~9UJT4PLCSOS9.2 size=534200 2024-09-12T17:42:02.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.924+0000 7f330fbcc780 1 < canceled multipart upload key=LF4NGY13WYHK upload=9UJT4PLCSOS9 tag=OKJM3J81U5HA type=write size=3679928 2024-09-12T17:42:02.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.925+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=S80MP8QBRZ0A type=del size=418368 2024-09-12T17:42:02.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.928+0000 7f330fbcc780 1 < suggested update operation key=IEL4VF8ROC72 tag=W396VXTKPH8O type=del size=2785625 2024-09-12T17:42:02.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.930+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~G31NI114UBR9.0 size=1048576 2024-09-12T17:42:02.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.931+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~G31NI114UBR9.1 size=73100 2024-09-12T17:42:02.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.931+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=G31NI114UBR9 tag=D9M2X8C81Y2R type=write size=2170252 2024-09-12T17:42:02.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.932+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=4EEN2HWF3WO3 type=del 2024-09-12T17:42:02.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.933+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=S39LQOOGAD8V type=del size=1188286 2024-09-12T17:42:02.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.934+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~XJ8UEUZAASBN.0 size=1048576 2024-09-12T17:42:02.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.935+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~XJ8UEUZAASBN.1 size=828778 2024-09-12T17:42:02.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.937+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=XJ8UEUZAASBN tag=W89MMBI36M6S type=write size=2925930 2024-09-12T17:42:02.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.939+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~G4AIBHZF0U60.0 size=1048576 2024-09-12T17:42:02.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.940+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~G4AIBHZF0U60.1 size=659418 2024-09-12T17:42:02.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.940+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=G4AIBHZF0U60 tag=6ZN2R5QBGCQ6 type=write size=2756570 2024-09-12T17:42:02.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.942+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=XYW7ULQSG9YQ type=del 2024-09-12T17:42:02.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.943+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=8FFHL3LKGP6D type=del size=1050525 2024-09-12T17:42:02.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.945+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.0 size=1048576 2024-09-12T17:42:02.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.945+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.1 size=1048576 2024-09-12T17:42:02.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.945+0000 7f330fbcc780 1 < canceled part key=_multipart_2CY67P4QM19H.2~BH5Y59PFN6BP.2 size=100876 2024-09-12T17:42:02.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.948+0000 7f330fbcc780 1 < canceled multipart upload key=2CY67P4QM19H upload=BH5Y59PFN6BP tag=9CY9I2CRRQP2 type=write size=3246604 2024-09-12T17:42:02.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.949+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=T7J6BVP4T1NW type=del size=1454617 2024-09-12T17:42:02.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.950+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=BGS3K4CU7E0U type=del 2024-09-12T17:42:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.952+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.0 size=1048576 2024-09-12T17:42:02.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.953+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.1 size=1048576 2024-09-12T17:42:02.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.954+0000 7f330fbcc780 1 > prepared part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.2 size=991714 2024-09-12T17:42:02.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.954+0000 7f330fbcc780 1 > prepared multipart upload key=2CY67P4QM19H upload=LY0S5RF8D0NV tag=6N7AP6CEDRLW type=write size=4137442 2024-09-12T17:42:02.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.955+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.0 size=1048576 2024-09-12T17:42:02.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.955+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.1 size=1048576 2024-09-12T17:42:02.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.956+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~VBOHZKKN67V7.2 size=613395 2024-09-12T17:42:02.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.958+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=VBOHZKKN67V7 tag=P2TUBBEICKQ3 type=write size=3759123 2024-09-12T17:42:02.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.960+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=N8CKGKXQ9JOQ type=write size=725817 2024-09-12T17:42:02.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.961+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=BX6L0QZFH7PP type=del 2024-09-12T17:42:02.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.963+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~YPMYIPDVW1XJ.0 size=662230 2024-09-12T17:42:02.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.963+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=YPMYIPDVW1XJ tag=AZYBVBHS5MVW type=write size=1710806 2024-09-12T17:42:02.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.964+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=OSGFYQ11SH1T type=del 2024-09-12T17:42:02.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.966+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=DN0DO6AIWCBR type=del size=3657910 2024-09-12T17:42:02.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.968+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~NZKJFEG829CA.0 size=1048576 2024-09-12T17:42:02.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.968+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~NZKJFEG829CA.1 size=954057 2024-09-12T17:42:02.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.970+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=NZKJFEG829CA tag=D22VTK609M6Q type=write size=3051209 2024-09-12T17:42:02.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.971+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=PUXF72LQ2MJO type=del size=3269473 2024-09-12T17:42:02.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.972+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.0 size=1048576 2024-09-12T17:42:02.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.973+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.1 size=1048576 2024-09-12T17:42:02.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.974+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~XV27POV9I6XE.2 size=224594 2024-09-12T17:42:02.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.976+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=XV27POV9I6XE tag=PZJ9ZO186GLP type=write size=3370322 2024-09-12T17:42:02.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.977+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=H04UZMDBJI2C type=del size=3352128 2024-09-12T17:42:02.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.978+0000 7f330fbcc780 1 < canceled part key=_multipart_9X4FNKQWJCX4.2~NDS1CX94AFRL.0 size=1048576 2024-09-12T17:42:02.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.978+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~NDS1CX94AFRL.1 size=730297 2024-09-12T17:42:02.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.980+0000 7f330fbcc780 1 < canceled multipart upload key=9X4FNKQWJCX4 upload=NDS1CX94AFRL tag=2EWDUYPTAXDX type=write size=2827449 2024-09-12T17:42:02.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.981+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=FTW038BXK13L type=del size=2826891 2024-09-12T17:42:02.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.982+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~4EL4LELE8283.0 size=640227 2024-09-12T17:42:02.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.984+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=4EL4LELE8283 tag=WPI6F0EN03WJ type=write size=1688803 2024-09-12T17:42:02.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.985+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=CDXBNZPDYACZ type=del size=2659340 2024-09-12T17:42:02.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.987+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=BIP5ITUF6TFC type=del 2024-09-12T17:42:02.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.988+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=8UPNL1GYBQPR type=del size=1975343 2024-09-12T17:42:02.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.989+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=6GQRVYI0I1PG type=del 2024-09-12T17:42:02.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.990+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=XRSOCUTFFHTU type=del size=1729876 2024-09-12T17:42:02.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.992+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=S80MP8QBRZ0A type=del 2024-09-12T17:42:02.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.993+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=HB3DJC3WN4KA type=write size=561846 2024-09-12T17:42:02.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.995+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~G31NI114UBR9.0 size=1048576 2024-09-12T17:42:02.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.995+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~G31NI114UBR9.1 size=73100 2024-09-12T17:42:02.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.997+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=G31NI114UBR9 tag=D9M2X8C81Y2R type=write size=2170252 2024-09-12T17:42:02.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:02.998+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=TGKCSD1COPGX type=del size=1597080 2024-09-12T17:42:03.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.001+0000 7f330fbcc780 1 < suggested update operation key=HJL73WQD8SD2 tag=S39LQOOGAD8V type=del size=1188286 2024-09-12T17:42:03.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.002+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=3KHLXISB0RT1 type=del size=1095478 2024-09-12T17:42:03.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.004+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~G4AIBHZF0U60.0 size=1048576 2024-09-12T17:42:03.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.004+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~G4AIBHZF0U60.1 size=659418 2024-09-12T17:42:03.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.006+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=G4AIBHZF0U60 tag=6ZN2R5QBGCQ6 type=write size=2756570 2024-09-12T17:42:03.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.009+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~7P433GTFJWTO.0 size=1048576 2024-09-12T17:42:03.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.009+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~7P433GTFJWTO.1 size=996101 2024-09-12T17:42:03.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.009+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=7P433GTFJWTO tag=AG2KHZMRIT9W type=write size=3093253 2024-09-12T17:42:03.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.011+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=8FFHL3LKGP6D type=del 2024-09-12T17:42:03.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.012+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.0 size=1048576 2024-09-12T17:42:03.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.013+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.1 size=1048576 2024-09-12T17:42:03.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.014+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.2 size=779029 2024-09-12T17:42:03.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.014+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=VENIMCMGBVCE tag=B06OSQ4VDOYH type=write size=3924757 2024-09-12T17:42:03.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.016+0000 7f330fbcc780 1 < suggested update operation key=5QBSRDY0LJ60 tag=T7J6BVP4T1NW type=del size=1454617 2024-09-12T17:42:03.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.018+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.0 size=1048576 2024-09-12T17:42:03.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.019+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.1 size=1048576 2024-09-12T17:42:03.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.020+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.2 size=322360 2024-09-12T17:42:03.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.020+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=MBFY5T96CISC tag=PB9M41UGSFU7 type=write size=3468088 2024-09-12T17:42:03.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.022+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.0 size=1048576 2024-09-12T17:42:03.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.023+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.1 size=1048576 2024-09-12T17:42:03.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.023+0000 7f330fbcc780 1 < completed part key=_multipart_2CY67P4QM19H.2~LY0S5RF8D0NV.2 size=991714 2024-09-12T17:42:03.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.026+0000 7f330fbcc780 1 < completed multipart upload key=2CY67P4QM19H upload=LY0S5RF8D0NV tag=6N7AP6CEDRLW type=write size=4137442 2024-09-12T17:42:03.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.027+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=ZR8QVMXQ4VF5 type=del size=3724583 2024-09-12T17:42:03.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.028+0000 7f330fbcc780 1 < completed write operation key=IEL4VF8ROC72 tag=N8CKGKXQ9JOQ type=write size=725817 2024-09-12T17:42:03.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.029+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=GBE8KFGQKDJJ type=write size=161440 2024-09-12T17:42:03.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.031+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~YPMYIPDVW1XJ.0 size=662230 2024-09-12T17:42:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.033+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=YPMYIPDVW1XJ tag=AZYBVBHS5MVW type=write size=1710806 2024-09-12T17:42:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.035+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~J4BDYZK7HE5U.0 size=265275 2024-09-12T17:42:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.035+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=J4BDYZK7HE5U tag=HI1UJT82YJ75 type=write size=1313851 2024-09-12T17:42:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.036+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=DN0DO6AIWCBR type=del 2024-09-12T17:42:03.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.037+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=8FKHU33RIY8B type=del size=1158915 2024-09-12T17:42:03.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.038+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=PUXF72LQ2MJO type=del 2024-09-12T17:42:03.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.040+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~TGMSNUCPKTWA.0 size=1048576 2024-09-12T17:42:03.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.042+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~TGMSNUCPKTWA.1 size=967886 2024-09-12T17:42:03.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.042+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=TGMSNUCPKTWA tag=4KH4IJE3O43K type=write size=3065038 2024-09-12T17:42:03.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.043+0000 7f330fbcc780 -1 < failed to complete operation key=8UX8W3FAJ3D9 tag=H04UZMDBJI2C type=del size=3352128: (22) Invalid argument 2024-09-12T17:42:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.044+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=GGTHA6JGZTFP type=del size=421700 2024-09-12T17:42:03.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.045+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=FTW038BXK13L type=del 2024-09-12T17:42:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.047+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.0 size=1048576 2024-09-12T17:42:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.048+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.1 size=1048576 2024-09-12T17:42:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.049+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.2 size=481674 2024-09-12T17:42:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.049+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=UJQYV2OMPA61 tag=YYG6C9EZPO27 type=write size=3627402 2024-09-12T17:42:03.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.051+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=CDXBNZPDYACZ type=del 2024-09-12T17:42:03.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.053+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.0 size=1048576 2024-09-12T17:42:03.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.054+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.1 size=1048576 2024-09-12T17:42:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.055+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.2 size=614942 2024-09-12T17:42:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.055+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=XAFLXOY5XTKZ tag=VICA4U845PWC type=write size=3760670 2024-09-12T17:42:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.056+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=8UPNL1GYBQPR type=del 2024-09-12T17:42:03.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.057+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=FQ9FANNFS44L type=del size=2301223 2024-09-12T17:42:03.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.060+0000 7f330fbcc780 1 < suggested remove operation key=1MJ2W1WMLR85 tag=XRSOCUTFFHTU type=del 2024-09-12T17:42:03.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.062+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.0 size=1048576 2024-09-12T17:42:03.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.063+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.1 size=1048576 2024-09-12T17:42:03.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.064+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.2 size=671102 2024-09-12T17:42:03.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.064+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=POGB8DW5GOFS tag=V8Z9MCN5Q8GQ type=write size=3816830 2024-09-12T17:42:03.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.065+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=HB3DJC3WN4KA type=write size=561846 2024-09-12T17:42:03.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.067+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.0 size=1048576 2024-09-12T17:42:03.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.068+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.1 size=1048576 2024-09-12T17:42:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.069+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.2 size=716410 2024-09-12T17:42:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.069+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=8YBMHZBKYGZM tag=DXQIVY7QOQAP type=write size=3862138 2024-09-12T17:42:03.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.070+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=TGKCSD1COPGX type=del 2024-09-12T17:42:03.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.071+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=RL7UDK74X0NB type=del size=3667143 2024-09-12T17:42:03.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.073+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=3KHLXISB0RT1 type=del 2024-09-12T17:42:03.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.074+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=KPFZSIK9X1AJ type=del size=3750077 2024-09-12T17:42:03.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.075+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~7P433GTFJWTO.0 size=1048576 2024-09-12T17:42:03.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.077+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~7P433GTFJWTO.1 size=996101 2024-09-12T17:42:03.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.079+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=7P433GTFJWTO tag=AG2KHZMRIT9W type=write size=3093253 2024-09-12T17:42:03.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.080+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=VP6CUJ89GJ58 type=del size=241577 2024-09-12T17:42:03.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.082+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.0 size=1048576 2024-09-12T17:42:03.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.083+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.1 size=1048576 2024-09-12T17:42:03.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.084+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~VENIMCMGBVCE.2 size=779029 2024-09-12T17:42:03.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.086+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=VENIMCMGBVCE tag=B06OSQ4VDOYH type=write size=3924757 2024-09-12T17:42:03.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.087+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=T56GB10VERMP type=del size=2764427 2024-09-12T17:42:03.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.088+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.0 size=1048576 2024-09-12T17:42:03.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.089+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.1 size=1048576 2024-09-12T17:42:03.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.090+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~MBFY5T96CISC.2 size=322360 2024-09-12T17:42:03.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.092+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=MBFY5T96CISC tag=PB9M41UGSFU7 type=write size=3468088 2024-09-12T17:42:03.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.094+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~WJWCSWAU10G8.0 size=1048576 2024-09-12T17:42:03.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.095+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~WJWCSWAU10G8.1 size=904882 2024-09-12T17:42:03.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.095+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=WJWCSWAU10G8 tag=D53LRMP53HYH type=write size=3002034 2024-09-12T17:42:03.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.096+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=ZR8QVMXQ4VF5 type=del 2024-09-12T17:42:03.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.099+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.0 size=1048576 2024-09-12T17:42:03.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.100+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.1 size=1048576 2024-09-12T17:42:03.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.101+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.2 size=820899 2024-09-12T17:42:03.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.101+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=7HP2X9UMB61U tag=KCEX6SU60D52 type=write size=3966627 2024-09-12T17:42:03.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.102+0000 7f330fbcc780 1 < completed write operation key=AGM33OK1W7A6 tag=GBE8KFGQKDJJ type=write size=161440 2024-09-12T17:42:03.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.104+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~UL1EP69RP7H7.0 size=820556 2024-09-12T17:42:03.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.104+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=UL1EP69RP7H7 tag=X25WROK6ZRNE type=write size=1869132 2024-09-12T17:42:03.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.105+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~J4BDYZK7HE5U.0 size=265275 2024-09-12T17:42:03.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.107+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=J4BDYZK7HE5U tag=HI1UJT82YJ75 type=write size=1313851 2024-09-12T17:42:03.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.109+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=BB3BZ9QXLLLD type=write size=389407 2024-09-12T17:42:03.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.110+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=8FKHU33RIY8B type=del 2024-09-12T17:42:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.111+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=PPZ00D3EE5UH type=del size=1279184 2024-09-12T17:42:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.112+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~TGMSNUCPKTWA.0 size=1048576 2024-09-12T17:42:03.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.113+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~TGMSNUCPKTWA.1 size=967886 2024-09-12T17:42:03.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.115+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=TGMSNUCPKTWA tag=4KH4IJE3O43K type=write size=3065038 2024-09-12T17:42:03.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.117+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~JIKM07ZCBJFK.0 size=1048576 2024-09-12T17:42:03.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.118+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~JIKM07ZCBJFK.1 size=900689 2024-09-12T17:42:03.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.118+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=JIKM07ZCBJFK tag=3XE34DJ7KWUC type=write size=2997841 2024-09-12T17:42:03.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.120+0000 7f330fbcc780 1 < suggested update operation key=QE2QJH2J5QDY tag=GGTHA6JGZTFP type=del size=421700 2024-09-12T17:42:03.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.121+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=LYYZ8FMQS3QL type=del size=3278188 2024-09-12T17:42:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.123+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.0 size=1048576 2024-09-12T17:42:03.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.124+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.1 size=1048576 2024-09-12T17:42:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.125+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~UJQYV2OMPA61.2 size=481674 2024-09-12T17:42:03.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.126+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=UJQYV2OMPA61 tag=YYG6C9EZPO27 type=write size=3627402 2024-09-12T17:42:03.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.128+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~7Q9A0Y5PDPO0.0 size=1048576 2024-09-12T17:42:03.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.129+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~7Q9A0Y5PDPO0.1 size=859192 2024-09-12T17:42:03.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.129+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=7Q9A0Y5PDPO0 tag=GR82OUJNJEAR type=write size=2956344 2024-09-12T17:42:03.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.130+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.0 size=1048576 2024-09-12T17:42:03.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.130+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.1 size=1048576 2024-09-12T17:42:03.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.131+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~XAFLXOY5XTKZ.2 size=614942 2024-09-12T17:42:03.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.133+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=XAFLXOY5XTKZ tag=VICA4U845PWC type=write size=3760670 2024-09-12T17:42:03.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.337+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~LE4DVP30CQR0.0 size=1048576 2024-09-12T17:42:03.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.338+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~LE4DVP30CQR0.1 size=657325 2024-09-12T17:42:03.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.338+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=LE4DVP30CQR0 tag=XAZW8A5GCMHL type=write size=2754477 2024-09-12T17:42:03.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.339+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=FQ9FANNFS44L type=del 2024-09-12T17:42:03.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.341+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~RYMFMSOEI7AU.0 size=1048576 2024-09-12T17:42:03.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.342+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~RYMFMSOEI7AU.1 size=784864 2024-09-12T17:42:03.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.342+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=RYMFMSOEI7AU tag=3GDKXWVHOEZL type=write size=2882016 2024-09-12T17:42:03.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.344+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.0 size=1048576 2024-09-12T17:42:03.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.345+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.1 size=1048576 2024-09-12T17:42:03.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.345+0000 7f330fbcc780 1 < canceled part key=_multipart_3IHGI1UMI1BA.2~POGB8DW5GOFS.2 size=671102 2024-09-12T17:42:03.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.347+0000 7f330fbcc780 1 < canceled multipart upload key=3IHGI1UMI1BA upload=POGB8DW5GOFS tag=V8Z9MCN5Q8GQ type=write size=3816830 2024-09-12T17:42:03.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.349+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.0 size=1048576 2024-09-12T17:42:03.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.350+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.1 size=1048576 2024-09-12T17:42:03.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.351+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.2 size=645270 2024-09-12T17:42:03.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.351+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=7Q2QP3NSD93T tag=8T1DALCUIUPI type=write size=3790998 2024-09-12T17:42:03.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.353+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.0 size=1048576 2024-09-12T17:42:03.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.354+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.1 size=1048576 2024-09-12T17:42:03.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.355+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~8YBMHZBKYGZM.2 size=716410 2024-09-12T17:42:03.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.357+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=8YBMHZBKYGZM tag=DXQIVY7QOQAP type=write size=3862138 2024-09-12T17:42:03.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.358+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=FH2HXD4DI3CL type=del size=3518617 2024-09-12T17:42:03.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.359+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=RL7UDK74X0NB type=del 2024-09-12T17:42:03.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.362+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.0 size=1048576 2024-09-12T17:42:03.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.363+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.1 size=1048576 2024-09-12T17:42:03.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.364+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.2 size=219382 2024-09-12T17:42:03.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.364+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=07ATMMX2VEG8 tag=6O9QIBPS5M0W type=write size=3365110 2024-09-12T17:42:03.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.365+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=KPFZSIK9X1AJ type=del 2024-09-12T17:42:03.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.366+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=NYGAGTTW7CZH type=write size=666514 2024-09-12T17:42:03.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.368+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=VP6CUJ89GJ58 type=del 2024-09-12T17:42:03.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.369+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=80UBGYKP2TT0 type=del size=1948896 2024-09-12T17:42:03.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.372+0000 7f330fbcc780 1 < suggested update operation key=XIW3OJB1STT9 tag=T56GB10VERMP type=del size=2764427 2024-09-12T17:42:03.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.374+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~92CJB50R1SSA.0 size=1048576 2024-09-12T17:42:03.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.375+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~92CJB50R1SSA.1 size=528794 2024-09-12T17:42:03.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.375+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=92CJB50R1SSA tag=5MSNUNZXK3LU type=write size=2625946 2024-09-12T17:42:03.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.376+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~WJWCSWAU10G8.0 size=1048576 2024-09-12T17:42:03.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.377+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~WJWCSWAU10G8.1 size=904882 2024-09-12T17:42:03.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.380+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=WJWCSWAU10G8 tag=D53LRMP53HYH type=write size=3002034 2024-09-12T17:42:03.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.381+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=BGDQ3SZ61NMK type=write size=879034 2024-09-12T17:42:03.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.382+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.0 size=1048576 2024-09-12T17:42:03.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.383+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.1 size=1048576 2024-09-12T17:42:03.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.384+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7HP2X9UMB61U.2 size=820899 2024-09-12T17:42:03.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.386+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=7HP2X9UMB61U tag=KCEX6SU60D52 type=write size=3966627 2024-09-12T17:42:03.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.387+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=3ADVAK6V3WP7 type=del size=2415720 2024-09-12T17:42:03.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.390+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~UL1EP69RP7H7.0 size=820556 2024-09-12T17:42:03.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.392+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=UL1EP69RP7H7 tag=X25WROK6ZRNE type=write size=1869132 2024-09-12T17:42:03.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.393+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=85S2OX734NA1 type=write size=534514 2024-09-12T17:42:03.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.394+0000 7f330fbcc780 1 < completed write operation key=8UX8W3FAJ3D9 tag=BB3BZ9QXLLLD type=write size=389407 2024-09-12T17:42:03.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.396+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=8TT5JHA8YBED type=del size=721185 2024-09-12T17:42:03.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.398+0000 7f330fbcc780 1 < suggested remove operation key=TKJOJ17LIWX6 tag=PPZ00D3EE5UH type=del 2024-09-12T17:42:03.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.400+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.0 size=1048576 2024-09-12T17:42:03.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.401+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.1 size=1048576 2024-09-12T17:42:03.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.402+0000 7f330fbcc780 1 > prepared part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.2 size=847737 2024-09-12T17:42:03.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.402+0000 7f330fbcc780 1 > prepared multipart upload key=ZEC2RXNOR3D1 upload=R4A2VY4FHCC8 tag=93ZFR1SQ5CH0 type=write size=3993465 2024-09-12T17:42:03.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.403+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~JIKM07ZCBJFK.0 size=1048576 2024-09-12T17:42:03.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.404+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~JIKM07ZCBJFK.1 size=900689 2024-09-12T17:42:03.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.406+0000 7f330fbcc780 1 < completed multipart upload key=8UX8W3FAJ3D9 upload=JIKM07ZCBJFK tag=3XE34DJ7KWUC type=write size=2997841 2024-09-12T17:42:03.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.408+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=J2IL5EENZJTK type=del size=3987204 2024-09-12T17:42:03.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.409+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=LYYZ8FMQS3QL type=del 2024-09-12T17:42:03.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.410+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=0X3X0RJ3F29Y type=del size=136666 2024-09-12T17:42:03.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.411+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~7Q9A0Y5PDPO0.0 size=1048576 2024-09-12T17:42:03.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.411+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~7Q9A0Y5PDPO0.1 size=859192 2024-09-12T17:42:03.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.414+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=7Q9A0Y5PDPO0 tag=GR82OUJNJEAR type=write size=2956344 2024-09-12T17:42:03.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.415+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=QVTQJKKWLBQ2 type=del size=344293 2024-09-12T17:42:03.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.416+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~LE4DVP30CQR0.0 size=1048576 2024-09-12T17:42:03.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.417+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~LE4DVP30CQR0.1 size=657325 2024-09-12T17:42:03.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.419+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=LE4DVP30CQR0 tag=XAZW8A5GCMHL type=write size=2754477 2024-09-12T17:42:03.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.420+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=TY9AE7V7S2B5 type=del size=1953131 2024-09-12T17:42:03.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.422+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~RYMFMSOEI7AU.0 size=1048576 2024-09-12T17:42:03.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.423+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~RYMFMSOEI7AU.1 size=784864 2024-09-12T17:42:03.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.425+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=RYMFMSOEI7AU tag=3GDKXWVHOEZL type=write size=2882016 2024-09-12T17:42:03.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.426+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=EJAM8LDIENW8 type=write size=1027807 2024-09-12T17:42:03.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.427+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.0 size=1048576 2024-09-12T17:42:03.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.428+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.1 size=1048576 2024-09-12T17:42:03.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.429+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~7Q2QP3NSD93T.2 size=645270 2024-09-12T17:42:03.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.431+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=7Q2QP3NSD93T tag=8T1DALCUIUPI type=write size=3790998 2024-09-12T17:42:03.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.432+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=SFYU6L9C6987 type=del size=554587 2024-09-12T17:42:03.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.433+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=FH2HXD4DI3CL type=del 2024-09-12T17:42:03.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.436+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~HB3IBYZT55Q9.0 size=737581 2024-09-12T17:42:03.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.436+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=HB3IBYZT55Q9 tag=VMJIPNKZ8NDK type=write size=1786157 2024-09-12T17:42:03.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.437+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.0 size=1048576 2024-09-12T17:42:03.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.438+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.1 size=1048576 2024-09-12T17:42:03.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.439+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~07ATMMX2VEG8.2 size=219382 2024-09-12T17:42:03.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.441+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=07ATMMX2VEG8 tag=6O9QIBPS5M0W type=write size=3365110 2024-09-12T17:42:03.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.442+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=BZ5A7HIJA2NF type=del size=3265620 2024-09-12T17:42:03.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.444+0000 7f330fbcc780 1 < suggested update operation key=H1LAU7WDZW6S tag=NYGAGTTW7CZH type=write size=666514 2024-09-12T17:42:03.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.446+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~UTZD67PEHIZU.0 size=863078 2024-09-12T17:42:03.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.446+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=UTZD67PEHIZU tag=OCAB0A6JWHNA type=write size=1911654 2024-09-12T17:42:03.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.449+0000 7f330fbcc780 1 < suggested remove operation key=ZEC2RXNOR3D1 tag=80UBGYKP2TT0 type=del 2024-09-12T17:42:03.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.451+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~WIDIIMXSHOHK.0 size=133219 2024-09-12T17:42:03.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.451+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=WIDIIMXSHOHK tag=VDL1PMF3UKQK type=write size=1181795 2024-09-12T17:42:03.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.452+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~92CJB50R1SSA.0 size=1048576 2024-09-12T17:42:03.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.453+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~92CJB50R1SSA.1 size=528794 2024-09-12T17:42:03.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.455+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=92CJB50R1SSA tag=5MSNUNZXK3LU type=write size=2625946 2024-09-12T17:42:03.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.456+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=5E68WWUEO97D type=del size=1295884 2024-09-12T17:42:03.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.457+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=BGDQ3SZ61NMK type=write size=879034 2024-09-12T17:42:03.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.458+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=IIG7G4B0IZXG type=del size=1524496 2024-09-12T17:42:03.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.459+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=3ADVAK6V3WP7 type=del 2024-09-12T17:42:03.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.461+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~O7T797YLNU2A.0 size=1048576 2024-09-12T17:42:03.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.462+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~O7T797YLNU2A.1 size=346678 2024-09-12T17:42:03.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.462+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=O7T797YLNU2A tag=6O9NR9124NG8 type=write size=2443830 2024-09-12T17:42:03.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.463+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=85S2OX734NA1 type=write size=534514 2024-09-12T17:42:03.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.465+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=222DNHSW29KN type=del size=1569936 2024-09-12T17:42:03.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.466+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=8TT5JHA8YBED type=del 2024-09-12T17:42:03.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.468+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.0 size=1048576 2024-09-12T17:42:03.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.469+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.1 size=1048576 2024-09-12T17:42:03.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.470+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.2 size=1472 2024-09-12T17:42:03.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.470+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=S2SEF7UFFYND tag=S097RXR4SI02 type=write size=3147200 2024-09-12T17:42:03.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.471+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.0 size=1048576 2024-09-12T17:42:03.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.472+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.1 size=1048576 2024-09-12T17:42:03.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.473+0000 7f330fbcc780 1 < completed part key=_multipart_ZEC2RXNOR3D1.2~R4A2VY4FHCC8.2 size=847737 2024-09-12T17:42:03.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.475+0000 7f330fbcc780 1 < completed multipart upload key=ZEC2RXNOR3D1 upload=R4A2VY4FHCC8 tag=93ZFR1SQ5CH0 type=write size=3993465 2024-09-12T17:42:03.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.476+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=RXILPD1ENTLD type=del size=967298 2024-09-12T17:42:03.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.477+0000 7f330fbcc780 1 < completed delete operation key=8UX8W3FAJ3D9 tag=J2IL5EENZJTK type=del 2024-09-12T17:42:03.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.479+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~PKILYNY2CPWR.0 size=1048576 2024-09-12T17:42:03.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.480+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~PKILYNY2CPWR.1 size=804389 2024-09-12T17:42:03.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.480+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=PKILYNY2CPWR tag=B883QZ4YS213 type=write size=2901541 2024-09-12T17:42:03.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.481+0000 7f330fbcc780 1 < canceled operation key=8UX8W3FAJ3D9 tag=0X3X0RJ3F29Y type=del size=136666 2024-09-12T17:42:03.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.482+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=GTX58SY10N72 type=del size=2442883 2024-09-12T17:42:03.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.484+0000 7f330fbcc780 1 < completed delete operation key=SPKBX4WU9A9R tag=QVTQJKKWLBQ2 type=del 2024-09-12T17:42:03.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.485+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=VKUZ5CJKQS0S type=write size=517828 2024-09-12T17:42:03.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.486+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=TY9AE7V7S2B5 type=del 2024-09-12T17:42:03.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.488+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~LQCU2UYTNUJ6.0 size=789074 2024-09-12T17:42:03.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.488+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=LQCU2UYTNUJ6 tag=O9ETX8WRNSJ8 type=write size=1837650 2024-09-12T17:42:03.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.490+0000 7f330fbcc780 1 < suggested remove operation key=IEYJS7X97O1A tag=EJAM8LDIENW8 type=write 2024-09-12T17:42:03.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.492+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=319HVIHWWL27 type=del size=145057 2024-09-12T17:42:03.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.494+0000 7f330fbcc780 1 < suggested update operation key=D5ZZ93XAPRAA tag=SFYU6L9C6987 type=del size=554587 2024-09-12T17:42:03.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.495+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=0HGGO47B2TUK type=del size=3486996 2024-09-12T17:42:03.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.496+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~HB3IBYZT55Q9.0 size=737581 2024-09-12T17:42:03.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.499+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=HB3IBYZT55Q9 tag=VMJIPNKZ8NDK type=write size=1786157 2024-09-12T17:42:03.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.502+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~B431Y604KT7J.0 size=1048576 2024-09-12T17:42:03.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.503+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~B431Y604KT7J.1 size=673391 2024-09-12T17:42:03.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.503+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=B431Y604KT7J tag=UQYWZ645DKUM type=write size=2770543 2024-09-12T17:42:03.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.505+0000 7f330fbcc780 1 < suggested update operation key=QE2QJH2J5QDY tag=BZ5A7HIJA2NF type=del size=3265620 2024-09-12T17:42:03.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.506+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=9O7T5I0I82SB type=write size=910216 2024-09-12T17:42:03.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.507+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~UTZD67PEHIZU.0 size=863078 2024-09-12T17:42:03.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.510+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=UTZD67PEHIZU tag=OCAB0A6JWHNA type=write size=1911654 2024-09-12T17:42:03.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.512+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.0 size=1048576 2024-09-12T17:42:03.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.513+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.1 size=1048576 2024-09-12T17:42:03.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.513+0000 7f330fbcc780 1 > prepared part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.2 size=836872 2024-09-12T17:42:03.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.514+0000 7f330fbcc780 1 > prepared multipart upload key=9IYALJED5G85 upload=01Q34HF6VVGI tag=YV2WEP0MWVVZ type=write size=3982600 2024-09-12T17:42:03.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.515+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~WIDIIMXSHOHK.0 size=133219 2024-09-12T17:42:03.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.517+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=WIDIIMXSHOHK tag=VDL1PMF3UKQK type=write size=1181795 2024-09-12T17:42:03.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.518+0000 7f330fbcc780 1 > prepared operation key=AL3ESPG15NO4 tag=MOEB102HA9WH type=del size=2002306 2024-09-12T17:42:03.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.519+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=5E68WWUEO97D type=del 2024-09-12T17:42:03.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.521+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~Q5UYRQ4Y4O3X.0 size=359962 2024-09-12T17:42:03.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.521+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=Q5UYRQ4Y4O3X tag=0KFD9ZCC1QIY type=write size=1408538 2024-09-12T17:42:03.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.523+0000 7f330fbcc780 1 < suggested update operation key=LF4NGY13WYHK tag=IIG7G4B0IZXG type=del size=1524496 2024-09-12T17:42:03.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.524+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=L1YJD8I9HI5E type=write size=509783 2024-09-12T17:42:03.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.526+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~O7T797YLNU2A.0 size=1048576 2024-09-12T17:42:03.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.527+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~O7T797YLNU2A.1 size=346678 2024-09-12T17:42:03.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.529+0000 7f330fbcc780 1 < completed multipart upload key=1MJ2W1WMLR85 upload=O7T797YLNU2A tag=6O9NR9124NG8 type=write size=2443830 2024-09-12T17:42:03.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.530+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=2131GS0ML7YQ type=del size=2798639 2024-09-12T17:42:03.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.531+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=222DNHSW29KN type=del 2024-09-12T17:42:03.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.533+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~FOOZ5Y61K9QE.0 size=1048576 2024-09-12T17:42:03.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.534+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~FOOZ5Y61K9QE.1 size=657214 2024-09-12T17:42:03.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.534+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=FOOZ5Y61K9QE tag=3FY1KQZLRKTE type=write size=2754366 2024-09-12T17:42:03.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.535+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.0 size=1048576 2024-09-12T17:42:03.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.536+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.1 size=1048576 2024-09-12T17:42:03.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.537+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~S2SEF7UFFYND.2 size=1472 2024-09-12T17:42:03.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.539+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=S2SEF7UFFYND tag=S097RXR4SI02 type=write size=3147200 2024-09-12T17:42:03.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.540+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=W2OHLETC3NCI type=del size=3891102 2024-09-12T17:42:03.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.541+0000 7f330fbcc780 -1 < failed to complete operation key=LF4NGY13WYHK tag=RXILPD1ENTLD type=del size=967298: (22) Invalid argument 2024-09-12T17:42:03.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.542+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=FV3B00GF941K type=del size=1331955 2024-09-12T17:42:03.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.544+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~PKILYNY2CPWR.0 size=1048576 2024-09-12T17:42:03.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.545+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~PKILYNY2CPWR.1 size=804389 2024-09-12T17:42:03.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.547+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=PKILYNY2CPWR tag=B883QZ4YS213 type=write size=2901541 2024-09-12T17:42:03.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.549+0000 7f330fbcc780 1 > prepared part key=_multipart_AGM33OK1W7A6.2~PKRLEBYJX9K9.0 size=470113 2024-09-12T17:42:03.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.549+0000 7f330fbcc780 1 > prepared multipart upload key=AGM33OK1W7A6 upload=PKRLEBYJX9K9 tag=8CXMG2PCALLP type=write size=1518689 2024-09-12T17:42:03.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.550+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=GTX58SY10N72 type=del 2024-09-12T17:42:03.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.552+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.0 size=1048576 2024-09-12T17:42:03.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.553+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.1 size=1048576 2024-09-12T17:42:03.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.554+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.2 size=611031 2024-09-12T17:42:03.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.554+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=T10XCQ0JK72R tag=3CPMNL1YQ2NF type=write size=3756759 2024-09-12T17:42:03.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.555+0000 7f330fbcc780 -1 < failed to complete operation key=IEYJS7X97O1A tag=VKUZ5CJKQS0S type=write size=517828: (22) Invalid argument 2024-09-12T17:42:03.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.557+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.0 size=1048576 2024-09-12T17:42:03.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.558+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.1 size=1048576 2024-09-12T17:42:03.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.559+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.2 size=309401 2024-09-12T17:42:03.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.559+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=WS1AD8VELWTT tag=FCKOW07XMO63 type=write size=3455129 2024-09-12T17:42:03.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.559+0000 7f330fbcc780 1 < canceled part key=_multipart_XIW3OJB1STT9.2~LQCU2UYTNUJ6.0 size=789074 2024-09-12T17:42:03.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.561+0000 7f330fbcc780 1 < canceled multipart upload key=XIW3OJB1STT9 upload=LQCU2UYTNUJ6 tag=O9ETX8WRNSJ8 type=write size=1837650 2024-09-12T17:42:03.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.563+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=1P5OGD9N40XQ type=del size=1651355 2024-09-12T17:42:03.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.565+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=319HVIHWWL27 type=del 2024-09-12T17:42:03.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.566+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=H59RKX2ZM049 type=write size=55627 2024-09-12T17:42:03.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.567+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=0HGGO47B2TUK type=del 2024-09-12T17:42:03.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.570+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~6O4DDIAXG02I.0 size=1048576 2024-09-12T17:42:03.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.570+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~6O4DDIAXG02I.1 size=1032414 2024-09-12T17:42:03.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.570+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=6O4DDIAXG02I tag=KIVX0BHLX2DZ type=write size=3129566 2024-09-12T17:42:03.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.572+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~B431Y604KT7J.0 size=1048576 2024-09-12T17:42:03.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.572+0000 7f330fbcc780 1 < canceled part key=_multipart_3BU8T85GXCX4.2~B431Y604KT7J.1 size=673391 2024-09-12T17:42:03.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.574+0000 7f330fbcc780 1 < canceled multipart upload key=3BU8T85GXCX4 upload=B431Y604KT7J tag=UQYWZ645DKUM type=write size=2770543 2024-09-12T17:42:03.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.575+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=FSVUGNYWYAFH type=del size=1912111 2024-09-12T17:42:03.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.576+0000 7f330fbcc780 1 < canceled operation key=9X4FNKQWJCX4 tag=9O7T5I0I82SB type=write size=910216 2024-09-12T17:42:03.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.578+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~C3J44IDZYC9X.0 size=1048576 2024-09-12T17:42:03.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.579+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~C3J44IDZYC9X.1 size=106052 2024-09-12T17:42:03.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.579+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=C3J44IDZYC9X tag=IJBY7R59PT53 type=write size=2203204 2024-09-12T17:42:03.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.580+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.0 size=1048576 2024-09-12T17:42:03.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.582+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.1 size=1048576 2024-09-12T17:42:03.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.583+0000 7f330fbcc780 1 < completed part key=_multipart_9IYALJED5G85.2~01Q34HF6VVGI.2 size=836872 2024-09-12T17:42:03.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.585+0000 7f330fbcc780 1 < completed multipart upload key=9IYALJED5G85 upload=01Q34HF6VVGI tag=YV2WEP0MWVVZ type=write size=3982600 2024-09-12T17:42:03.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.586+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=O1ILRZ351CBM type=del size=4057558 2024-09-12T17:42:03.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.588+0000 7f330fbcc780 1 < suggested remove operation key=AL3ESPG15NO4 tag=MOEB102HA9WH type=del 2024-09-12T17:42:03.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.591+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.0 size=1048576 2024-09-12T17:42:03.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.592+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.1 size=1048576 2024-09-12T17:42:03.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.593+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.2 size=239477 2024-09-12T17:42:03.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.593+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=IWS3OSJ7Q1P7 tag=FGVWEKZJNUJ1 type=write size=3385205 2024-09-12T17:42:03.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.594+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~Q5UYRQ4Y4O3X.0 size=359962 2024-09-12T17:42:03.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.596+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=Q5UYRQ4Y4O3X tag=0KFD9ZCC1QIY type=write size=1408538 2024-09-12T17:42:03.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.598+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~0DK5BJPUX7Y1.0 size=1048576 2024-09-12T17:42:03.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.599+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~0DK5BJPUX7Y1.1 size=406478 2024-09-12T17:42:03.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.599+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=0DK5BJPUX7Y1 tag=XXNUGU0G1TQN type=write size=2503630 2024-09-12T17:42:03.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.600+0000 7f330fbcc780 1 < completed write operation key=7TBNLJDCL4YB tag=L1YJD8I9HI5E type=write size=509783 2024-09-12T17:42:03.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.602+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~0CBWWLSESF7X.0 size=185131 2024-09-12T17:42:03.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.602+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=0CBWWLSESF7X tag=DX6YNKWTDLTH type=write size=1233707 2024-09-12T17:42:03.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.604+0000 7f330fbcc780 1 < completed delete operation key=HJL73WQD8SD2 tag=2131GS0ML7YQ type=del 2024-09-12T17:42:03.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.605+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=QOBJS8BB8K90 type=write size=919323 2024-09-12T17:42:03.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.606+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~FOOZ5Y61K9QE.0 size=1048576 2024-09-12T17:42:03.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.606+0000 7f330fbcc780 1 < canceled part key=_multipart_MQV01X5P8JLG.2~FOOZ5Y61K9QE.1 size=657214 2024-09-12T17:42:03.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.608+0000 7f330fbcc780 1 < canceled multipart upload key=MQV01X5P8JLG upload=FOOZ5Y61K9QE tag=3FY1KQZLRKTE type=write size=2754366 2024-09-12T17:42:03.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.610+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=IAWEUFDQTM2E type=del size=3064989 2024-09-12T17:42:03.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.611+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=W2OHLETC3NCI type=del 2024-09-12T17:42:03.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.612+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=UH12N4X8PK7P type=del size=1031040 2024-09-12T17:42:03.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.613+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=FV3B00GF941K type=del 2024-09-12T17:42:03.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.614+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=O3FC4Q2QSNUC type=del size=3660706 2024-09-12T17:42:03.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.616+0000 7f330fbcc780 1 < completed part key=_multipart_AGM33OK1W7A6.2~PKRLEBYJX9K9.0 size=470113 2024-09-12T17:42:03.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.617+0000 7f330fbcc780 1 < completed multipart upload key=AGM33OK1W7A6 upload=PKRLEBYJX9K9 tag=8CXMG2PCALLP type=write size=1518689 2024-09-12T17:42:03.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.619+0000 7f330fbcc780 1 > prepared part key=_multipart_FY2BXMZBVMDL.2~33HV3Z8ZUZ6G.0 size=461854 2024-09-12T17:42:03.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.619+0000 7f330fbcc780 1 > prepared multipart upload key=FY2BXMZBVMDL upload=33HV3Z8ZUZ6G tag=3S2OEXEBVGEB type=write size=1510430 2024-09-12T17:42:03.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.621+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.0 size=1048576 2024-09-12T17:42:03.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.621+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.1 size=1048576 2024-09-12T17:42:03.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.622+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~T10XCQ0JK72R.2 size=611031 2024-09-12T17:42:03.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.624+0000 7f330fbcc780 1 < completed multipart upload key=HJL73WQD8SD2 upload=T10XCQ0JK72R tag=3CPMNL1YQ2NF type=write size=3756759 2024-09-12T17:42:03.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.626+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=BDRIN9MOG4LL type=del size=738596 2024-09-12T17:42:03.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.627+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.0 size=1048576 2024-09-12T17:42:03.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.628+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.1 size=1048576 2024-09-12T17:42:03.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.629+0000 7f330fbcc780 1 < completed part key=_multipart_QE2QJH2J5QDY.2~WS1AD8VELWTT.2 size=309401 2024-09-12T17:42:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.631+0000 7f330fbcc780 1 < completed multipart upload key=QE2QJH2J5QDY upload=WS1AD8VELWTT tag=FCKOW07XMO63 type=write size=3455129 2024-09-12T17:42:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.632+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=2I7VNLV31USD type=write size=173656 2024-09-12T17:42:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.633+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=1P5OGD9N40XQ type=del 2024-09-12T17:42:03.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.635+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.0 size=1048576 2024-09-12T17:42:03.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.636+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.1 size=1048576 2024-09-12T17:42:03.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.637+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.2 size=935962 2024-09-12T17:42:03.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.637+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=B3CJVDUDK51N tag=ZSXEH2OJVA28 type=write size=4081690 2024-09-12T17:42:03.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.639+0000 7f330fbcc780 1 < completed write operation key=D5ZZ93XAPRAA tag=H59RKX2ZM049 type=write size=55627 2024-09-12T17:42:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.640+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=Y29BJFY2K8FK type=del size=3084069 2024-09-12T17:42:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.640+0000 7f330fbcc780 1 < canceled part key=_multipart_LF4NGY13WYHK.2~6O4DDIAXG02I.0 size=1048576 2024-09-12T17:42:03.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.641+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~6O4DDIAXG02I.1 size=1032414 2024-09-12T17:42:03.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.643+0000 7f330fbcc780 1 < canceled multipart upload key=LF4NGY13WYHK upload=6O4DDIAXG02I tag=KIVX0BHLX2DZ type=write size=3129566 2024-09-12T17:42:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.644+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=J7C2M7Y1O4EB type=del size=1682055 2024-09-12T17:42:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.645+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=FSVUGNYWYAFH type=del 2024-09-12T17:42:03.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.647+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=KQD6H76RJN7Y type=del size=4029036 2024-09-12T17:42:03.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.648+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~C3J44IDZYC9X.0 size=1048576 2024-09-12T17:42:03.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.649+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~C3J44IDZYC9X.1 size=106052 2024-09-12T17:42:03.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.651+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=C3J44IDZYC9X tag=IJBY7R59PT53 type=write size=2203204 2024-09-12T17:42:03.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.652+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=7F9L76QD4JZN type=del size=214661 2024-09-12T17:42:03.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.653+0000 7f330fbcc780 1 < completed delete operation key=D5ZZ93XAPRAA tag=O1ILRZ351CBM type=del 2024-09-12T17:42:03.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.655+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~SRCFM72A9KJJ.0 size=459757 2024-09-12T17:42:03.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.655+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=SRCFM72A9KJJ tag=CXQ96B6T5GQ6 type=write size=1508333 2024-09-12T17:42:03.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.657+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.0 size=1048576 2024-09-12T17:42:03.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.658+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.1 size=1048576 2024-09-12T17:42:03.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.659+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~IWS3OSJ7Q1P7.2 size=239477 2024-09-12T17:42:03.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.661+0000 7f330fbcc780 1 < completed multipart upload key=5QBSRDY0LJ60 upload=IWS3OSJ7Q1P7 tag=FGVWEKZJNUJ1 type=write size=3385205 2024-09-12T17:42:03.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.662+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=2V3CJU8LHADO type=del size=563176 2024-09-12T17:42:03.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.663+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~0DK5BJPUX7Y1.0 size=1048576 2024-09-12T17:42:03.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.664+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~0DK5BJPUX7Y1.1 size=406478 2024-09-12T17:42:03.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.666+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=0DK5BJPUX7Y1 tag=XXNUGU0G1TQN type=write size=2503630 2024-09-12T17:42:03.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.667+0000 7f330fbcc780 1 > prepared operation key=D5ZZ93XAPRAA tag=07T76AZQA3TF type=del size=1241728 2024-09-12T17:42:03.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.667+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~0CBWWLSESF7X.0 size=185131 2024-09-12T17:42:03.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.669+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=0CBWWLSESF7X tag=DX6YNKWTDLTH type=write size=1233707 2024-09-12T17:42:03.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.670+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=G4LTA754P1XP type=write size=110705 2024-09-12T17:42:03.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.672+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=QOBJS8BB8K90 type=write size=919323 2024-09-12T17:42:03.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.673+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=S94KKTQSLVEX type=del size=824827 2024-09-12T17:42:03.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.674+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=IAWEUFDQTM2E type=del 2024-09-12T17:42:03.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.675+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=PHTCBEOSH5W6 type=del size=2788592 2024-09-12T17:42:03.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.676+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=UH12N4X8PK7P type=del 2024-09-12T17:42:03.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.678+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=BCDVUN1MNSNQ type=del size=847973 2024-09-12T17:42:03.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.680+0000 7f330fbcc780 1 < suggested remove operation key=7TBNLJDCL4YB tag=O3FC4Q2QSNUC type=del 2024-09-12T17:42:03.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.681+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=E3G44LOW3NFS type=del size=3291767 2024-09-12T17:42:03.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.682+0000 7f330fbcc780 1 < completed part key=_multipart_FY2BXMZBVMDL.2~33HV3Z8ZUZ6G.0 size=461854 2024-09-12T17:42:03.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.887+0000 7f330fbcc780 1 < completed multipart upload key=FY2BXMZBVMDL upload=33HV3Z8ZUZ6G tag=3S2OEXEBVGEB type=write size=1510430 2024-09-12T17:42:03.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.888+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=OWGFSYL7134O type=del size=2760890 2024-09-12T17:42:03.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.890+0000 7f330fbcc780 1 < completed delete operation key=9IYALJED5G85 tag=BDRIN9MOG4LL type=del 2024-09-12T17:42:03.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.891+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=FKTQ2TDNXM00 type=write size=47220 2024-09-12T17:42:03.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.893+0000 7f330fbcc780 1 < completed write operation key=HJL73WQD8SD2 tag=2I7VNLV31USD type=write size=173656 2024-09-12T17:42:03.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.895+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~K4ISCCMTHRN9.0 size=451067 2024-09-12T17:42:03.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.895+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=K4ISCCMTHRN9 tag=I5FC01C507E0 type=write size=1499643 2024-09-12T17:42:03.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.897+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.0 size=1048576 2024-09-12T17:42:03.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.898+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.1 size=1048576 2024-09-12T17:42:03.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.899+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~B3CJVDUDK51N.2 size=935962 2024-09-12T17:42:03.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.901+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=B3CJVDUDK51N tag=ZSXEH2OJVA28 type=write size=4081690 2024-09-12T17:42:03.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.903+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=D38KN3OYFL5A type=del size=1219312 2024-09-12T17:42:03.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.904+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=Y29BJFY2K8FK type=del 2024-09-12T17:42:03.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.906+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=9R91700D2EKH type=del size=3978520 2024-09-12T17:42:03.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.908+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=J7C2M7Y1O4EB type=del size=1682055 2024-09-12T17:42:03.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.911+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~AT4SKTPSMHV5.0 size=265153 2024-09-12T17:42:03.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.911+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=AT4SKTPSMHV5 tag=N4T2VZY10OBW type=write size=1313729 2024-09-12T17:42:03.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.913+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=KQD6H76RJN7Y type=del 2024-09-12T17:42:03.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.914+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=W2VQHGW0DERU type=write size=590833 2024-09-12T17:42:03.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.916+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=7F9L76QD4JZN type=del 2024-09-12T17:42:03.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.918+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~NL86B3RPF6GU.0 size=1048576 2024-09-12T17:42:03.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.919+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~NL86B3RPF6GU.1 size=820162 2024-09-12T17:42:03.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.919+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=NL86B3RPF6GU tag=ZKN6VDD1AMZV type=write size=2917314 2024-09-12T17:42:03.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.921+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~SRCFM72A9KJJ.0 size=459757 2024-09-12T17:42:03.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.923+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=SRCFM72A9KJJ tag=CXQ96B6T5GQ6 type=write size=1508333 2024-09-12T17:42:03.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.925+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~2DFER3F56TF1.0 size=1048576 2024-09-12T17:42:03.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.926+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~2DFER3F56TF1.1 size=733677 2024-09-12T17:42:03.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.926+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=2DFER3F56TF1 tag=3FA1D1LQOLH8 type=write size=2830829 2024-09-12T17:42:03.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.931+0000 7f330fbcc780 1 < suggested remove operation key=50WR6KLF40W7 tag=2V3CJU8LHADO type=del 2024-09-12T17:42:03.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.932+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=CMJ5DGZFALKJ type=del size=189819 2024-09-12T17:42:03.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.935+0000 7f330fbcc780 1 < suggested update operation key=D5ZZ93XAPRAA tag=07T76AZQA3TF type=del size=1241728 2024-09-12T17:42:03.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.936+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=C6Z1HSUSXT4P type=del size=54553 2024-09-12T17:42:03.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.938+0000 7f330fbcc780 1 < suggested update operation key=3BU8T85GXCX4 tag=G4LTA754P1XP type=write size=110705 2024-09-12T17:42:03.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.940+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=K4YNQRYS1BTW type=write size=393522 2024-09-12T17:42:03.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.941+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=S94KKTQSLVEX type=del 2024-09-12T17:42:03.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.942+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=MYYN3KRY08B1 type=write size=45986 2024-09-12T17:42:03.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.944+0000 7f330fbcc780 1 < completed delete operation key=4KNGMX117Z7G tag=PHTCBEOSH5W6 type=del 2024-09-12T17:42:03.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.946+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.0 size=1048576 2024-09-12T17:42:03.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.947+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.1 size=1048576 2024-09-12T17:42:03.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.948+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.2 size=571424 2024-09-12T17:42:03.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.948+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=WOGYM25ZD4BT tag=G3X7004PQVXQ type=write size=3717152 2024-09-12T17:42:03.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.949+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=BCDVUN1MNSNQ type=del 2024-09-12T17:42:03.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.952+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.0 size=1048576 2024-09-12T17:42:03.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.953+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.1 size=1048576 2024-09-12T17:42:03.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.954+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.2 size=700713 2024-09-12T17:42:03.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.954+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=XZLNFPUBZCTY tag=WTE3B04G11QE type=write size=3846441 2024-09-12T17:42:03.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.955+0000 7f330fbcc780 -1 < failed to complete operation key=50WR6KLF40W7 tag=E3G44LOW3NFS type=del size=3291767: (22) Invalid argument 2024-09-12T17:42:03.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.957+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=FLZUU0DOOJ5A type=write size=846933 2024-09-12T17:42:03.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.957+0000 7f330fbcc780 -1 < no bi entry to suggest for operation key=50WR6KLF40W7 tag=OWGFSYL7134O type=del size=2760890: (2) No such file or directory 2024-09-12T17:42:03.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.958+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=7NAQDDXQD2SO type=del size=3715408 2024-09-12T17:42:03.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.959+0000 7f330fbcc780 -1 < failed to complete operation key=7TBNLJDCL4YB tag=FKTQ2TDNXM00 type=write size=47220: (22) Invalid argument 2024-09-12T17:42:03.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.962+0000 7f330fbcc780 1 > prepared part key=_multipart_6HBW7077B3MS.2~UFO3THU8XGPO.0 size=311345 2024-09-12T17:42:03.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.962+0000 7f330fbcc780 1 > prepared multipart upload key=6HBW7077B3MS upload=UFO3THU8XGPO tag=9OPYZ3RMM5BX type=write size=1359921 2024-09-12T17:42:03.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.963+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~K4ISCCMTHRN9.0 size=451067 2024-09-12T17:42:03.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.965+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=K4ISCCMTHRN9 tag=I5FC01C507E0 type=write size=1499643 2024-09-12T17:42:03.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.968+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.0 size=1048576 2024-09-12T17:42:03.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.969+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.1 size=1048576 2024-09-12T17:42:03.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.970+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.2 size=571212 2024-09-12T17:42:03.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.970+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=GLJYI28OVKCW tag=JGJDWB54BE5W type=write size=3716940 2024-09-12T17:42:03.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.971+0000 7f330fbcc780 1 < canceled operation key=9IYALJED5G85 tag=D38KN3OYFL5A type=del size=1219312 2024-09-12T17:42:03.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.972+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=W09912E698W6 type=del size=1484111 2024-09-12T17:42:03.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.973+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=9R91700D2EKH type=del 2024-09-12T17:42:03.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.976+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~2JOG1VYTSCKJ.0 size=1048576 2024-09-12T17:42:03.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.976+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~2JOG1VYTSCKJ.1 size=10367 2024-09-12T17:42:03.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.976+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=2JOG1VYTSCKJ tag=BFIPHP68JXHU type=write size=2107519 2024-09-12T17:42:03.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.978+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~AT4SKTPSMHV5.0 size=265153 2024-09-12T17:42:03.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.980+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=AT4SKTPSMHV5 tag=N4T2VZY10OBW type=write size=1313729 2024-09-12T17:42:03.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.982+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.0 size=1048576 2024-09-12T17:42:03.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.983+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.1 size=1048576 2024-09-12T17:42:03.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.984+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.2 size=257231 2024-09-12T17:42:03.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.984+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=D7DUIKBIJ150 tag=WREH0VFN05OD type=write size=3402959 2024-09-12T17:42:03.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.985+0000 7f330fbcc780 1 < completed write operation key=6MFVO30OX5W1 tag=W2VQHGW0DERU type=write size=590833 2024-09-12T17:42:03.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.986+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=MXQ1DJ00VHHE type=del size=3001461 2024-09-12T17:42:03.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.987+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~NL86B3RPF6GU.0 size=1048576 2024-09-12T17:42:03.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.988+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~NL86B3RPF6GU.1 size=820162 2024-09-12T17:42:03.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.990+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=NL86B3RPF6GU tag=ZKN6VDD1AMZV type=write size=2917314 2024-09-12T17:42:03.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.991+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=NQEN059USBKU type=del size=3254441 2024-09-12T17:42:03.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.993+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~2DFER3F56TF1.0 size=1048576 2024-09-12T17:42:03.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.994+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~2DFER3F56TF1.1 size=733677 2024-09-12T17:42:03.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.996+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=2DFER3F56TF1 tag=3FA1D1LQOLH8 type=write size=2830829 2024-09-12T17:42:03.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.998+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~M25APD2Z26O8.0 size=1048576 2024-09-12T17:42:03.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.999+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~M25APD2Z26O8.1 size=37869 2024-09-12T17:42:04.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:03.999+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=M25APD2Z26O8 tag=9LU08O2WOHNO type=write size=2135021 2024-09-12T17:42:04.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.000+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=CMJ5DGZFALKJ type=del 2024-09-12T17:42:04.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.001+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=ZIPCQ9UNQUC7 type=del size=2664707 2024-09-12T17:42:04.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.002+0000 7f330fbcc780 1 < completed delete operation key=IEYJS7X97O1A tag=C6Z1HSUSXT4P type=del 2024-09-12T17:42:04.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.003+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=2A5L8O2GDYEW type=write size=753350 2024-09-12T17:42:04.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.005+0000 7f330fbcc780 1 < completed write operation key=MQV01X5P8JLG tag=K4YNQRYS1BTW type=write size=393522 2024-09-12T17:42:04.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.006+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=0NKT4MERVOYA type=del size=1587838 2024-09-12T17:42:04.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.008+0000 7f330fbcc780 1 < suggested update operation key=6HBW7077B3MS tag=MYYN3KRY08B1 type=write size=45986 2024-09-12T17:42:04.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.010+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.0 size=1048576 2024-09-12T17:42:04.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.011+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.1 size=1048576 2024-09-12T17:42:04.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.012+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.2 size=852419 2024-09-12T17:42:04.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.012+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=AK81E8B94LB6 tag=QNU1Q18KNVD5 type=write size=3998147 2024-09-12T17:42:04.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.013+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.0 size=1048576 2024-09-12T17:42:04.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.014+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.1 size=1048576 2024-09-12T17:42:04.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.015+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~WOGYM25ZD4BT.2 size=571424 2024-09-12T17:42:04.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.017+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=WOGYM25ZD4BT tag=G3X7004PQVXQ type=write size=3717152 2024-09-12T17:42:04.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.018+0000 7f330fbcc780 1 > prepared operation key=2CY67P4QM19H tag=HPTOR92LZWK7 type=del size=3318101 2024-09-12T17:42:04.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.019+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.0 size=1048576 2024-09-12T17:42:04.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.020+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.1 size=1048576 2024-09-12T17:42:04.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.020+0000 7f330fbcc780 1 < canceled part key=_multipart_50WR6KLF40W7.2~XZLNFPUBZCTY.2 size=700713 2024-09-12T17:42:04.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.022+0000 7f330fbcc780 1 < canceled multipart upload key=50WR6KLF40W7 upload=XZLNFPUBZCTY tag=WTE3B04G11QE type=write size=3846441 2024-09-12T17:42:04.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.023+0000 7f330fbcc780 1 > prepared operation key=SPKBX4WU9A9R tag=DM1T5RAEUOUK type=del size=4176442 2024-09-12T17:42:04.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.024+0000 7f330fbcc780 -1 < failed to complete operation key=6HBW7077B3MS tag=FLZUU0DOOJ5A type=write size=846933: (22) Invalid argument 2024-09-12T17:42:04.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.025+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=EQYGZIW5ARMQ type=del size=165944 2024-09-12T17:42:04.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.027+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=7NAQDDXQD2SO type=del 2024-09-12T17:42:04.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.029+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.0 size=1048576 2024-09-12T17:42:04.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.030+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.1 size=1048576 2024-09-12T17:42:04.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.031+0000 7f330fbcc780 1 > prepared part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.2 size=601411 2024-09-12T17:42:04.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.031+0000 7f330fbcc780 1 > prepared multipart upload key=1MJ2W1WMLR85 upload=R4ZTLHK8JPUQ tag=1URH240MWHS4 type=write size=3747139 2024-09-12T17:42:04.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.032+0000 7f330fbcc780 1 < completed part key=_multipart_6HBW7077B3MS.2~UFO3THU8XGPO.0 size=311345 2024-09-12T17:42:04.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.034+0000 7f330fbcc780 1 < completed multipart upload key=6HBW7077B3MS upload=UFO3THU8XGPO tag=9OPYZ3RMM5BX type=write size=1359921 2024-09-12T17:42:04.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.036+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=NI33SH4UFLCC type=del size=3444837 2024-09-12T17:42:04.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.037+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.0 size=1048576 2024-09-12T17:42:04.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.038+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.1 size=1048576 2024-09-12T17:42:04.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.039+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~GLJYI28OVKCW.2 size=571212 2024-09-12T17:42:04.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.040+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=GLJYI28OVKCW tag=JGJDWB54BE5W type=write size=3716940 2024-09-12T17:42:04.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.041+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=2749W7MZ5A97 type=write size=292891 2024-09-12T17:42:04.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.044+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=W09912E698W6 type=del 2024-09-12T17:42:04.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.046+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.0 size=1048576 2024-09-12T17:42:04.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.047+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.1 size=1048576 2024-09-12T17:42:04.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.048+0000 7f330fbcc780 1 > prepared part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.2 size=367307 2024-09-12T17:42:04.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.048+0000 7f330fbcc780 1 > prepared multipart upload key=50WR6KLF40W7 upload=GBQFP71BC5VS tag=4MB6QMGD9MU1 type=write size=3513035 2024-09-12T17:42:04.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.049+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~2JOG1VYTSCKJ.0 size=1048576 2024-09-12T17:42:04.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.050+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~2JOG1VYTSCKJ.1 size=10367 2024-09-12T17:42:04.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.053+0000 7f330fbcc780 1 < completed multipart upload key=H1LAU7WDZW6S upload=2JOG1VYTSCKJ tag=BFIPHP68JXHU type=write size=2107519 2024-09-12T17:42:04.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.054+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=9E3Y43Y99I32 type=del size=2072057 2024-09-12T17:42:04.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.055+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.0 size=1048576 2024-09-12T17:42:04.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.055+0000 7f330fbcc780 1 < canceled part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.1 size=1048576 2024-09-12T17:42:04.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.056+0000 7f330fbcc780 1 < completed part key=_multipart_HJL73WQD8SD2.2~D7DUIKBIJ150.2 size=257231 2024-09-12T17:42:04.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.058+0000 7f330fbcc780 1 < canceled multipart upload key=HJL73WQD8SD2 upload=D7DUIKBIJ150 tag=WREH0VFN05OD type=write size=3402959 2024-09-12T17:42:04.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.061+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~NS5QBE5DJ4EA.0 size=963366 2024-09-12T17:42:04.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.061+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=NS5QBE5DJ4EA tag=HXL7PDQLGQ3M type=write size=2011942 2024-09-12T17:42:04.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.062+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=MXQ1DJ00VHHE type=del 2024-09-12T17:42:04.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.064+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.0 size=1048576 2024-09-12T17:42:04.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.065+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.1 size=1048576 2024-09-12T17:42:04.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.066+0000 7f330fbcc780 1 > prepared part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.2 size=292420 2024-09-12T17:42:04.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.066+0000 7f330fbcc780 1 > prepared multipart upload key=30CIXFQV5VBI upload=KM4P19EX6QK6 tag=V0843MAMC56Q type=write size=3438148 2024-09-12T17:42:04.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.068+0000 7f330fbcc780 1 < canceled operation key=6MFVO30OX5W1 tag=NQEN059USBKU type=del size=3254441 2024-09-12T17:42:04.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.069+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=MJO82UG2NB69 type=del size=2594953 2024-09-12T17:42:04.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.070+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~M25APD2Z26O8.0 size=1048576 2024-09-12T17:42:04.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.071+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~M25APD2Z26O8.1 size=37869 2024-09-12T17:42:04.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.073+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=M25APD2Z26O8 tag=9LU08O2WOHNO type=write size=2135021 2024-09-12T17:42:04.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.076+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~670PBS69FJHS.0 size=1048576 2024-09-12T17:42:04.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.077+0000 7f330fbcc780 1 > prepared part key=_multipart_5QBSRDY0LJ60.2~670PBS69FJHS.1 size=745695 2024-09-12T17:42:04.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.077+0000 7f330fbcc780 1 > prepared multipart upload key=5QBSRDY0LJ60 upload=670PBS69FJHS tag=UMX6WILP5D4W type=write size=2842847 2024-09-12T17:42:04.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.078+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=ZIPCQ9UNQUC7 type=del 2024-09-12T17:42:04.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.079+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=V1W6393988ZB type=del size=1022921 2024-09-12T17:42:04.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.080+0000 7f330fbcc780 1 < completed write operation key=4KNGMX117Z7G tag=2A5L8O2GDYEW type=write size=753350 2024-09-12T17:42:04.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.081+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=LYLOGJBFOVMP type=del size=2496180 2024-09-12T17:42:04.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.082+0000 7f330fbcc780 1 < completed delete operation key=MQV01X5P8JLG tag=0NKT4MERVOYA type=del 2024-09-12T17:42:04.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.084+0000 7f330fbcc780 1 > prepared part key=_multipart_4KNGMX117Z7G.2~3Q00LMG9LIXJ.0 size=910441 2024-09-12T17:42:04.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.084+0000 7f330fbcc780 1 > prepared multipart upload key=4KNGMX117Z7G upload=3Q00LMG9LIXJ tag=F3PFNSVLGNUA type=write size=1959017 2024-09-12T17:42:04.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.085+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.0 size=1048576 2024-09-12T17:42:04.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.086+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.1 size=1048576 2024-09-12T17:42:04.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.087+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~AK81E8B94LB6.2 size=852419 2024-09-12T17:42:04.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.089+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=AK81E8B94LB6 tag=QNU1Q18KNVD5 type=write size=3998147 2024-09-12T17:42:04.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.090+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=1MF0I21ZCZV5 type=del size=4078921 2024-09-12T17:42:04.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.091+0000 7f330fbcc780 1 < completed delete operation key=2CY67P4QM19H tag=HPTOR92LZWK7 type=del 2024-09-12T17:42:04.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.093+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~UI5HSNPFMK0X.0 size=687778 2024-09-12T17:42:04.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.094+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=UI5HSNPFMK0X tag=F1QEJ6AHYPX7 type=write size=1736354 2024-09-12T17:42:04.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.096+0000 7f330fbcc780 1 < suggested update operation key=SPKBX4WU9A9R tag=DM1T5RAEUOUK type=del size=4176442 2024-09-12T17:42:04.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.097+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=MP581ZUNJ7W4 type=del size=3331679 2024-09-12T17:42:04.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.099+0000 7f330fbcc780 1 < suggested remove operation key=6ZDBF249S1L6 tag=EQYGZIW5ARMQ type=del 2024-09-12T17:42:04.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.100+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=P4CUOX3R30BJ type=del size=2277423 2024-09-12T17:42:04.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.100+0000 7f330fbcc780 1 < canceled part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.0 size=1048576 2024-09-12T17:42:04.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.101+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.1 size=1048576 2024-09-12T17:42:04.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.102+0000 7f330fbcc780 1 < completed part key=_multipart_1MJ2W1WMLR85.2~R4ZTLHK8JPUQ.2 size=601411 2024-09-12T17:42:04.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.104+0000 7f330fbcc780 1 < canceled multipart upload key=1MJ2W1WMLR85 upload=R4ZTLHK8JPUQ tag=1URH240MWHS4 type=write size=3747139 2024-09-12T17:42:04.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.105+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=MJO33YI1DA1S type=del size=3722924 2024-09-12T17:42:04.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.106+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=NI33SH4UFLCC type=del 2024-09-12T17:42:04.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.108+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=RBWRRWZW2MTL type=del size=366830 2024-09-12T17:42:04.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.109+0000 7f330fbcc780 1 < canceled operation key=LNE0UR6JPWR8 tag=2749W7MZ5A97 type=write size=292891 2024-09-12T17:42:04.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.111+0000 7f330fbcc780 1 > prepared part key=_multipart_LF4NGY13WYHK.2~VYUGR9MKIN9E.0 size=984675 2024-09-12T17:42:04.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.111+0000 7f330fbcc780 1 > prepared multipart upload key=LF4NGY13WYHK upload=VYUGR9MKIN9E tag=EEZWD9IGAT2H type=write size=2033251 2024-09-12T17:42:04.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.112+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.0 size=1048576 2024-09-12T17:42:04.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.113+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.1 size=1048576 2024-09-12T17:42:04.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.114+0000 7f330fbcc780 1 < completed part key=_multipart_50WR6KLF40W7.2~GBQFP71BC5VS.2 size=367307 2024-09-12T17:42:04.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.116+0000 7f330fbcc780 1 < completed multipart upload key=50WR6KLF40W7 upload=GBQFP71BC5VS tag=4MB6QMGD9MU1 type=write size=3513035 2024-09-12T17:42:04.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.117+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=IGGCMH70ZZMN type=del size=2270491 2024-09-12T17:42:04.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.118+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=9E3Y43Y99I32 type=del 2024-09-12T17:42:04.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.120+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~4FE2Y7S1FE45.0 size=1048576 2024-09-12T17:42:04.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.121+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~4FE2Y7S1FE45.1 size=191071 2024-09-12T17:42:04.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.121+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=4FE2Y7S1FE45 tag=BNS19HIL7BKD type=write size=2288223 2024-09-12T17:42:04.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.122+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~NS5QBE5DJ4EA.0 size=963366 2024-09-12T17:42:04.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.124+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=NS5QBE5DJ4EA tag=HXL7PDQLGQ3M type=write size=2011942 2024-09-12T17:42:04.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.125+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=S8IH96EFYJTE type=del size=403985 2024-09-12T17:42:04.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.126+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.0 size=1048576 2024-09-12T17:42:04.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.127+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.1 size=1048576 2024-09-12T17:42:04.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.128+0000 7f330fbcc780 1 < completed part key=_multipart_30CIXFQV5VBI.2~KM4P19EX6QK6.2 size=292420 2024-09-12T17:42:04.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.130+0000 7f330fbcc780 1 < completed multipart upload key=30CIXFQV5VBI upload=KM4P19EX6QK6 tag=V0843MAMC56Q type=write size=3438148 2024-09-12T17:42:04.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.131+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=NJFLXMQ9KQVJ type=del size=792088 2024-09-12T17:42:04.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.132+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=MJO82UG2NB69 type=del 2024-09-12T17:42:04.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.133+0000 7f330fbcc780 1 > prepared operation key=MQV01X5P8JLG tag=F1VXG9D9VDJT type=del size=1307056 2024-09-12T17:42:04.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.134+0000 7f330fbcc780 1 < completed part key=_multipart_5QBSRDY0LJ60.2~670PBS69FJHS.0 size=1048576 2024-09-12T17:42:04.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.134+0000 7f330fbcc780 1 < canceled part key=_multipart_5QBSRDY0LJ60.2~670PBS69FJHS.1 size=745695 2024-09-12T17:42:04.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.136+0000 7f330fbcc780 1 < canceled multipart upload key=5QBSRDY0LJ60 upload=670PBS69FJHS tag=UMX6WILP5D4W type=write size=2842847 2024-09-12T17:42:04.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.137+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=TRZ7JF6OV1WC type=del size=2412269 2024-09-12T17:42:04.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.138+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=V1W6393988ZB type=del 2024-09-12T17:42:04.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.140+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~PEM4TVWJMKQ0.0 size=1048576 2024-09-12T17:42:04.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.141+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~PEM4TVWJMKQ0.1 size=660349 2024-09-12T17:42:04.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.141+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=PEM4TVWJMKQ0 tag=XJ9HRYEI117K type=write size=2757501 2024-09-12T17:42:04.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.142+0000 7f330fbcc780 1 < canceled operation key=9IYALJED5G85 tag=LYLOGJBFOVMP type=del size=2496180 2024-09-12T17:42:04.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.144+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.0 size=1048576 2024-09-12T17:42:04.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.145+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.1 size=1048576 2024-09-12T17:42:04.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.146+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.2 size=385032 2024-09-12T17:42:04.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.146+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=CELZP1AK655V tag=BQV2QGIO1VYY type=write size=3530760 2024-09-12T17:42:04.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.147+0000 7f330fbcc780 1 < completed part key=_multipart_4KNGMX117Z7G.2~3Q00LMG9LIXJ.0 size=910441 2024-09-12T17:42:04.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.149+0000 7f330fbcc780 1 < completed multipart upload key=4KNGMX117Z7G upload=3Q00LMG9LIXJ tag=F3PFNSVLGNUA type=write size=1959017 2024-09-12T17:42:04.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.152+0000 7f330fbcc780 1 > prepared part key=_multipart_IEL4VF8ROC72.2~OLA0LEUOFLUC.0 size=48057 2024-09-12T17:42:04.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.152+0000 7f330fbcc780 1 > prepared multipart upload key=IEL4VF8ROC72 upload=OLA0LEUOFLUC tag=ATW53865XY16 type=write size=1096633 2024-09-12T17:42:04.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.153+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=1MF0I21ZCZV5 type=del 2024-09-12T17:42:04.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.155+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=FLTQT48ZVBIP type=del size=2680676 2024-09-12T17:42:04.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.156+0000 7f330fbcc780 1 < completed part key=_multipart_TKJOJ17LIWX6.2~UI5HSNPFMK0X.0 size=687778 2024-09-12T17:42:04.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.158+0000 7f330fbcc780 1 < completed multipart upload key=TKJOJ17LIWX6 upload=UI5HSNPFMK0X tag=F1QEJ6AHYPX7 type=write size=1736354 2024-09-12T17:42:04.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.159+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=CJ8SG62ZDGON type=del size=2626736 2024-09-12T17:42:04.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.160+0000 7f330fbcc780 1 < canceled operation key=ZEC2RXNOR3D1 tag=MP581ZUNJ7W4 type=del size=3331679 2024-09-12T17:42:04.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.162+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.0 size=1048576 2024-09-12T17:42:04.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.163+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.1 size=1048576 2024-09-12T17:42:04.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.164+0000 7f330fbcc780 1 > prepared part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.2 size=171448 2024-09-12T17:42:04.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.164+0000 7f330fbcc780 1 > prepared multipart upload key=XIW3OJB1STT9 upload=NK3N5LLZ9QD9 tag=ZRSSEVDKSY6G type=write size=3317176 2024-09-12T17:42:04.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.166+0000 7f330fbcc780 1 < suggested remove operation key=AGM33OK1W7A6 tag=P4CUOX3R30BJ type=del 2024-09-12T17:42:04.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.168+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.0 size=1048576 2024-09-12T17:42:04.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.169+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.1 size=1048576 2024-09-12T17:42:04.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.170+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.2 size=235010 2024-09-12T17:42:04.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.170+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=QTM2SXBBG0UG tag=OWWRFKPO8S8F type=write size=3380738 2024-09-12T17:42:04.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.171+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=MJO33YI1DA1S type=del 2024-09-12T17:42:04.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.172+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=OG7Q75XNPQ7J type=del size=884684 2024-09-12T17:42:04.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.173+0000 7f330fbcc780 1 < canceled operation key=50WR6KLF40W7 tag=RBWRRWZW2MTL type=del size=366830 2024-09-12T17:42:04.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.174+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=7AC594WA1Y2J type=del size=2561180 2024-09-12T17:42:04.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.176+0000 7f330fbcc780 1 < completed part key=_multipart_LF4NGY13WYHK.2~VYUGR9MKIN9E.0 size=984675 2024-09-12T17:42:04.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.177+0000 7f330fbcc780 1 < completed multipart upload key=LF4NGY13WYHK upload=VYUGR9MKIN9E tag=EEZWD9IGAT2H type=write size=2033251 2024-09-12T17:42:04.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.179+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~C8KT503IULWL.0 size=1048576 2024-09-12T17:42:04.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.180+0000 7f330fbcc780 1 > prepared part key=_multipart_9X4FNKQWJCX4.2~C8KT503IULWL.1 size=1045136 2024-09-12T17:42:04.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.180+0000 7f330fbcc780 1 > prepared multipart upload key=9X4FNKQWJCX4 upload=C8KT503IULWL tag=45OJM8ZXMNNW type=write size=3142288 2024-09-12T17:42:04.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.181+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=IGGCMH70ZZMN type=del 2024-09-12T17:42:04.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.183+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=RSO60UXPDISD type=del size=4126830 2024-09-12T17:42:04.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.184+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~4FE2Y7S1FE45.0 size=1048576 2024-09-12T17:42:04.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.185+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~4FE2Y7S1FE45.1 size=191071 2024-09-12T17:42:04.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.187+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=4FE2Y7S1FE45 tag=BNS19HIL7BKD type=write size=2288223 2024-09-12T17:42:04.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.188+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=KS2U84GSMR9I type=del size=2376599 2024-09-12T17:42:04.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.189+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=S8IH96EFYJTE type=del 2024-09-12T17:42:04.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.190+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=IQ53GP77DP68 type=del size=2341331 2024-09-12T17:42:04.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.191+0000 7f330fbcc780 1 < completed delete operation key=ZEC2RXNOR3D1 tag=NJFLXMQ9KQVJ type=del 2024-09-12T17:42:04.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.192+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=UY834XQHO4VK type=del size=350847 2024-09-12T17:42:04.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.195+0000 7f330fbcc780 1 < suggested update operation key=MQV01X5P8JLG tag=F1VXG9D9VDJT type=del size=1307056 2024-09-12T17:42:04.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.196+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=393PS3OYD9DG type=write size=812760 2024-09-12T17:42:04.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.197+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=TRZ7JF6OV1WC type=del 2024-09-12T17:42:04.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.199+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~JDAI877ONUPM.0 size=1048576 2024-09-12T17:42:04.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.200+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~JDAI877ONUPM.1 size=721332 2024-09-12T17:42:04.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.200+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=JDAI877ONUPM tag=17SYJP1PBBLD type=write size=2818484 2024-09-12T17:42:04.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.201+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~PEM4TVWJMKQ0.0 size=1048576 2024-09-12T17:42:04.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.202+0000 7f330fbcc780 1 < completed part key=_multipart_3BU8T85GXCX4.2~PEM4TVWJMKQ0.1 size=660349 2024-09-12T17:42:04.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.204+0000 7f330fbcc780 1 < completed multipart upload key=3BU8T85GXCX4 upload=PEM4TVWJMKQ0 tag=XJ9HRYEI117K type=write size=2757501 2024-09-12T17:42:04.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.205+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=BYOKMHOZOQ8F type=del size=3395335 2024-09-12T17:42:04.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.207+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.0 size=1048576 2024-09-12T17:42:04.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.208+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.1 size=1048576 2024-09-12T17:42:04.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.209+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~CELZP1AK655V.2 size=385032 2024-09-12T17:42:04.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.211+0000 7f330fbcc780 1 < completed multipart upload key=SPKBX4WU9A9R upload=CELZP1AK655V tag=BQV2QGIO1VYY type=write size=3530760 2024-09-12T17:42:04.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.212+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=EZCMD4O75AZE type=write size=752310 2024-09-12T17:42:04.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.213+0000 7f330fbcc780 1 < completed part key=_multipart_IEL4VF8ROC72.2~OLA0LEUOFLUC.0 size=48057 2024-09-12T17:42:04.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.215+0000 7f330fbcc780 1 < completed multipart upload key=IEL4VF8ROC72 upload=OLA0LEUOFLUC tag=ATW53865XY16 type=write size=1096633 2024-09-12T17:42:04.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.216+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=86C5RB06PYXB type=del size=3433618 2024-09-12T17:42:04.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.217+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=FLTQT48ZVBIP type=del 2024-09-12T17:42:04.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.218+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=3VAM53YNG322 type=del size=2016540 2024-09-12T17:42:04.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.220+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=CJ8SG62ZDGON type=del 2024-09-12T17:42:04.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.221+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=Z2R6PP8O77K8 type=del size=169082 2024-09-12T17:42:04.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.222+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.0 size=1048576 2024-09-12T17:42:04.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.223+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.1 size=1048576 2024-09-12T17:42:04.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.224+0000 7f330fbcc780 1 < completed part key=_multipart_XIW3OJB1STT9.2~NK3N5LLZ9QD9.2 size=171448 2024-09-12T17:42:04.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.226+0000 7f330fbcc780 1 < completed multipart upload key=XIW3OJB1STT9 upload=NK3N5LLZ9QD9 tag=ZRSSEVDKSY6G type=write size=3317176 2024-09-12T17:42:04.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.227+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=EA0AO6X3Q6KN type=del size=721346 2024-09-12T17:42:04.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.228+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.0 size=1048576 2024-09-12T17:42:04.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.229+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.1 size=1048576 2024-09-12T17:42:04.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.230+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~QTM2SXBBG0UG.2 size=235010 2024-09-12T17:42:04.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.232+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=QTM2SXBBG0UG tag=OWWRFKPO8S8F type=write size=3380738 2024-09-12T17:42:04.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.233+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=J63YP36404TV type=del size=2662432 2024-09-12T17:42:04.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.234+0000 7f330fbcc780 1 < completed delete operation key=1MJ2W1WMLR85 tag=OG7Q75XNPQ7J type=del 2024-09-12T17:42:04.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.236+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~4LQTMFAGRQOQ.0 size=1048576 2024-09-12T17:42:04.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.237+0000 7f330fbcc780 1 > prepared part key=_multipart_70COM4KLK2R1.2~4LQTMFAGRQOQ.1 size=440529 2024-09-12T17:42:04.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.237+0000 7f330fbcc780 1 > prepared multipart upload key=70COM4KLK2R1 upload=4LQTMFAGRQOQ tag=Q5PHPAANP26J type=write size=2537681 2024-09-12T17:42:04.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.238+0000 7f330fbcc780 1 < completed delete operation key=IEL4VF8ROC72 tag=7AC594WA1Y2J type=del 2024-09-12T17:42:04.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.240+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=AJOFWUOI1D91 type=del size=2537355 2024-09-12T17:42:04.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.241+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~C8KT503IULWL.0 size=1048576 2024-09-12T17:42:04.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.242+0000 7f330fbcc780 1 < completed part key=_multipart_9X4FNKQWJCX4.2~C8KT503IULWL.1 size=1045136 2024-09-12T17:42:04.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.243+0000 7f330fbcc780 1 < completed multipart upload key=9X4FNKQWJCX4 upload=C8KT503IULWL tag=45OJM8ZXMNNW type=write size=3142288 2024-09-12T17:42:04.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.245+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=F12FTCZ1V13D type=del size=1454261 2024-09-12T17:42:04.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.246+0000 7f330fbcc780 1 < completed delete operation key=7TBNLJDCL4YB tag=RSO60UXPDISD type=del 2024-09-12T17:42:04.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.247+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=1JDMC5D99FB2 type=write size=502721 2024-09-12T17:42:04.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.248+0000 7f330fbcc780 1 < completed delete operation key=XIW3OJB1STT9 tag=KS2U84GSMR9I type=del 2024-09-12T17:42:04.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.250+0000 7f330fbcc780 1 > prepared part key=_multipart_IEYJS7X97O1A.2~V1L9T97CR5T0.0 size=971090 2024-09-12T17:42:04.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.250+0000 7f330fbcc780 1 > prepared multipart upload key=IEYJS7X97O1A upload=V1L9T97CR5T0 tag=7MC253WWCVC7 type=write size=2019666 2024-09-12T17:42:04.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.252+0000 7f330fbcc780 1 < suggested update operation key=LNE0UR6JPWR8 tag=IQ53GP77DP68 type=del size=2341331 2024-09-12T17:42:04.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.253+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=KW5PG1TY5TDE type=del size=1430256 2024-09-12T17:42:04.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.255+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=UY834XQHO4VK type=del 2024-09-12T17:42:04.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.257+0000 7f330fbcc780 1 > prepared part key=_multipart_TKJOJ17LIWX6.2~1XCTT3XT9I4S.0 size=338567 2024-09-12T17:42:04.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.257+0000 7f330fbcc780 1 > prepared multipart upload key=TKJOJ17LIWX6 upload=1XCTT3XT9I4S tag=NQO7C1CE81NQ type=write size=1387143 2024-09-12T17:42:04.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.260+0000 7f330fbcc780 1 < completed write operation key=XIW3OJB1STT9 tag=393PS3OYD9DG type=write size=812760 2024-09-12T17:42:04.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.261+0000 7f330fbcc780 1 > prepared operation key=5QBSRDY0LJ60 tag=IMSXRE80TAJ0 type=del size=3233413 2024-09-12T17:42:04.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.262+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~JDAI877ONUPM.0 size=1048576 2024-09-12T17:42:04.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.263+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~JDAI877ONUPM.1 size=721332 2024-09-12T17:42:04.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.265+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=JDAI877ONUPM tag=17SYJP1PBBLD type=write size=2818484 2024-09-12T17:42:04.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.266+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=W80TUVOH1RZB type=del size=2894657 2024-09-12T17:42:04.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.267+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=BYOKMHOZOQ8F type=del 2024-09-12T17:42:04.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.269+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~0UASDCUX5DN3.0 size=1048576 2024-09-12T17:42:04.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.270+0000 7f330fbcc780 1 > prepared part key=_multipart_3IHGI1UMI1BA.2~0UASDCUX5DN3.1 size=670687 2024-09-12T17:42:04.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.270+0000 7f330fbcc780 1 > prepared multipart upload key=3IHGI1UMI1BA upload=0UASDCUX5DN3 tag=BO2NC20JQ74D type=write size=2767839 2024-09-12T17:42:04.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.271+0000 7f330fbcc780 1 < completed write operation key=70COM4KLK2R1 tag=EZCMD4O75AZE type=write size=752310 2024-09-12T17:42:04.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.272+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=GRV36YMNTWOB type=del size=1098323 2024-09-12T17:42:04.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.273+0000 7f330fbcc780 1 < completed delete operation key=70COM4KLK2R1 tag=86C5RB06PYXB type=del 2024-09-12T17:42:04.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.274+0000 7f330fbcc780 1 > prepared operation key=H1LAU7WDZW6S tag=9JCRUHQB3V5H type=del size=935491 2024-09-12T17:42:04.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.276+0000 7f330fbcc780 1 < suggested remove operation key=3BU8T85GXCX4 tag=3VAM53YNG322 type=del 2024-09-12T17:42:04.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.278+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.0 size=1048576 2024-09-12T17:42:04.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.279+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.1 size=1048576 2024-09-12T17:42:04.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.280+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.2 size=63349 2024-09-12T17:42:04.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.280+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=GAF7DDQ5JRDL tag=NX5NF8NZH7ZM type=write size=3209077 2024-09-12T17:42:04.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.281+0000 7f330fbcc780 1 < completed delete operation key=30CIXFQV5VBI tag=Z2R6PP8O77K8 type=del 2024-09-12T17:42:04.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.282+0000 7f330fbcc780 1 > prepared operation key=7TBNLJDCL4YB tag=P01GJ4RM2F6U type=del size=2575798 2024-09-12T17:42:04.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.283+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=EA0AO6X3Q6KN type=del 2024-09-12T17:42:04.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.285+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~6NFJJWT6ILJX.0 size=1048576 2024-09-12T17:42:04.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.286+0000 7f330fbcc780 1 > prepared part key=_multipart_8UX8W3FAJ3D9.2~6NFJJWT6ILJX.1 size=650531 2024-09-12T17:42:04.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.286+0000 7f330fbcc780 1 > prepared multipart upload key=8UX8W3FAJ3D9 upload=6NFJJWT6ILJX tag=MGGPF7HPNLCB type=write size=2747683 2024-09-12T17:42:04.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.287+0000 7f330fbcc780 1 < completed delete operation key=6ZDBF249S1L6 tag=J63YP36404TV type=del 2024-09-12T17:42:04.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.290+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~668X7RZDBT1T.0 size=1048576 2024-09-12T17:42:04.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.290+0000 7f330fbcc780 1 > prepared part key=_multipart_6ZDBF249S1L6.2~668X7RZDBT1T.1 size=559241 2024-09-12T17:42:04.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.290+0000 7f330fbcc780 1 > prepared multipart upload key=6ZDBF249S1L6 upload=668X7RZDBT1T tag=5NPO1LIC6EYN type=write size=2656393 2024-09-12T17:42:04.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.292+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~4LQTMFAGRQOQ.0 size=1048576 2024-09-12T17:42:04.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.292+0000 7f330fbcc780 1 < completed part key=_multipart_70COM4KLK2R1.2~4LQTMFAGRQOQ.1 size=440529 2024-09-12T17:42:04.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.294+0000 7f330fbcc780 1 < completed multipart upload key=70COM4KLK2R1 upload=4LQTMFAGRQOQ tag=Q5PHPAANP26J type=write size=2537681 2024-09-12T17:42:04.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.296+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.0 size=1048576 2024-09-12T17:42:04.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.297+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.1 size=1048576 2024-09-12T17:42:04.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.298+0000 7f330fbcc780 1 > prepared part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.2 size=283949 2024-09-12T17:42:04.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.298+0000 7f330fbcc780 1 > prepared multipart upload key=AL3ESPG15NO4 upload=1071RJNNE261 tag=9LNZZXOY5QHJ type=write size=3429677 2024-09-12T17:42:04.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.300+0000 7f330fbcc780 1 < suggested remove operation key=IEL4VF8ROC72 tag=AJOFWUOI1D91 type=del 2024-09-12T17:42:04.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.301+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=G8GYGKRLMMHL type=del size=2476989 2024-09-12T17:42:04.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.304+0000 7f330fbcc780 1 < suggested update operation key=7TBNLJDCL4YB tag=F12FTCZ1V13D type=del size=1454261 2024-09-12T17:42:04.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.306+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~LXG7FI19AJF7.0 size=1048576 2024-09-12T17:42:04.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.307+0000 7f330fbcc780 1 > prepared part key=_multipart_LNE0UR6JPWR8.2~LXG7FI19AJF7.1 size=558221 2024-09-12T17:42:04.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.307+0000 7f330fbcc780 1 > prepared multipart upload key=LNE0UR6JPWR8 upload=LXG7FI19AJF7 tag=K9KY5LPKPI2T type=write size=2655373 2024-09-12T17:42:04.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.308+0000 7f330fbcc780 1 < completed write operation key=ZEC2RXNOR3D1 tag=1JDMC5D99FB2 type=write size=502721 2024-09-12T17:42:04.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.309+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=CO7Q9UBO94HI type=write size=721310 2024-09-12T17:42:04.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.310+0000 7f330fbcc780 1 < completed part key=_multipart_IEYJS7X97O1A.2~V1L9T97CR5T0.0 size=971090 2024-09-12T17:42:04.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.312+0000 7f330fbcc780 1 < completed multipart upload key=IEYJS7X97O1A upload=V1L9T97CR5T0 tag=7MC253WWCVC7 type=write size=2019666 2024-09-12T17:42:04.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.314+0000 7f330fbcc780 1 > prepared part key=_multipart_D5ZZ93XAPRAA.2~06VHMWTQG2HD.0 size=474498 2024-09-12T17:42:04.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.314+0000 7f330fbcc780 1 > prepared multipart upload key=D5ZZ93XAPRAA upload=06VHMWTQG2HD tag=493E2UE4B03O type=write size=1523074 2024-09-12T17:42:04.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.316+0000 7f330fbcc780 1 < suggested update operation key=9IYALJED5G85 tag=KW5PG1TY5TDE type=del size=1430256 2024-09-12T17:42:04.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.318+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=M2AO5NKN4IMU type=del size=1313258 2024-09-12T17:42:04.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.318+0000 7f330fbcc780 1 < canceled part key=_multipart_TKJOJ17LIWX6.2~1XCTT3XT9I4S.0 size=338567 2024-09-12T17:42:04.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.320+0000 7f330fbcc780 1 < canceled multipart upload key=TKJOJ17LIWX6 upload=1XCTT3XT9I4S tag=NQO7C1CE81NQ type=write size=1387143 2024-09-12T17:42:04.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.322+0000 7f330fbcc780 1 > prepared part key=_multipart_QE2QJH2J5QDY.2~L27VD6RXCDLW.0 size=376145 2024-09-12T17:42:04.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.322+0000 7f330fbcc780 1 > prepared multipart upload key=QE2QJH2J5QDY upload=L27VD6RXCDLW tag=3X8VCXR4074A type=write size=1424721 2024-09-12T17:42:04.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.323+0000 7f330fbcc780 1 < completed delete operation key=5QBSRDY0LJ60 tag=IMSXRE80TAJ0 type=del 2024-09-12T17:42:04.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.324+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=8TWBXCN4FVLK type=del size=3233397 2024-09-12T17:42:04.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.326+0000 7f330fbcc780 1 < suggested remove operation key=QE2QJH2J5QDY tag=W80TUVOH1RZB type=del 2024-09-12T17:42:04.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.327+0000 7f330fbcc780 1 > prepared operation key=6HBW7077B3MS tag=PUGTD8ZLI0X0 type=write size=847053 2024-09-12T17:42:04.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.329+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~0UASDCUX5DN3.0 size=1048576 2024-09-12T17:42:04.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.329+0000 7f330fbcc780 1 < completed part key=_multipart_3IHGI1UMI1BA.2~0UASDCUX5DN3.1 size=670687 2024-09-12T17:42:04.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.331+0000 7f330fbcc780 1 < completed multipart upload key=3IHGI1UMI1BA upload=0UASDCUX5DN3 tag=BO2NC20JQ74D type=write size=2767839 2024-09-12T17:42:04.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.332+0000 7f330fbcc780 1 > prepared operation key=4KNGMX117Z7G tag=GKAVNJM0D9QC type=del size=1958273 2024-09-12T17:42:04.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.334+0000 7f330fbcc780 1 < completed delete operation key=6HBW7077B3MS tag=GRV36YMNTWOB type=del 2024-09-12T17:42:04.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.335+0000 7f330fbcc780 1 > prepared operation key=LNE0UR6JPWR8 tag=FSOD491X9OAQ type=del size=3523415 2024-09-12T17:42:04.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.337+0000 7f330fbcc780 1 < suggested update operation key=H1LAU7WDZW6S tag=9JCRUHQB3V5H type=del size=935491 2024-09-12T17:42:04.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.338+0000 7f330fbcc780 1 > prepared operation key=50WR6KLF40W7 tag=4F0KEZ56S3RZ type=del size=3408664 2024-09-12T17:42:04.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.339+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.0 size=1048576 2024-09-12T17:42:04.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.340+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.1 size=1048576 2024-09-12T17:42:04.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.341+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~GAF7DDQ5JRDL.2 size=63349 2024-09-12T17:42:04.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.343+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=GAF7DDQ5JRDL tag=NX5NF8NZH7ZM type=write size=3209077 2024-09-12T17:42:04.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.344+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=NOGG57MLVMHW type=del size=3106054 2024-09-12T17:42:04.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.345+0000 7f330fbcc780 -1 < failed to complete operation key=7TBNLJDCL4YB tag=P01GJ4RM2F6U type=del size=2575798: (22) Invalid argument 2024-09-12T17:42:04.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.347+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~91CT6H3MEBE6.0 size=1048576 2024-09-12T17:42:04.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.348+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~91CT6H3MEBE6.1 size=136015 2024-09-12T17:42:04.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.348+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=91CT6H3MEBE6 tag=Q6E11FXXY2EO type=write size=2233167 2024-09-12T17:42:04.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.348+0000 7f330fbcc780 1 < canceled part key=_multipart_8UX8W3FAJ3D9.2~6NFJJWT6ILJX.0 size=1048576 2024-09-12T17:42:04.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.349+0000 7f330fbcc780 1 < completed part key=_multipart_8UX8W3FAJ3D9.2~6NFJJWT6ILJX.1 size=650531 2024-09-12T17:42:04.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.351+0000 7f330fbcc780 1 < canceled multipart upload key=8UX8W3FAJ3D9 upload=6NFJJWT6ILJX tag=MGGPF7HPNLCB type=write size=2747683 2024-09-12T17:42:04.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.352+0000 7f330fbcc780 1 > prepared operation key=3IHGI1UMI1BA tag=Z6PGWQJ1WB2V type=del size=2740074 2024-09-12T17:42:04.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.353+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~668X7RZDBT1T.0 size=1048576 2024-09-12T17:42:04.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.354+0000 7f330fbcc780 1 < completed part key=_multipart_6ZDBF249S1L6.2~668X7RZDBT1T.1 size=559241 2024-09-12T17:42:04.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.356+0000 7f330fbcc780 1 < completed multipart upload key=6ZDBF249S1L6 upload=668X7RZDBT1T tag=5NPO1LIC6EYN type=write size=2656393 2024-09-12T17:42:04.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.357+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=8H56W6HPW49R type=del size=1615673 2024-09-12T17:42:04.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.359+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.0 size=1048576 2024-09-12T17:42:04.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.360+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.1 size=1048576 2024-09-12T17:42:04.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.361+0000 7f330fbcc780 1 < completed part key=_multipart_AL3ESPG15NO4.2~1071RJNNE261.2 size=283949 2024-09-12T17:42:04.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.363+0000 7f330fbcc780 1 < completed multipart upload key=AL3ESPG15NO4 upload=1071RJNNE261 tag=9LNZZXOY5QHJ type=write size=3429677 2024-09-12T17:42:04.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.365+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=VZORL6G66JXD type=del size=2148448 2024-09-12T17:42:04.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.368+0000 7f330fbcc780 1 < suggested remove operation key=70COM4KLK2R1 tag=G8GYGKRLMMHL type=del 2024-09-12T17:42:04.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.369+0000 7f330fbcc780 1 > prepared operation key=ZEC2RXNOR3D1 tag=HUNHCRPK4TK4 type=del size=233733 2024-09-12T17:42:04.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.370+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~LXG7FI19AJF7.0 size=1048576 2024-09-12T17:42:04.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.371+0000 7f330fbcc780 1 < completed part key=_multipart_LNE0UR6JPWR8.2~LXG7FI19AJF7.1 size=558221 2024-09-12T17:42:04.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.373+0000 7f330fbcc780 1 < completed multipart upload key=LNE0UR6JPWR8 upload=LXG7FI19AJF7 tag=K9KY5LPKPI2T type=write size=2655373 2024-09-12T17:42:04.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.375+0000 7f330fbcc780 1 > prepared operation key=TKJOJ17LIWX6 tag=FCTJ5EH2A4WL type=del size=1941862 2024-09-12T17:42:04.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.376+0000 7f330fbcc780 1 < canceled operation key=3BU8T85GXCX4 tag=CO7Q9UBO94HI type=write size=721310 2024-09-12T17:42:04.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.377+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=27U08XZ8H9TS type=write size=368978 2024-09-12T17:42:04.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.378+0000 7f330fbcc780 1 < completed part key=_multipart_D5ZZ93XAPRAA.2~06VHMWTQG2HD.0 size=474498 2024-09-12T17:42:04.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.380+0000 7f330fbcc780 1 < completed multipart upload key=D5ZZ93XAPRAA upload=06VHMWTQG2HD tag=493E2UE4B03O type=write size=1523074 2024-09-12T17:42:04.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.382+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C6GB7W9VMH6Y.0 size=1048576 2024-09-12T17:42:04.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.383+0000 7f330fbcc780 1 > prepared part key=_multipart_H1LAU7WDZW6S.2~C6GB7W9VMH6Y.1 size=67178 2024-09-12T17:42:04.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.383+0000 7f330fbcc780 1 > prepared multipart upload key=H1LAU7WDZW6S upload=C6GB7W9VMH6Y tag=0331MYPQ0XJT type=write size=2164330 2024-09-12T17:42:04.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.384+0000 7f330fbcc780 -1 < failed to complete operation key=QE2QJH2J5QDY tag=M2AO5NKN4IMU type=del size=1313258: (22) Invalid argument 2024-09-12T17:42:04.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.386+0000 7f330fbcc780 1 > prepared operation key=LF4NGY13WYHK tag=69CQ70Q6324G type=del size=1195234 2024-09-12T17:42:04.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.386+0000 7f330fbcc780 1 < canceled part key=_multipart_QE2QJH2J5QDY.2~L27VD6RXCDLW.0 size=376145 2024-09-12T17:42:04.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.388+0000 7f330fbcc780 1 < canceled multipart upload key=QE2QJH2J5QDY upload=L27VD6RXCDLW tag=3X8VCXR4074A type=write size=1424721 2024-09-12T17:42:04.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.389+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=XIE0OOGBN26O type=del size=1244834 2024-09-12T17:42:04.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.390+0000 7f330fbcc780 1 < completed delete operation key=FY2BXMZBVMDL tag=8TWBXCN4FVLK type=del 2024-09-12T17:42:04.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.392+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.0 size=1048576 2024-09-12T17:42:04.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.393+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.1 size=1048576 2024-09-12T17:42:04.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.394+0000 7f330fbcc780 1 > prepared part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.2 size=663516 2024-09-12T17:42:04.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.394+0000 7f330fbcc780 1 > prepared multipart upload key=MQV01X5P8JLG upload=SWZTX6X8D668 tag=37Z2OKDRSFGC type=write size=3809244 2024-09-12T17:42:04.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.396+0000 7f330fbcc780 1 < suggested remove operation key=6HBW7077B3MS tag=PUGTD8ZLI0X0 type=write 2024-09-12T17:42:04.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.398+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~JNZ29L75YN0M.0 size=1048576 2024-09-12T17:42:04.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.399+0000 7f330fbcc780 1 > prepared part key=_multipart_SPKBX4WU9A9R.2~JNZ29L75YN0M.1 size=457877 2024-09-12T17:42:04.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.399+0000 7f330fbcc780 1 > prepared multipart upload key=SPKBX4WU9A9R upload=JNZ29L75YN0M tag=DYJHZP56DY63 type=write size=2555029 2024-09-12T17:42:04.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.402+0000 7f330fbcc780 1 < suggested remove operation key=4KNGMX117Z7G tag=GKAVNJM0D9QC type=del 2024-09-12T17:42:04.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.403+0000 7f330fbcc780 1 > prepared operation key=FY2BXMZBVMDL tag=RC9E0WYPN60H type=del size=3097912 2024-09-12T17:42:04.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.404+0000 7f330fbcc780 1 < completed delete operation key=LNE0UR6JPWR8 tag=FSOD491X9OAQ type=del 2024-09-12T17:42:04.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.405+0000 7f330fbcc780 1 > prepared operation key=AGM33OK1W7A6 tag=K7M446WGKZWU type=del size=3837832 2024-09-12T17:42:04.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.406+0000 7f330fbcc780 1 < completed delete operation key=50WR6KLF40W7 tag=4F0KEZ56S3RZ type=del 2024-09-12T17:42:04.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.407+0000 7f330fbcc780 1 > prepared operation key=QE2QJH2J5QDY tag=MT0M16NKWAQS type=del size=1267526 2024-09-12T17:42:04.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.410+0000 7f330fbcc780 1 < suggested update operation key=6ZDBF249S1L6 tag=NOGG57MLVMHW type=del size=3106054 2024-09-12T17:42:04.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.411+0000 7f330fbcc780 1 > prepared operation key=9IYALJED5G85 tag=XTR1VXER6B86 type=write size=695942 2024-09-12T17:42:04.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.412+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~91CT6H3MEBE6.0 size=1048576 2024-09-12T17:42:04.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.413+0000 7f330fbcc780 1 < completed part key=_multipart_7TBNLJDCL4YB.2~91CT6H3MEBE6.1 size=136015 2024-09-12T17:42:04.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.414+0000 7f330fbcc780 1 < completed multipart upload key=7TBNLJDCL4YB upload=91CT6H3MEBE6 tag=Q6E11FXXY2EO type=write size=2233167 2024-09-12T17:42:04.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.416+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=GNK6DG08LWS2 type=del size=3826392 2024-09-12T17:42:04.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.417+0000 7f330fbcc780 1 < completed delete operation key=3IHGI1UMI1BA tag=Z6PGWQJ1WB2V type=del 2024-09-12T17:42:04.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.418+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=9CNJ001J5DWY type=del size=1476795 2024-09-12T17:42:04.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.420+0000 7f330fbcc780 1 < suggested update operation key=6ZDBF249S1L6 tag=8H56W6HPW49R type=del size=1615673 2024-09-12T17:42:04.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.421+0000 7f330fbcc780 1 > prepared operation key=6MFVO30OX5W1 tag=1MRQUGDCUULL type=del size=2706238 2024-09-12T17:42:04.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.422+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=VZORL6G66JXD type=del 2024-09-12T17:42:04.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.424+0000 7f330fbcc780 1 > prepared operation key=6ZDBF249S1L6 tag=4YC10ZV4BKZ9 type=del size=2630275 2024-09-12T17:42:04.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.427+0000 7f330fbcc780 1 < suggested update operation key=ZEC2RXNOR3D1 tag=HUNHCRPK4TK4 type=del size=233733 2024-09-12T17:42:04.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.428+0000 7f330fbcc780 1 > prepared operation key=70COM4KLK2R1 tag=NP2Y42UQZ3RQ type=write size=553947 2024-09-12T17:42:04.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.429+0000 7f330fbcc780 1 < completed delete operation key=TKJOJ17LIWX6 tag=FCTJ5EH2A4WL type=del 2024-09-12T17:42:04.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.430+0000 7f330fbcc780 1 > prepared operation key=IEYJS7X97O1A tag=9PZDALZWQOTN type=del size=591742 2024-09-12T17:42:04.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.432+0000 7f330fbcc780 1 < completed write operation key=QE2QJH2J5QDY tag=27U08XZ8H9TS type=write size=368978 2024-09-12T17:42:04.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.433+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=E7JKZK9L8PNA type=del size=1880914 2024-09-12T17:42:04.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.434+0000 7f330fbcc780 1 < completed part key=_multipart_H1LAU7WDZW6S.2~C6GB7W9VMH6Y.0 size=1048576 2024-09-12T17:42:04.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.434+0000 7f330fbcc780 1 < canceled part key=_multipart_H1LAU7WDZW6S.2~C6GB7W9VMH6Y.1 size=67178 2024-09-12T17:42:04.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.436+0000 7f330fbcc780 1 < canceled multipart upload key=H1LAU7WDZW6S upload=C6GB7W9VMH6Y tag=0331MYPQ0XJT type=write size=2164330 2024-09-12T17:42:04.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.437+0000 7f330fbcc780 1 > prepared operation key=XIW3OJB1STT9 tag=2SB0OQNVFEBO type=del size=520296 2024-09-12T17:42:04.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.438+0000 7f330fbcc780 1 < completed delete operation key=LF4NGY13WYHK tag=69CQ70Q6324G type=del 2024-09-12T17:42:04.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.439+0000 7f330fbcc780 1 > prepared operation key=30CIXFQV5VBI tag=AA6SWEQSKVZS type=del size=1734917 2024-09-12T17:42:04.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.440+0000 7f330fbcc780 -1 < failed to complete operation key=6ZDBF249S1L6 tag=XIE0OOGBN26O type=del size=1244834: (22) Invalid argument 2024-09-12T17:42:04.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.442+0000 7f330fbcc780 1 > prepared part key=_multipart_3BU8T85GXCX4.2~LUYLZVKTQM7M.0 size=217631 2024-09-12T17:42:04.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.442+0000 7f330fbcc780 1 > prepared multipart upload key=3BU8T85GXCX4 upload=LUYLZVKTQM7M tag=V799BKFA13M6 type=write size=1266207 2024-09-12T17:42:04.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.444+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.0 size=1048576 2024-09-12T17:42:04.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.445+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.1 size=1048576 2024-09-12T17:42:04.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.446+0000 7f330fbcc780 1 < completed part key=_multipart_MQV01X5P8JLG.2~SWZTX6X8D668.2 size=663516 2024-09-12T17:42:04.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.448+0000 7f330fbcc780 1 < completed multipart upload key=MQV01X5P8JLG upload=SWZTX6X8D668 tag=37Z2OKDRSFGC type=write size=3809244 2024-09-12T17:42:04.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.450+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~WMYNP3KIQE88.0 size=1048576 2024-09-12T17:42:04.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.451+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~WMYNP3KIQE88.1 size=1048576 2024-09-12T17:42:04.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.452+0000 7f330fbcc780 1 > prepared part key=_multipart_7TBNLJDCL4YB.2~WMYNP3KIQE88.2 size=842247 2024-09-12T17:42:04.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.452+0000 7f330fbcc780 1 > prepared multipart upload key=7TBNLJDCL4YB upload=WMYNP3KIQE88 tag=SYNPGQZZ42G2 type=write size=3987975 2024-09-12T17:42:04.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.452+0000 7f330fbcc780 1 < canceled part key=_multipart_SPKBX4WU9A9R.2~JNZ29L75YN0M.0 size=1048576 2024-09-12T17:42:04.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.453+0000 7f330fbcc780 1 < completed part key=_multipart_SPKBX4WU9A9R.2~JNZ29L75YN0M.1 size=457877 2024-09-12T17:42:04.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.455+0000 7f330fbcc780 1 < canceled multipart upload key=SPKBX4WU9A9R upload=JNZ29L75YN0M tag=DYJHZP56DY63 type=write size=2555029 2024-09-12T17:42:04.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.456+0000 7f330fbcc780 1 > prepared operation key=1MJ2W1WMLR85 tag=R5PUF265Y359 type=del size=2328692 2024-09-12T17:42:04.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.457+0000 7f330fbcc780 1 < canceled operation key=FY2BXMZBVMDL tag=RC9E0WYPN60H type=del size=3097912 2024-09-12T17:42:04.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.459+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=3CYWLWYOODHY type=del size=266439 2024-09-12T17:42:04.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.460+0000 7f330fbcc780 1 < completed delete operation key=AGM33OK1W7A6 tag=K7M446WGKZWU type=del 2024-09-12T17:42:04.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.461+0000 7f330fbcc780 1 > prepared operation key=IEL4VF8ROC72 tag=W7L9SOY1AN2C type=del size=3043525 2024-09-12T17:42:04.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.462+0000 7f330fbcc780 1 < completed delete operation key=QE2QJH2J5QDY tag=MT0M16NKWAQS type=del 2024-09-12T17:42:04.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.465+0000 7f330fbcc780 1 > prepared part key=_multipart_HJL73WQD8SD2.2~5TU5119MGJZA.0 size=737208 2024-09-12T17:42:04.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.465+0000 7f330fbcc780 1 > prepared multipart upload key=HJL73WQD8SD2 upload=5TU5119MGJZA tag=HWF00ZOUYC24 type=write size=1785784 2024-09-12T17:42:04.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.466+0000 7f330fbcc780 1 < completed write operation key=9IYALJED5G85 tag=XTR1VXER6B86 type=write size=695942 2024-09-12T17:42:04.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.467+0000 7f330fbcc780 1 > prepared operation key=9X4FNKQWJCX4 tag=ZKR61MLRU1P5 type=del size=3320666 2024-09-12T17:42:04.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.469+0000 7f330fbcc780 1 < suggested remove operation key=8UX8W3FAJ3D9 tag=GNK6DG08LWS2 type=del 2024-09-12T17:42:04.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.471+0000 7f330fbcc780 1 > prepared operation key=3BU8T85GXCX4 tag=B0ZKEW82IT2R type=del size=503734 2024-09-12T17:42:04.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.472+0000 7f330fbcc780 1 < completed delete operation key=3BU8T85GXCX4 tag=9CNJ001J5DWY type=del 2024-09-12T17:42:04.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.473+0000 7f330fbcc780 1 > prepared operation key=8UX8W3FAJ3D9 tag=T1KF11OWM926 type=del size=2334532 2024-09-12T17:42:04.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.474+0000 7f330fbcc780 1 < completed delete operation key=6MFVO30OX5W1 tag=1MRQUGDCUULL type=del 2024-09-12T17:42:04.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:42:04.475+0000 7f330fbcc780 1 > prepared operation key=HJL73WQD8SD2 tag=JIW222AG79HE type=write size=367603 2024-09-12T17:42:04.477 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_stats.simulate (8948 ms) 2024-09-12T17:42:04.477 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats (8948 ms total) 2024-09-12T17:42:04.477 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:42:04.477 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:04.534 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 1 test from 1 test suite ran. (10877 ms total) 2024-09-12T17:42:04.534 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 1 test. 2024-09-12T17:42:04.537 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:42:04.537 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:42:04.616 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:42:04.617 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:42:04.617 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:42:04.700 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:42:04.700 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:42:04.700 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:06.551 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:42:06.551 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:42:06.567 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-12T17:42:06.567 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:42:06.571 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-12T17:42:06.571 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:42:06.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:42:06.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:42:06.577 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T17:42:06.577 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:42:06.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_str (8 ms) 2024-09-12T17:42:06.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:42:06.590 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-09-12T17:42:06.590 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:42:06.593 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T17:42:06.593 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:42:06.596 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T17:42:06.596 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:42:06.600 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T17:42:06.600 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:42:06.604 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T17:42:06.604 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:42:06.605 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:42:06.605 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:42:06.605 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T17:42:06.605 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:42:06.613 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2024-09-12T17:42:06.613 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:42:06.620 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T17:42:06.620 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:42:06.625 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (5 ms) 2024-09-12T17:42:06.625 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:42:06.631 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T17:42:06.631 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:42:06.638 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-12T17:42:06.639 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:42:06.648 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2024-09-12T17:42:06.649 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:42:06.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-12T17:42:06.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:42:06.653 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-12T17:42:06.653 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:42:06.654 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T17:42:06.654 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:42:06.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T17:42:06.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:42:06.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-12T17:42:06.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:42:06.667 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-12T17:42:06.667 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:42:06.673 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (6 ms) 2024-09-12T17:42:06.673 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:42:06.682 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-12T17:42:06.682 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:42:06.684 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T17:42:06.684 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:42:06.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T17:42:06.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:42:06.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:42:06.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:42:06.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T17:42:06.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:42:06.695 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T17:42:06.695 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap (144 ms total) 2024-09-12T17:42:06.695 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:42:06.695 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:07.554 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 31 tests from 1 test suite ran. (2853 ms total) 2024-09-12T17:42:07.554 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 31 tests. 2024-09-12T17:42:07.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:42:07.557 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:42:07.599 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:42:07.601 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:42:07.601 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:42:07.685 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:42:07.685 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:42:07.686 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:07.686 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:42:07.686 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:42:10.578 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2892 ms) 2024-09-12T17:42:10.578 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:42:13.593 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3015 ms) 2024-09-12T17:42:13.593 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:42:16.605 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Reserve (3013 ms) 2024-09-12T17:42:16.606 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:42:19.622 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3016 ms) 2024-09-12T17:42:19.622 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:42:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Commit (3023 ms) 2024-09-12T17:42:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:42:25.657 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Stats (3012 ms) 2024-09-12T17:42:25.657 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:42:29.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4026 ms) 2024-09-12T17:42:29.687 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:42:32.698 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Abort (3016 ms) 2024-09-12T17:42:32.698 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:42:35.715 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveError (3017 ms) 2024-09-12T17:42:35.715 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:42:38.729 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitError (3014 ms) 2024-09-12T17:42:38.729 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:42:41.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortError (3019 ms) 2024-09-12T17:42:41.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:42:44.769 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3020 ms) 2024-09-12T17:42:44.769 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:42:47.774 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3005 ms) 2024-09-12T17:42:47.774 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:42:50.802 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3029 ms) 2024-09-12T17:42:50.802 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:42:53.816 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3013 ms) 2024-09-12T17:42:53.817 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:42:56.845 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3030 ms) 2024-09-12T17:42:56.845 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:42:59.851 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3006 ms) 2024-09-12T17:42:59.852 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:43:02.876 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Cleanup (3025 ms) 2024-09-12T17:43:02.876 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:43:12.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10085 ms) 2024-09-12T17:43:12.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:43:15.975 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3014 ms) 2024-09-12T17:43:15.975 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:43:29.004 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13029 ms) 2024-09-12T17:43:29.005 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:43:33.036 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4031 ms) 2024-09-12T17:43:33.036 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:43:39.066 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6030 ms) 2024-09-12T17:43:39.066 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5084 ms) 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue (96464 ms total) 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (96464 ms total) 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-12T17:43:44.152 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:44.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:44.198 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:43:44.199 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:43:44.199 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:43:44.253 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:44.253 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:44.254 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:43:44.254 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:46.151 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:43:46.152 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:43:46.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.add (22 ms) 2024-09-12T17:43:46.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:43:46.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.get (4 ms) 2024-09-12T17:43:46.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:43:46.184 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T17:43:46.184 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:43:46.201 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.list (17 ms) 2024-09-12T17:43:46.201 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount (50 ms total) 2024-09-12T17:43:46.201 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:43:46.201 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:47.166 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (2913 ms total) 2024-09-12T17:43:47.166 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-12T17:43:47.170 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:47.170 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:47.214 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:43:47.215 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:43:47.215 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:43:47.307 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:47.307 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:47.307 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:43:47.308 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:49.175 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:43:49.175 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:43:49.188 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_queue (13 ms) 2024-09-12T17:43:49.188 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:43:49.191 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T17:43:49.191 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:43:49.194 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-12T17:43:49.194 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:43:49.196 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T17:43:49.196 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:43:49.199 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:43:49.199 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:43:49.201 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T17:43:49.201 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log (26 ms total) 2024-09-12T17:43:49.201 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:43:49.201 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:50.177 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 6 tests from 1 test suite ran. (2869 ms total) 2024-09-12T17:43:50.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 6 tests. 2024-09-12T17:43:50.181 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:50.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:50.223 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:43:50.224 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:43:50.225 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.321 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.322 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.324 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.325 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.326 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.327 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.328 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.330 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.331 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.332 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.333 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.334 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.335 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.337 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.338 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.341 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.342 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.344 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.345 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.347 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.348 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.349 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.350 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.351 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.352 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.354 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.355 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.356 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.357 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.358 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.359 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.361 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-12T17:43:50.362 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.364 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.365 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.367 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.368 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.370 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.371 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.372 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.373 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.373 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.373 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.373 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.376 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.376 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.376 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-12T17:43:50.376 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.376 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.378 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.379 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.380 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.381 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.382 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.383 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.385 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.386 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.387 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.388 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.390 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.391 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.391 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.391 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.391 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.391 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.392 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.393 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.394 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.395 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.397 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.398 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.399 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.399 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.399 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.399 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.399 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.400 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.400 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.400 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.400 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.400 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.401 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.402 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.403 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.405 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.406 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.408 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.409 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:43:50.410 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.412 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.413 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.414 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.416 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.417 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.418 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.419 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.420 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.421 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.423 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-12T17:43:50.424 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.425 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.427 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.428 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.429 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.431 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.432 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.433 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.435 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.436 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.437 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.439 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.440 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.442 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.443 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.445 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.446 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.447 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.448 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.449 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.450 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.451 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.452 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.453 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.454 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.456 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.457 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.458 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.460 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.461 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.462 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.464 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.465 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.466 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.468 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.469 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.470 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.472 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.473 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.474 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.474 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.474 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.474 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.474 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.475 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.476 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.477 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.479 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.480 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.482 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.483 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.485 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.486 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.487 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.488 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.489 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.490 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.492 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.493 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.494 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.495 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.496 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.497 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.499 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.500 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.502 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.503 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.505 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.506 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:43:50.507 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.508 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.509 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.510 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.512 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.513 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.514 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.515 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.516 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.517 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.519 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.520 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.522 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.523 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.525 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:43:50.526 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:43:50.528 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.529 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.530 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.531 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.533 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.534 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.536 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.537 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.538 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.539 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.540 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.542 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.543 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.544 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.546 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.547 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:43:50.549 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-12T17:43:50.550 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:50.551 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:43:50.552 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-12T17:43:50.552 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:50.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:50.592 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:43:50.593 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:43:50.593 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:43:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:50.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.772+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 realm 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.774+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.775+0000 7f5a9af26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:50.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.775+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.775+0000 7f5a9af26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:50.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.775+0000 7f5a9af26800 20 searching for the correct realm 2024-09-12T17:43:50.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.780+0000 7f5a8e46e640 0 -- 172.21.15.94:0/3823930534 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f5a88018070 msgr2=0x7f5a8805f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:50.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.783+0000 7f5a8e46e640 0 -- 172.21.15.94:0/3823930534 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f59600841d0 msgr2=0x7f5960086600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:50.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:50.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.787+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 zone default found 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 4 Realm: () 2024-09-12T17:43:50.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 zonegroup default 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.788+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.789+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.789+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.789+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.789+0000 7f5a9af26800 20 started sync module instance, tier type = 2024-09-12T17:43:50.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.789+0000 7f5a9af26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:43:50.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=0 2024-09-12T17:43:50.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=1 2024-09-12T17:43:50.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=2 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=3 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=4 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=5 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=6 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 20 add_watcher() i=7 2024-09-12T17:43:50.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.799+0000 7f5a9af26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:50.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.801+0000 7f594d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 5 note: GC not initialized 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f58c7fff640 20 reqs_thread_entry: start 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 Filter name: none 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f58c5ffb640 20 reqs_thread_entry: start 2024-09-12T17:43:50.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:43:50.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.802+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 cache get: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= : miss 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 20 rados->read ofs=0 len=0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= info.flags=0x0 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 adding default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= to cache LRU end 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 cache get: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= : hit (negative entry) 2024-09-12T17:43:50.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.803+0000 7f5a9af26800 10 cache get: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= : hit (negative entry) 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.804+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.804+0000 7f5a9af26800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.804+0000 7f5a9af26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.805+0000 7f597a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889409 cookie 94298927914336 notifier 5550 bl.length()=697 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.805+0000 7f597a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:43:50.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.805+0000 7f597a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:43:50.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.807+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.807+0000 7f5a9af26800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.807+0000 7f5a9af26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.808+0000 7f597a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889408 cookie 94298927909936 notifier 5550 bl.length()=194 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.808+0000 7f597a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.808+0000 7f597a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:43:50.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f5a9af26800 10 cache put: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= info.flags=0x7 2024-09-12T17:43:50.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f5a9af26800 10 moving default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= to cache LRU end 2024-09-12T17:43:50.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f5a9af26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:eKN98RuJpMBh0tWcUvAC4jTI8Xo=, ofs0, ns] 2024-09-12T17:43:50.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f597a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889410 cookie 94298927914336 notifier 5550 bl.length()=203 2024-09-12T17:43:50.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f597a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= info.flags=0x7 2024-09-12T17:43:50.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.811+0000 7f597a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+eKN98RuJpMBh0tWcUvAC4jTI8Xo= to cache LRU end 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "librgw test user", 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "librgw@example.com", 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "eKN98RuJpMBh0tWcUvAC4jTI8Xo=", 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "ezeKT6oHDQmGz+vjEbLfKG1gv/UizyJjWLra3I0XmXXBcpwlZyznTw==", 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:43:50.804419Z" 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T17:43:50.814 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:43:50.815 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:43:50.804409Z", 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:43:50.816 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:43:50.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.813+0000 7f594d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:50.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.815+0000 7f5a9af26800 20 remove_watcher() i=0 2024-09-12T17:43:50.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.815+0000 7f5a9af26800 2 removed watcher, disabling cache 2024-09-12T17:43:50.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.816+0000 7f5a9af26800 20 remove_watcher() i=1 2024-09-12T17:43:50.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.818+0000 7f5a9af26800 20 remove_watcher() i=2 2024-09-12T17:43:50.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.819+0000 7f5a9af26800 20 remove_watcher() i=3 2024-09-12T17:43:50.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.820+0000 7f5a9af26800 20 remove_watcher() i=4 2024-09-12T17:43:50.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.821+0000 7f5a9af26800 20 remove_watcher() i=5 2024-09-12T17:43:50.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.822+0000 7f5a9af26800 20 remove_watcher() i=6 2024-09-12T17:43:50.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:50.823+0000 7f5a9af26800 20 remove_watcher() i=7 2024-09-12T17:43:50.833 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.1 2024-09-12T17:43:50.855 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:43:50.855 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:50.855 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:43:50.855 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:43:50.866 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:50.866 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:51.239 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-09-12T17:43:51.239 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:43:51.240 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:43:51.240 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:43:51.240 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:43:51.240 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:43:51.255 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:43:51.260 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f1 2024-09-12T17:43:51.263 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f2 2024-09-12T17:43:51.266 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:43:51.269 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:43:51.273 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:43:51.276 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:43:51.279 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:43:51.282 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:43:51.285 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:43:51.289 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:43:51.292 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:43:51.296 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (56 ms) 2024-09-12T17:43:51.296 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:43:51.407 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (111 ms) 2024-09-12T17:43:51.408 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:43:51.408 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:43:51.408 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:43:51.425 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-12T17:43:51.425 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:43:51.470 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (45 ms) 2024-09-12T17:43:51.470 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:43:51.470 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:43:51.476 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-12T17:43:51.476 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:43:51.476 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:43:51.484 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:43:51.486 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:43:51.486 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:43:51.488 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:43:51.488 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:43:51.488 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:43:51.489 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:43:51.489 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:43:51.490 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:43:51.490 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:43:51.490 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:43:51.492 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:43:51.492 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:43:51.493 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:43:51.493 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T17:43:51.493 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:43:51.665 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:43:51.666 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:43:51.674 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:43:51.674 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:43:51.679 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:43:51.680 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:43:51.683 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:43:51.683 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:43:51.684 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:43:51.684 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:43:51.685 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:43:51.685 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:43:51.686 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:43:51.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:43:51.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:43:51.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:51.687+0000 7f943bb3b8c0 -1 shutting down 2024-09-12T17:43:51.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:43:51.688+0000 7f9313a3f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63672, si_uid : 1000, si_addr0x3e80000f8b8, si_status0 2024-09-12T17:44:21.389 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29701 ms) 2024-09-12T17:44:21.390 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30534 ms total) 2024-09-12T17:44:21.390 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:44:21.390 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:21.390 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30534 ms total) 2024-09-12T17:44:21.390 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-12T17:44:21.396 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.2 2024-09-12T17:44:21.420 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:44:21.420 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:21.420 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:44:21.420 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:44:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-12T17:44:21.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:44:21.809 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:44:21.810 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:44:21.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:44:21.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:44:21.808+0000 7fd88fd1f8c0 -1 shutting down 2024-09-12T17:44:21.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:44:21.809+0000 7fd767227640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64291, si_uid : 1000, si_addr0x3e80000fb23, si_status0 2024-09-12T17:44:52.215 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30406 ms) 2024-09-12T17:44:52.216 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30795 ms total) 2024-09-12T17:44:52.216 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:44:52.216 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:52.216 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30795 ms total) 2024-09-12T17:44:52.216 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-12T17:44:52.221 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.3 2024-09-12T17:44:52.246 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:44:52.247 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:52.247 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:44:52.247 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:44:52.257 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:52.257 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.668 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (422 ms) 2024-09-12T17:44:52.668 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:44:52.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:44:52.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:44:52.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:44:52.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:44:52.675 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T17:44:52.675 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:44:52.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:44:52.765+0000 7f11df1168c0 -1 shutting down 2024-09-12T17:44:52.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:44:52.766+0000 7f10b8e55640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64911, si_uid : 1000, si_addr0x3e80000fd8f, si_status0 2024-09-12T17:45:23.041 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30274 ms) 2024-09-12T17:45:23.041 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30794 ms total) 2024-09-12T17:45:23.042 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:45:23.042 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:45:23.042 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30794 ms total) 2024-09-12T17:45:23.042 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-12T17:45:23.047 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.1 2024-09-12T17:45:23.071 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:45:23.071 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:45:23.072 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:45:23.072 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:45:23.081 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:23.081 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:23.486 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (414 ms) 2024-09-12T17:45:23.486 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:45:23.486 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:45:23.486 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:45:23.508 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-12T17:45:23.519 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-12T17:45:23.553 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-12T17:45:23.566 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-12T17:45:23.578 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-12T17:45:23.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-12T17:45:23.601 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-12T17:45:23.612 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-12T17:45:23.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (115 ms) 2024-09-12T17:45:23.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:45:23.918 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (306 ms) 2024-09-12T17:45:23.918 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:45:23.918 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:45:23.919 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:45:23.919 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:45:23.919 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:45:23.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:45:23.917+0000 7f18b891f8c0 -1 shutting down 2024-09-12T17:45:23.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:45:23.918+0000 7f178fc31640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65530, si_uid : 1000, si_addr0x3e80000fffa, si_status0 2024-09-12T17:45:53.764 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29846 ms) 2024-09-12T17:45:53.765 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30693 ms total) 2024-09-12T17:45:53.765 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:45:53.765 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:45:53.765 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30693 ms total) 2024-09-12T17:45:53.765 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-12T17:45:53.770 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.2 2024-09-12T17:45:53.796 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:45:53.796 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:45:53.796 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:45:53.796 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:45:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:54.402 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (606 ms) 2024-09-12T17:45:54.402 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:45:54.402 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:45:54.403 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:45:54.403 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:45:54.403 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:45:54.434 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-09-12T17:45:54.434 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:45:54.448 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-12T17:45:54.462 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-12T17:45:54.472 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-12T17:45:54.482 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-12T17:45:54.493 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-12T17:45:54.503 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-12T17:45:54.513 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-12T17:45:54.523 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-12T17:45:54.535 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-12T17:45:54.545 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-12T17:45:54.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (111 ms) 2024-09-12T17:45:54.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (294 ms) 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:45:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:45:54.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:45:54.838+0000 7fb86ab3b8c0 -1 shutting down 2024-09-12T17:45:54.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:45:54.839+0000 7fb744878640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66149, si_uid : 1000, si_addr0x3e800010265, si_status0 2024-09-12T17:46:24.674 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29834 ms) 2024-09-12T17:46:24.674 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30877 ms total) 2024-09-12T17:46:24.674 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:46:24.674 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:24.674 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30877 ms total) 2024-09-12T17:46:24.675 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-12T17:46:24.679 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.1 2024-09-12T17:46:24.999 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:46:24.999 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:24.999 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:46:24.999 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:46:25.008 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:25.008 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:25.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (178 ms) 2024-09-12T17:46:25.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:46:25.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:46:25.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:46:25.188 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T17:46:25.188 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:46:25.192 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:46:25.192 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:46:25.194 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:46:25.194 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:46:25.239 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (45 ms) 2024-09-12T17:46:25.239 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:46:25.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (44 ms) 2024-09-12T17:46:25.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:46:25.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:46:25.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:46:25.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:46:25.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:46:25.282+0000 7f8cf191f8c0 -1 shutting down 2024-09-12T17:46:25.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:46:25.284+0000 7f8bc9898640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66769, si_uid : 1000, si_addr0x3e8000104d1, si_status0 2024-09-12T17:46:55.451 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30167 ms) 2024-09-12T17:46:55.451 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30452 ms total) 2024-09-12T17:46:55.451 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:46:55.451 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:55.451 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30452 ms total) 2024-09-12T17:46:55.452 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-12T17:46:55.458 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.2 2024-09-12T17:46:55.775 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:46:55.776 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:55.776 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:46:55.776 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:46:55.784 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:55.784 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-12T17:46:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:46:55.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:46:55.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:46:55.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:46:55.961 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:46:55.966 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:46:55.966 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:46:55.970 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:46:55.970 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:46:56.023 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:46:56.028 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T17:46:56.028 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:46:56.056 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:46:56.055+0000 7efd2cf2f8c0 -1 shutting down 2024-09-12T17:46:56.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:46:56.057+0000 7efc04ec7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67388, si_uid : 1000, si_addr0x3e80001073c, si_status0 2024-09-12T17:47:26.056 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29999 ms) 2024-09-12T17:47:26.056 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30279 ms total) 2024-09-12T17:47:26.056 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:47:26.056 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:26.057 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30280 ms total) 2024-09-12T17:47:26.057 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-12T17:47:26.063 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.1 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:47:26.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:47:26.102 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:26.102 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:26.508 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (417 ms) 2024-09-12T17:47:26.508 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:47:26.509 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:47:26.509 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:47:26.528 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2024-09-12T17:47:26.528 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_0 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_1 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_2 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_3 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_4 2024-09-12T17:47:27.141 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_5 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_6 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_7 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_8 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_9 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_10 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_11 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_12 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_13 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_14 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_15 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_16 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_17 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_18 2024-09-12T17:47:27.142 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_19 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_20 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_21 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_22 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_23 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_24 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_25 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_26 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_27 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_28 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_29 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_30 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_31 2024-09-12T17:47:27.143 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_32 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_33 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_34 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_35 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_36 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_37 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_38 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_39 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_40 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_41 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_42 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_43 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_44 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_45 2024-09-12T17:47:27.144 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_46 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_47 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_48 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_49 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_50 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_51 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_52 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_53 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_54 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_55 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_56 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_57 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_58 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_59 2024-09-12T17:47:27.145 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_60 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_61 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_62 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_63 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_64 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_65 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_66 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_67 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_68 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_69 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_70 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_71 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_72 2024-09-12T17:47:27.146 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_73 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_74 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_75 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_76 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_77 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_78 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_79 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_80 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_81 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_82 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_83 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_84 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_85 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_86 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_87 2024-09-12T17:47:27.147 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_88 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_89 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_90 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_91 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_92 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_93 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_94 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_95 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_96 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_97 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_98 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_99 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (613 ms) 2024-09-12T17:47:27.148 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:47:27.150 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:47:27.151 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:47:27.152 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:47:27.153 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:47:27.154 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:47:27.155 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:47:27.156 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:47:27.157 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:47:27.158 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:47:27.159 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:47:27.160 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:47:27.161 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:47:27.162 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:47:27.163 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:47:27.164 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:47:27.165 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:47:27.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:47:27.145+0000 7fe2ef7278c0 -1 shutting down 2024-09-12T17:47:27.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:47:27.146+0000 7fe1c75ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68008, si_uid : 1000, si_addr0x3e8000109a8, si_status0 2024-09-12T17:47:56.859 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29712 ms) 2024-09-12T17:47:56.859 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30768 ms total) 2024-09-12T17:47:56.859 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:47:56.860 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:56.860 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30768 ms total) 2024-09-12T17:47:56.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-12T17:47:56.866 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.2 2024-09-12T17:47:56.891 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:47:56.891 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:47:56.892 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:47:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:57.511 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (620 ms) 2024-09-12T17:47:57.511 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:47:57.512 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:47:57.512 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:47:57.522 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:47:57.526 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:47:57.527 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:47:57.528 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:47:57.529 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:47:57.530 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:47:57.531 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:47:57.532 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:47:57.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:47:57.524+0000 7f7d96b1f8c0 -1 shutting down 2024-09-12T17:47:57.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:47:57.525+0000 7f7c6e9cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68628, si_uid : 1000, si_addr0x3e800010c14, si_status0 2024-09-12T17:48:27.613 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30087 ms) 2024-09-12T17:48:27.613 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30721 ms total) 2024-09-12T17:48:27.614 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:48:27.614 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:48:27.614 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30721 ms total) 2024-09-12T17:48:27.614 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-12T17:48:27.618 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.1 2024-09-12T17:48:27.651 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:48:27.652 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:48:27.652 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:48:27.652 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:48:27.662 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:27.662 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:28.086 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (435 ms) 2024-09-12T17:48:28.086 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:48:28.086 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:48:28.086 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:48:28.098 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T17:48:28.098 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:48:28.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:48:28.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:48:28.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:48:28.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:48:28.104 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:48:28.104 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:48:28.104 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:48:28.105 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:48:28.110 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (6 ms) 2024-09-12T17:48:28.110 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:48:28.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:48:28.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:48:28.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:48:28.111+0000 7f182ab3b8c0 -1 shutting down 2024-09-12T17:48:28.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:48:28.112+0000 7f1704878640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69247, si_uid : 1000, si_addr0x3e800010e7f, si_status0 2024-09-12T17:48:58.225 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30112 ms) 2024-09-12T17:48:58.226 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30573 ms total) 2024-09-12T17:48:58.226 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:48:58.226 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:48:58.226 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30573 ms total) 2024-09-12T17:48:58.226 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-12T17:48:58.231 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.2 2024-09-12T17:48:58.265 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:48:58.266 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:48:58.266 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:48:58.266 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:48:58.273 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:58.273 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:58.859 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (593 ms) 2024-09-12T17:48:58.859 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:48:58.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:48:58.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:48:58.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:48:58.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:48:58.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:48:58.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:48:58.871 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T17:48:58.871 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (238 ms) 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:48:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:48:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:48:59.108+0000 7f9d7d6328c0 -1 shutting down 2024-09-12T17:48:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:48:59.109+0000 7f9c52ce0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69866, si_uid : 1000, si_addr0x3e8000110ea, si_status0 2024-09-12T17:49:29.183 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30074 ms) 2024-09-12T17:49:29.184 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30917 ms total) 2024-09-12T17:49:29.184 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:49:29.184 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:29.184 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30917 ms total) 2024-09-12T17:49:29.184 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-12T17:49:29.189 INFO:tasks.workunit.client.0.smithi094.stdout:phase 6.1 2024-09-12T17:49:29.214 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:49:29.214 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:29.214 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:49:29.214 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:49:29.221 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:29.221 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:29.396 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-09-12T17:49:29.396 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:49:29.397 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:49:29.397 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:49:29.419 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKETS (22 ms) 2024-09-12T17:49:29.419 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:49:29.427 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T17:49:29.427 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:49:29.449 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.TOPDIR_RENAME (22 ms) 2024-09-12T17:49:29.449 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:49:29.475 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SUBDIR_RENAME (26 ms) 2024-09-12T17:49:29.475 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (23 ms) 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:49:29.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:29.497+0000 7f383ef258c0 -1 shutting down 2024-09-12T17:49:29.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:29.498+0000 7f3716ef7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70485, si_uid : 1000, si_addr0x3e800011355, si_status0 2024-09-12T17:49:59.611 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30112 ms) 2024-09-12T17:49:59.612 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW (30397 ms total) 2024-09-12T17:49:59.612 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:49:59.612 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:59.612 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (30397 ms total) 2024-09-12T17:49:59.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-12T17:49:59.618 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:59.618 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:59.661 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:49:59.662 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:49:59.663 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:49:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:49:59.773 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:59.773 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:59.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.808+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 realm 2024-09-12T17:49:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.810+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.811+0000 7f22a92bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.811+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.812+0000 7f22a92bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:59.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.812+0000 7f22a92bb800 20 searching for the correct realm 2024-09-12T17:49:59.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.816+0000 7f22a65a4640 0 -- 172.21.15.94:0/614857055 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f2298089030 msgr2=0x7f2298089410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:59.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.819+0000 7f22a75a6640 0 -- 172.21.15.94:0/614857055 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f229c08bd10 msgr2=0x7f229c049a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.824+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 zone default found 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 4 Realm: () 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 zonegroup default 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 started sync module instance, tier type = 2024-09-12T17:49:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.825+0000 7f22a92bb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=0 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=1 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=2 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=3 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=4 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=5 2024-09-12T17:49:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.834+0000 7f22a92bb800 20 add_watcher() i=6 2024-09-12T17:49:59.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.835+0000 7f22a92bb800 20 add_watcher() i=7 2024-09-12T17:49:59.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.835+0000 7f22a92bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f215d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 5 note: GC not initialized 2024-09-12T17:49:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f20d7fff640 20 reqs_thread_entry: start 2024-09-12T17:49:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 20 Filter name: none 2024-09-12T17:49:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f20d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:49:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.837+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.838+0000 7f22a92bb800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f22a92bb800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:49:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f22a92bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:49:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f218a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889421 cookie 94223263372704 notifier 5793 bl.length()=677 2024-09-12T17:49:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f218a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:49:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.839+0000 7f218a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:49:59.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.842+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:49:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.842+0000 7f22a92bb800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:49:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.842+0000 7f22a92bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:49:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.843+0000 7f218a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889463 cookie 94223263361840 notifier 5793 bl.length()=187 2024-09-12T17:49:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.843+0000 7f218a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:49:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.843+0000 7f218a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:49:59.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.845+0000 7f22a92bb800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:49:59.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.845+0000 7f22a92bb800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:49:59.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.845+0000 7f22a92bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:49:59.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.846+0000 7f2189ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889464 cookie 94223263361840 notifier 5793 bl.length()=197 2024-09-12T17:49:59.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.846+0000 7f2189ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:49:59.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.846+0000 7f2189ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:49:59.848 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "maven test user", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "sigv4@example.com", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-maven", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-12T17:49:59.849 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:49:59.840566Z" 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:49:59.850 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:49:59.840555Z", 2024-09-12T17:49:59.851 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.848+0000 7f215d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.850+0000 7f22a92bb800 20 remove_watcher() i=0 2024-09-12T17:49:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.850+0000 7f22a92bb800 2 removed watcher, disabling cache 2024-09-12T17:49:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.851+0000 7f22a92bb800 20 remove_watcher() i=1 2024-09-12T17:49:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.852+0000 7f22a92bb800 20 remove_watcher() i=2 2024-09-12T17:49:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.853+0000 7f22a92bb800 20 remove_watcher() i=3 2024-09-12T17:49:59.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.854+0000 7f22a92bb800 20 remove_watcher() i=4 2024-09-12T17:49:59.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.855+0000 7f22a92bb800 20 remove_watcher() i=5 2024-09-12T17:49:59.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.856+0000 7f22a92bb800 20 remove_watcher() i=6 2024-09-12T17:49:59.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:49:59.856+0000 7f22a92bb800 20 remove_watcher() i=7 2024-09-12T17:49:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-12T17:49:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:49:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:49:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi094.front.sepia.ceph.com:80 2024-09-12T17:49:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi094.front.sepia.ceph.com:80 2024-09-12T17:49:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:49:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:49:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw clean package 2024-09-12T17:49:59.967 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:50:01.437 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-12T17:50:01.566 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:50:01.649 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 65 kB/s) 2024-09-12T17:50:01.662 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:50:01.703 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T17:50:01.713 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:50:01.734 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T17:50:01.763 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:01.763 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:50:01.764 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:50:01.764 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-12T17:50:01.764 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:50:01.766 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:50:01.782 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:50:01.789 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:50:01.804 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 707 kB/s) 2024-09-12T17:50:01.807 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:50:01.822 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-12T17:50:01.827 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:50:01.843 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-12T17:50:01.858 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:50:01.874 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T17:50:01.881 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:50:01.895 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 583 kB/s) 2024-09-12T17:50:01.898 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:50:01.913 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:50:01.915 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:50:01.930 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-12T17:50:01.934 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:50:01.953 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.1 MB/s) 2024-09-12T17:50:01.965 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:50:01.977 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T17:50:01.984 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:50:01.999 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:50:02.005 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:50:02.021 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-12T17:50:02.030 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:50:02.047 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-12T17:50:02.050 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:50:02.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-12T17:50:02.068 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:50:02.083 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-12T17:50:02.088 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:50:02.102 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.7 MB/s) 2024-09-12T17:50:02.110 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:50:02.125 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:50:02.129 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:50:02.145 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-12T17:50:02.152 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:50:02.169 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T17:50:02.169 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:50:02.183 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-12T17:50:02.186 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:50:02.201 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-12T17:50:02.204 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:50:02.219 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T17:50:02.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:50:02.238 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 2.0 MB/s) 2024-09-12T17:50:02.251 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:50:02.266 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T17:50:02.268 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:50:02.283 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T17:50:02.286 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:50:02.301 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T17:50:02.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:50:02.324 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-12T17:50:02.327 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:50:02.343 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T17:50:02.345 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:50:02.360 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:50:02.364 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:50:02.379 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:50:02.383 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:50:02.398 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T17:50:02.402 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:50:02.418 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-12T17:50:02.422 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:50:02.437 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T17:50:02.441 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:50:02.456 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-12T17:50:02.460 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:50:02.475 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T17:50:02.478 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:50:02.492 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T17:50:02.495 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:50:02.509 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-12T17:50:02.511 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:50:02.525 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-12T17:50:02.528 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:50:02.542 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T17:50:02.546 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:50:02.560 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-12T17:50:02.564 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:50:02.584 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-09-12T17:50:02.585 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:50:02.600 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:50:02.603 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:50:02.619 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T17:50:02.622 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:50:02.636 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T17:50:02.640 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:50:02.655 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-12T17:50:02.657 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:50:02.672 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-12T17:50:02.675 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:50:02.690 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T17:50:02.694 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:50:02.709 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T17:50:02.712 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:50:02.727 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-12T17:50:02.730 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:50:02.745 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T17:50:02.749 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:50:02.763 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T17:50:02.765 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:50:02.779 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T17:50:02.783 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:50:02.798 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T17:50:02.800 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:50:02.814 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-12T17:50:02.816 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:50:02.831 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T17:50:02.834 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:50:02.848 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T17:50:02.852 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:50:02.866 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-12T17:50:02.868 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:50:02.883 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T17:50:02.886 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:50:02.901 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-12T17:50:02.902 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:50:02.918 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-12T17:50:02.923 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:50:02.938 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-12T17:50:02.941 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:50:02.955 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:50:02.957 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:50:02.973 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T17:50:02.977 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:50:02.993 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-12T17:50:02.994 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:50:03.009 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-12T17:50:03.011 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:50:03.027 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:50:03.032 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:50:03.047 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-12T17:50:03.048 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:50:03.063 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-12T17:50:03.065 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:50:03.080 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:50:03.082 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:50:03.097 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T17:50:03.099 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:50:03.113 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T17:50:03.115 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:50:03.130 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-12T17:50:03.132 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:50:03.147 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-12T17:50:03.149 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:50:03.163 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-12T17:50:03.165 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:50:03.180 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:50:03.182 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:50:03.197 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:50:03.199 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:50:03.214 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T17:50:03.217 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:50:03.231 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T17:50:03.234 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:50:03.249 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T17:50:03.251 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:50:03.266 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:50:03.268 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:50:03.283 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:50:03.285 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:50:03.299 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:50:03.301 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:50:03.315 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-12T17:50:03.331 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:50:03.414 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 40 MB/s) 2024-09-12T17:50:03.415 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:50:03.415 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:50:03.416 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:50:03.416 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:50:03.416 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:50:03.433 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-12T17:50:03.433 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:50:03.448 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-12T17:50:03.448 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:50:03.462 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (2): 2.8/16 kB | 1.4/49 kB Progress (2): 4.1/16 kB | 1.4/49 kB Progress (2): 4.1/16 kB | 2.8/49 kB Progress (2): 5.5/16 kB | 2.8/49 kB Progress (2): 5.5/16 kB | 4.1/49 kB Progress (2): 6.9/16 kB | 4.1/49 kB Progress (2): 6.9/16 kB | 5.5/49 kB Progress (2): 8.3/16 kB | 5.5/49 kB Progress (2): 8.3/16 kB | 6.9/49 kB Progress (2): 9.7/16 kB | 6.9/49 kB Progress (2): 9.7/16 kB | 8.3/49 kB Progress (2): 11/16 kB | 8.3/49 kB Progress (2): 11/16 kB | 9.7/49 kB Progress (2): 12/16 kB | 9.7/49 kB Progress (2): 14/16 kB | 9.7/49 kB Progress (2): 15/16 kB | 9.7/49 kB Progress (2): 16 kB | 9.7/49 kB Progress (3): 16 kB | 9.7/49 kB | 16/98 kB Progress (4): 16 kB | 9.7/49 kB | 16/98 kB | 16/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 343 kB/s) 2024-09-12T17:50:03.462 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 9.7/49 kB | 16/98 kB | 16/71 kB | 16/782 kB Progress (4): 9.7/49 kB | 16/98 kB | 16/71 kB | 32/782 kB Progress (4): 9.7/49 kB | 16/98 kB | 16/71 kB | 49/782 kB Progress (4): 11/49 kB | 16/98 kB | 16/71 kB | 49/782 kB Progress (4): 11/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 12/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 14/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 14/49 kB | 16/98 kB | 16/71 kB | 81/782 kB Progress (4): 15/49 kB | 16/98 kB | 16/71 kB | 81/782 kB Progress (4): 17/49 kB | 16/98 kB | 16/71 kB | 81/782 kB Progress (4): 17/49 kB | 16/98 kB | 16/71 kB | 98/782 kB Progress (4): 18/49 kB | 16/98 kB | 16/71 kB | 98/782 kB Progress (4): 19/49 kB | 16/98 kB | 16/71 kB | 98/782 kB Progress (4): 19/49 kB | 16/98 kB | 16/71 kB | 114/782 kB Progress (4): 21/49 kB | 16/98 kB | 16/71 kB | 114/782 kB Progress (4): 22/49 kB | 16/98 kB | 16/71 kB | 114/782 kB Progress (4): 22/49 kB | 16/98 kB | 16/71 kB | 130/782 kB Progress (4): 23/49 kB | 16/98 kB | 16/71 kB | 130/782 kB Progress (4): 25/49 kB | 16/98 kB | 16/71 kB | 130/782 kB Progress (4): 25/49 kB | 16/98 kB | 16/71 kB | 147/782 kB Progress (4): 26/49 kB | 16/98 kB | 16/71 kB | 147/782 kB Progress (4): 28/49 kB | 16/98 kB | 16/71 kB | 147/782 kB Progress (4): 28/49 kB | 16/98 kB | 16/71 kB | 163/782 kB Progress (4): 29/49 kB | 16/98 kB | 16/71 kB | 163/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 163/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 180/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 196/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 212/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 229/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 245/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 262/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 278/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 294/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 311/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 327/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 343/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 360/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 376/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 393/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 402/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 418/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 435/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 451/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 468/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 484/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 500/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 517/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 533/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 549/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 566/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 582/782 kB Progress (4): 32/49 kB | 16/98 kB | 16/71 kB | 582/782 kB Progress (4): 33/49 kB | 16/98 kB | 16/71 kB | 582/782 kB Progress (4): 33/49 kB | 16/98 kB | 16/71 kB | 599/782 kB Progress (4): 34/49 kB | 16/98 kB | 16/71 kB | 599/782 kB Progress (4): 36/49 kB | 16/98 kB | 16/71 kB | 599/782 kB Progress (4): 36/49 kB | 16/98 kB | 33/71 kB | 599/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 599/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 615/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 631/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 648/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 664/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 681/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 697/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 713/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 730/782 kB Progress (4): 36/49 kB | 33/98 kB | 49/71 kB | 730/782 kB Progress (4): 36/49 kB | 33/98 kB | 49/71 kB | 746/782 kB Progress (4): 36/49 kB | 33/98 kB | 49/71 kB | 762/782 kB Progress (4): 36/49 kB | 33/98 kB | 49/71 kB | 779/782 kB Progress (4): 36/49 kB | 33/98 kB | 49/71 kB | 782 kB Progress (5): 36/49 kB | 33/98 kB | 49/71 kB | 782 kB | 1.4/11 kB Progress (5): 37/49 kB | 33/98 kB | 49/71 kB | 782 kB | 1.4/11 kB Progress (5): 37/49 kB | 49/98 kB | 49/71 kB | 782 kB | 1.4/11 kB Progress (5): 37/49 kB | 49/98 kB | 49/71 kB | 782 kB | 2.8/11 kB Progress (5): 39/49 kB | 49/98 kB | 49/71 kB | 782 kB | 2.8/11 kB Progress (5): 39/49 kB | 49/98 kB | 49/71 kB | 782 kB | 4.1/11 kB Progress (5): 40/49 kB | 49/98 kB | 49/71 kB | 782 kB | 4.1/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 13 MB/s) 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 41/49 kB | 49/98 kB | 49/71 kB | 4.1/11 kB Progress (4): 41/49 kB | 49/98 kB | 49/71 kB | 5.5/11 kB Progress (4): 43/49 kB | 49/98 kB | 49/71 kB | 5.5/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 43/49 kB | 49/98 kB | 49/71 kB | 6.9/11 kB Progress (4): 44/49 kB | 49/98 kB | 49/71 kB | 6.9/11 kB Progress (4): 44/49 kB | 49/98 kB | 49/71 kB | 8.3/11 kB Progress (4): 46/49 kB | 49/98 kB | 49/71 kB | 8.3/11 kB Progress (4): 46/49 kB | 49/98 kB | 49/71 kB | 9.7/11 kB Progress (4): 47/49 kB | 49/98 kB | 49/71 kB | 9.7/11 kB Progress (4): 48/49 kB | 49/98 kB | 49/71 kB | 9.7/11 kB Progress (4): 48/49 kB | 49/98 kB | 49/71 kB | 11/11 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 11/11 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 186 kB/s) 2024-09-12T17:50:03.478 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:50:03.485 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/98 kB | 66/71 kB Progress (2): 66/98 kB | 66/71 kB Progress (2): 66/98 kB | 71 kB Progress (2): 82/98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T17:50:03.485 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:50:03.486 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-12T17:50:03.486 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:50:03.493 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (1): 82/205 kB Progress (2): 82/205 kB | 1.4/30 kB Progress (2): 82/205 kB | 2.8/30 kB Progress (2): 82/205 kB | 4.1/30 kB Progress (2): 98/205 kB | 4.1/30 kB Progress (2): 98/205 kB | 5.5/30 kB Progress (2): 98/205 kB | 6.9/30 kB Progress (2): 98/205 kB | 8.3/30 kB Progress (2): 98/205 kB | 9.7/30 kB Progress (2): 115/205 kB | 9.7/30 kB Progress (2): 131/205 kB | 9.7/30 kB Progress (2): 147/205 kB | 9.7/30 kB Progress (2): 147/205 kB | 11/30 kB Progress (2): 147/205 kB | 12/30 kB Progress (2): 164/205 kB | 12/30 kB Progress (2): 164/205 kB | 14/30 kB Progress (2): 164/205 kB | 15/30 kB Progress (2): 164/205 kB | 16/30 kB Progress (3): 164/205 kB | 16/30 kB | 16/81 kB Progress (3): 180/205 kB | 16/30 kB | 16/81 kB Progress (3): 197/205 kB | 16/30 kB | 16/81 kB Progress (3): 205 kB | 16/30 kB | 16/81 kB Progress (3): 205 kB | 17/30 kB | 16/81 kB Progress (3): 205 kB | 19/30 kB | 16/81 kB Progress (3): 205 kB | 20/30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.7 MB/s) 2024-09-12T17:50:03.493 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:50:03.495 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 21/30 kB | 16/81 kB Progress (2): 23/30 kB | 16/81 kB Progress (2): 24/30 kB | 16/81 kB Progress (2): 24/30 kB | 33/81 kB Progress (2): 25/30 kB | 33/81 kB Progress (2): 27/30 kB | 33/81 kB Progress (2): 28/30 kB | 33/81 kB Progress (2): 30/30 kB | 33/81 kB Progress (2): 30 kB | 33/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 382 kB/s) 2024-09-12T17:50:03.495 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:50:03.501 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/81 kB Progress (2): 49/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 158 kB/s) 2024-09-12T17:50:03.501 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:50:03.504 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/81 kB | 16/798 kB Progress (2): 49/81 kB | 33/798 kB Progress (2): 66/81 kB | 33/798 kB Progress (2): 81 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 934 kB/s) 2024-09-12T17:50:03.505 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:50:03.511 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/798 kB Progress (1): 66/798 kB Progress (2): 66/798 kB | 16/182 kB Progress (2): 66/798 kB | 32/182 kB Progress (2): 66/798 kB | 49/182 kB Progress (2): 66/798 kB | 65/182 kB Progress (2): 66/798 kB | 81/182 kB Progress (2): 66/798 kB | 98/182 kB Progress (2): 66/798 kB | 114/182 kB Progress (3): 66/798 kB | 114/182 kB | 16/151 kB Progress (3): 66/798 kB | 130/182 kB | 16/151 kB Progress (3): 66/798 kB | 147/182 kB | 16/151 kB Progress (3): 66/798 kB | 163/182 kB | 16/151 kB Progress (3): 66/798 kB | 180/182 kB | 16/151 kB Progress (3): 66/798 kB | 182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 2.0 MB/s) 2024-09-12T17:50:03.511 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:50:03.517 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/798 kB | 33/151 kB Progress (2): 82/798 kB | 33/151 kB Progress (2): 82/798 kB | 49/151 kB Progress (2): 98/798 kB | 49/151 kB Progress (2): 115/798 kB | 49/151 kB Progress (3): 115/798 kB | 49/151 kB | 16/27 kB Progress (3): 131/798 kB | 49/151 kB | 16/27 kB Progress (3): 131/798 kB | 49/151 kB | 27 kB Progress (3): 147/798 kB | 49/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 276 kB/s) 2024-09-12T17:50:03.517 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:50:03.526 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 164/798 kB | 49/151 kB Progress (2): 180/798 kB | 49/151 kB Progress (2): 197/798 kB | 49/151 kB Progress (2): 197/798 kB | 66/151 kB Progress (2): 197/798 kB | 82/151 kB Progress (2): 197/798 kB | 98/151 kB Progress (2): 197/798 kB | 115/151 kB Progress (2): 213/798 kB | 115/151 kB Progress (2): 213/798 kB | 131/151 kB Progress (2): 229/798 kB | 131/151 kB Progress (2): 246/798 kB | 131/151 kB Progress (3): 246/798 kB | 131/151 kB | 16/30 kB Progress (4): 246/798 kB | 131/151 kB | 16/30 kB | 16/385 kB Progress (4): 246/798 kB | 147/151 kB | 16/30 kB | 16/385 kB Progress (4): 246/798 kB | 151 kB | 16/30 kB | 16/385 kB Progress (4): 256/798 kB | 151 kB | 16/30 kB | 16/385 kB Progress (4): 256/798 kB | 151 kB | 16/30 kB | 32/385 kB Progress (4): 256/798 kB | 151 kB | 30 kB | 32/385 kB Progress (4): 272/798 kB | 151 kB | 30 kB | 32/385 kB Progress (4): 272/798 kB | 151 kB | 30 kB | 49/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-12T17:50:03.526 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 278 kB/s) 2024-09-12T17:50:03.527 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:50:03.527 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:50:03.531 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 272/798 kB | 65/385 kB Progress (2): 289/798 kB | 65/385 kB Progress (2): 289/798 kB | 81/385 kB Progress (2): 305/798 kB | 81/385 kB Progress (2): 305/798 kB | 98/385 kB Progress (2): 305/798 kB | 114/385 kB Progress (2): 305/798 kB | 130/385 kB Progress (2): 305/798 kB | 147/385 kB Progress (2): 305/798 kB | 163/385 kB Progress (2): 305/798 kB | 180/385 kB Progress (2): 321/798 kB | 180/385 kB Progress (2): 321/798 kB | 196/385 kB Progress (2): 338/798 kB | 196/385 kB Progress (2): 338/798 kB | 212/385 kB Progress (2): 354/798 kB | 212/385 kB Progress (2): 354/798 kB | 229/385 kB Progress (2): 370/798 kB | 229/385 kB Progress (2): 370/798 kB | 245/385 kB Progress (2): 370/798 kB | 262/385 kB Progress (2): 387/798 kB | 262/385 kB Progress (2): 387/798 kB | 278/385 kB Progress (2): 403/798 kB | 278/385 kB Progress (2): 403/798 kB | 294/385 kB Progress (2): 420/798 kB | 294/385 kB Progress (2): 420/798 kB | 311/385 kB Progress (2): 420/798 kB | 327/385 kB Progress (2): 420/798 kB | 343/385 kB Progress (2): 436/798 kB | 343/385 kB Progress (2): 436/798 kB | 360/385 kB Progress (3): 436/798 kB | 360/385 kB | 13 kB Progress (3): 436/798 kB | 376/385 kB | 13 kB Progress (3): 436/798 kB | 385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 116 kB/s) 2024-09-12T17:50:03.531 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:50:03.531 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.4 MB/s) 2024-09-12T17:50:03.531 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:50:03.542 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 452/798 kB Progress (1): 469/798 kB Progress (1): 485/798 kB Progress (1): 502/798 kB Progress (1): 518/798 kB Progress (1): 534/798 kB Progress (1): 551/798 kB Progress (1): 567/798 kB Progress (1): 583/798 kB Progress (1): 600/798 kB Progress (1): 616/798 kB Progress (1): 633/798 kB Progress (1): 649/798 kB Progress (1): 665/798 kB Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (1): 715/798 kB Progress (1): 731/798 kB Progress (1): 747/798 kB Progress (2): 747/798 kB | 16/75 kB Progress (2): 764/798 kB | 16/75 kB Progress (2): 764/798 kB | 33/75 kB Progress (2): 780/798 kB | 33/75 kB Progress (2): 796/798 kB | 33/75 kB Progress (2): 798 kB | 33/75 kB Progress (2): 798 kB | 49/75 kB Progress (2): 798 kB | 66/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.4 MB/s) 2024-09-12T17:50:03.542 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/75 kB | 16/780 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:50:03.542 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 75 kB | 16/780 kB Progress (2): 75 kB | 33/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 601 kB/s) 2024-09-12T17:50:03.542 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:50:03.551 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (1): 98/780 kB Progress (1): 115/780 kB Progress (1): 131/780 kB Progress (2): 131/780 kB | 16/329 kB Progress (3): 131/780 kB | 16/329 kB | 16/501 kB Progress (3): 131/780 kB | 33/329 kB | 16/501 kB Progress (3): 131/780 kB | 49/329 kB | 16/501 kB Progress (3): 147/780 kB | 49/329 kB | 16/501 kB Progress (3): 147/780 kB | 66/329 kB | 16/501 kB Progress (3): 147/780 kB | 66/329 kB | 33/501 kB Progress (3): 147/780 kB | 82/329 kB | 33/501 kB Progress (3): 147/780 kB | 98/329 kB | 33/501 kB Progress (3): 147/780 kB | 115/329 kB | 33/501 kB Progress (3): 147/780 kB | 131/329 kB | 33/501 kB Progress (3): 147/780 kB | 131/329 kB | 49/501 kB Progress (3): 147/780 kB | 147/329 kB | 49/501 kB Progress (3): 147/780 kB | 164/329 kB | 49/501 kB Progress (3): 147/780 kB | 180/329 kB | 49/501 kB Progress (3): 147/780 kB | 197/329 kB | 49/501 kB Progress (3): 147/780 kB | 197/329 kB | 66/501 kB Progress (3): 147/780 kB | 213/329 kB | 66/501 kB Progress (3): 147/780 kB | 229/329 kB | 66/501 kB Progress (3): 147/780 kB | 246/329 kB | 66/501 kB Progress (3): 147/780 kB | 246/329 kB | 82/501 kB Progress (3): 147/780 kB | 262/329 kB | 82/501 kB Progress (3): 147/780 kB | 279/329 kB | 82/501 kB Progress (3): 147/780 kB | 295/329 kB | 82/501 kB Progress (3): 147/780 kB | 311/329 kB | 82/501 kB Progress (3): 147/780 kB | 328/329 kB | 82/501 kB Progress (3): 147/780 kB | 329 kB | 82/501 kB Progress (3): 147/780 kB | 329 kB | 98/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.5 MB/s) 2024-09-12T17:50:03.551 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:50:03.558 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 164/780 kB | 98/501 kB Progress (2): 180/780 kB | 98/501 kB Progress (2): 197/780 kB | 98/501 kB Progress (2): 213/780 kB | 98/501 kB Progress (2): 229/780 kB | 98/501 kB Progress (2): 246/780 kB | 98/501 kB Progress (2): 262/780 kB | 98/501 kB Progress (2): 279/780 kB | 98/501 kB Progress (3): 279/780 kB | 98/501 kB | 16/41 kB Progress (4): 279/780 kB | 98/501 kB | 16/41 kB | 16/354 kB Progress (4): 279/780 kB | 98/501 kB | 33/41 kB | 16/354 kB Progress (4): 295/780 kB | 98/501 kB | 33/41 kB | 16/354 kB Progress (4): 295/780 kB | 98/501 kB | 41 kB | 16/354 kB Progress (4): 295/780 kB | 98/501 kB | 41 kB | 33/354 kB Progress (4): 295/780 kB | 98/501 kB | 41 kB | 49/354 kB Progress (4): 311/780 kB | 98/501 kB | 41 kB | 49/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 296 kB/s) 2024-09-12T17:50:03.558 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 328/780 kB | 98/501 kB | 49/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:50:03.567 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 328/780 kB | 98/501 kB | 66/354 kB Progress (3): 328/780 kB | 115/501 kB | 66/354 kB Progress (3): 344/780 kB | 115/501 kB | 66/354 kB Progress (3): 344/780 kB | 115/501 kB | 82/354 kB Progress (3): 360/780 kB | 115/501 kB | 82/354 kB Progress (3): 360/780 kB | 131/501 kB | 82/354 kB Progress (3): 360/780 kB | 131/501 kB | 98/354 kB Progress (3): 377/780 kB | 131/501 kB | 98/354 kB Progress (3): 377/780 kB | 131/501 kB | 115/354 kB Progress (3): 393/780 kB | 131/501 kB | 115/354 kB Progress (3): 393/780 kB | 147/501 kB | 115/354 kB Progress (3): 393/780 kB | 147/501 kB | 131/354 kB Progress (3): 402/780 kB | 147/501 kB | 131/354 kB Progress (3): 402/780 kB | 164/501 kB | 131/354 kB Progress (3): 402/780 kB | 164/501 kB | 147/354 kB Progress (3): 418/780 kB | 164/501 kB | 147/354 kB Progress (3): 418/780 kB | 164/501 kB | 164/354 kB Progress (3): 435/780 kB | 164/501 kB | 164/354 kB Progress (3): 451/780 kB | 164/501 kB | 164/354 kB Progress (3): 451/780 kB | 180/501 kB | 164/354 kB Progress (3): 451/780 kB | 180/501 kB | 180/354 kB Progress (3): 451/780 kB | 180/501 kB | 197/354 kB Progress (3): 451/780 kB | 197/501 kB | 197/354 kB Progress (3): 451/780 kB | 197/501 kB | 213/354 kB Progress (3): 451/780 kB | 213/501 kB | 213/354 kB Progress (3): 451/780 kB | 229/501 kB | 213/354 kB Progress (3): 451/780 kB | 246/501 kB | 213/354 kB Progress (3): 451/780 kB | 256/501 kB | 213/354 kB Progress (3): 451/780 kB | 272/501 kB | 213/354 kB Progress (3): 468/780 kB | 272/501 kB | 213/354 kB Progress (3): 484/780 kB | 272/501 kB | 213/354 kB Progress (3): 500/780 kB | 272/501 kB | 213/354 kB Progress (3): 517/780 kB | 272/501 kB | 213/354 kB Progress (4): 517/780 kB | 272/501 kB | 213/354 kB | 6.4 kB Progress (4): 533/780 kB | 272/501 kB | 213/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 43 kB/s) 2024-09-12T17:50:03.567 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 549/780 kB | 272/501 kB | 213/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:50:03.572 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 566/780 kB | 272/501 kB | 213/354 kB Progress (3): 582/780 kB | 272/501 kB | 213/354 kB Progress (3): 582/780 kB | 272/501 kB | 229/354 kB Progress (3): 599/780 kB | 272/501 kB | 229/354 kB Progress (3): 599/780 kB | 272/501 kB | 246/354 kB Progress (3): 615/780 kB | 272/501 kB | 246/354 kB Progress (3): 615/780 kB | 272/501 kB | 262/354 kB Progress (3): 631/780 kB | 272/501 kB | 262/354 kB Progress (3): 631/780 kB | 272/501 kB | 279/354 kB Progress (3): 648/780 kB | 272/501 kB | 279/354 kB Progress (3): 658/780 kB | 272/501 kB | 279/354 kB Progress (3): 658/780 kB | 272/501 kB | 295/354 kB Progress (3): 658/780 kB | 289/501 kB | 295/354 kB Progress (3): 674/780 kB | 289/501 kB | 295/354 kB Progress (3): 674/780 kB | 289/501 kB | 311/354 kB Progress (3): 674/780 kB | 305/501 kB | 311/354 kB Progress (3): 691/780 kB | 305/501 kB | 311/354 kB Progress (3): 691/780 kB | 305/501 kB | 328/354 kB Progress (3): 694/780 kB | 305/501 kB | 328/354 kB Progress (3): 694/780 kB | 321/501 kB | 328/354 kB Progress (3): 694/780 kB | 321/501 kB | 344/354 kB Progress (3): 711/780 kB | 321/501 kB | 344/354 kB Progress (3): 711/780 kB | 321/501 kB | 354 kB Progress (3): 711/780 kB | 338/501 kB | 354 kB Progress (3): 727/780 kB | 338/501 kB | 354 kB Progress (3): 727/780 kB | 354/501 kB | 354 kB Progress (3): 743/780 kB | 354/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.3 MB/s) 2024-09-12T17:50:03.572 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:50:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 743/780 kB | 370/501 kB Progress (2): 760/780 kB | 370/501 kB Progress (2): 776/780 kB | 370/501 kB Progress (2): 776/780 kB | 387/501 kB Progress (2): 780 kB | 387/501 kB Progress (2): 780 kB | 403/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.1 MB/s) 2024-09-12T17:50:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:50:03.576 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 403/501 kB | 16/586 kB Progress (2): 420/501 kB | 16/586 kB Progress (2): 420/501 kB | 33/586 kB Progress (2): 420/501 kB | 49/586 kB Progress (2): 436/501 kB | 49/586 kB Progress (2): 436/501 kB | 66/586 kB Progress (2): 452/501 kB | 66/586 kB Progress (2): 452/501 kB | 82/586 kB Progress (2): 469/501 kB | 82/586 kB Progress (2): 469/501 kB | 98/586 kB Progress (2): 469/501 kB | 115/586 kB Progress (2): 485/501 kB | 115/586 kB Progress (2): 485/501 kB | 131/586 kB Progress (2): 501 kB | 131/586 kB Progress (2): 501 kB | 147/586 kB Progress (2): 501 kB | 164/586 kB Progress (2): 501 kB | 180/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-12T17:50:03.576 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:50:03.582 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 256/586 kB Progress (1): 272/586 kB Progress (1): 289/586 kB Progress (1): 305/586 kB Progress (1): 321/586 kB Progress (1): 338/586 kB Progress (1): 354/586 kB Progress (1): 370/586 kB Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Progress (2): 586 kB | 16/211 kB Progress (2): 586 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.6 MB/s) 2024-09-12T17:50:03.582 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:50:03.584 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (1): 180/211 kB Progress (1): 197/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.3 MB/s) 2024-09-12T17:50:03.584 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:50:03.585 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 86 kB/s) 2024-09-12T17:50:03.585 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:50:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/106 kB Progress (1): 32/106 kB Progress (1): 49/106 kB Progress (1): 65/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 625 kB/s) 2024-09-12T17:50:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:50:03.589 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 40 kB/s) 2024-09-12T17:50:03.589 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (2): 180/245 kB | 6.4 kB Progress (3): 180/245 kB | 6.4 kB | 16/16 kB Progress (4): 180/245 kB | 6.4 kB | 16/16 kB | 16/205 kB Progress (5): 180/245 kB | 6.4 kB | 16/16 kB | 16/205 kB | 15 kB Progress (5): 197/245 kB | 6.4 kB | 16/16 kB | 16/205 kB | 15 kB Progress (5): 197/245 kB | 6.4 kB | 16 kB | 16/205 kB | 15 kB Progress (5): 197/245 kB | 6.4 kB | 16 kB | 33/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 213/245 kB | 16 kB | 33/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 74 kB/s) 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 213/245 kB | 16 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 80 kB/s) 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:50:03.626 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 229/245 kB | 49/205 kB Progress (2): 229/245 kB | 66/205 kB Progress (2): 245 kB | 66/205 kB Progress (2): 245 kB | 82/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:50:03.627 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 98/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:50:03.629 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 975 kB/s) 2024-09-12T17:50:03.640 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (2): 16/17 kB | 16/23 kB Progress (2): 17 kB | 16/23 kB Progress (2): 17 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 79 kB/s) 2024-09-12T17:50:03.640 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 102 kB/s) 2024-09-12T17:50:03.641 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/184 kB Progress (2): 24 kB | 16/184 kB Progress (2): 24 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 109 kB/s) 2024-09-12T17:50:03.644 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 817 kB/s) 2024-09-12T17:50:03.667 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:03.667 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:50:03.674 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:50:03.689 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:50:03.691 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:50:03.706 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:50:03.708 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:50:03.724 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T17:50:03.729 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:50:03.743 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T17:50:03.749 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:50:03.766 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 37/153 kB Progress (1): 53/153 kB Progress (1): 69/153 kB Progress (1): 86/153 kB Progress (1): 102/153 kB Progress (1): 118/153 kB Progress (1): 135/153 kB Progress (1): 151/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T17:50:03.767 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:50:03.785 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T17:50:03.832 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:03.832 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:50:03.836 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:50:03.850 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:50:03.852 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:50:03.866 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:50:03.870 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:50:03.884 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T17:50:03.887 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:50:03.902 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T17:50:03.905 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:50:03.919 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:50:03.921 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:50:03.935 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T17:50:03.939 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:50:03.953 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T17:50:03.955 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:50:03.969 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:50:03.971 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:50:03.985 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:50:03.987 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:50:04.001 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T17:50:04.003 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:50:04.017 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T17:50:04.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:50:04.033 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:50:04.035 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:50:04.050 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:50:04.053 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:50:04.068 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:50:04.073 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:50:04.087 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:50:04.089 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:50:04.104 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:50:04.109 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:50:04.123 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:50:04.127 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:50:04.142 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:50:04.142 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:50:04.142 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:50:04.143 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:50:04.143 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:50:04.143 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:50:04.157 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/55 kB Progress (4): 2.5 kB | 8.5 kB | 16/55 kB | 16/41 kB Progress (4): 2.5 kB | 8.5 kB | 33/55 kB | 16/41 kB Progress (4): 2.5 kB | 8.5 kB | 33/55 kB | 33/41 kB Progress (4): 2.5 kB | 8.5 kB | 49/55 kB | 33/41 kB Progress (4): 2.5 kB | 8.5 kB | 49/55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-12T17:50:04.157 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:50:04.157 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:50:04.157 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:50:04.157 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:50:04.158 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-12T17:50:04.161 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T17:50:04.178 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 66/587 kB Progress (1): 82/587 kB Progress (2): 82/587 kB | 16/327 kB Progress (2): 98/587 kB | 16/327 kB Progress (2): 98/587 kB | 33/327 kB Progress (2): 115/587 kB | 33/327 kB Progress (2): 115/587 kB | 49/327 kB Progress (2): 131/587 kB | 49/327 kB Progress (2): 131/587 kB | 66/327 kB Progress (2): 147/587 kB | 66/327 kB Progress (2): 147/587 kB | 82/327 kB Progress (2): 164/587 kB | 82/327 kB Progress (2): 164/587 kB | 98/327 kB Progress (2): 180/587 kB | 98/327 kB Progress (2): 180/587 kB | 115/327 kB Progress (2): 197/587 kB | 115/327 kB Progress (2): 197/587 kB | 131/327 kB Progress (2): 213/587 kB | 131/327 kB Progress (2): 213/587 kB | 147/327 kB Progress (2): 229/587 kB | 147/327 kB Progress (2): 229/587 kB | 164/327 kB Progress (2): 246/587 kB | 164/327 kB Progress (2): 256/587 kB | 164/327 kB Progress (2): 256/587 kB | 180/327 kB Progress (2): 272/587 kB | 180/327 kB Progress (2): 272/587 kB | 197/327 kB Progress (2): 289/587 kB | 197/327 kB Progress (2): 289/587 kB | 213/327 kB Progress (2): 305/587 kB | 213/327 kB Progress (2): 305/587 kB | 229/327 kB Progress (2): 321/587 kB | 229/327 kB Progress (2): 321/587 kB | 246/327 kB Progress (2): 321/587 kB | 256/327 kB Progress (2): 338/587 kB | 256/327 kB Progress (2): 338/587 kB | 272/327 kB Progress (2): 354/587 kB | 272/327 kB Progress (2): 354/587 kB | 289/327 kB Progress (2): 370/587 kB | 289/327 kB Progress (2): 370/587 kB | 305/327 kB Progress (2): 387/587 kB | 305/327 kB Progress (2): 387/587 kB | 321/327 kB Progress (2): 403/587 kB | 321/327 kB Progress (2): 403/587 kB | 327 kB Progress (2): 420/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-12T17:50:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T17:50:04.225 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:50:04.225 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:04.225 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:50:04.231 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:50:04.245 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T17:50:04.247 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:50:04.262 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T17:50:04.263 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:50:04.277 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:50:04.279 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:50:04.292 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:50:04.295 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:50:04.308 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 63 kB/s) 2024-09-12T17:50:04.310 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:50:04.324 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:50:04.326 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:50:04.340 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:50:04.342 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:50:04.357 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T17:50:04.358 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:50:04.373 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T17:50:04.375 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:50:04.388 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-12T17:50:04.390 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:50:04.404 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T17:50:04.407 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:50:04.424 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T17:50:04.425 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:50:04.437 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T17:50:04.439 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:50:04.453 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:50:04.454 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:50:04.469 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T17:50:04.470 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:50:04.484 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-12T17:50:04.487 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:50:04.500 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T17:50:04.503 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:50:04.517 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T17:50:04.519 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:50:04.533 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 59 kB/s) 2024-09-12T17:50:04.534 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:50:04.548 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:50:04.549 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:50:04.563 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T17:50:04.566 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:50:04.581 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T17:50:04.583 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:50:04.597 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T17:50:04.604 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:50:04.618 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:50:04.618 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:50:04.618 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:50:04.618 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:50:04.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:50:04.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:50:04.636 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (2): 4.2 kB | 33/55 kB Progress (3): 4.2 kB | 33/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 33/55 kB | 16/122 kB | 16/27 kB Progress (3): 49/55 kB | 16/122 kB | 16/27 kB Progress (3): 49/55 kB | 33/122 kB | 16/27 kB Progress (3): 55 kB | 33/122 kB | 16/27 kB Progress (3): 55 kB | 33/122 kB | 27 kB Progress (3): 55 kB | 49/122 kB | 27 kB Progress (4): 55 kB | 49/122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.9 MB/s) 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:50:04.637 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/122 kB | 33/334 kB Progress (2): 66/122 kB | 33/334 kB Progress (2): 66/122 kB | 49/334 kB Progress (2): 82/122 kB | 49/334 kB Progress (2): 82/122 kB | 62/334 kB Progress (2): 98/122 kB | 62/334 kB Progress (2): 98/122 kB | 78/334 kB Progress (2): 115/122 kB | 78/334 kB Progress (2): 115/122 kB | 94/334 kB Progress (2): 122 kB | 94/334 kB Progress (2): 122 kB | 111/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-12T17:50:04.638 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 127/334 kB Progress (1): 143/334 kB Progress (1): 160/334 kB Progress (1): 176/334 kB Progress (1): 193/334 kB Progress (1): 209/334 kB Progress (1): 225/334 kB Progress (1): 242/334 kB Progress (1): 258/334 kB Progress (1): 275/334 kB Progress (1): 291/334 kB Progress (1): 307/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-12T17:50:04.650 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Progress (3): 4.7 kB | 16/267 kB | 16/23 kB Progress (3): 4.7 kB | 16/267 kB | 23 kB Progress (3): 4.7 kB | 32/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-12T17:50:04.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 844 kB/s) 2024-09-12T17:50:04.650 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-12T17:50:04.697 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:50:04.698 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:50:05.328 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:50:05.328 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:05.328 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:50:05.332 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:50:05.332 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:05.332 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:50:05.339 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:50:05.339 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:50:05.560 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:50:05.560 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:05.560 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:50:05.566 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:50:05.581 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:50:05.585 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:50:05.601 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T17:50:05.606 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:50:05.621 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T17:50:05.626 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:50:05.641 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-12T17:50:05.646 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:50:05.661 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T17:50:05.665 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:50:05.680 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T17:50:05.685 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:50:05.699 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T17:50:05.702 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:50:05.716 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:50:05.719 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:50:05.733 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:50:05.736 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:50:05.751 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:50:05.754 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:50:05.771 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 322 kB/s) 2024-09-12T17:50:05.777 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:50:05.793 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-09-12T17:50:05.795 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:50:05.811 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T17:50:05.813 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:50:05.829 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T17:50:05.832 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:50:05.847 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:50:05.851 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:50:05.865 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T17:50:05.868 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:50:05.883 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-12T17:50:05.886 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:50:05.902 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T17:50:05.906 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:50:05.921 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-12T17:50:05.925 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:50:05.938 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:50:05.941 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:50:05.955 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-12T17:50:05.957 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:50:05.970 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-12T17:50:05.972 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:50:05.986 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:50:05.988 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:50:06.002 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:50:06.004 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:50:06.018 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:50:06.020 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:50:06.034 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:50:06.035 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:50:06.050 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 453 kB/s) 2024-09-12T17:50:06.051 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:50:06.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-12T17:50:06.066 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:50:06.079 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-12T17:50:06.081 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:50:06.095 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T17:50:06.098 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:50:06.112 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:50:06.115 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:50:06.130 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-12T17:50:06.132 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:50:06.147 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:50:06.150 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:50:06.164 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:50:06.165 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:50:06.180 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:50:06.182 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:50:06.196 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T17:50:06.197 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:50:06.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-12T17:50:06.214 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:50:06.227 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.3 MB/s) 2024-09-12T17:50:06.229 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:50:06.244 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-12T17:50:06.246 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:50:06.261 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-12T17:50:06.262 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:50:06.276 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T17:50:06.278 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:50:06.292 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T17:50:06.295 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:50:06.310 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-12T17:50:06.313 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:50:06.327 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T17:50:06.329 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:50:06.343 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T17:50:06.345 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:50:06.359 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T17:50:06.361 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:50:06.375 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T17:50:06.377 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:50:06.390 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T17:50:06.392 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:50:06.406 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T17:50:06.408 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:50:06.422 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T17:50:06.423 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:50:06.437 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-12T17:50:06.438 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:50:06.451 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-12T17:50:06.452 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:50:06.466 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T17:50:06.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:50:06.482 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T17:50:06.484 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:50:06.499 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T17:50:06.501 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:50:06.516 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-12T17:50:06.518 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:50:06.532 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:50:06.534 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:50:06.548 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 435 kB/s) 2024-09-12T17:50:06.550 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:50:06.563 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:50:06.565 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:50:06.578 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-12T17:50:06.579 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:50:06.593 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.1 MB/s) 2024-09-12T17:50:06.596 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:50:06.609 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-12T17:50:06.614 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:50:06.633 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 62/308 kB Progress (1): 79/308 kB Progress (1): 95/308 kB Progress (1): 111/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 161/308 kB Progress (1): 177/308 kB Progress (1): 193/308 kB Progress (1): 210/308 kB Progress (1): 226/308 kB Progress (1): 242/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 292/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-12T17:50:06.634 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:50:06.634 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:50:06.634 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:50:06.634 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:50:06.634 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:50:06.650 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 16/26 kB Progress (3): 16/171 kB | 16/26 kB | 14 kB Progress (3): 16/171 kB | 26 kB | 14 kB Progress (3): 32/171 kB | 26 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-12T17:50:06.650 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.8 MB/s) 2024-09-12T17:50:06.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:50:06.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 65/171 kB Progress (2): 65/171 kB | 16/118 kB Progress (2): 81/171 kB | 16/118 kB Progress (2): 81/171 kB | 32/118 kB Progress (2): 98/171 kB | 32/118 kB Progress (2): 114/171 kB | 32/118 kB Progress (2): 114/171 kB | 49/118 kB Progress (2): 130/171 kB | 49/118 kB Progress (2): 130/171 kB | 65/118 kB Progress (2): 147/171 kB | 65/118 kB Progress (2): 163/171 kB | 65/118 kB Progress (2): 163/171 kB | 81/118 kB Progress (2): 171 kB | 81/118 kB Progress (3): 171 kB | 81/118 kB | 8.2 kB Progress (3): 171 kB | 98/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 114/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-12T17:50:06.652 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:50:06.664 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (1): 98/146 kB Progress (1): 115/146 kB Progress (2): 115/146 kB | 16/136 kB Progress (2): 131/146 kB | 16/136 kB Progress (2): 131/146 kB | 32/136 kB Progress (2): 146 kB | 32/136 kB Progress (2): 146 kB | 49/136 kB Progress (2): 146 kB | 65/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.9 MB/s) 2024-09-12T17:50:06.664 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:50:06.668 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 81/136 kB Progress (2): 81/136 kB | 16/61 kB Progress (2): 98/136 kB | 16/61 kB Progress (3): 98/136 kB | 16/61 kB | 16/58 kB Progress (3): 98/136 kB | 33/61 kB | 16/58 kB Progress (4): 98/136 kB | 33/61 kB | 16/58 kB | 16/501 kB Progress (4): 114/136 kB | 33/61 kB | 16/58 kB | 16/501 kB Progress (4): 114/136 kB | 33/61 kB | 33/58 kB | 16/501 kB Progress (4): 114/136 kB | 33/61 kB | 33/58 kB | 32/501 kB Progress (4): 114/136 kB | 49/61 kB | 33/58 kB | 32/501 kB Progress (4): 130/136 kB | 49/61 kB | 33/58 kB | 32/501 kB Progress (4): 130/136 kB | 49/61 kB | 49/58 kB | 32/501 kB Progress (4): 130/136 kB | 61 kB | 49/58 kB | 32/501 kB Progress (4): 130/136 kB | 61 kB | 49/58 kB | 49/501 kB Progress (4): 136 kB | 61 kB | 49/58 kB | 49/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 49/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 65/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T17:50:06.668 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 136 kB | 58 kB | 81/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-12T17:50:06.668 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-12T17:50:06.668 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:50:06.673 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (1): 468/501 kB Progress (1): 484/501 kB Progress (1): 500/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T17:50:06.679 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:50:06.723 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-09-12T17:50:06.786 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:06.786 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:50:06.789 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:50:06.803 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:50:06.804 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:50:06.818 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T17:50:06.820 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:50:06.834 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-12T17:50:06.836 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:50:06.850 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T17:50:06.853 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:50:06.866 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-12T17:50:06.868 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:50:06.885 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:50:06.885 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:50:06.899 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:50:06.901 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:50:06.915 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:50:06.917 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:50:06.934 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-12T17:50:06.937 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:50:06.952 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-12T17:50:06.954 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:50:06.968 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 157 kB/s) 2024-09-12T17:50:06.970 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:50:06.983 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:50:06.985 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:50:06.999 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:50:07.004 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:50:07.018 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:50:07.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:50:07.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:50:07.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:50:07.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:50:07.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:50:07.033 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/58 kB Progress (2): 26 kB | 16/58 kB Progress (2): 26 kB | 33/58 kB Progress (2): 26 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.9 MB/s) 2024-09-12T17:50:07.033 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:50:07.033 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 58 kB Progress (2): 58 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 4.1 MB/s) 2024-09-12T17:50:07.033 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:50:07.037 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (2): 82/211 kB | 16/79 kB Progress (2): 98/211 kB | 16/79 kB Progress (2): 98/211 kB | 32/79 kB Progress (2): 115/211 kB | 32/79 kB Progress (2): 115/211 kB | 49/79 kB Progress (2): 131/211 kB | 49/79 kB Progress (2): 131/211 kB | 65/79 kB Progress (3): 131/211 kB | 65/79 kB | 0/1.0 MB Progress (3): 131/211 kB | 79 kB | 0/1.0 MB Progress (3): 147/211 kB | 79 kB | 0/1.0 MB Progress (3): 147/211 kB | 79 kB | 0/1.0 MB Progress (3): 164/211 kB | 79 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T17:50:07.037 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 164/211 kB | 0/1.0 MB Progress (2): 164/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 197/211 kB | 0.1/1.0 MB Progress (2): 197/211 kB | 0.1/1.0 MB Progress (2): 197/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T17:50:07.049 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 66/116 kB Progress (2): 0.8/1.0 MB | 66/116 kB Progress (2): 0.8/1.0 MB | 82/116 kB Progress (2): 0.8/1.0 MB | 82/116 kB Progress (2): 0.8/1.0 MB | 98/116 kB Progress (2): 0.8/1.0 MB | 98/116 kB Progress (2): 0.8/1.0 MB | 115/116 kB Progress (2): 0.8/1.0 MB | 116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (3): 0.9/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-12T17:50:07.052 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 0.9/1.0 MB | 33/267 kB Progress (2): 0.9/1.0 MB | 33/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 66/267 kB Progress (2): 0.9/1.0 MB | 66/267 kB Progress (2): 0.9/1.0 MB | 82/267 kB Progress (2): 0.9/1.0 MB | 82/267 kB Progress (2): 0.9/1.0 MB | 98/267 kB Progress (2): 1.0/1.0 MB | 98/267 kB Progress (2): 1.0/1.0 MB | 115/267 kB Progress (2): 1.0/1.0 MB | 115/267 kB Progress (2): 1.0/1.0 MB | 115/267 kB Progress (2): 1.0/1.0 MB | 131/267 kB Progress (2): 1.0/1.0 MB | 131/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0 MB | 147/267 kB Progress (2): 1.0 MB | 164/267 kB Progress (2): 1.0 MB | 180/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 31 MB/s) 2024-09-12T17:50:07.052 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.9 MB/s) 2024-09-12T17:50:07.191 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:50:07.214 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:50:07.214 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:50:07.215 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:50:07.215 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 5.811 s 2024-09-12T17:50:07.215 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-12T17:50:07Z 2024-09-12T17:50:07.215 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:50:07.258 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:50:07.267 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:50:08.264 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-12T17:50:08.337 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.337 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:50:08.337 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:50:08.338 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-12T17:50:08.338 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:50:08.564 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.564 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:50:08.654 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:50:08.655 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.655 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:50:08.748 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:50:08.755 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.755 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:08.756 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:50:08.936 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:50:09.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:50:09.352 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 25 kB/s) 2024-09-12T17:50:09.360 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:50:09.380 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-12T17:50:09.387 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:50:09.405 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T17:50:09.411 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:50:09.429 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T17:50:09.432 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:50:09.449 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:50:09.453 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:50:09.470 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T17:50:09.473 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:50:09.490 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:50:09.497 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:50:09.520 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:50:09.522 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:50:09.523 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:50:09.523 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:50:09.523 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:50:09.524 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:50:09.543 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 798 kB/s) 2024-09-12T17:50:09.577 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (2): 4.1/7.7 kB | 16/103 kB Progress (2): 5.5/7.7 kB | 16/103 kB Progress (3): 5.5/7.7 kB | 16/103 kB | 1.4/189 kB Progress (3): 6.9/7.7 kB | 16/103 kB | 1.4/189 kB Progress (3): 6.9/7.7 kB | 16/103 kB | 2.8/189 kB Progress (3): 7.7 kB | 16/103 kB | 2.8/189 kB Progress (4): 7.7 kB | 16/103 kB | 2.8/189 kB | 16/169 kB Progress (4): 7.7 kB | 16/103 kB | 4.1/189 kB | 16/169 kB Progress (4): 7.7 kB | 16/103 kB | 5.5/189 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 144 kB/s) 2024-09-12T17:50:09.609 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 16/103 kB | 6.9/189 kB | 16/169 kB Progress (3): 16/103 kB | 8.3/189 kB | 16/169 kB Progress (3): 16/103 kB | 9.7/189 kB | 16/169 kB Progress (3): 16/103 kB | 11/189 kB | 16/169 kB Progress (3): 16/103 kB | 12/189 kB | 16/169 kB Progress (3): 16/103 kB | 14/189 kB | 16/169 kB Progress (3): 16/103 kB | 15/189 kB | 16/169 kB Progress (3): 16/103 kB | 16/189 kB | 16/169 kB Progress (3): 16/103 kB | 32/189 kB | 16/169 kB Progress (3): 33/103 kB | 32/189 kB | 16/169 kB Progress (3): 33/103 kB | 32/189 kB | 33/169 kB Progress (3): 33/103 kB | 49/189 kB | 33/169 kB Progress (3): 49/103 kB | 49/189 kB | 33/169 kB Progress (3): 49/103 kB | 49/189 kB | 49/169 kB Progress (3): 66/103 kB | 49/189 kB | 49/169 kB Progress (3): 66/103 kB | 65/189 kB | 49/169 kB Progress (3): 66/103 kB | 65/189 kB | 66/169 kB Progress (3): 82/103 kB | 65/189 kB | 66/169 kB Progress (3): 82/103 kB | 81/189 kB | 66/169 kB Progress (3): 82/103 kB | 81/189 kB | 82/169 kB Progress (3): 98/103 kB | 81/189 kB | 82/169 kB Progress (3): 103 kB | 81/189 kB | 82/169 kB Progress (3): 103 kB | 98/189 kB | 82/169 kB Progress (3): 103 kB | 98/189 kB | 98/169 kB Progress (3): 103 kB | 114/189 kB | 98/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T17:50:09.615 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 114/189 kB | 115/169 kB Progress (2): 131/189 kB | 115/169 kB Progress (2): 131/189 kB | 131/169 kB Progress (2): 147/189 kB | 131/169 kB Progress (2): 147/189 kB | 147/169 kB Progress (2): 163/189 kB | 147/169 kB Progress (2): 163/189 kB | 164/169 kB Progress (2): 180/189 kB | 164/169 kB Progress (2): 180/189 kB | 169 kB Progress (2): 189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-12T17:50:09.615 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T17:50:09.630 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:50:09.630 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:50:09.630 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] T E S T S 2024-09-12T17:50:09.630 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:50:10.093 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:50:10.210 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjects.java: starting test run: 2024-09-12T17:50:10.210 INFO:tasks.workunit.client.0.smithi094.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:50:10.210 INFO:tasks.workunit.client.0.smithi094.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:50:10.210 INFO:tasks.workunit.client.0.smithi094.stdout: EndpointUrl=http://smithi094.front.sepia.ceph.com:80 2024-09-12T17:50:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:50:10.307 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Environment Variables Read 2024-09-12T17:50:10.608 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:50:10.608 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.609 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.609 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.609 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.609 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.709 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.709 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.710 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.710 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.710 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.711 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-12T17:50:10.711 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-12T17:50:10.711 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generated Big Files 2024-09-12T17:50:10.908 INFO:tasks.workunit.client.0.smithi094.stdout:HeadBucketResponse() 2024-09-12T17:50:10.908 INFO:tasks.workunit.client.0.smithi094.stdout:sheik is ready 2024-09-12T17:50:10.908 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Test Bucket Created 2024-09-12T17:50:11.008 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:50:11.208 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:50:11.309 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:50:11.609 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:50:11.709 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:50:11.809 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:50:12.010 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:50:12.110 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:50:12.410 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:50:12.811 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:50:16.417 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:50:18.620 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:50:38.460 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-0b 2024-09-12T17:50:38.461 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-8b 2024-09-12T17:50:38.462 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-200b 2024-09-12T17:50:38.463 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-21983b 2024-09-12T17:50:38.464 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-5519b 2024-09-12T17:50:38.465 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-204329b 2024-09-12T17:50:38.466 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-256k 2024-09-12T17:50:38.467 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1m 2024-09-12T17:50:38.467 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1038757b 2024-09-12T17:50:38.546 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:50:38.600 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:38.646 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:50:38.719 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:38.746 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:50:38.845 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:38.846 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:50:38.946 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:39.046 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:50:39.047 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:39.146 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:50:39.246 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:39.347 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:50:39.411 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:39.447 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:50:39.926 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:39.947 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:50:40.213 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-12T17:50:40.248 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:50:41.549 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:50:44.554 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:51:27.958 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.85 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:51:27.971 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:51:27.971 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Results: 2024-09-12T17:51:27.971 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:51:27.971 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:51:27.971 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-12T17:51:27.973 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:51:27.973 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:51:27.973 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:51:27.975 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 01:19 min 2024-09-12T17:51:27.975 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-12T17:51:27Z 2024-09-12T17:51:27.975 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:51:27.987 INFO:tasks.workunit.client.0.smithi094.stderr:+ exit 2024-09-12T17:51:27.988 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:51:27.988 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:51:28.068 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:51:28.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:51:28.420 DEBUG:teuthology.parallel:result is None 2024-09-12T17:51:28.420 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:51:28.459 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:51:28.459 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:51:28.527 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:51:28.528 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:51:28.538 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:51:28.538 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:51:28.538 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:51:28.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:51:28.597 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:51:28.597 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:51:28.666 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:51:28.666 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:51:28.735 INFO:tasks.workunit:timeout=3h 2024-09-12T17:51:28.735 INFO:tasks.workunit:cleanup=True 2024-09-12T17:51:28.736 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:51:28.805 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:52:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:52:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-12T17:52:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.344 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:52:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:52:28.344 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:52:28.347 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:52:28.416 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:52:28.418 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:52:28.418 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:52:28.466 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:52:28.515 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:52:28.555 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:52:28.556 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:52:28.556 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:52:28.595 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:52:28.598 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:52:28.598 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:52:28.668 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:52:28.669 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:52:28.669 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:52:28.743 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: fully qualified domain name: smithi094.front.sepia.ceph.com 2024-09-12T17:52:28.743 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:52:28.743 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T17:52:31.323 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:52:31.503 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-12T17:52:31.508 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:52:31.553 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-12T17:52:31.553 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-12T17:52:31.553 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:52:31.705 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:52:31.710 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:52:32.439 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-12T17:52:33.267 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-12T17:52:33.269 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:52:33.860 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:52:33.861 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:52:33.908 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:52:33.910 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:52:33.948 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:52:33.949 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:52:33.990 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:52:33.991 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:52:34.058 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:52:34.059 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:52:34.254 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:52:34.255 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:52:34.260 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:52:34.261 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:52:34.271 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:52:34.272 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:52:34.273 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:52:34.275 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:52:34.276 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:52:34.349 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:52:35.390 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:52:35.622 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: creating user 2024-09-12T17:52:35.735 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "testid", 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "M. Tester", 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "tester@ceph.com", 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "testid", 2024-09-12T17:52:35.736 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:52:35.726552Z" 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:52:35.737 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-12T17:52:35.738 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-12T17:52:35.726541Z", 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-12T17:52:35.739 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-12T17:52:36.020 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records in 2024-09-12T17:52:36.020 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records out 2024-09-12T17:52:36.020 INFO:tasks.workunit.client.0.smithi094.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142441 s, 368 MB/s 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:bucket nams is reupload-bkt-122085 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:endpoint is http://smithi094.front.sepia.ceph.com:80 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:start UploadId=2~szikeSkXYB3rovtqWbi8bEtTythymti 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 2} 2024-09-12T17:52:45.300 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1} 2024-09-12T17:52:45.301 INFO:tasks.workunit.client.0.smithi094.stdout:completing multipart upload, parts=[{'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 1}, {'ETag': '"3ee06f5ce644e52428daa38a394bf0f6"', 'PartNumber': 2}] 2024-09-12T17:52:45.921 INFO:tasks.workunit.client.0.smithi094.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:52:45.922 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3_mpu_test4 2024-09-12T17:52:45.922 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__multipart_mpu_test4.2~szikeSkXYB3rovtqWbi8bEtTythymti.2 2024-09-12T17:52:45.922 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__multipart_mpu_test4.sillUT2FTmP8lsDMo7lPu-yto6RP6hZ_.1 2024-09-12T17:52:45.922 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__shadow_mpu_test4.2~szikeSkXYB3rovtqWbi8bEtTythymti.2_1 2024-09-12T17:52:45.922 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__shadow_mpu_test4.sillUT2FTmP8lsDMo7lPu-yto6RP6hZ_.1_1 2024-09-12T17:52:45.982 INFO:tasks.workunit.client.0.smithi094.stdout:rados ls: 2024-09-12T17:52:45.982 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3_mpu_test4 2024-09-12T17:52:45.982 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__multipart_mpu_test4.2~szikeSkXYB3rovtqWbi8bEtTythymti.2 2024-09-12T17:52:45.983 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__multipart_mpu_test4.sillUT2FTmP8lsDMo7lPu-yto6RP6hZ_.1 2024-09-12T17:52:45.983 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__shadow_mpu_test4.2~szikeSkXYB3rovtqWbi8bEtTythymti.2_1 2024-09-12T17:52:45.983 INFO:tasks.workunit.client.0.smithi094.stdout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3__shadow_mpu_test4.sillUT2FTmP8lsDMo7lPu-yto6RP6hZ_.1_1 2024-09-12T17:52:45.989 INFO:tasks.workunit.client.0.smithi094.stdout:== PASSED == 2024-09-12T17:52:45.990 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:52:45.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:52:46.068 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:52:46.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:52:46.426 DEBUG:teuthology.parallel:result is None 2024-09-12T17:52:46.426 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:52:46.465 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:52:46.465 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:52:46.534 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:52:46.534 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:52:46.549 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:52:46.550 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:52:46.550 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:52:46.550 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:52:46.603 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:52:46.633 INFO:teuthology.orchestra.run.smithi094.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:52:46.633 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:52:46.634 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:52:46.635 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:52:46.704 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:52:46.891 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:52:46.892 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:52:46.892 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key DEXEGGINGKNDGBFTJCEU --secret OkpAnbdrruOZ5NJ7OLp9vZhT/JNlYX2UL6gcsNoSb2BCqFzgWtjmJA== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:47.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.031+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 realm 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:47.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.032+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.033+0000 7fd71cb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:47.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.033+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.034+0000 7fd71cb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:47.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.034+0000 7fd71cb25800 20 searching for the correct realm 2024-09-12T17:52:47.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.037+0000 7fd718f34640 0 -- 172.21.15.94:0/569408623 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5639cfca87d0 msgr2=0x5639cfcaac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:47.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.041+0000 7fd718733640 0 -- 172.21.15.94:0/569408623 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fd70c0e31d0 msgr2=0x7fd70c0b0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.045+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 zone default found 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 4 Realm: () 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 zonegroup default 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.046+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.047+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.047+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.047+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.047+0000 7fd71cb25800 20 started sync module instance, tier type = 2024-09-12T17:52:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.047+0000 7fd71cb25800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=0 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=1 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=2 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=3 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=4 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=5 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.056+0000 7fd71cb25800 20 add_watcher() i=6 2024-09-12T17:52:47.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.057+0000 7fd71cb25800 20 add_watcher() i=7 2024-09-12T17:52:47.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.057+0000 7fd71cb25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.058+0000 7fd5cf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.058+0000 7fd71cb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.058+0000 7fd71cb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.058+0000 7fd71cb25800 5 note: GC not initialized 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd5ce7dc640 20 reqs_thread_entry: start 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 20 init_complete bucket index max shards: 11 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 20 Filter name: none 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd5c77fe640 20 reqs_thread_entry: start 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:52:47.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.059+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 cache get: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU : miss 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU info.flags=0x0 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 adding default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU to cache LRU end 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 cache get: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU : hit (negative entry) 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.060+0000 7fd71cb25800 10 cache get: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU : hit (negative entry) 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:52:47.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd71cb25800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:52:47.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd71cb25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:52:47.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd5ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791315 cookie 94806299342176 notifier 5615 bl.length()=675 2024-09-12T17:52:47.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd5ef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:52:47.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.062+0000 7fd5ef7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd71cb25800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd71cb25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd5ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791353 cookie 94806299335488 notifier 5615 bl.length()=202 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd5ef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:52:47.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.065+0000 7fd5ef7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.067+0000 7fd71cb25800 10 cache put: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU info.flags=0x7 2024-09-12T17:52:47.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.067+0000 7fd71cb25800 10 moving default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU to cache LRU end 2024-09-12T17:52:47.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.067+0000 7fd71cb25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:DEXEGGINGKNDGBFTJCEU, ofs0, ns] 2024-09-12T17:52:47.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.068+0000 7fd5ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791316 cookie 94806299342176 notifier 5615 bl.length()=190 2024-09-12T17:52:47.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.068+0000 7fd5ef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU info.flags=0x7 2024-09-12T17:52:47.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.068+0000 7fd5ef7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DEXEGGINGKNDGBFTJCEU to cache LRU end 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T17:52:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "ragweed.client.0", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "DEXEGGINGKNDGBFTJCEU", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "OkpAnbdrruOZ5NJ7OLp9vZhT/JNlYX2UL6gcsNoSb2BCqFzgWtjmJA==", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T17:52:47.061692Z" 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T17:52:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T17:52:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T17:52:47.061677Z", 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T17:52:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:52:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.070+0000 7fd5cf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.072+0000 7fd71cb25800 20 remove_watcher() i=0 2024-09-12T17:52:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.072+0000 7fd71cb25800 2 removed watcher, disabling cache 2024-09-12T17:52:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.074+0000 7fd71cb25800 20 remove_watcher() i=1 2024-09-12T17:52:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.075+0000 7fd71cb25800 20 remove_watcher() i=2 2024-09-12T17:52:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.076+0000 7fd71cb25800 20 remove_watcher() i=3 2024-09-12T17:52:47.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.077+0000 7fd71cb25800 20 remove_watcher() i=4 2024-09-12T17:52:47.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.078+0000 7fd71cb25800 20 remove_watcher() i=5 2024-09-12T17:52:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.078+0000 7fd71cb25800 20 remove_watcher() i=6 2024-09-12T17:52:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.079+0000 7fd71cb25800 20 remove_watcher() i=7 2024-09-12T17:52:47.091 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:52:47.091 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZMOMNVIAGMCRRUNGCHAJ --secret St8Il+kDv/twukFMkvRZwE1K3qX/1esqJ2R9w+0nDEckYOmEg7BsIA== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:52:47.157 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:47.157 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:47.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.190+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 20 realm 2024-09-12T17:52:47.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:47.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.191+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.192+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.192+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.193+0000 7f943a840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:47.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.193+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.193+0000 7f943a840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:47.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.193+0000 7f943a840800 20 searching for the correct realm 2024-09-12T17:52:47.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.197+0000 7f9438b2b640 0 -- 172.21.15.94:0/2070720810 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f942c06ac10 msgr2=0x7f942c073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:47.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.200+0000 7f943832a640 0 -- 172.21.15.94:0/2070720810 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f942c0a0210 msgr2=0x7f942c0685d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:47.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:52:47.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:47.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.406+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 zone default found 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 4 Realm: () 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 zonegroup default 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.407+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.408+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.408+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.408+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.408+0000 7f943a840800 20 started sync module instance, tier type = 2024-09-12T17:52:47.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.408+0000 7f943a840800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:52:47.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=0 2024-09-12T17:52:47.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=1 2024-09-12T17:52:47.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=2 2024-09-12T17:52:47.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=3 2024-09-12T17:52:47.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=4 2024-09-12T17:52:47.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=5 2024-09-12T17:52:47.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.417+0000 7f943a840800 20 add_watcher() i=6 2024-09-12T17:52:47.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.418+0000 7f943a840800 20 add_watcher() i=7 2024-09-12T17:52:47.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.418+0000 7f943a840800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:47.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.419+0000 7f92eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:47.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:47.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:47.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 5 note: GC not initialized 2024-09-12T17:52:47.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f92edfdb640 20 reqs_thread_entry: start 2024-09-12T17:52:47.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 20 init_complete bucket index max shards: 11 2024-09-12T17:52:47.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 20 Filter name: none 2024-09-12T17:52:47.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f925f7fe640 20 reqs_thread_entry: start 2024-09-12T17:52:47.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:52:47.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.420+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:52:47.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 10 cache get: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ : miss 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.421+0000 7f943a840800 20 rados->read ofs=0 len=0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.422+0000 7f943a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.422+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ info.flags=0x0 2024-09-12T17:52:47.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.422+0000 7f943a840800 10 adding default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ to cache LRU end 2024-09-12T17:52:47.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.422+0000 7f943a840800 10 cache get: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ : hit (negative entry) 2024-09-12T17:52:47.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.422+0000 7f943a840800 10 cache get: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ : hit (negative entry) 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.423+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.423+0000 7f943a840800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.423+0000 7f943a840800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.424+0000 7f930f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791354 cookie 94779620627680 notifier 5937 bl.length()=675 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.424+0000 7f930f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.424+0000 7f930f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:52:47.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:52:47.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f943a840800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f943a840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:52:47.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f930f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791317 cookie 94779620631808 notifier 5937 bl.length()=202 2024-09-12T17:52:47.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f930f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:52:47.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.427+0000 7f930f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:52:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f943a840800 10 cache put: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ info.flags=0x7 2024-09-12T17:52:47.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f943a840800 10 moving default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ to cache LRU end 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f943a840800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ZMOMNVIAGMCRRUNGCHAJ, ofs0, ns] 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f930f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791318 cookie 94779620617696 notifier 5937 bl.length()=190 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f930f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ info.flags=0x7 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.430+0000 7f930f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZMOMNVIAGMCRRUNGCHAJ to cache LRU end 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:52:47.432 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "sysuser.client.0", 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "ZMOMNVIAGMCRRUNGCHAJ", 2024-09-12T17:52:47.433 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "St8Il+kDv/twukFMkvRZwE1K3qX/1esqJ2R9w+0nDEckYOmEg7BsIA==", 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T17:52:47.423159Z" 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T17:52:47.434 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "system": true, 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:47.435 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T17:52:47.436 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T17:52:47.423141Z", 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T17:52:47.437 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:52:47.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.432+0000 7f92eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:47.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.435+0000 7f943a840800 20 remove_watcher() i=0 2024-09-12T17:52:47.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.435+0000 7f943a840800 2 removed watcher, disabling cache 2024-09-12T17:52:47.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.436+0000 7f943a840800 20 remove_watcher() i=1 2024-09-12T17:52:47.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.437+0000 7f943a840800 20 remove_watcher() i=2 2024-09-12T17:52:47.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.438+0000 7f943a840800 20 remove_watcher() i=3 2024-09-12T17:52:47.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.439+0000 7f943a840800 20 remove_watcher() i=4 2024-09-12T17:52:47.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.440+0000 7f943a840800 20 remove_watcher() i=5 2024-09-12T17:52:47.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.441+0000 7f943a840800 20 remove_watcher() i=6 2024-09-12T17:52:47.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:52:47.442+0000 7f943a840800 20 remove_watcher() i=7 2024-09-12T17:52:47.454 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:52:47.455 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:52:47.455 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:52:47.484 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:52:47.484 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:52:47.485 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:52:47.554 DEBUG:teuthology.orchestra.run.smithi094:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:52:47.740 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:52:47.897 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:52:48.466 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:52:55.077 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:52:58.454 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=c8ef6e22abc7aee2efd2aaa0ca66e8d14a37caf4a02a27967d43b68d6972ad56,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:52:58.454 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='2164966488' 2024-09-12T17:52:58.454 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:52:58.656 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-12T17:52:58.656 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:52:58.656 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:52:58.656 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:52:58.656 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-12T17:52:58.752 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 9 items 2024-09-12T17:52:58.752 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:53:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:53:02.982 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:53:06.204 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:53:08.471 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:53:10.614 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:53:19.620 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:53:24.931 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:53:29.990 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:53:38.246 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:53:38.247 INFO:teuthology.orchestra.run.smithi094.stdout:======================== 9 passed, 1 warning in 39.59s ========================= 2024-09-12T17:53:38.278 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:53:38.278 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-12T17:53:38.278 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-12T17:53:38.296 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:53:38.297 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:53:38.326 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:53:38.423 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:38.423 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.455+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.456+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.456+0000 7fbb2690c800 20 realm 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.456+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.457+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.457+0000 7fbb2690c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.457+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.457+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.457+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.458+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.458+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.458+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.458+0000 7fbb2690c800 20 searching for the correct realm 2024-09-12T17:53:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.461+0000 7fbb23bf5640 0 -- 172.21.15.94:0/438732368 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56245bb14730 msgr2=0x56245bb16bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.465+0000 7fbb243f6640 0 -- 172.21.15.94:0/438732368 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbb180075f0 msgr2=0x7fbb1804de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:53:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:53:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.469+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 zone default found 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 4 Realm: () 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 zonegroup default 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.470+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.471+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.471+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.471+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.471+0000 7fbb2690c800 20 started sync module instance, tier type = 2024-09-12T17:53:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.471+0000 7fbb2690c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:53:38.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=0 2024-09-12T17:53:38.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=1 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=2 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=3 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=4 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=5 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.479+0000 7fbb2690c800 20 add_watcher() i=6 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.480+0000 7fbb2690c800 20 add_watcher() i=7 2024-09-12T17:53:38.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.480+0000 7fbb2690c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:38.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.482+0000 7fb9dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:38.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.482+0000 7fbb2690c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:38.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.482+0000 7fbb2690c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.521+0000 7fb9d9fdb640 20 reqs_thread_entry: start 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.521+0000 7fbb2690c800 20 init_complete bucket index max shards: 11 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 20 Filter name: none 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fb94b7fe640 20 reqs_thread_entry: start 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:53:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:53:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:53:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.522+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 : miss 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 info.flags=0x17 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 to cache LRU end 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.523+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 2024-09-12T17:53:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.524+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:53:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.524+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:53:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.524+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:53:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.525+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:53:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.525+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:53:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.525+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:53:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.526+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:53:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.526+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:53:38.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.527+0000 7fbb2690c800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:53:38.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56245bbd47f8 s->prefetch_data=0 2024-09-12T17:53:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 10 manifest: total_size = 7791 2024-09-12T17:53:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17664381139827973959 2024-09-12T17:53:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56245bbd47f8 s->prefetch_data=0 2024-09-12T17:53:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd47f8 2024-09-12T17:53:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.528+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.1 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=7791 stripe_ofs=7791 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17664381139827973959 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.Jkf6bFQHtdocgbkTZsVYmVE-m5Nv8Pe_0 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.531+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17664381139827973959 2024-09-12T17:53:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.532+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:53:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.532+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56245bbd42a8 s->prefetch_data=0 2024-09-12T17:53:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.533+0000 7fbb2690c800 10 manifest: total_size = 7416 2024-09-12T17:53:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.533+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17317998501597302268 2024-09-12T17:53:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.533+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56245bbd42a8 s->prefetch_data=0 2024-09-12T17:53:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.533+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd42a8 2024-09-12T17:53:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.533+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.2 2024-09-12T17:53:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=7416 stripe_ofs=7416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17317998501597302268 2024-09-12T17:53:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.vTCKRVjs2iIPlJkZF_fuCJwgxd9Ao-3_0 2024-09-12T17:53:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.535+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17317998501597302268 2024-09-12T17:53:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:53:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56245bbd42a8 s->prefetch_data=0 2024-09-12T17:53:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 10 manifest: total_size = 15907 2024-09-12T17:53:38.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12357966254277335468 2024-09-12T17:53:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56245bbd42a8 s->prefetch_data=0 2024-09-12T17:53:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd42a8 2024-09-12T17:53:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.537+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.2 2024-09-12T17:53:38.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=15907 stripe_ofs=15907 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12357966254277335468 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.GOCviLTHM1t6qkzATb6ZzKRkZWgoovU_0 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.540+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12357966254277335468 2024-09-12T17:53:38.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:53:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 10 manifest: total_size = 7659 2024-09-12T17:53:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2709317650297298260 2024-09-12T17:53:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.541+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.3 2024-09-12T17:53:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=7659 stripe_ofs=7659 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2709317650297298260 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.mqZfA-jFo5oN34D-mqM---0oNM8dCyt_0 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.543+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2709317650297298260 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.544+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 10 manifest: total_size = 5223 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8866274582553351816 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 20 get_obj_state: octx=0x56245babbf70 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.545+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.4 2024-09-12T17:53:38.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5223 stripe_ofs=5223 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8866274582553351816 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.CiARhY57FodjuOrLUcpV5GETz9cgYLE_0 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.548+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8866274582553351816 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.549+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.549+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5e770 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.550+0000 7fbb2690c800 10 manifest: total_size = 13551 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.550+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6590346764683120500 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.550+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5e770 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.550+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.550+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.4 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=13551 stripe_ofs=13551 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6590346764683120500 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.lJbFM63hyZmvXly6MUN6MbHnOttDIhV_0 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.552+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6590346764683120500 2024-09-12T17:53:38.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.553+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:53:38.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 10 manifest: total_size = 12813 2024-09-12T17:53:38.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13467115751610007399 2024-09-12T17:53:38.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.554+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.5 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=12813 stripe_ofs=12813 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13467115751610007399 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.23pyLtKAPwc-yMkP7J4Y06pU8mW8Ge6_0 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.556+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13467115751610007399 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180c6870 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 10 manifest: total_size = 5388 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17461671826757961452 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180c6870 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.558+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.7 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5388 stripe_ofs=5388 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17461671826757961452 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.2hHznfNwB-GiJGDNnfX8TDXoi2ns9dn_0 2024-09-12T17:53:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.561+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17461671826757961452 2024-09-12T17:53:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:53:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb14069cc0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 10 manifest: total_size = 38485 2024-09-12T17:53:38.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5510509473852949020 2024-09-12T17:53:38.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb14069cc0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56245bbd4218 s->prefetch_data=0 2024-09-12T17:53:38.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bbd4218 2024-09-12T17:53:38.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.562+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4.8 2024-09-12T17:53:38.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=38485 stripe_ofs=38485 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5510509473852949020 2024-09-12T17:53:38.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.aomPvNSXKAe4-BV_Me75NBi6ZMbqN7q_0 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.565+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5510509473852949020 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.566+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.566+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.566+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.567+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.567+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.567+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.567+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.567+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.569+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:53:38.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.569+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.569+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:53:38.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.569+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:53:38.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.569+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:53:38.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.570+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:53:38.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.570+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:53:38.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.570+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94714157164608 notifier 5970 bl.length()=162 2024-09-12T17:53:38.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.573+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 from cache 2024-09-12T17:53:38.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.573+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4, ofs0, ns] 2024-09-12T17:53:38.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.574+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595122 cookie 94714157162080 notifier 5970 bl.length()=219 2024-09-12T17:53:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.578+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 : miss 2024-09-12T17:53:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.578+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.578+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.578+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 info.flags=0x0 2024-09-12T17:53:38.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.578+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4 to cache LRU end 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.580+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 : miss 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.580+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 info.flags=0x17 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 to cache LRU end 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.581+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 2024-09-12T17:53:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb56290 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56245bb586b8 s->prefetch_data=0 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 10 manifest: total_size = 18874368 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4266767193815631768 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb56290 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56245bb586b8 s->prefetch_data=0 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb586b8 2024-09-12T17:53:38.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.585+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11.10 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:38.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4266767193815631768 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.1 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.1_1 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.2 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.2_1 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-12T17:53:38.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.3 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.3_1 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.4 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.588+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4266767193815631768 2024-09-12T17:53:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.589+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:38.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.589+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.589+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.590+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.590+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.590+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.590+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.590+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.591+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.591+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.592+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.592+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:53:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.592+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:53:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.593+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:53:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.593+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:53:38.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.593+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595123 cookie 94714157162080 notifier 5970 bl.length()=191 2024-09-12T17:53:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.596+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 from cache 2024-09-12T17:53:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.596+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11, ofs0, ns] 2024-09-12T17:53:38.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.596+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595086 cookie 94714157181856 notifier 5970 bl.length()=249 2024-09-12T17:53:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.599+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 : miss 2024-09-12T17:53:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.599+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.599+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.599+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 info.flags=0x0 2024-09-12T17:53:38.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.599+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11 to cache LRU end 2024-09-12T17:53:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.601+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 : miss 2024-09-12T17:53:38.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.601+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 info.flags=0x17 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 to cache LRU end 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.602+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 2024-09-12T17:53:38.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.606+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.606+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6b50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56245bb586b8 s->prefetch_data=0 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.607+0000 7fbb2690c800 10 manifest: total_size = 1667 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.607+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18190922734335442127 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.607+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6b50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56245bb586b8 s->prefetch_data=0 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.607+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb586b8 2024-09-12T17:53:38.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.607+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12.10 2024-09-12T17:53:38.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-12T17:53:38.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18190922734335442127 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.1 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.2 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.3 2024-09-12T17:53:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:53:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.4 2024-09-12T17:53:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:53:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.609+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18190922734335442127 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.611+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.613+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:53:38.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.613+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.614+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.614+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.614+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.615+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.615+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:53:38.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.615+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595137 cookie 94714157172368 notifier 5970 bl.length()=198 2024-09-12T17:53:38.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.618+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 from cache 2024-09-12T17:53:38.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.618+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12, ofs0, ns] 2024-09-12T17:53:38.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.618+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595138 cookie 94714157172368 notifier 5970 bl.length()=256 2024-09-12T17:53:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.622+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 : miss 2024-09-12T17:53:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.622+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.622+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.622+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 info.flags=0x0 2024-09-12T17:53:38.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.622+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12 to cache LRU end 2024-09-12T17:53:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 : miss 2024-09-12T17:53:38.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 info.flags=0x17 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 to cache LRU end 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.625+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 2024-09-12T17:53:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.629+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo[EHqGoslyBMwvZybuIUf1Gt-Fv6HT8sV] 2024-09-12T17:53:38.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.629+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.629+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb1b900 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56245bb62e88 s->prefetch_data=0 2024-09-12T17:53:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.630+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to whkhs6wzlgkdo0nty5bgtdljwaby9hyi 2024-09-12T17:53:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.630+0000 7fbb2690c800 20 get_obj_state_impl: setting s->olh_tag to ufvru5gep7ilepmo0py4c43dfltd1khc 2024-09-12T17:53:38.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.630+0000 7fbb2690c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ufvru5gep7ilepmo0py4c43dfltd1khc 2024-09-12T17:53:38.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.631+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.632+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 olh_log_entry: epoch=3 op=3 key=foo[EHqGoslyBMwvZybuIUf1Gt-Fv6HT8sV] 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb1b900 obj=test-client.0-r-test-multipart-index-versioning.1:_:EHqGoslyBMwvZybuIUf1Gt-Fv6HT8sV_foo state=0x56245bb6ab18 s->prefetch_data=0 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 10 manifest: total_size = 26082 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11460283205344986273 2024-09-12T17:53:38.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb1b900 obj=test-client.0-r-test-multipart-index-versioning.1:_:EHqGoslyBMwvZybuIUf1Gt-Fv6HT8sV_foo state=0x56245bb6ab18 s->prefetch_data=0 2024-09-12T17:53:38.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb6ab18 2024-09-12T17:53:38.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.633+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7673 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7671 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4197881 part_ofs=7673 rule->part_size=7671 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7671 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4205552 part_ofs=15344 rule->part_size=7671 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-12T17:53:38.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4213223 part_ofs=23015 rule->part_size=3067 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11460283205344986273 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.1 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.2 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.3 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.4 2024-09-12T17:53:38.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:53:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.635+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11460283205344986273 2024-09-12T17:53:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.636+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo[EHqGoslyBMwvZybuIUf1Gt-Fv6HT8sV] 2024-09-12T17:53:38.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.638+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb1b900 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56245bb62e88 s->prefetch_data=0 2024-09-12T17:53:38.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.639+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.640+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10.10 2024-09-12T17:53:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.640+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.640+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.641+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.641+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.641+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.641+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.641+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.643+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:53:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.643+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.643+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:53:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.643+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:53:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.643+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:53:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.644+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:53:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.644+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:53:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.644+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595139 cookie 94714157172368 notifier 5970 bl.length()=193 2024-09-12T17:53:38.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.647+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 from cache 2024-09-12T17:53:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.647+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10, ofs0, ns] 2024-09-12T17:53:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.647+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94714157164608 notifier 5970 bl.length()=251 2024-09-12T17:53:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.651+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 : miss 2024-09-12T17:53:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.651+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.651+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.651+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 info.flags=0x0 2024-09-12T17:53:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.651+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10 to cache LRU end 2024-09-12T17:53:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 : miss 2024-09-12T17:53:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:53:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 info.flags=0x17 2024-09-12T17:53:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 to cache LRU end 2024-09-12T17:53:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.653+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 2024-09-12T17:53:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.657+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.657+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb59b60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56245bb62de8 s->prefetch_data=0 2024-09-12T17:53:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.658+0000 7fbb2690c800 10 manifest: total_size = 74198 2024-09-12T17:53:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.658+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14801797032883325210 2024-09-12T17:53:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.658+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb59b60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56245bb62de8 s->prefetch_data=0 2024-09-12T17:53:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.658+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62de8 2024-09-12T17:53:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.658+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9.10 2024-09-12T17:53:38.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4252047 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14801797032883325210 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.1 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.2 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.3 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.4 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.660+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14801797032883325210 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.662+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.662+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.662+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.663+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.663+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.663+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.663+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.663+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.664+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:53:38.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.664+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.665+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:53:38.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.665+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:53:38.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.665+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:53:38.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.666+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:53:38.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.666+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:53:38.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.666+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94714157179168 notifier 5970 bl.length()=183 2024-09-12T17:53:38.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.668+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 from cache 2024-09-12T17:53:38.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.668+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9, ofs0, ns] 2024-09-12T17:53:38.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.669+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 94714157185920 notifier 5970 bl.length()=240 2024-09-12T17:53:38.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.673+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 : miss 2024-09-12T17:53:38.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.673+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.674+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.674+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 info.flags=0x0 2024-09-12T17:53:38.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.674+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9 to cache LRU end 2024-09-12T17:53:38.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.676+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 : miss 2024-09-12T17:53:38.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.676+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 info.flags=0x17 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 to cache LRU end 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.677+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 2024-09-12T17:53:38.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.678+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:53:38.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.679+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:53:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.679+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.680+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:53:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.681+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.681+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:53:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.681+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _3N229wPxCZhfLOgCJFOEUcfkbs_RiEM 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.682+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.0 2024-09-12T17:53:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _3N229wPxCZhfLOgCJFOEUcfkbs_RiEM 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.yK5DldQw2LI9QsY900AHv_jDSoGhSY6_0 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.yK5DldQw2LI9QsY900AHv_jDSoGhSY6_1 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.684+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _3N229wPxCZhfLOgCJFOEUcfkbs_RiEM 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.685+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _oW8jT7EHhwjc_-7PkPe_nZ8S_cGbEFM 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.686+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.2 2024-09-12T17:53:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _oW8jT7EHhwjc_-7PkPe_nZ8S_cGbEFM 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.g0mpe8D7550fUw2nMaGMeLFOFLpPNzY_0 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.g0mpe8D7550fUw2nMaGMeLFOFLpPNzY_1 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.688+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _oW8jT7EHhwjc_-7PkPe_nZ8S_cGbEFM 2024-09-12T17:53:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.689+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:53:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13277338424273695508 2024-09-12T17:53:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6c20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.690+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.3 2024-09-12T17:53:38.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13277338424273695508 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_0 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_1 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.692+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13277338424273695508 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.693+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb56020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _XrrVkp9javolEthPtoOa0BG8xtsNYA8 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb56020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.694+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.5 2024-09-12T17:53:38.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _XrrVkp9javolEthPtoOa0BG8xtsNYA8 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.G2jrMgtVYZ-oHX3eRrNd3HoYlLi8OqJ_0 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.G2jrMgtVYZ-oHX3eRrNd3HoYlLi8OqJ_1 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.696+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _XrrVkp9javolEthPtoOa0BG8xtsNYA8 2024-09-12T17:53:38.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:53:38.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5c4e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _CfuZW394ABsJxHrnZ5rIi94fbXhif2h 2024-09-12T17:53:38.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5c4e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.698+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.5 2024-09-12T17:53:38.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _CfuZW394ABsJxHrnZ5rIi94fbXhif2h 2024-09-12T17:53:38.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.zv_9OJ05kbSpIgX1t74anM4LUCsanwX_0 2024-09-12T17:53:38.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:38.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.zv_9OJ05kbSpIgX1t74anM4LUCsanwX_1 2024-09-12T17:53:38.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:53:38.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.700+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _CfuZW394ABsJxHrnZ5rIi94fbXhif2h 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.701+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1374338983161249010 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.702+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.5 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1374338983161249010 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_0 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_1 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.704+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1374338983161249010 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.705+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.705+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.706+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.706+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _ASutp0-dejsqR2ph_k5kVpxc1dCUyWZ 2024-09-12T17:53:38.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.706+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.706+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.706+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.7 2024-09-12T17:53:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _ASutp0-dejsqR2ph_k5kVpxc1dCUyWZ 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.4LX86ymCSphzOMlR62jUejvxlf0rdlK_0 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.4LX86ymCSphzOMlR62jUejvxlf0rdlK_1 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.708+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _ASutp0-dejsqR2ph_k5kVpxc1dCUyWZ 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.709+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180074b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13581157047320684942 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180074b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.710+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.7 2024-09-12T17:53:38.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13581157047320684942 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_0 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_1 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.712+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13581157047320684942 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.713+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.713+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.714+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.714+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15151485537606547679 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.714+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.714+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.714+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.7 2024-09-12T17:53:38.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15151485537606547679 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_0 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_1 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 561 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.716+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15151485537606547679 2024-09-12T17:53:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:53:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457614986168670356 2024-09-12T17:53:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.718+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.8 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457614986168670356 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_0 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_1 2024-09-12T17:53:38.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 577 2024-09-12T17:53:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.721+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457614986168670356 2024-09-12T17:53:38.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _vRGKH9NN8neC_EPpI2tZ0oZaAaB15K2 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.722+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.8 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _vRGKH9NN8neC_EPpI2tZ0oZaAaB15K2 2024-09-12T17:53:38.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.IVjI1IXAM6Av7fLtksqp2RkDTku_cYZ_0 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.IVjI1IXAM6Av7fLtksqp2RkDTku_cYZ_1 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.725+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _vRGKH9NN8neC_EPpI2tZ0oZaAaB15K2 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5bd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 10 manifest: total_size = 5242880 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10573304067476189880 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5bd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56245baf1a88 s->prefetch_data=0 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245baf1a88 2024-09-12T17:53:38.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.726+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15.9 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10573304067476189880 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_0 2024-09-12T17:53:38.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:38.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_1 2024-09-12T17:53:38.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:53:38.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.729+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10573304067476189880 2024-09-12T17:53:38.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.730+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:53:38.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.730+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.730+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.731+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.731+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.731+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.731+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.731+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.732+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:53:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.732+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.733+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:53:38.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.733+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:53:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.733+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:53:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.734+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:53:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.734+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:53:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.734+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595140 cookie 94714157172368 notifier 5970 bl.length()=189 2024-09-12T17:53:38.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.737+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 from cache 2024-09-12T17:53:38.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.737+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15, ofs0, ns] 2024-09-12T17:53:38.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.737+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94714157164608 notifier 5970 bl.length()=247 2024-09-12T17:53:38.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.741+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 : miss 2024-09-12T17:53:38.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.741+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.741+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.741+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 info.flags=0x0 2024-09-12T17:53:38.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.741+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15 to cache LRU end 2024-09-12T17:53:38.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 : miss 2024-09-12T17:53:38.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:53:38.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 info.flags=0x17 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 to cache LRU end 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.743+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:53:38.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.744+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:53:38.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.744+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:38.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.745+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:53:38.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.745+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:53:38.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.745+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:38.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.746+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:53:38.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.746+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:38.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.746+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:53:38.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.747+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:38.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.747+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:53:38.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.747+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:53:38.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.747+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.748+0000 7fbb2690c800 10 manifest: total_size = 45360 2024-09-12T17:53:38.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.748+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _y6C7fuEbZiZ3zy4XyVOpBGo2skQl6Kt 2024-09-12T17:53:38.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.748+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bbd6040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.748+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb59ec8 2024-09-12T17:53:38.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.748+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.0 2024-09-12T17:53:38.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _y6C7fuEbZiZ3zy4XyVOpBGo2skQl6Kt 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CqpHf_jousg-OgMJyoHJawGUlsGvkAW_0 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.751+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _y6C7fuEbZiZ3zy4XyVOpBGo2skQl6Kt 2024-09-12T17:53:38.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:53:38.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _2Ycb0wf5s1Gm8Oe-tp86G4SK431C_65 2024-09-12T17:53:38.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.752+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.2 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _2Ycb0wf5s1Gm8Oe-tp86G4SK431C_65 2024-09-12T17:53:38.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__0 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__1 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__2 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.755+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _2Ycb0wf5s1Gm8Oe-tp86G4SK431C_65 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.756+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.756+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb14070420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.757+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.757+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7870822656303851154 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.757+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb14070420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.757+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.757+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.3 2024-09-12T17:53:38.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7870822656303851154 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1_1 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2_1 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:53:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.3 2024-09-12T17:53:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:53:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.759+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7870822656303851154 2024-09-12T17:53:38.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.760+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _ZRJQft7bj8erG9BKIQXlBKDW0IujHTh 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.761+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.5 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZRJQft7bj8erG9BKIQXlBKDW0IujHTh 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_0 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_1 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_2 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.763+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _ZRJQft7bj8erG9BKIQXlBKDW0IujHTh 2024-09-12T17:53:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:53:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _ruMZqTQ7C8Xgsz98r7YEZCU7_vtHaEv 2024-09-12T17:53:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.765+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.5 2024-09-12T17:53:38.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _ruMZqTQ7C8Xgsz98r7YEZCU7_vtHaEv 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_0 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_1 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:53:38.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_2 2024-09-12T17:53:38.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T17:53:38.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.767+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _ruMZqTQ7C8Xgsz98r7YEZCU7_vtHaEv 2024-09-12T17:53:38.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.768+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 10 manifest: total_size = 45360 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8255832112452445960 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb140728b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.769+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.5 2024-09-12T17:53:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T17:53:38.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:53:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8255832112452445960 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.1 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.2 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:53:38.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.3 2024-09-12T17:53:38.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:53:38.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.771+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8255832112452445960 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.772+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bafc080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _HckPd2cssfOD9tKyrlQiErq0jeB-0Q_ 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bafc080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.773+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.7 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _HckPd2cssfOD9tKyrlQiErq0jeB-0Q_ 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_0 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:38.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_1 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_2 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.775+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _HckPd2cssfOD9tKyrlQiErq0jeB-0Q_ 2024-09-12T17:53:38.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.776+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb1c047f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6275589319792975082 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb1c047f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.777+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.7 2024-09-12T17:53:38.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6275589319792975082 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1_1 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2 2024-09-12T17:53:38.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:53:38.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2_1 2024-09-12T17:53:38.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:53:38.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.3 2024-09-12T17:53:38.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:53:38.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.779+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6275589319792975082 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.780+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.780+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf3560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.781+0000 7fbb2690c800 10 manifest: total_size = 45360 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.781+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5937306400431385859 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.781+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf3560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.781+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.781+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.7 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T17:53:38.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5937306400431385859 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.1 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.2 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:53:38.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.3 2024-09-12T17:53:38.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:53:38.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.783+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5937306400431385859 2024-09-12T17:53:38.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.784+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:53:38.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb1c012e80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686192241065215657 2024-09-12T17:53:38.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb1c012e80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.785+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.8 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686192241065215657 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1_1 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2 2024-09-12T17:53:38.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2_1 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.3 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.788+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686192241065215657 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb605a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 10 manifest: total_size = 45360 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to _Wz8o3McOKgI-r3gSf5nKRmV4_JNMpst 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb605a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.789+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.8 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: _Wz8o3McOKgI-r3gSf5nKRmV4_JNMpst 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.3ZanmFScomin0lHdePvhN8KT-QII7vx_0 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.792+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _Wz8o3McOKgI-r3gSf5nKRmV4_JNMpst 2024-09-12T17:53:38.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:53:38.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6638308331128197254 2024-09-12T17:53:38.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56245bb62cf8 s->prefetch_data=0 2024-09-12T17:53:38.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb62cf8 2024-09-12T17:53:38.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.793+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16.9 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6638308331128197254 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1_1 2024-09-12T17:53:38.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2_1 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.3 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.796+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6638308331128197254 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.797+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.797+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.797+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.798+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.798+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.798+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.798+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.798+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.799+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.799+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.800+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.800+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:53:38.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.800+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:53:38.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.801+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:53:38.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.801+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:53:38.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.801+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94714157176432 notifier 5970 bl.length()=199 2024-09-12T17:53:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.804+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 from cache 2024-09-12T17:53:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.804+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16, ofs0, ns] 2024-09-12T17:53:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.804+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94714157176432 notifier 5970 bl.length()=257 2024-09-12T17:53:38.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.807+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 : miss 2024-09-12T17:53:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.807+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.808+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.808+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 info.flags=0x0 2024-09-12T17:53:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.808+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16 to cache LRU end 2024-09-12T17:53:38.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 : miss 2024-09-12T17:53:38.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 info.flags=0x17 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 to cache LRU end 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.810+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 2024-09-12T17:53:38.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.812+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:38.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.812+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.813+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb564c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14856109713806027893 2024-09-12T17:53:38.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb564c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb59ec8 2024-09-12T17:53:38.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.814+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14.3 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14856109713806027893 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.1 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:53:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.1_1 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.2 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.2_1 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.3 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.817+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14856109713806027893 2024-09-12T17:53:38.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.818+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:38.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.818+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.819+0000 7fbb2690c800 10 manifest: total_size = 16373 2024-09-12T17:53:38.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.819+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10966527156655396539 2024-09-12T17:53:38.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.819+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.819+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb59ec8 2024-09-12T17:53:38.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.819+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14.5 2024-09-12T17:53:38.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7670 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7668 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=7668 rules.size()=3 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4197878 part_ofs=7670 rule->part_size=7668 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=15338 stripe_ofs=15338 part_ofs=15338 rule->part_size=1035 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4205546 part_ofs=15338 rule->part_size=1035 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=16373 stripe_ofs=16373 part_ofs=16373 rule->part_size=1035 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10966527156655396539 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.1 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.2 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.3 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.821+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10966527156655396539 2024-09-12T17:53:38.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.822+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:38.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.822+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5c800 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.823+0000 7fbb2690c800 10 manifest: total_size = 11534336 2024-09-12T17:53:38.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.823+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13948287868554332846 2024-09-12T17:53:38.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.823+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5c800 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56245bb59ec8 s->prefetch_data=0 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.823+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb59ec8 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.823+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14.7 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:38.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13948287868554332846 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.1 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.1_1 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.2 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.2_1 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:53:38.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.3 2024-09-12T17:53:38.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:53:38.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.825+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13948287868554332846 2024-09-12T17:53:38.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.826+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.826+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.826+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.827+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.827+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.827+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.827+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.828+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.829+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:53:38.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.829+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.830+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:53:38.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.830+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:53:38.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.830+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:53:38.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.831+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:53:38.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.831+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:53:38.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.831+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595087 cookie 94714157181856 notifier 5970 bl.length()=194 2024-09-12T17:53:38.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.834+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 from cache 2024-09-12T17:53:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.834+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14, ofs0, ns] 2024-09-12T17:53:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.834+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94714157176432 notifier 5970 bl.length()=252 2024-09-12T17:53:38.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.837+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 : miss 2024-09-12T17:53:38.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.837+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.838+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.838+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 info.flags=0x0 2024-09-12T17:53:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.838+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14 to cache LRU end 2024-09-12T17:53:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.840+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 : miss 2024-09-12T17:53:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.840+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:53:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 info.flags=0x17 2024-09-12T17:53:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 to cache LRU end 2024-09-12T17:53:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.841+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 2024-09-12T17:53:38.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.842+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:38.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.843+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:38.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.843+0000 7fbb2690c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:38.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.844+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb6c8c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56245bb5a148 s->prefetch_data=0 2024-09-12T17:53:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.845+0000 7fbb2690c800 10 manifest: total_size = 10485760 2024-09-12T17:53:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.845+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15838182471712464325 2024-09-12T17:53:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.845+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb6c8c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56245bb5a148 s->prefetch_data=0 2024-09-12T17:53:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.845+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb5a148 2024-09-12T17:53:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.845+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13.3 2024-09-12T17:53:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15838182471712464325 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_0 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_1 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_2 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.847+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15838182471712464325 2024-09-12T17:53:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.848+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180c6870 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56245bb5a038 s->prefetch_data=0 2024-09-12T17:53:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 10 manifest: total_size = 649292 2024-09-12T17:53:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10177736985847400179 2024-09-12T17:53:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb180c6870 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56245bb5a038 s->prefetch_data=0 2024-09-12T17:53:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb5a038 2024-09-12T17:53:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.850+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13.5 2024-09-12T17:53:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10177736985847400179 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ce1P84EDrEdQ8aXfi5XtlY7MFg0aMgT_0 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.852+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10177736985847400179 2024-09-12T17:53:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.854+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:38.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.855+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56245bb5a038 s->prefetch_data=0 2024-09-12T17:53:38.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.856+0000 7fbb2690c800 10 manifest: total_size = 10485760 2024-09-12T17:53:38.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.856+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3557362931370887057 2024-09-12T17:53:38.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.856+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18063df0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56245bb5a038 s->prefetch_data=0 2024-09-12T17:53:38.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.856+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb5a038 2024-09-12T17:53:38.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.856+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13.7 2024-09-12T17:53:38.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3557362931370887057 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_0 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_1 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_2 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.858+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3557362931370887057 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.859+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.859+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.859+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.860+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.860+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.860+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.860+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.860+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.862+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:53:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.862+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.862+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:53:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.862+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:53:38.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.862+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:53:38.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.863+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:53:38.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.863+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:53:38.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.863+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595141 cookie 94714157172368 notifier 5970 bl.length()=184 2024-09-12T17:53:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.866+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 from cache 2024-09-12T17:53:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.866+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13, ofs0, ns] 2024-09-12T17:53:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.867+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595142 cookie 94714157172368 notifier 5970 bl.length()=242 2024-09-12T17:53:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.870+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 : miss 2024-09-12T17:53:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.870+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.870+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.870+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 info.flags=0x0 2024-09-12T17:53:38.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.870+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13 to cache LRU end 2024-09-12T17:53:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 : miss 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 info.flags=0x17 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 to cache LRU end 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.872+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 2024-09-12T17:53:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.873+0000 7fbb2690c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:38.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.874+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.875+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.876+0000 7fbb2690c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:38.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.876+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.877+0000 7fbb2690c800 10 manifest: total_size = 0 2024-09-12T17:53:38.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.877+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10273886123832761472 2024-09-12T17:53:38.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.877+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.877+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b708 2024-09-12T17:53:38.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.877+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6.2 2024-09-12T17:53:38.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 10 manifest: total_size = 0 2024-09-12T17:53:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5189232952032263990 2024-09-12T17:53:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b708 2024-09-12T17:53:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.880+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6.3 2024-09-12T17:53:38.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.881+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:38.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 10 manifest: total_size = 0 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6096906581097677077 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b708 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.883+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6.6 2024-09-12T17:53:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.884+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:38.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.885+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.886+0000 7fbb2690c800 10 manifest: total_size = 0 2024-09-12T17:53:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.886+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13182549605417851118 2024-09-12T17:53:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.886+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56245bb0b708 s->prefetch_data=0 2024-09-12T17:53:38.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.886+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b708 2024-09-12T17:53:38.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.886+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6.8 2024-09-12T17:53:38.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.887+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:38.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.888+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.888+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.889+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:38.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.890+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.890+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.890+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.890+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.890+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.891+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:53:38.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.891+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.892+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:38.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.892+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:53:38.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.892+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:53:38.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.893+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:53:38.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.893+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:53:38.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.893+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595124 cookie 94714157162080 notifier 5970 bl.length()=181 2024-09-12T17:53:38.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.896+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 from cache 2024-09-12T17:53:38.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.896+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6, ofs0, ns] 2024-09-12T17:53:38.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.896+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94714157179168 notifier 5970 bl.length()=238 2024-09-12T17:53:38.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.900+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 : miss 2024-09-12T17:53:38.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.900+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.900+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.900+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 info.flags=0x0 2024-09-12T17:53:38.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.900+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6 to cache LRU end 2024-09-12T17:53:38.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.902+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 : miss 2024-09-12T17:53:38.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.902+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 info.flags=0x17 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 to cache LRU end 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 2024-09-12T17:53:38.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.903+0000 7fbb2690c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:38.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.904+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:38.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.905+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:38.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.905+0000 7fbb2690c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:38.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.906+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56245bb0cd98 s->prefetch_data=0 2024-09-12T17:53:38.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.906+0000 7fbb2690c800 10 manifest: total_size = 2078 2024-09-12T17:53:38.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.906+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12868587725693091757 2024-09-12T17:53:38.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.906+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56245bb0cd98 s->prefetch_data=0 2024-09-12T17:53:38.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.906+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0cd98 2024-09-12T17:53:38.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.907+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7.2 2024-09-12T17:53:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12868587725693091757 2024-09-12T17:53:38.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.OOSTGtEwLcv9S7UfApsTMtsVIQTrdpv_0 2024-09-12T17:53:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.909+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12868587725693091757 2024-09-12T17:53:38.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.910+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:38.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 10 manifest: total_size = 38 2024-09-12T17:53:38.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16741558557231072164 2024-09-12T17:53:38.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b5f8 2024-09-12T17:53:38.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.911+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7.3 2024-09-12T17:53:38.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.913+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16741558557231072164 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.b3Ohu8joR-W4XZbowuGuo9vF2juNiVd_0 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.914+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16741558557231072164 2024-09-12T17:53:38.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:38.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fbb2690c800 10 manifest: total_size = 2078 2024-09-12T17:53:38.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12173414764066213000 2024-09-12T17:53:38.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.915+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b5f8 2024-09-12T17:53:38.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.916+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7.6 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12173414764066213000 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.cWQNz1eBrdk4Fhus7_go-mELqv6vl42_0 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.918+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12173414764066213000 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.919+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.919+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.920+0000 7fbb2690c800 10 manifest: total_size = 38 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.920+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5230214712504596800 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.920+0000 7fbb2690c800 20 get_obj_state: octx=0x56245bb5b080 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56245bb0b5f8 s->prefetch_data=0 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.920+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb0b5f8 2024-09-12T17:53:38.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.920+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7.8 2024-09-12T17:53:38.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5230214712504596800 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.KFxGLDn6f9yOH0Pd66Itnyq9InYGdnl_0 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.926+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5230214712504596800 2024-09-12T17:53:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.928+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.928+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.928+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.929+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.929+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.929+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.929+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.929+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.930+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:53:38.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.930+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.931+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.931+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:53:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.931+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:53:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.931+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:53:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.931+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:53:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.932+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595125 cookie 94714157162080 notifier 5970 bl.length()=181 2024-09-12T17:53:38.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.934+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 from cache 2024-09-12T17:53:38.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.934+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7, ofs0, ns] 2024-09-12T17:53:38.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.934+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 94714157179168 notifier 5970 bl.length()=238 2024-09-12T17:53:38.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.939+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 : miss 2024-09-12T17:53:38.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.939+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.939+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.939+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 info.flags=0x0 2024-09-12T17:53:38.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.939+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7 to cache LRU end 2024-09-12T17:53:38.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.941+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 : miss 2024-09-12T17:53:38.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.941+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 info.flags=0x17 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 to cache LRU end 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:38.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.942+0000 7fbb2690c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 2024-09-12T17:53:38.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.943+0000 7fbb2690c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:38.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.943+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:38.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.944+0000 7fbb2690c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:38.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.945+0000 7fbb2690c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:38.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 10 manifest: total_size = 4134 2024-09-12T17:53:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18252583974976225161 2024-09-12T17:53:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb65098 2024-09-12T17:53:38.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.946+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8.2 2024-09-12T17:53:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18252583974976225161 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.FBo5Kp92jehdaHk0ZN-QJEKvU6Ck6sV_0 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.949+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18252583974976225161 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.950+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:38.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 10 manifest: total_size = 1035 2024-09-12T17:53:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13922652384692646261 2024-09-12T17:53:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb65098 2024-09-12T17:53:38.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.951+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8.3 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13922652384692646261 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.VbG-6z5_4LmqbvBqqwEcfhoFnSrc1h6_0 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.954+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13922652384692646261 2024-09-12T17:53:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:38.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 10 manifest: total_size = 49187 2024-09-12T17:53:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13659205634136770865 2024-09-12T17:53:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 20 get_obj_state: octx=0x56245baf2310 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb65098 2024-09-12T17:53:38.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.955+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8.6 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13659205634136770865 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.iVx8fLzEH_hY8ym-eLx9pLZ7q3vd1Y-_0 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.958+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13659205634136770865 2024-09-12T17:53:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.959+0000 7fb9faffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:38.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.959+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18057450 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.960+0000 7fbb2690c800 10 manifest: total_size = 1035 2024-09-12T17:53:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.960+0000 7fbb2690c800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9085106448550294147 2024-09-12T17:53:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.960+0000 7fbb2690c800 20 get_obj_state: octx=0x7fbb18057450 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56245bb65098 s->prefetch_data=0 2024-09-12T17:53:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.960+0000 7fbb2690c800 20 prepare_atomic_modification: state is not atomic. state=0x56245bb65098 2024-09-12T17:53:38.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.960+0000 7fbb2690c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8.8 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9085106448550294147 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.FuZg0_GqOddKfFZfOD4jf7AI50Xg3wa_0 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:38.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.962+0000 7fbb2690c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9085106448550294147 2024-09-12T17:53:38.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.963+0000 7fb9fb7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:38.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.963+0000 7fbb2690c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:38.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.963+0000 7fbb2690c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:38.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.964+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:38.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.964+0000 7fbb2690c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:38.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.964+0000 7fbb2690c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:38.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.964+0000 7fbb2690c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:38.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.964+0000 7fbb2690c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:38.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.966+0000 7fbb2690c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:53:38.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.966+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.966+0000 7fbb2690c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:38.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.966+0000 7fbb2690c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:53:38.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.966+0000 7fbb2690c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:53:38.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.967+0000 7fbb2690c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:53:38.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.967+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:53:38.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.968+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595126 cookie 94714157162080 notifier 5970 bl.length()=181 2024-09-12T17:53:38.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.970+0000 7fbb2690c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 from cache 2024-09-12T17:53:38.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.970+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8, ofs0, ns] 2024-09-12T17:53:38.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.970+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94714157179168 notifier 5970 bl.length()=238 2024-09-12T17:53:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.974+0000 7fbb2690c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 : miss 2024-09-12T17:53:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.974+0000 7fbb2690c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.974+0000 7fbb2690c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.974+0000 7fbb2690c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 info.flags=0x0 2024-09-12T17:53:38.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.974+0000 7fbb2690c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8 to cache LRU end 2024-09-12T17:53:38.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.976+0000 7fbb2690c800 10 removing key index: DEXEGGINGKNDGBFTJCEU 2024-09-12T17:53:38.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.977+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:DEXEGGINGKNDGBFTJCEU, ofs0, ns] 2024-09-12T17:53:38.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.977+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94714157179168 notifier 5970 bl.length()=170 2024-09-12T17:53:38.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.978+0000 7fbb2690c800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:53:38.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.979+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:53:38.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.980+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595143 cookie 94714157172368 notifier 5970 bl.length()=182 2024-09-12T17:53:38.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.981+0000 7fbb2690c800 10 removing user buckets index 2024-09-12T17:53:38.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.982+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:53:38.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.983+0000 7fb9faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 94714157181856 notifier 5970 bl.length()=173 2024-09-12T17:53:38.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.984+0000 7fbb2690c800 10 removing user index: ragweed.client.0 2024-09-12T17:53:38.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.985+0000 7fbb2690c800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:53:38.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.985+0000 7fbb2690c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:53:38.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.985+0000 7fb9fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94714157179168 notifier 5970 bl.length()=165 2024-09-12T17:53:38.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.989+0000 7fb9dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:38.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.991+0000 7fbb2690c800 20 remove_watcher() i=0 2024-09-12T17:53:38.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.991+0000 7fbb2690c800 2 removed watcher, disabling cache 2024-09-12T17:53:38.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.992+0000 7fbb2690c800 20 remove_watcher() i=1 2024-09-12T17:53:38.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.993+0000 7fbb2690c800 20 remove_watcher() i=2 2024-09-12T17:53:38.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.994+0000 7fbb2690c800 20 remove_watcher() i=3 2024-09-12T17:53:38.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.995+0000 7fbb2690c800 20 remove_watcher() i=4 2024-09-12T17:53:38.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.995+0000 7fbb2690c800 20 remove_watcher() i=5 2024-09-12T17:53:38.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.996+0000 7fbb2690c800 20 remove_watcher() i=6 2024-09-12T17:53:38.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:38.997+0000 7fbb2690c800 20 remove_watcher() i=7 2024-09-12T17:53:39.009 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:53:39.106 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:39.107 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.139+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.140+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.140+0000 7f1870538800 20 realm 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.140+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.141+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.142+0000 7f1870538800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:39.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.142+0000 7f1870538800 20 searching for the correct realm 2024-09-12T17:53:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.145+0000 7f1863a80640 0 -- 172.21.15.94:0/2564209430 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x561f1a6e1810 msgr2=0x561f1a6e3cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:39.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.148+0000 7f186c281640 0 -- 172.21.15.94:0/2564209430 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f185400cb60 msgr2=0x7f18540883a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.152+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 zone default found 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 4 Realm: () 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 zonegroup default 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.153+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.154+0000 7f1870538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:39.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.154+0000 7f1870538800 20 started sync module instance, tier type = 2024-09-12T17:53:39.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.154+0000 7f1870538800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=0 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=1 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=2 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=3 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=4 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=5 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.162+0000 7f1870538800 20 add_watcher() i=6 2024-09-12T17:53:39.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.163+0000 7f1870538800 20 add_watcher() i=7 2024-09-12T17:53:39.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.163+0000 7f1870538800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:39.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.164+0000 7f1722fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:39.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.164+0000 7f1870538800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:39.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.164+0000 7f1870538800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.197+0000 7f1721fdb640 20 reqs_thread_entry: start 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.197+0000 7f1870538800 20 init_complete bucket index max shards: 11 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.197+0000 7f1870538800 20 Filter name: none 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.197+0000 7f16937fe640 20 reqs_thread_entry: start 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:53:39.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 20 rados->read ofs=0 len=0 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.198+0000 7f1870538800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.199+0000 7f1870538800 10 removing key index: ZMOMNVIAGMCRRUNGCHAJ 2024-09-12T17:53:39.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.200+0000 7f1870538800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:ZMOMNVIAGMCRRUNGCHAJ, ofs0, ns] 2024-09-12T17:53:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.200+0000 7f17437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94691587410736 notifier 5985 bl.length()=170 2024-09-12T17:53:39.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.202+0000 7f1870538800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:53:39.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.203+0000 7f1870538800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:53:39.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.203+0000 7f1742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94691587421808 notifier 5985 bl.length()=182 2024-09-12T17:53:39.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.204+0000 7f1870538800 10 removing user buckets index 2024-09-12T17:53:39.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.205+0000 7f1870538800 10 removing user index: sysuser.client.0 2024-09-12T17:53:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.206+0000 7f1870538800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:53:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.206+0000 7f1870538800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:53:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.207+0000 7f1742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595144 cookie 94691587416496 notifier 5985 bl.length()=165 2024-09-12T17:53:39.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.208+0000 7f1722fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.211+0000 7f1870538800 20 remove_watcher() i=0 2024-09-12T17:53:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.211+0000 7f1870538800 2 removed watcher, disabling cache 2024-09-12T17:53:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.212+0000 7f1870538800 20 remove_watcher() i=1 2024-09-12T17:53:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.213+0000 7f1870538800 20 remove_watcher() i=2 2024-09-12T17:53:39.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.214+0000 7f1870538800 20 remove_watcher() i=3 2024-09-12T17:53:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.215+0000 7f1870538800 20 remove_watcher() i=4 2024-09-12T17:53:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.216+0000 7f1870538800 20 remove_watcher() i=5 2024-09-12T17:53:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.217+0000 7f1870538800 20 remove_watcher() i=6 2024-09-12T17:53:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T17:53:39.218+0000 7f1870538800 20 remove_watcher() i=7 2024-09-12T17:53:39.229 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:53:39.229 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:53:39.310 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:53:39.321 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:53:39.321 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:53:39.321 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:39.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:53:39.350 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:53:39.351 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:39.419 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:39.420 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:53:39.489 INFO:tasks.workunit:timeout=3h 2024-09-12T17:53:39.489 INFO:tasks.workunit:cleanup=True 2024-09-12T17:53:39.490 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:53:39.559 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:54:39.690 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.691 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:39.692 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:54:39.695 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:54:39.763 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:54:39.765 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:54:39.766 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:54:39.816 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:54:39.864 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:54:39.902 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:54:39.904 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:54:39.904 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:54:39.942 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:54:39.945 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T17:54:39.945 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:54:40.014 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:54:40.015 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:54:40.016 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:54:40.088 INFO:tasks.workunit.client.0.smithi094.stderr:+ ulimit -c 0 2024-09-12T17:54:40.088 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:54:40.088 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:40.088 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:42.400 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-12T17:54:42.401 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:54:42.402 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:54:42.402 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T17:54:42.403 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-12T17:54:42.628 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:54:42.803 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-12T17:54:42.808 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:54:42.853 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-12T17:54:42.853 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-12T17:54:42.853 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:54:43.005 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:54:43.011 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:54:43.744 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-12T17:54:43.793 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-12T17:54:44.561 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-12T17:54:44.562 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:54:45.141 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:54:45.143 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:54:45.196 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:54:45.197 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:54:45.243 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:54:45.243 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:54:45.293 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:45.295 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:54:45.370 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:45.372 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:54:45.549 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:45.550 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:54:45.554 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:54:45.556 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:54:45.565 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:54:45.567 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:54:45.568 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:54:45.569 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:54:45.571 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:54:45.645 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:54:46.796 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:54:46.922 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:54:46.956 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:46.956 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:46.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.991+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.992+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.992+0000 7fd491123800 20 realm 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.992+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.993+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.993+0000 7fd491123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.993+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.993+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.993+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.994+0000 7fd491123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.994+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.994+0000 7fd491123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:46.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.994+0000 7fd491123800 20 searching for the correct realm 2024-09-12T17:54:47.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:46.998+0000 7fd487fff640 0 -- 172.21.15.94:0/26706966 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fd48006cb90 msgr2=0x7fd48006b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.002+0000 7fd48d614640 0 -- 172.21.15.94:0/26706966 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fd4780b6980 msgr2=0x7fd4780ae7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.006+0000 7fd491123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 zone default found 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 4 Realm: () 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 zonegroup default 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 started sync module instance, tier type = 2024-09-12T17:54:47.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.007+0000 7fd491123800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:47.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=0 2024-09-12T17:54:47.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=1 2024-09-12T17:54:47.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=2 2024-09-12T17:54:47.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=3 2024-09-12T17:54:47.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=4 2024-09-12T17:54:47.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=5 2024-09-12T17:54:47.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.016+0000 7fd491123800 20 add_watcher() i=6 2024-09-12T17:54:47.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.017+0000 7fd491123800 20 add_watcher() i=7 2024-09-12T17:54:47.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.017+0000 7fd491123800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.019+0000 7fd342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.019+0000 7fd491123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.019+0000 7fd491123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.019+0000 7fd491123800 5 note: GC not initialized 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd341fe3640 20 reqs_thread_entry: start 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 Filter name: none 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd2b37fe640 20 reqs_thread_entry: start 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T17:54:47.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:47.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:54:47.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.020+0000 7fd491123800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:54:47.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd491123800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:54:47.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd491123800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:47.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd491123800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T17:54:47.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd363fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529681 cookie 94688164937056 notifier 6003 bl.length()=569 2024-09-12T17:54:47.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd363fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:54:47.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.022+0000 7fd363fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd491123800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd491123800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd491123800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd363fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529682 cookie 94688164934016 notifier 6003 bl.length()=180 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd363fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.025+0000 7fd363fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.027+0000 7fd342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.030+0000 7fd491123800 20 remove_watcher() i=0 2024-09-12T17:54:47.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.030+0000 7fd491123800 2 removed watcher, disabling cache 2024-09-12T17:54:47.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.031+0000 7fd491123800 20 remove_watcher() i=1 2024-09-12T17:54:47.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.032+0000 7fd491123800 20 remove_watcher() i=2 2024-09-12T17:54:47.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.033+0000 7fd491123800 20 remove_watcher() i=3 2024-09-12T17:54:47.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.034+0000 7fd491123800 20 remove_watcher() i=4 2024-09-12T17:54:47.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.035+0000 7fd491123800 20 remove_watcher() i=5 2024-09-12T17:54:47.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.036+0000 7fd491123800 20 remove_watcher() i=6 2024-09-12T17:54:47.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.037+0000 7fd491123800 20 remove_watcher() i=7 2024-09-12T17:54:47.404 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add 2024-09-12T17:54:47.404 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:47.405 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:47.435 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.435 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.470+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 realm 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.472+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.473+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.473+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.474+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.474+0000 7f03c4f24800 20 searching for the correct realm 2024-09-12T17:54:47.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.478+0000 7f03c1303640 0 -- 172.21.15.94:0/3883159669 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f03ac0613f0 msgr2=0x7f03ac061870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:47.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.685+0000 7f03c0b02640 0 -- 172.21.15.94:0/3883159669 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x56017cd7fb50 msgr2=0x56017cd81f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.688+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 zone default found 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 4 Realm: () 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 zonegroup default 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.689+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.690+0000 7f03c4f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.690+0000 7f03c4f24800 20 started sync module instance, tier type = 2024-09-12T17:54:47.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.690+0000 7f03c4f24800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=0 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=1 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=2 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=3 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=4 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=5 2024-09-12T17:54:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.699+0000 7f03c4f24800 20 add_watcher() i=6 2024-09-12T17:54:47.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.700+0000 7f03c4f24800 20 add_watcher() i=7 2024-09-12T17:54:47.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.700+0000 7f03c4f24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.701+0000 7f02777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 5 note: GC not initialized 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f02767dc640 20 reqs_thread_entry: start 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 20 Filter name: none 2024-09-12T17:54:47.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f01e7fff640 20 reqs_thread_entry: start 2024-09-12T17:54:47.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.702+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.703+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:47.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.703+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.703+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.703+0000 7f03c4f24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.703+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.704+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.704+0000 7f03c4f24800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.704+0000 7f03c4f24800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.704+0000 7f03c4f24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.706+0000 7f02777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.708+0000 7f03c4f24800 20 remove_watcher() i=0 2024-09-12T17:54:47.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.708+0000 7f03c4f24800 2 removed watcher, disabling cache 2024-09-12T17:54:47.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.709+0000 7f03c4f24800 20 remove_watcher() i=1 2024-09-12T17:54:47.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.710+0000 7f03c4f24800 20 remove_watcher() i=2 2024-09-12T17:54:47.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.711+0000 7f03c4f24800 20 remove_watcher() i=3 2024-09-12T17:54:47.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.712+0000 7f03c4f24800 20 remove_watcher() i=4 2024-09-12T17:54:47.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.713+0000 7f03c4f24800 20 remove_watcher() i=5 2024-09-12T17:54:47.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.714+0000 7f03c4f24800 20 remove_watcher() i=6 2024-09-12T17:54:47.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.714+0000 7f03c4f24800 20 remove_watcher() i=7 2024-09-12T17:54:47.726 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:47.726 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:47.726 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:54:47.726 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:47.727 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:54:47.758 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.758 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.794+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 realm 2024-09-12T17:54:47.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.796+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.797+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.797+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.797+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.797+0000 7f33c9720800 20 searching for the correct realm 2024-09-12T17:54:47.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.801+0000 7f33bcc67640 0 -- 172.21.15.94:0/942173119 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f33b80a7040 msgr2=0x7f33b80a2d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.805+0000 7f33c5c69640 0 -- 172.21.15.94:0/942173119 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f33b0054400 msgr2=0x7f33b0054880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.809+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 zone default found 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 4 Realm: () 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 zonegroup default 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 started sync module instance, tier type = 2024-09-12T17:54:47.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.810+0000 7f33c9720800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:47.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=0 2024-09-12T17:54:47.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=1 2024-09-12T17:54:47.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=2 2024-09-12T17:54:47.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=3 2024-09-12T17:54:47.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=4 2024-09-12T17:54:47.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=5 2024-09-12T17:54:47.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.819+0000 7f33c9720800 20 add_watcher() i=6 2024-09-12T17:54:47.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.820+0000 7f33c9720800 20 add_watcher() i=7 2024-09-12T17:54:47.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.820+0000 7f33c9720800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f327bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f33c9720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f33c9720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f33c9720800 5 note: GC not initialized 2024-09-12T17:54:47.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f327afe5640 20 reqs_thread_entry: start 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.822+0000 7f33c9720800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 20 Filter name: none 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f3278fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:47.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.823+0000 7f33c9720800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:47.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.824+0000 7f33c9720800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:47.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.826+0000 7f327bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.828+0000 7f33c9720800 20 remove_watcher() i=0 2024-09-12T17:54:47.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.828+0000 7f33c9720800 2 removed watcher, disabling cache 2024-09-12T17:54:47.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.829+0000 7f33c9720800 20 remove_watcher() i=1 2024-09-12T17:54:47.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.830+0000 7f33c9720800 20 remove_watcher() i=2 2024-09-12T17:54:47.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.831+0000 7f33c9720800 20 remove_watcher() i=3 2024-09-12T17:54:47.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.832+0000 7f33c9720800 20 remove_watcher() i=4 2024-09-12T17:54:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.833+0000 7f33c9720800 20 remove_watcher() i=5 2024-09-12T17:54:47.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.834+0000 7f33c9720800 20 remove_watcher() i=6 2024-09-12T17:54:47.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.835+0000 7f33c9720800 20 remove_watcher() i=7 2024-09-12T17:54:47.848 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-12T17:54:47.874 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.875 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.910+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 realm 2024-09-12T17:54:47.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.912+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.913+0000 7f2b54620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.913+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.914+0000 7f2b54620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.914+0000 7f2b54620800 20 searching for the correct realm 2024-09-12T17:54:47.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.916+0000 7f2b5210a640 0 -- 172.21.15.94:0/3250955316 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f2b4c026040 msgr2=0x7f2b4c017680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.920+0000 7f2b5290b640 0 -- 172.21.15.94:0/3250955316 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f2b400030f0 msgr2=0x7f2b3c002000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:47.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:47.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.925+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 zone default found 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 4 Realm: () 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 zonegroup default 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.926+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 started sync module instance, tier type = 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.927+0000 7f2b54620800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:47.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=0 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=1 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=2 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=3 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=4 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=5 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.936+0000 7f2b54620800 20 add_watcher() i=6 2024-09-12T17:54:47.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.937+0000 7f2b54620800 20 add_watcher() i=7 2024-09-12T17:54:47.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.937+0000 7f2b54620800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.940+0000 7f2a08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.940+0000 7f2b54620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.940+0000 7f2b54620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.940+0000 7f2b54620800 5 note: GC not initialized 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.940+0000 7f29837fe640 20 reqs_thread_entry: start 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.941+0000 7f2b54620800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.941+0000 7f2b54620800 20 Filter name: none 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.941+0000 7f29817fa640 20 reqs_thread_entry: start 2024-09-12T17:54:47.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.947+0000 7f2a08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.949+0000 7f2b54620800 20 remove_watcher() i=0 2024-09-12T17:54:47.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.949+0000 7f2b54620800 2 removed watcher, disabling cache 2024-09-12T17:54:47.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.950+0000 7f2b54620800 20 remove_watcher() i=1 2024-09-12T17:54:47.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.951+0000 7f2b54620800 20 remove_watcher() i=2 2024-09-12T17:54:47.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.952+0000 7f2b54620800 20 remove_watcher() i=3 2024-09-12T17:54:47.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.954+0000 7f2b54620800 20 remove_watcher() i=4 2024-09-12T17:54:47.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.955+0000 7f2b54620800 20 remove_watcher() i=5 2024-09-12T17:54:47.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.956+0000 7f2b54620800 20 remove_watcher() i=6 2024-09-12T17:54:47.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:47.957+0000 7f2b54620800 20 remove_watcher() i=7 2024-09-12T17:54:47.968 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-12T17:54:47.968 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process 2024-09-12T17:54:47.968 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:47.969 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-12T17:54:47.996 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.997 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:48.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.032+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.033+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.033+0000 7f1378d39800 20 realm 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.033+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.034+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.034+0000 7f1378d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.034+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.034+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.034+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.035+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.035+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.035+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:48.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.035+0000 7f1378d39800 20 searching for the correct realm 2024-09-12T17:54:48.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.038+0000 7f13751c8640 0 -- 172.21.15.94:0/1341860057 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f135c08a040 msgr2=0x7f135c093990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.042+0000 7f13749c7640 0 -- 172.21.15.94:0/1341860057 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f135c06e0c0 msgr2=0x7f135c070980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:48.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:48.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:48.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:48.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.249+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 zone default found 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 4 Realm: () 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:48.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 zonegroup default 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 started sync module instance, tier type = 2024-09-12T17:54:48.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.250+0000 7f1378d39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=0 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=1 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=2 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=3 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=4 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=5 2024-09-12T17:54:48.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.260+0000 7f1378d39800 20 add_watcher() i=6 2024-09-12T17:54:48.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.261+0000 7f1378d39800 20 add_watcher() i=7 2024-09-12T17:54:48.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.261+0000 7f1378d39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:48.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f122afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1378d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1378d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1378d39800 5 note: GC not initialized 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1229fe3640 20 reqs_thread_entry: start 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1378d39800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.263+0000 7f1378d39800 20 Filter name: none 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.264+0000 7f119b7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:48.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.264+0000 7f1378d39800 20 processing logshard = reshard.0000000000 2024-09-12T17:54:48.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.266+0000 7f1378d39800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:54:48.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.266+0000 7f1378d39800 20 processing logshard = reshard.0000000001 2024-09-12T17:54:48.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.269+0000 7f1378d39800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:54:48.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.269+0000 7f1378d39800 20 processing logshard = reshard.0000000002 2024-09-12T17:54:48.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.271+0000 7f1378d39800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:54:48.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.271+0000 7f1378d39800 20 processing logshard = reshard.0000000003 2024-09-12T17:54:48.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.274+0000 7f1378d39800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:54:48.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.274+0000 7f1378d39800 20 processing logshard = reshard.0000000004 2024-09-12T17:54:48.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.276+0000 7f1378d39800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:54:48.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.276+0000 7f1378d39800 20 processing logshard = reshard.0000000005 2024-09-12T17:54:48.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.278+0000 7f1378d39800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:54:48.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.278+0000 7f1378d39800 20 processing logshard = reshard.0000000006 2024-09-12T17:54:48.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.280+0000 7f1378d39800 20 process_entry resharding a-bucket 2024-09-12T17:54:48.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.280+0000 7f1378d39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:48.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.280+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:48.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:48.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.281+0000 7f1378d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f1378d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f1378d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f1378d39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f1378d39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f124bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529686 cookie 94745855699168 notifier 5765 bl.length()=827 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f124bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f124bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.288+0000 7f124bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.290+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:48.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.290+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:48.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.290+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:48.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.290+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:48.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:48.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.0 2024-09-12T17:54:48.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.295+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1 2024-09-12T17:54:48.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.296+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2 2024-09-12T17:54:48.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.296+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3 2024-09-12T17:54:48.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.297+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.4 2024-09-12T17:54:48.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.297+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.5 2024-09-12T17:54:48.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.298+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.6 2024-09-12T17:54:48.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.298+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.7 2024-09-12T17:54:48.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.299+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.8 2024-09-12T17:54:48.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.299+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.9 2024-09-12T17:54:48.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.300+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.10 2024-09-12T17:54:48.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.300+0000 7f1378d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:48.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.300+0000 7f1378d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f1378d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f1378d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f1378d39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f1378d39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f124bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529687 cookie 94745855699168 notifier 5765 bl.length()=827 2024-09-12T17:54:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f124bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f124bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.302+0000 7f124bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.304+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.304+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.304+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.304+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:48.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.306+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.0 2024-09-12T17:54:48.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.306+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1 2024-09-12T17:54:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.307+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2 2024-09-12T17:54:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.307+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3 2024-09-12T17:54:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.307+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.4 2024-09-12T17:54:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.308+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.5 2024-09-12T17:54:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.308+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.6 2024-09-12T17:54:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.308+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.7 2024-09-12T17:54:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.309+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.8 2024-09-12T17:54:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.309+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.9 2024-09-12T17:54:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.309+0000 7f1378d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.10 2024-09-12T17:54:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.309+0000 7f1378d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.309+0000 7f1378d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:48.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f1378d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f1378d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f1378d39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f1378d39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:48.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f124bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529688 cookie 94745855699168 notifier 5765 bl.length()=795 2024-09-12T17:54:48.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f124bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:48.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f124bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:48.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.311+0000 7f124bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:48.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.313+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:48.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.313+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:48.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.313+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:48.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.313+0000 7f1378d39800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:48.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.315+0000 7f1378d39800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:54:48.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.316+0000 7f1378d39800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:54:48.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.318+0000 7f1378d39800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:54:48.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.318+0000 7f1378d39800 20 processing logshard = reshard.0000000007 2024-09-12T17:54:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.320+0000 7f1378d39800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:54:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.320+0000 7f1378d39800 20 processing logshard = reshard.0000000008 2024-09-12T17:54:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.323+0000 7f1378d39800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:54:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.323+0000 7f1378d39800 20 processing logshard = reshard.0000000009 2024-09-12T17:54:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.325+0000 7f1378d39800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:54:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.325+0000 7f1378d39800 20 processing logshard = reshard.0000000010 2024-09-12T17:54:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.327+0000 7f1378d39800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:54:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.327+0000 7f1378d39800 20 processing logshard = reshard.0000000011 2024-09-12T17:54:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.329+0000 7f1378d39800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:54:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.329+0000 7f1378d39800 20 processing logshard = reshard.0000000012 2024-09-12T17:54:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.332+0000 7f1378d39800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:54:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.332+0000 7f1378d39800 20 processing logshard = reshard.0000000013 2024-09-12T17:54:48.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.334+0000 7f1378d39800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:54:48.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.334+0000 7f1378d39800 20 processing logshard = reshard.0000000014 2024-09-12T17:54:48.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.336+0000 7f1378d39800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:54:48.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.336+0000 7f1378d39800 20 processing logshard = reshard.0000000015 2024-09-12T17:54:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.339+0000 7f1378d39800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:54:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.340+0000 7f122afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.342+0000 7f1378d39800 20 remove_watcher() i=0 2024-09-12T17:54:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.342+0000 7f1378d39800 2 removed watcher, disabling cache 2024-09-12T17:54:48.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.343+0000 7f1378d39800 20 remove_watcher() i=1 2024-09-12T17:54:48.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.344+0000 7f1378d39800 20 remove_watcher() i=2 2024-09-12T17:54:48.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.345+0000 7f1378d39800 20 remove_watcher() i=3 2024-09-12T17:54:48.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.346+0000 7f1378d39800 20 remove_watcher() i=4 2024-09-12T17:54:48.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.347+0000 7f1378d39800 20 remove_watcher() i=5 2024-09-12T17:54:48.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.348+0000 7f1378d39800 20 remove_watcher() i=6 2024-09-12T17:54:48.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:48.349+0000 7f1378d39800 20 remove_watcher() i=7 2024-09-12T17:54:53.368 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:53.399 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:53.399 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:53.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.439+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 realm 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.441+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.442+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.442+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.443+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.443+0000 7f779a325800 20 searching for the correct realm 2024-09-12T17:54:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.445+0000 7f778ffff640 0 -- 172.21.15.94:0/2143578117 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f7788011040 msgr2=0x7f778805f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:53.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.652+0000 7f7795fae640 0 -- 172.21.15.94:0/2143578117 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f7780018440 msgr2=0x7f77800188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.860+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 zone default found 2024-09-12T17:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 4 Realm: () 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 zonegroup default 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.861+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.862+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.862+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.862+0000 7f779a325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.862+0000 7f779a325800 20 started sync module instance, tier type = 2024-09-12T17:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.862+0000 7f779a325800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=0 2024-09-12T17:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=1 2024-09-12T17:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=2 2024-09-12T17:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=3 2024-09-12T17:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=4 2024-09-12T17:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=5 2024-09-12T17:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.873+0000 7f779a325800 20 add_watcher() i=6 2024-09-12T17:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.874+0000 7f779a325800 20 add_watcher() i=7 2024-09-12T17:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.874+0000 7f779a325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.875+0000 7f76477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 5 note: GC not initialized 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f76467fc640 20 reqs_thread_entry: start 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 20 Filter name: none 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f75b7fff640 20 reqs_thread_entry: start 2024-09-12T17:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.876+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.877+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.877+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.878+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.878+0000 7f779a325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.878+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.878+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.878+0000 7f779a325800 20 rados->read ofs=0 len=0 2024-09-12T17:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.879+0000 7f779a325800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.879+0000 7f779a325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.881+0000 7f76477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.883+0000 7f779a325800 20 remove_watcher() i=0 2024-09-12T17:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.883+0000 7f779a325800 2 removed watcher, disabling cache 2024-09-12T17:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.885+0000 7f779a325800 20 remove_watcher() i=1 2024-09-12T17:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.886+0000 7f779a325800 20 remove_watcher() i=2 2024-09-12T17:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.887+0000 7f779a325800 20 remove_watcher() i=3 2024-09-12T17:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.888+0000 7f779a325800 20 remove_watcher() i=4 2024-09-12T17:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.889+0000 7f779a325800 20 remove_watcher() i=5 2024-09-12T17:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.890+0000 7f779a325800 20 remove_watcher() i=6 2024-09-12T17:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:53.891+0000 7f779a325800 20 remove_watcher() i=7 2024-09-12T17:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add non empty bucket 2024-09-12T17:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:54.224 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:54.251 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:54.252 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:54.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.286+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 realm 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.288+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.290+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.290+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.290+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.290+0000 7f866dabb800 20 searching for the correct realm 2024-09-12T17:54:54.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.293+0000 7f866ada4640 0 -- 172.21.15.94:0/3616455331 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f865c02c3f0 msgr2=0x7f865c02c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.296+0000 7f866b5a5640 0 -- 172.21.15.94:0/3616455331 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8660009eb0 msgr2=0x7f8660081a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:54.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 zone default found 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 4 Realm: () 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.503+0000 7f866dabb800 20 zonegroup default 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 started sync module instance, tier type = 2024-09-12T17:54:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.504+0000 7f866dabb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=0 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=1 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=2 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=3 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=4 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=5 2024-09-12T17:54:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.513+0000 7f866dabb800 20 add_watcher() i=6 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.514+0000 7f866dabb800 20 add_watcher() i=7 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.514+0000 7f866dabb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:54.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f8521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 5 note: GC not initialized 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f8520fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 20 Filter name: none 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f849a7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.516+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.517+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.517+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.517+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.517+0000 7f866dabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.517+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.518+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.518+0000 7f866dabb800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.518+0000 7f866dabb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:54.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.518+0000 7f866dabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:54.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.520+0000 7f8521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.522+0000 7f866dabb800 20 remove_watcher() i=0 2024-09-12T17:54:54.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.522+0000 7f866dabb800 2 removed watcher, disabling cache 2024-09-12T17:54:54.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.523+0000 7f866dabb800 20 remove_watcher() i=1 2024-09-12T17:54:54.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.523+0000 7f866dabb800 20 remove_watcher() i=2 2024-09-12T17:54:54.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.524+0000 7f866dabb800 20 remove_watcher() i=3 2024-09-12T17:54:54.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.525+0000 7f866dabb800 20 remove_watcher() i=4 2024-09-12T17:54:54.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.526+0000 7f866dabb800 20 remove_watcher() i=5 2024-09-12T17:54:54.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.527+0000 7f866dabb800 20 remove_watcher() i=6 2024-09-12T17:54:54.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.528+0000 7f866dabb800 20 remove_watcher() i=7 2024-09-12T17:54:54.539 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:54.540 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:54.540 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:54:54.540 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:54.541 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:54:54.572 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:54.572 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:54.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.607+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 realm 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.609+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.610+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.610+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.610+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:54.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.610+0000 7f5257326800 20 searching for the correct realm 2024-09-12T17:54:54.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.614+0000 7f524bfff640 0 -- 172.21.15.94:0/158824713 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5611d4b4a050 msgr2=0x5611d4b4c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.617+0000 7f525306f640 0 -- 172.21.15.94:0/158824713 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f523c0138f0 msgr2=0x7f523c01f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:54.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:54.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.621+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 zone default found 2024-09-12T17:54:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 4 Realm: () 2024-09-12T17:54:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 zonegroup default 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.622+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.623+0000 7f5257326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.623+0000 7f5257326800 20 started sync module instance, tier type = 2024-09-12T17:54:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.623+0000 7f5257326800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=0 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=1 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=2 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=3 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=4 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=5 2024-09-12T17:54:54.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.631+0000 7f5257326800 20 add_watcher() i=6 2024-09-12T17:54:54.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.632+0000 7f5257326800 20 add_watcher() i=7 2024-09-12T17:54:54.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.632+0000 7f5257326800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:54.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f510a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f5257326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f5257326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f5257326800 5 note: GC not initialized 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f51097e2640 20 reqs_thread_entry: start 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f5257326800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.634+0000 7f5257326800 20 Filter name: none 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f51027fc640 20 reqs_thread_entry: start 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:54:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.635+0000 7f5257326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.637+0000 7f510a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.639+0000 7f5257326800 20 remove_watcher() i=0 2024-09-12T17:54:54.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.639+0000 7f5257326800 2 removed watcher, disabling cache 2024-09-12T17:54:54.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.640+0000 7f5257326800 20 remove_watcher() i=1 2024-09-12T17:54:54.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.641+0000 7f5257326800 20 remove_watcher() i=2 2024-09-12T17:54:54.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.642+0000 7f5257326800 20 remove_watcher() i=3 2024-09-12T17:54:54.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.643+0000 7f5257326800 20 remove_watcher() i=4 2024-09-12T17:54:54.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.644+0000 7f5257326800 20 remove_watcher() i=5 2024-09-12T17:54:54.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.645+0000 7f5257326800 20 remove_watcher() i=6 2024-09-12T17:54:54.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.646+0000 7f5257326800 20 remove_watcher() i=7 2024-09-12T17:54:54.659 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-12T17:54:54.686 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:54.686 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.722+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 20 realm 2024-09-12T17:54:54.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:54.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.723+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.724+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.724+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.724+0000 7f45da30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.724+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.725+0000 7f45da30c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.725+0000 7f45da30c800 20 searching for the correct realm 2024-09-12T17:54:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.727+0000 7f45cffff640 0 -- 172.21.15.94:0/3442754911 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f45c806d070 msgr2=0x7f45c8099230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.731+0000 7f45d7df6640 0 -- 172.21.15.94:0/3442754911 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f45c006ab80 msgr2=0x7f45c007a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:54.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:54.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.937+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 zone default found 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 4 Realm: () 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 zonegroup default 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.938+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 started sync module instance, tier type = 2024-09-12T17:54:54.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.939+0000 7f45da30c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:54.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=0 2024-09-12T17:54:54.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=1 2024-09-12T17:54:54.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=2 2024-09-12T17:54:54.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=3 2024-09-12T17:54:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=4 2024-09-12T17:54:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=5 2024-09-12T17:54:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.948+0000 7f45da30c800 20 add_watcher() i=6 2024-09-12T17:54:54.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.949+0000 7f45da30c800 20 add_watcher() i=7 2024-09-12T17:54:54.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.949+0000 7f45da30c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:54.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.950+0000 7f448dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f45da30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f45da30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f45da30c800 5 note: GC not initialized 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f448cfe1640 20 reqs_thread_entry: start 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f45da30c800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f45da30c800 20 Filter name: none 2024-09-12T17:54:54.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.951+0000 7f44067fc640 20 reqs_thread_entry: start 2024-09-12T17:54:54.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.957+0000 7f448dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.960+0000 7f45da30c800 20 remove_watcher() i=0 2024-09-12T17:54:54.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.960+0000 7f45da30c800 2 removed watcher, disabling cache 2024-09-12T17:54:54.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.961+0000 7f45da30c800 20 remove_watcher() i=1 2024-09-12T17:54:54.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.962+0000 7f45da30c800 20 remove_watcher() i=2 2024-09-12T17:54:54.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.963+0000 7f45da30c800 20 remove_watcher() i=3 2024-09-12T17:54:54.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.964+0000 7f45da30c800 20 remove_watcher() i=4 2024-09-12T17:54:54.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.965+0000 7f45da30c800 20 remove_watcher() i=5 2024-09-12T17:54:54.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.965+0000 7f45da30c800 20 remove_watcher() i=6 2024-09-12T17:54:54.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:54.966+0000 7f45da30c800 20 remove_watcher() i=7 2024-09-12T17:54:54.978 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-12T17:54:54.978 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process non empty bucket 2024-09-12T17:54:54.978 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:54.979 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-12T17:54:55.006 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:55.006 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:55.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.043+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.044+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.044+0000 7fba8f432800 20 realm 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.044+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.045+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.045+0000 7fba8f432800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.045+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.045+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.045+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.046+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:55.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.046+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.046+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:55.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.046+0000 7fba8f432800 20 searching for the correct realm 2024-09-12T17:54:55.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.048+0000 7fba8a7cc640 0 -- 172.21.15.94:0/2189942064 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x562001780d20 msgr2=0x7fba84018910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:55.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.051+0000 7fba8afcd640 0 -- 172.21.15.94:0/2189942064 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fba740c4030 msgr2=0x7fba740a9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.056+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 zone default found 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 4 Realm: () 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 zonegroup default 2024-09-12T17:54:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.057+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 started sync module instance, tier type = 2024-09-12T17:54:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.058+0000 7fba8f432800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=0 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=1 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=2 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=3 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=4 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=5 2024-09-12T17:54:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.067+0000 7fba8f432800 20 add_watcher() i=6 2024-09-12T17:54:55.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.068+0000 7fba8f432800 20 add_watcher() i=7 2024-09-12T17:54:55.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.068+0000 7fba8f432800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:55.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.069+0000 7fb940fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 5 note: GC not initialized 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fb8bb7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 20 Filter name: none 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fb8b97fa640 20 reqs_thread_entry: start 2024-09-12T17:54:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.070+0000 7fba8f432800 20 processing logshard = reshard.0000000000 2024-09-12T17:54:55.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.072+0000 7fba8f432800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:54:55.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.072+0000 7fba8f432800 20 processing logshard = reshard.0000000001 2024-09-12T17:54:55.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.075+0000 7fba8f432800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:54:55.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.075+0000 7fba8f432800 20 processing logshard = reshard.0000000002 2024-09-12T17:54:55.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.077+0000 7fba8f432800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:54:55.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.077+0000 7fba8f432800 20 processing logshard = reshard.0000000003 2024-09-12T17:54:55.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.079+0000 7fba8f432800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:54:55.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.079+0000 7fba8f432800 20 processing logshard = reshard.0000000004 2024-09-12T17:54:55.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.081+0000 7fba8f432800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:54:55.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.081+0000 7fba8f432800 20 processing logshard = reshard.0000000005 2024-09-12T17:54:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.083+0000 7fba8f432800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:54:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.083+0000 7fba8f432800 20 processing logshard = reshard.0000000006 2024-09-12T17:54:55.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 20 process_entry resharding a-bucket 2024-09-12T17:54:55.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:55.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.085+0000 7fba8f432800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.086+0000 7fba8f432800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:55.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.091+0000 7fba8f432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.091+0000 7fba8f432800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.091+0000 7fba8f432800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.091+0000 7fba8f432800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.092+0000 7fb96dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94695466010064 notifier 6162 bl.length()=827 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.092+0000 7fb96dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.092+0000 7fb96dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.092+0000 7fb96dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.093+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:55.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.093+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:55.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.093+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:55.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.093+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:54:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:54:55.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:54:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:54:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.097+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.098+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.098+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.098+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.098+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.099+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.099+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.099+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.099+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.100+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.100+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.100+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.100+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.101+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.102+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:55.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.102+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:55.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.102+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:55.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.102+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:55.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.105+0000 7fba8f432800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:55.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.105+0000 7fba8f432800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:55.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fba8f432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fba8f432800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fba8f432800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fba8f432800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:55.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fb96dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94695466010064 notifier 6162 bl.length()=827 2024-09-12T17:54:55.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fb96dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fb96dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.106+0000 7fb96dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.108+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.108+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.108+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.108+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:55.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.110+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:55.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.110+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.0 2024-09-12T17:54:55.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.110+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:55.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.110+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.1 2024-09-12T17:54:55.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:55.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.2 2024-09-12T17:54:55.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:55.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.3 2024-09-12T17:54:55.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:55.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.111+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.4 2024-09-12T17:54:55.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:55.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.5 2024-09-12T17:54:55.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.6 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.112+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.7 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.8 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.9 2024-09-12T17:54:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.10 2024-09-12T17:54:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.113+0000 7fba8f432800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.1.11 2024-09-12T17:54:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.114+0000 7fba8f432800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.114+0000 7fba8f432800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fba8f432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fba8f432800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fba8f432800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fba8f432800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fb96dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94695466010064 notifier 6162 bl.length()=795 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fb96dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fb96dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.115+0000 7fb96dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.117+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.117+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.117+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:54:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.117+0000 7fba8f432800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:54:55.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.119+0000 7fba8f432800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:54:55.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.120+0000 7fba8f432800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:54:55.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.122+0000 7fba8f432800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:54:55.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.122+0000 7fba8f432800 20 processing logshard = reshard.0000000007 2024-09-12T17:54:55.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.124+0000 7fba8f432800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:54:55.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.124+0000 7fba8f432800 20 processing logshard = reshard.0000000008 2024-09-12T17:54:55.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.126+0000 7fba8f432800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:54:55.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.126+0000 7fba8f432800 20 processing logshard = reshard.0000000009 2024-09-12T17:54:55.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.128+0000 7fba8f432800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:54:55.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.128+0000 7fba8f432800 20 processing logshard = reshard.0000000010 2024-09-12T17:54:55.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.130+0000 7fba8f432800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:54:55.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.130+0000 7fba8f432800 20 processing logshard = reshard.0000000011 2024-09-12T17:54:55.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.132+0000 7fba8f432800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:54:55.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.132+0000 7fba8f432800 20 processing logshard = reshard.0000000012 2024-09-12T17:54:55.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.135+0000 7fba8f432800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:54:55.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.135+0000 7fba8f432800 20 processing logshard = reshard.0000000013 2024-09-12T17:54:55.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.137+0000 7fba8f432800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:54:55.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.137+0000 7fba8f432800 20 processing logshard = reshard.0000000014 2024-09-12T17:54:55.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.139+0000 7fba8f432800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:54:55.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.139+0000 7fba8f432800 20 processing logshard = reshard.0000000015 2024-09-12T17:54:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.141+0000 7fba8f432800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:54:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.142+0000 7fb940fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:55.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.144+0000 7fba8f432800 20 remove_watcher() i=0 2024-09-12T17:54:55.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.144+0000 7fba8f432800 2 removed watcher, disabling cache 2024-09-12T17:54:55.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.145+0000 7fba8f432800 20 remove_watcher() i=1 2024-09-12T17:54:55.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.147+0000 7fba8f432800 20 remove_watcher() i=2 2024-09-12T17:54:55.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.148+0000 7fba8f432800 20 remove_watcher() i=3 2024-09-12T17:54:55.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.148+0000 7fba8f432800 20 remove_watcher() i=4 2024-09-12T17:54:55.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.149+0000 7fba8f432800 20 remove_watcher() i=5 2024-09-12T17:54:55.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.150+0000 7fba8f432800 20 remove_watcher() i=6 2024-09-12T17:54:55.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.151+0000 7fba8f432800 20 remove_watcher() i=7 2024-09-12T17:54:55.164 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:55.192 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:55.192 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.228+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 realm 2024-09-12T17:54:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.229+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.230+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.230+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.231+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:55.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.231+0000 7f41eb723800 20 searching for the correct realm 2024-09-12T17:54:55.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.234+0000 7f41dffff640 0 -- 172.21.15.94:0/2236921690 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55d6e0c7d960 msgr2=0x55d6e0c7fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:55.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.237+0000 7f41dffff640 0 -- 172.21.15.94:0/2236921690 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f41d8024070 msgr2=0x7f41d8061390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:55.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.241+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 zone default found 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 4 Realm: () 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 zonegroup default 2024-09-12T17:54:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 started sync module instance, tier type = 2024-09-12T17:54:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.242+0000 7f41eb723800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=0 2024-09-12T17:54:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=1 2024-09-12T17:54:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=2 2024-09-12T17:54:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=3 2024-09-12T17:54:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=4 2024-09-12T17:54:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=5 2024-09-12T17:54:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.251+0000 7f41eb723800 20 add_watcher() i=6 2024-09-12T17:54:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.252+0000 7f41eb723800 20 add_watcher() i=7 2024-09-12T17:54:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.252+0000 7f41eb723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.253+0000 7f409dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 5 note: GC not initialized 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f409cfe1640 20 reqs_thread_entry: start 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 20 Filter name: none 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f40167fc640 20 reqs_thread_entry: start 2024-09-12T17:54:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.254+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.255+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.255+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.255+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.255+0000 7f41eb723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.255+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.256+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.256+0000 7f41eb723800 20 rados->read ofs=0 len=0 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.256+0000 7f41eb723800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:54:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.256+0000 7f41eb723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:55.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.258+0000 7f409dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:55.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.260+0000 7f41eb723800 20 remove_watcher() i=0 2024-09-12T17:54:55.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.260+0000 7f41eb723800 2 removed watcher, disabling cache 2024-09-12T17:54:55.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.261+0000 7f41eb723800 20 remove_watcher() i=1 2024-09-12T17:54:55.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.262+0000 7f41eb723800 20 remove_watcher() i=2 2024-09-12T17:54:55.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.263+0000 7f41eb723800 20 remove_watcher() i=3 2024-09-12T17:54:55.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.264+0000 7f41eb723800 20 remove_watcher() i=4 2024-09-12T17:54:55.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.265+0000 7f41eb723800 20 remove_watcher() i=5 2024-09-12T17:54:55.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.266+0000 7f41eb723800 20 remove_watcher() i=6 2024-09-12T17:54:55.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:55.267+0000 7f41eb723800 20 remove_watcher() i=7 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:54:55.278 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:56.098 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:54:56.126 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:56.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.162+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.163+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.163+0000 7fbedf92e800 20 realm 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.164+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.165+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.165+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.165+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.165+0000 7fbedf92e800 20 searching for the correct realm 2024-09-12T17:54:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.168+0000 7fbed2edc640 0 -- 172.21.15.94:0/3338266818 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55d45fa88b20 msgr2=0x55d45fa8af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.171+0000 7fbedb6dd640 0 -- 172.21.15.94:0/3338266818 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbec4068980 msgr2=0x7fbec405c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:56.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.175+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 zone default found 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 4 Realm: () 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 zonegroup default 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.176+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.177+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.177+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.177+0000 7fbedf92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.177+0000 7fbedf92e800 20 started sync module instance, tier type = 2024-09-12T17:54:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.177+0000 7fbedf92e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:56.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=0 2024-09-12T17:54:56.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=1 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=2 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=3 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=4 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=5 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.185+0000 7fbedf92e800 20 add_watcher() i=6 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.186+0000 7fbedf92e800 20 add_watcher() i=7 2024-09-12T17:54:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.186+0000 7fbedf92e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:56.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbd91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbedf92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:56.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbedf92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbedf92e800 5 note: GC not initialized 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbd90fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbedf92e800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbedf92e800 20 Filter name: none 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.188+0000 7fbd0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.189+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.189+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.189+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:56.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:56.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.190+0000 7fbedf92e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:56.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.192+0000 7fbd91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.194+0000 7fbedf92e800 20 remove_watcher() i=0 2024-09-12T17:54:56.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.194+0000 7fbedf92e800 2 removed watcher, disabling cache 2024-09-12T17:54:56.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.195+0000 7fbedf92e800 20 remove_watcher() i=1 2024-09-12T17:54:56.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.196+0000 7fbedf92e800 20 remove_watcher() i=2 2024-09-12T17:54:56.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.197+0000 7fbedf92e800 20 remove_watcher() i=3 2024-09-12T17:54:56.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.198+0000 7fbedf92e800 20 remove_watcher() i=4 2024-09-12T17:54:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.199+0000 7fbedf92e800 20 remove_watcher() i=5 2024-09-12T17:54:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.200+0000 7fbedf92e800 20 remove_watcher() i=6 2024-09-12T17:54:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.200+0000 7fbedf92e800 20 remove_watcher() i=7 2024-09-12T17:54:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:54:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:54:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:56.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.282+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 realm 2024-09-12T17:54:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.284+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.285+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.285+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.286+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:56.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.286+0000 7f4416a98800 20 searching for the correct realm 2024-09-12T17:54:56.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.289+0000 7f4413d81640 0 -- 172.21.15.94:0/3177982480 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f44040712b0 msgr2=0x7f44040a2280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:56.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.292+0000 7f4414582640 0 -- 172.21.15.94:0/3177982480 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f440807b420 msgr2=0x7f440807b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 zone default found 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 4 Realm: () 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 zonegroup default 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.500+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 started sync module instance, tier type = 2024-09-12T17:54:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.501+0000 7f4416a98800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=0 2024-09-12T17:54:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=1 2024-09-12T17:54:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=2 2024-09-12T17:54:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=3 2024-09-12T17:54:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=4 2024-09-12T17:54:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=5 2024-09-12T17:54:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.510+0000 7f4416a98800 20 add_watcher() i=6 2024-09-12T17:54:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.511+0000 7f4416a98800 20 add_watcher() i=7 2024-09-12T17:54:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.511+0000 7f4416a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:56.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.513+0000 7f42cb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.513+0000 7f4416a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.513+0000 7f4416a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.513+0000 7f4416a98800 5 note: GC not initialized 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.513+0000 7f42ca7dc640 20 reqs_thread_entry: start 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 20 Filter name: none 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f42c37fe640 20 reqs_thread_entry: start 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:54:56.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 : miss 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.514+0000 7f4416a98800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.515+0000 7f4416a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.516+0000 7f4416a98800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:54:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.516+0000 7f4416a98800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:54:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.518+0000 7f42cb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.520+0000 7f4416a98800 20 remove_watcher() i=0 2024-09-12T17:54:56.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.520+0000 7f4416a98800 2 removed watcher, disabling cache 2024-09-12T17:54:56.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.521+0000 7f4416a98800 20 remove_watcher() i=1 2024-09-12T17:54:56.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.522+0000 7f4416a98800 20 remove_watcher() i=2 2024-09-12T17:54:56.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.523+0000 7f4416a98800 20 remove_watcher() i=3 2024-09-12T17:54:56.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.524+0000 7f4416a98800 20 remove_watcher() i=4 2024-09-12T17:54:56.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.525+0000 7f4416a98800 20 remove_watcher() i=5 2024-09-12T17:54:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.526+0000 7f4416a98800 20 remove_watcher() i=6 2024-09-12T17:54:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.527+0000 7f4416a98800 20 remove_watcher() i=7 2024-09-12T17:54:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:54:56.568 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:56.568 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:56.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.603+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 realm 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.605+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.606+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.606+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.606+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.606+0000 7f46afe0e800 20 searching for the correct realm 2024-09-12T17:54:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.609+0000 7f46a2d6a640 0 -- 172.21.15.94:0/3255595164 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f469c099040 msgr2=0x7f469c071950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:56.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.612+0000 7f46ab56b640 0 -- 172.21.15.94:0/3255595164 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f4694009cd0 msgr2=0x7f469407e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.819+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 zone default found 2024-09-12T17:54:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 4 Realm: () 2024-09-12T17:54:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 zonegroup default 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 started sync module instance, tier type = 2024-09-12T17:54:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.820+0000 7f46afe0e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:56.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=0 2024-09-12T17:54:56.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=1 2024-09-12T17:54:56.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=2 2024-09-12T17:54:56.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=3 2024-09-12T17:54:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=4 2024-09-12T17:54:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=5 2024-09-12T17:54:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.829+0000 7f46afe0e800 20 add_watcher() i=6 2024-09-12T17:54:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.830+0000 7f46afe0e800 20 add_watcher() i=7 2024-09-12T17:54:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.830+0000 7f46afe0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:56.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f4561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:56.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 5 note: GC not initialized 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f4560fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 20 Filter name: none 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f44da7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.832+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.833+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.833+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.833+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.833+0000 7f46afe0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.833+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.834+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.834+0000 7f46afe0e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.834+0000 7f46afe0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.834+0000 7f46afe0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:56.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.836+0000 7f4561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:56.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.838+0000 7f46afe0e800 20 remove_watcher() i=0 2024-09-12T17:54:56.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.838+0000 7f46afe0e800 2 removed watcher, disabling cache 2024-09-12T17:54:56.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.839+0000 7f46afe0e800 20 remove_watcher() i=1 2024-09-12T17:54:56.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.839+0000 7f46afe0e800 20 remove_watcher() i=2 2024-09-12T17:54:56.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.840+0000 7f46afe0e800 20 remove_watcher() i=3 2024-09-12T17:54:56.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.841+0000 7f46afe0e800 20 remove_watcher() i=4 2024-09-12T17:54:56.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.842+0000 7f46afe0e800 20 remove_watcher() i=5 2024-09-12T17:54:56.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.843+0000 7f46afe0e800 20 remove_watcher() i=6 2024-09-12T17:54:56.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:56.844+0000 7f46afe0e800 20 remove_watcher() i=7 2024-09-12T17:54:56.855 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:56.855 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:56.856 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:54:56.856 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:56.946 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:54:56.976 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:56.976 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:57.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.012+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.013+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.013+0000 7f1346537800 20 realm 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.013+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.014+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.015+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.015+0000 7f1346537800 20 searching for the correct realm 2024-09-12T17:54:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.019+0000 7f13429c4640 0 -- 172.21.15.94:0/3791527980 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f132c009040 msgr2=0x7f132c08d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.225+0000 7f13421c3640 0 -- 172.21.15.94:0/3791527980 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55a14c01c290 msgr2=0x55a14c01e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:57.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:57.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:57.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.227+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 zone default found 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 4 Realm: () 2024-09-12T17:54:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 zonegroup default 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.228+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.229+0000 7f1346537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.229+0000 7f1346537800 20 started sync module instance, tier type = 2024-09-12T17:54:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.229+0000 7f1346537800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=0 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=1 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=2 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=3 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=4 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=5 2024-09-12T17:54:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.237+0000 7f1346537800 20 add_watcher() i=6 2024-09-12T17:54:57.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.238+0000 7f1346537800 20 add_watcher() i=7 2024-09-12T17:54:57.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.238+0000 7f1346537800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:57.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.239+0000 7f11f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 5 note: GC not initialized 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f11737fe640 20 reqs_thread_entry: start 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 20 Filter name: none 2024-09-12T17:54:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f11717fa640 20 reqs_thread_entry: start 2024-09-12T17:54:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:54:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.240+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:54:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:54:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 : miss 2024-09-12T17:54:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.241+0000 7f1346537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 2024-09-12T17:54:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f1346537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f1346537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f1346537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f1346537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19, ofs0, ns] 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f12257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 94151253331008 notifier 5933 bl.length()=911 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f12257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f12257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.246+0000 7f12257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.248+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_sources= new_sources= 2024-09-12T17:54:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.248+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential sources added=[] removed=[] 2024-09-12T17:54:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.248+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_dests= new_dests= 2024-09-12T17:54:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.248+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential dests added=[] removed=[] 2024-09-12T17:54:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.0 2024-09-12T17:54:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.0 2024-09-12T17:54:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.1 2024-09-12T17:54:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.1 2024-09-12T17:54:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.2 2024-09-12T17:54:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.2 2024-09-12T17:54:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.3 2024-09-12T17:54:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.3 2024-09-12T17:54:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.4 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.4 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.5 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.5 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.6 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.6 2024-09-12T17:54:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.7 2024-09-12T17:54:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.7 2024-09-12T17:54:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.8 2024-09-12T17:54:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.8 2024-09-12T17:54:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.9 2024-09-12T17:54:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.9 2024-09-12T17:54:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.10 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.10 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.11 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1.11 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.252+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.0 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.253+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1 2024-09-12T17:54:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.253+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.2 2024-09-12T17:54:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.254+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.3 2024-09-12T17:54:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.254+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.4 2024-09-12T17:54:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.254+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.5 2024-09-12T17:54:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.255+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.6 2024-09-12T17:54:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.255+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.7 2024-09-12T17:54:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.256+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.8 2024-09-12T17:54:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.257+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.9 2024-09-12T17:54:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.258+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.10 2024-09-12T17:54:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.262+0000 7f1346537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.262+0000 7f1346537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 2024-09-12T17:54:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1346537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1346537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1346537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1346537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19, ofs0, ns] 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1225ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 94151253331008 notifier 5933 bl.length()=911 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1225ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1225ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.264+0000 7f1225ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.266+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_sources= new_sources= 2024-09-12T17:54:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.266+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential sources added=[] removed=[] 2024-09-12T17:54:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.266+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_dests= new_dests= 2024-09-12T17:54:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.266+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential dests added=[] removed=[] 2024-09-12T17:54:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.268+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.0 2024-09-12T17:54:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.268+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.1 2024-09-12T17:54:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.268+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.2 2024-09-12T17:54:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.269+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.3 2024-09-12T17:54:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.269+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.4 2024-09-12T17:54:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.269+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.5 2024-09-12T17:54:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.270+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.6 2024-09-12T17:54:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.270+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.7 2024-09-12T17:54:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.270+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.8 2024-09-12T17:54:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.270+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.9 2024-09-12T17:54:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.271+0000 7f1346537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19.10 2024-09-12T17:54:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.271+0000 7f1346537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.271+0000 7f1346537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 2024-09-12T17:54:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.272+0000 7f1346537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.272+0000 7f1346537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.272+0000 7f1346537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.272+0000 7f1346537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19, ofs0, ns] 2024-09-12T17:54:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.273+0000 7f12257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94151253331008 notifier 5933 bl.length()=879 2024-09-12T17:54:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.273+0000 7f12257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 info.flags=0x17 2024-09-12T17:54:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.273+0000 7f12257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 to cache LRU end 2024-09-12T17:54:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.273+0000 7f12257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.274+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_sources= new_sources= 2024-09-12T17:54:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.274+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential sources added=[] removed=[] 2024-09-12T17:54:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.274+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): orig_dests= new_dests= 2024-09-12T17:54:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.274+0000 7f1346537800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19]): potential dests added=[] removed=[] 2024-09-12T17:54:57.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.276+0000 7f1346537800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:54:57.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.279+0000 7f11f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.281+0000 7f1346537800 20 remove_watcher() i=0 2024-09-12T17:54:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.281+0000 7f1346537800 2 removed watcher, disabling cache 2024-09-12T17:54:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.282+0000 7f1346537800 20 remove_watcher() i=1 2024-09-12T17:54:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.283+0000 7f1346537800 20 remove_watcher() i=2 2024-09-12T17:54:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.284+0000 7f1346537800 20 remove_watcher() i=3 2024-09-12T17:54:57.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.285+0000 7f1346537800 20 remove_watcher() i=4 2024-09-12T17:54:57.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.286+0000 7f1346537800 20 remove_watcher() i=5 2024-09-12T17:54:57.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.287+0000 7f1346537800 20 remove_watcher() i=6 2024-09-12T17:54:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.288+0000 7f1346537800 20 remove_watcher() i=7 2024-09-12T17:54:57.301 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:54:57.330 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:57.330 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:57.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.365+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 20 realm 2024-09-12T17:54:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.367+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.368+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.368+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.369+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.369+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.369+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.369+0000 7f3bec219800 20 searching for the correct realm 2024-09-12T17:54:57.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.372+0000 7f3bdffff640 0 -- 172.21.15.94:0/79665644 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3bd804b070 msgr2=0x7f3bd805f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.375+0000 7f3be79eb640 0 -- 172.21.15.94:0/79665644 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3bd006c070 msgr2=0x7f3bd00e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:57.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 zone default found 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 4 Realm: () 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 zonegroup default 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.582+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 started sync module instance, tier type = 2024-09-12T17:54:57.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.583+0000 7f3bec219800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=0 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=1 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=2 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=3 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=4 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=5 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=6 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 20 add_watcher() i=7 2024-09-12T17:54:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.592+0000 7f3bec219800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:57.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.594+0000 7f3a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.594+0000 7f3bec219800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.594+0000 7f3bec219800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3bec219800 5 note: GC not initialized 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3a9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3bec219800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3bec219800 20 Filter name: none 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3a167fc640 20 reqs_thread_entry: start 2024-09-12T17:54:57.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.595+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.596+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:57.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.596+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.597+0000 7f3bec219800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:57.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.599+0000 7f3a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.601+0000 7f3bec219800 20 remove_watcher() i=0 2024-09-12T17:54:57.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.601+0000 7f3bec219800 2 removed watcher, disabling cache 2024-09-12T17:54:57.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.602+0000 7f3bec219800 20 remove_watcher() i=1 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.603+0000 7f3bec219800 20 remove_watcher() i=2 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.604+0000 7f3bec219800 20 remove_watcher() i=3 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.605+0000 7f3bec219800 20 remove_watcher() i=4 2024-09-12T17:54:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.606+0000 7f3bec219800 20 remove_watcher() i=5 2024-09-12T17:54:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.607+0000 7f3bec219800 20 remove_watcher() i=6 2024-09-12T17:54:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:57.608+0000 7f3bec219800 20 remove_watcher() i=7 2024-09-12T17:54:57.619 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:57.619 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:57.619 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:54:57.619 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:58.800 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:54:58.829 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:58.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.864+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 realm 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.866+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.867+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.867+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.867+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.867+0000 7f7c7b52e800 20 searching for the correct realm 2024-09-12T17:54:58.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.871+0000 7f7c6ffff640 0 -- 172.21.15.94:0/2904537859 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x558f3c27a770 msgr2=0x558f3c27cc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.874+0000 7f7c6ffff640 0 -- 172.21.15.94:0/2904537859 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f7c68009040 msgr2=0x7f7c680670f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.878+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 zone default found 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 4 Realm: () 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 zonegroup default 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.879+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.880+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.880+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.880+0000 7f7c7b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.880+0000 7f7c7b52e800 20 started sync module instance, tier type = 2024-09-12T17:54:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.880+0000 7f7c7b52e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=0 2024-09-12T17:54:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=1 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=2 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=3 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=4 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=5 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.888+0000 7f7c7b52e800 20 add_watcher() i=6 2024-09-12T17:54:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.889+0000 7f7c7b52e800 20 add_watcher() i=7 2024-09-12T17:54:58.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.889+0000 7f7c7b52e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:58.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7c7b52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7c7b52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7c7b52e800 5 note: GC not initialized 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7b2cfe1640 20 reqs_thread_entry: start 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7c7b52e800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7c7b52e800 20 Filter name: none 2024-09-12T17:54:58.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.891+0000 7f7aa67fc640 20 reqs_thread_entry: start 2024-09-12T17:54:58.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.892+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.892+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.892+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.893+0000 7f7c7b52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:58.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.895+0000 7f7b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.898+0000 7f7c7b52e800 20 remove_watcher() i=0 2024-09-12T17:54:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.898+0000 7f7c7b52e800 2 removed watcher, disabling cache 2024-09-12T17:54:58.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.899+0000 7f7c7b52e800 20 remove_watcher() i=1 2024-09-12T17:54:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.900+0000 7f7c7b52e800 20 remove_watcher() i=2 2024-09-12T17:54:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.901+0000 7f7c7b52e800 20 remove_watcher() i=3 2024-09-12T17:54:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.902+0000 7f7c7b52e800 20 remove_watcher() i=4 2024-09-12T17:54:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.903+0000 7f7c7b52e800 20 remove_watcher() i=5 2024-09-12T17:54:58.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.905+0000 7f7c7b52e800 20 remove_watcher() i=6 2024-09-12T17:54:58.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.906+0000 7f7c7b52e800 20 remove_watcher() i=7 2024-09-12T17:54:58.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:58.918 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:58.919 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:54:58.919 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:58.920 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:54:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.993+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 realm 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.995+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.996+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.996+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.996+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:58.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:58.996+0000 7f8caef35800 20 searching for the correct realm 2024-09-12T17:54:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.000+0000 7f8cab47e640 0 -- 172.21.15.94:0/3594280153 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x557f9002a440 msgr2=0x557f9002c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.003+0000 7f8caac7d640 0 -- 172.21.15.94:0/3594280153 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8ca00a2f10 msgr2=0x7f8ca00be6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:59.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:59.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.006+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 zone default found 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 4 Realm: () 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 zonegroup default 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.007+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 started sync module instance, tier type = 2024-09-12T17:54:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.008+0000 7f8caef35800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=0 2024-09-12T17:54:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=1 2024-09-12T17:54:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=2 2024-09-12T17:54:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=3 2024-09-12T17:54:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=4 2024-09-12T17:54:59.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=5 2024-09-12T17:54:59.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.020+0000 7f8caef35800 20 add_watcher() i=6 2024-09-12T17:54:59.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.021+0000 7f8caef35800 20 add_watcher() i=7 2024-09-12T17:54:59.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.021+0000 7f8caef35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:59.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8b617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8caef35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8caef35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8caef35800 5 note: GC not initialized 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8adbfff640 20 reqs_thread_entry: start 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.023+0000 7f8caef35800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 20 Filter name: none 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8ad9ffb640 20 reqs_thread_entry: start 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:54:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 : miss 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 info.flags=0x17 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 to cache LRU end 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.024+0000 7f8caef35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.025+0000 7f8caef35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.026+0000 7f8caef35800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:54:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.026+0000 7f8caef35800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:54:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.029+0000 7f8caef35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 info.flags=0x17 2024-09-12T17:54:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.029+0000 7f8caef35800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 to cache LRU end 2024-09-12T17:54:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.029+0000 7f8caef35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.029+0000 7f8caef35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20, ofs0, ns] 2024-09-12T17:54:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.030+0000 7f8b8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94006365368912 notifier 6306 bl.length()=911 2024-09-12T17:54:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.030+0000 7f8b8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 info.flags=0x17 2024-09-12T17:54:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.030+0000 7f8b8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 to cache LRU end 2024-09-12T17:54:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.030+0000 7f8b8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.031+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): orig_sources= new_sources= 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.031+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): potential sources added=[] removed=[] 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.031+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): orig_dests= new_dests= 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.031+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): potential dests added=[] removed=[] 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.0 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.0 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.1 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.1 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.2 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.2 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.3 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.3 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.4 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.4 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.5 2024-09-12T17:54:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.5 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.6 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.6 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.7 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.7 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.8 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.8 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.9 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.9 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.10 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.10 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.11 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1.11 2024-09-12T17:54:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.0 2024-09-12T17:54:59.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.034+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.1 2024-09-12T17:54:59.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.035+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.2 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.035+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.3 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.036+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.4 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.036+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.5 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.037+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.6 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.037+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.7 2024-09-12T17:54:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.038+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.8 2024-09-12T17:54:59.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.038+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.9 2024-09-12T17:54:59.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.038+0000 7f8caef35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20.10 2024-09-12T17:54:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.043+0000 7f8caef35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.043+0000 7f8caef35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 2024-09-12T17:54:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.044+0000 7f8caef35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 info.flags=0x17 2024-09-12T17:54:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.044+0000 7f8caef35800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 to cache LRU end 2024-09-12T17:54:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.044+0000 7f8caef35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.044+0000 7f8caef35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20, ofs0, ns] 2024-09-12T17:54:59.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.045+0000 7f8b8dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94006365368912 notifier 6306 bl.length()=879 2024-09-12T17:54:59.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.045+0000 7f8b8dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 info.flags=0x17 2024-09-12T17:54:59.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.045+0000 7f8b8dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 to cache LRU end 2024-09-12T17:54:59.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.045+0000 7f8b8dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:54:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.046+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): orig_sources= new_sources= 2024-09-12T17:54:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.046+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): potential sources added=[] removed=[] 2024-09-12T17:54:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.046+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): orig_dests= new_dests= 2024-09-12T17:54:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.046+0000 7f8caef35800 20 handle_bi_update(): bucket=:error-at-init-index[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20]): potential dests added=[] removed=[] 2024-09-12T17:54:59.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.049+0000 7f8caef35800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:54:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.050+0000 7f8b617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.052+0000 7f8caef35800 20 remove_watcher() i=0 2024-09-12T17:54:59.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.052+0000 7f8caef35800 2 removed watcher, disabling cache 2024-09-12T17:54:59.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.053+0000 7f8caef35800 20 remove_watcher() i=1 2024-09-12T17:54:59.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.054+0000 7f8caef35800 20 remove_watcher() i=2 2024-09-12T17:54:59.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.055+0000 7f8caef35800 20 remove_watcher() i=3 2024-09-12T17:54:59.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.057+0000 7f8caef35800 20 remove_watcher() i=4 2024-09-12T17:54:59.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.057+0000 7f8caef35800 20 remove_watcher() i=5 2024-09-12T17:54:59.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.058+0000 7f8caef35800 20 remove_watcher() i=6 2024-09-12T17:54:59.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.059+0000 7f8caef35800 20 remove_watcher() i=7 2024-09-12T17:54:59.072 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:54:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.137+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.138+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.138+0000 7f3508140800 20 realm 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.138+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.139+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.139+0000 7f3508140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.139+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.139+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.139+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.140+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.140+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.140+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.140+0000 7f3508140800 20 searching for the correct realm 2024-09-12T17:54:59.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.144+0000 7f34fbfff640 0 -- 172.21.15.94:0/925316959 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55e0842a59e0 msgr2=0x55e0842a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.147+0000 7f3503eed640 0 -- 172.21.15.94:0/925316959 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f34ec0a1030 msgr2=0x7f34ec089150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:54:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:54:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.151+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 zone default found 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 4 Realm: () 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:54:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 zonegroup default 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.152+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.153+0000 7f3508140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.153+0000 7f3508140800 20 started sync module instance, tier type = 2024-09-12T17:54:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.153+0000 7f3508140800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:54:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=0 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=1 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=2 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=3 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=4 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=5 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.161+0000 7f3508140800 20 add_watcher() i=6 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.162+0000 7f3508140800 20 add_watcher() i=7 2024-09-12T17:54:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.162+0000 7f3508140800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:59.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.163+0000 7f33b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.163+0000 7f3508140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.163+0000 7f3508140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.163+0000 7f3508140800 5 note: GC not initialized 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f33b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f3508140800 20 init_complete bucket index max shards: 11 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f3508140800 20 Filter name: none 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f33327fc640 20 reqs_thread_entry: start 2024-09-12T17:54:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.164+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.165+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.165+0000 7f3508140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.165+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.165+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:54:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.165+0000 7f3508140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.166+0000 7f3508140800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:54:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.166+0000 7f3508140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.167+0000 7f33b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.169+0000 7f3508140800 20 remove_watcher() i=0 2024-09-12T17:54:59.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.169+0000 7f3508140800 2 removed watcher, disabling cache 2024-09-12T17:54:59.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.170+0000 7f3508140800 20 remove_watcher() i=1 2024-09-12T17:54:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.171+0000 7f3508140800 20 remove_watcher() i=2 2024-09-12T17:54:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.172+0000 7f3508140800 20 remove_watcher() i=3 2024-09-12T17:54:59.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.173+0000 7f3508140800 20 remove_watcher() i=4 2024-09-12T17:54:59.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.174+0000 7f3508140800 20 remove_watcher() i=5 2024-09-12T17:54:59.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.175+0000 7f3508140800 20 remove_watcher() i=6 2024-09-12T17:54:59.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:54:59.176+0000 7f3508140800 20 remove_watcher() i=7 2024-09-12T17:54:59.187 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:54:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:54:59.187 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:54:59.575 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:54:59.575 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.381 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:55:00.409 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:00.409 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:00.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.445+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 20 realm 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.446+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.447+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.447+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.447+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.447+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.448+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.448+0000 7f1080f2e800 20 searching for the correct realm 2024-09-12T17:55:00.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.452+0000 7f107d4de640 0 -- 172.21.15.94:0/4244110465 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f106809dbb0 msgr2=0x7f1068044020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:00.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.658+0000 7f107d4de640 0 -- 172.21.15.94:0/4244110465 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f106800b040 msgr2=0x7f106806d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.661+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 zone default found 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 4 Realm: () 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 zonegroup default 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.662+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.663+0000 7f1080f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.663+0000 7f1080f2e800 20 started sync module instance, tier type = 2024-09-12T17:55:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.663+0000 7f1080f2e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=0 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=1 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=2 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=3 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=4 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=5 2024-09-12T17:55:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.671+0000 7f1080f2e800 20 add_watcher() i=6 2024-09-12T17:55:00.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.672+0000 7f1080f2e800 20 add_watcher() i=7 2024-09-12T17:55:00.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.672+0000 7f1080f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:00.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.673+0000 7f0f32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.673+0000 7f1080f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.673+0000 7f1080f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.673+0000 7f1080f2e800 5 note: GC not initialized 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f0f31fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f1080f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f1080f2e800 20 Filter name: none 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f0ea37fe640 20 reqs_thread_entry: start 2024-09-12T17:55:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.674+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.675+0000 7f1080f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:00.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.677+0000 7f0f32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.680+0000 7f1080f2e800 20 remove_watcher() i=0 2024-09-12T17:55:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.680+0000 7f1080f2e800 2 removed watcher, disabling cache 2024-09-12T17:55:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.681+0000 7f1080f2e800 20 remove_watcher() i=1 2024-09-12T17:55:00.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.682+0000 7f1080f2e800 20 remove_watcher() i=2 2024-09-12T17:55:00.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.683+0000 7f1080f2e800 20 remove_watcher() i=3 2024-09-12T17:55:00.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.684+0000 7f1080f2e800 20 remove_watcher() i=4 2024-09-12T17:55:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.685+0000 7f1080f2e800 20 remove_watcher() i=5 2024-09-12T17:55:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.686+0000 7f1080f2e800 20 remove_watcher() i=6 2024-09-12T17:55:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.687+0000 7f1080f2e800 20 remove_watcher() i=7 2024-09-12T17:55:00.698 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.698 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:00.698 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:00.698 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.700 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:55:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:00.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.769+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 realm 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.771+0000 7fc1e7d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 searching for the correct realm 2024-09-12T17:55:00.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.775+0000 7fc1dd036640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x560590f34ec0 msgr2=0x560590f37380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.779+0000 7fc1e5837640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc1d009d150 msgr2=0x7fc1d0089780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zone default found 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Realm: () 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:00.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zonegroup default 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started sync module instance, tier type = 2024-09-12T17:55:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=0 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=1 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=2 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=3 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=4 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=5 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=6 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.794+0000 7fc1e7d46800 20 add_watcher() i=7 2024-09-12T17:55:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.794+0000 7fc1e7d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:00.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.795+0000 7fc09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:00.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:00.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:00.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 note: GC not initialized 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc09afe5640 20 reqs_thread_entry: start 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 Filter name: none 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc098fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : miss 2024-09-12T17:55:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc1e7d46800 time 2024-09-12T17:55:00.799496+0000 2024-09-12T17:55:00.799 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc1eb38c71a] 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.800 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc1e7d46800 thread_name:radosgw-admin 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.799+0000 7fc1e7d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc1e7d46800 time 2024-09-12T17:55:00.799496+0000 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc1eb38c71a] 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.801 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:00.802 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc1ea03e6f0] 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc1ea08b99c] 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc1eb38c774] 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.821 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.800+0000 7fc1e7d46800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc1e7d46800 thread_name:radosgw-admin 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc1ea03e6f0] 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc1ea08b99c] 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:00.822 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc1eb38c774] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.823 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_done global_id 6020 payload 274 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:55:00.752+0000 7fc1e5837640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:55:00.752+0000 7fc1e5837640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:55:00.752+0000 7fc1e5837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.824 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: dump: 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.825 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: dump: 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6020 2024-09-12T17:55:00.826 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 4 set_mon_vals no callback set 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 10 monclient: shutdown 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 5 asok(0x560590c1e730) unregister_commands rotate-key 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.828 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: starting msgr at 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: starting objecter 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests hook 0x560590e6f860 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: setting wanted keys 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: calling monclient init 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.829 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.830 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key hook 0x560590e40808 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590ccb120 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590d86700 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590e471a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.268147s 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590e471a0 auth_method 0 2024-09-12T17:55:00.831 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590d86700 auth_method 0 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.832 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:55:00.754+0000 7fc1e6038640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: dump: 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: dump: 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6023 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:55:00.754+0000 7fc0d3e07640 4 set_mon_vals no callback set 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 1 librados: init done 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.835 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:55:00.756+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0cc0764a0 auth_method 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:55:00.757+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590e69030 auth_method 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:55:00.757+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590e8c350 auth_method 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:55:00.759+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590e913e0 auth_method 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.837 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests cmddesc objecter_requests hook 0x560590e98cf0 EEXIST 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.838 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.839 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x560590e944b0 EEXIST 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590ebc9e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590ebecb0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590ebb1b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.275152s 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ebecb0 auth_method 0 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.840 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590ebb1b0 auth_method 0 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590ebc9e0 auth_method 0 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.841 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_done global_id 6357 payload 824 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:55:00.761+0000 7fc1dd036640 1 monclient: found mon.noname-a 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: dump: 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.842 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: dump: 2024-09-12T17:55:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6357 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.844 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:55:00.761+0000 7fc1e6839640 4 set_mon_vals no callback set 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:55:00.763+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0c0076380 auth_method 0 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: get_monmap_and_config 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.845 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.846 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.847 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.848 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x7ffe2e708688 EEXIST 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590f10e10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590ee0970 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590edd8a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.279123s 2024-09-12T17:55:00.849 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ee0970 auth_method 0 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590f10e10 auth_method 0 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.850 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_done global_id 6029 payload 274 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:55:00.765+0000 7fc1dd036640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:55:00.765+0000 7fc1e6038640 10 monclient: get_auth_request con 0x560590edd8a0 auth_method 0 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: dump: 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6029 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 4 set_mon_vals no callback set 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.852 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: dump: 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: shutdown 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.853 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.854 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: starting msgr at 2024-09-12T17:55:00.855 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: starting objecter 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests cmddesc objecter_requests hook 0x560590f10470 EEXIST 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: setting wanted keys 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: calling monclient init 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.856 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x560590ed48d8 EEXIST 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590edd8a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590ee0970 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.857 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590f10e10 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.281373s 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590f10e10 auth_method 0 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ee0970 auth_method 0 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.858 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590edd8a0 auth_method 0 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_done global_id 6032 payload 824 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:55:00.767+0000 7fc1e6038640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.859 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: dump: 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.860 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6032 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: dump: 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:55:00.767+0000 7fc0c97fa640 4 set_mon_vals no callback set 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 1 librados: init done 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cr dump hook 0x560590f07e58 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:55:00.769+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:55:00.770+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0b00764a0 auth_method 0 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:55:00.770+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590f2b970 auth_method 0 2024-09-12T17:55:00.862 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 realm 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:55:00.771+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590f2fc30 auth_method 0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 searching for the correct realm 2024-09-12T17:55:00.863 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:55:00.772+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590f34ec0 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:55:00.773+0000 7fc1e6038640 10 monclient: get_auth_request con 0x7fc1d001e040 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:55:00.774+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc1e0061070 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:55:00.775+0000 7fc1dd036640 10 monclient: get_auth_request con 0x7fc1d804e040 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:55:00.775+0000 7fc1dd036640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x560590f34ec0 msgr2=0x560590f37380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 1 client.6032.objecter ms_handle_reset 0x560590f34ec0 session 0x560590f34840 osd.3 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 10 monclient: _renew_subs 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:55:00.776+0000 7fc1dd036640 10 monclient: get_auth_request con 0x7fc0b0086bc0 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:55:00.776+0000 7fc1e6038640 10 monclient: get_auth_request con 0x7fc1d008d130 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:55:00.778+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc1d009d150 auth_method 0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:55:00.779+0000 7fc1e5837640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc1d009d150 msgr2=0x7fc1d0089780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:55:00.779+0000 7fc0b77fe640 1 client.6032.objecter ms_handle_reset 0x7fc1d009d150 session 0x7fc1d0089460 osd.0 2024-09-12T17:55:00.864 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:55:00.779+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590f34ec0 auth_method 0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zone default found 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Realm: () 2024-09-12T17:55:00.865 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zonegroup default 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started sync module instance, tier type = 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=0 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=1 2024-09-12T17:55:00.866 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=2 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=3 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=4 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=5 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=6 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:55:00.794+0000 7fc1e7d46800 20 add_watcher() i=7 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:55:00.794+0000 7fc1e7d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.867 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:55:00.795+0000 7fc09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache list hook 0x560590f085e0 2024-09-12T17:55:00.868 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache inspect hook 0x560590f085e0 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache erase hook 0x560590f085e0 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache zap hook 0x560590f085e0 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 note: GC not initialized 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:55:00.796+0000 7fc09afe5640 20 reqs_thread_entry: start 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace show hook 0x7fc1d8029040 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace history hook 0x7fc1d8029040 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace active hook 0x7fc1d8029040 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace active_short hook 0x7fc1d8029040 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 Filter name: none 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:55:00.796+0000 7fc098fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:00.869 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : miss 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:55:00.799+0000 7fc1e7d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc1e7d46800 time 2024-09-12T17:55:00.799496+0000 2024-09-12T17:55:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc1eb38c71a] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:55:00.800+0000 7fc1e7d46800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc1e7d46800 thread_name:radosgw-admin 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc1ea03e6f0] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc1ea08b99c] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc1eb38c774] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.872 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:55:00.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:00.874 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:55:00.875 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:55:00.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:55:00.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:00.878 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc098fe1640 / http_manager 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc09afe5640 / http_manager 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc09bfe7640 / rgw_dt_lg_renew 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0b77fe640 / ms_dispatch 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0c97fa640 / io_context_pool 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0cb7fe640 / ms_dispatch 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0d2604640 / ms_dispatch 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0d3e07640 / io_context_pool 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1dd036640 / msgr-worker-2 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e5837640 / msgr-worker-1 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e6038640 / msgr-worker-0 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e6839640 / io_context_pool 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e7d46800 / radosgw-admin 2024-09-12T17:55:00.880 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.90002.log 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:55:00.751+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:55:00.751+0000 7fc1e5837640 10 monclient(hunting): handle_auth_done global_id 6020 payload 274 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:55:00.752+0000 7fc1e5837640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.881 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:55:00.752+0000 7fc1e5837640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:55:00.752+0000 7fc1e5837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: dump: 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.882 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:55:00.752+0000 7fc0d3e07640 10 monclient: dump: 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6020 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 4 set_mon_vals no callback set 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 10 monclient: shutdown 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:55:00.752+0000 7fc1e7d46800 5 asok(0x560590c1e730) unregister_commands rotate-key 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding auth protocol: cephx 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.885 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: crc 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e45d20) adding con mode: secure 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: starting msgr at 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: starting objecter 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests hook 0x560590e6f860 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: setting wanted keys 2024-09-12T17:55:00.886 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 1 librados: calling monclient init 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding auth protocol: cephx 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.887 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: crc 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 5 AuthRegistry(0x560590e406c0) adding con mode: secure 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:55:00.753+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key hook 0x560590e40808 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590ccb120 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590d86700 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590e471a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.888 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.268147s 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590e471a0 auth_method 0 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590d86700 auth_method 0 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.889 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:55:00.754+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:55:00.754+0000 7fc1e6038640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:55:00.754+0000 7fc1e6038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: dump: 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:55:00.754+0000 7fc0d2604640 10 monclient: dump: 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6023 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:55:00.754+0000 7fc0d3e07640 4 set_mon_vals no callback set 2024-09-12T17:55:00.892 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:55:00.754+0000 7fc1e7d46800 1 librados: init done 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:55:00.756+0000 7fc0d2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:55:00.756+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0cc0764a0 auth_method 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:55:00.757+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590e69030 auth_method 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:55:00.757+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590e8c350 auth_method 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:55:00.759+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590e913e0 auth_method 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.893 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding auth protocol: cephx 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.894 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: crc 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e95310) adding con mode: secure 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests cmddesc objecter_requests hook 0x560590e98cf0 EEXIST 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.895 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding auth protocol: cephx 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: crc 2024-09-12T17:55:00.896 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 5 AuthRegistry(0x560590e94368) adding con mode: secure 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:55:00.760+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x560590e944b0 EEXIST 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590ebc9e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590ebecb0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590ebb1b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.897 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.275152s 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ebecb0 auth_method 0 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590ebb1b0 auth_method 0 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.898 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:55:00.761+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590ebc9e0 auth_method 0 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:55:00.761+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient(hunting): handle_auth_done global_id 6357 payload 824 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:55:00.761+0000 7fc1dd036640 1 monclient: found mon.noname-a 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:55:00.761+0000 7fc1dd036640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:00.899 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: dump: 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.900 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:55:00.761+0000 7fc0cb7fe640 10 monclient: dump: 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6357 2024-09-12T17:55:00.901 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:55:00.761+0000 7fc1e6839640 4 set_mon_vals no callback set 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:55:00.761+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:55:00.763+0000 7fc0cb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:55:00.763+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0c0076380 auth_method 0 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: get_monmap_and_config 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.902 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding auth protocol: cephx 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.903 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: crc 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x560590edc8c0) adding con mode: secure 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.904 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding auth protocol: cephx 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: crc 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708540) adding con mode: secure 2024-09-12T17:55:00.905 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:55:00.764+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x7ffe2e708688 EEXIST 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590f10e10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590ee0970 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590edd8a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.279123s 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ee0970 auth_method 0 2024-09-12T17:55:00.906 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590f10e10 auth_method 0 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:55:00.765+0000 7fc1e5837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient(hunting): handle_auth_done global_id 6029 payload 274 2024-09-12T17:55:00.907 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:55:00.765+0000 7fc1dd036640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:55:00.765+0000 7fc1dd036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:55:00.765+0000 7fc1e6038640 10 monclient: get_auth_request con 0x560590edd8a0 auth_method 0 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: dump: 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6029 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:55:00.765+0000 7fc1e7d46800 4 set_mon_vals no callback set 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:55:00.765+0000 7fc0c97fa640 10 monclient: dump: 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: shutdown 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: build_initial_monmap 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 build_initial for_mkfs: 0 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: monmap: 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding auth protocol: cephx 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.911 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: crc 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ede3b0) adding con mode: secure 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: starting msgr at 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: starting objecter 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command objecter_requests cmddesc objecter_requests hook 0x560590f10470 EEXIST 2024-09-12T17:55:00.912 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: setting wanted keys 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 1 librados: calling monclient init 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 10 monclient: init 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding auth protocol: cephx 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.913 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: crc 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:55:00.766+0000 7fc1e7d46800 5 AuthRegistry(0x560590ed4790) adding con mode: secure 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command rotate-key cmddesc rotate-key hook 0x560590ed48d8 EEXIST 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-b con 0x560590edd8a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-a con 0x560590ee0970 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): picked mon.noname-c con 0x560590f10e10 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.914 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 10 monclient(hunting): authenticate will time out at 1974.281373s 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): get_auth_request con 0x560590f10e10 auth_method 0 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): get_auth_request con 0x560590ee0970 auth_method 0 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.915 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:55:00.767+0000 7fc1dd036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): get_auth_request con 0x560590edd8a0 auth_method 0 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:55:00.767+0000 7fc1e5837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient(hunting): handle_auth_done global_id 6032 payload 824 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient: _finish_hunting 0 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:55:00.767+0000 7fc1e6038640 1 monclient: found mon.noname-c 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:55:00.767+0000 7fc1e6038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:00.916 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: dump: 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: _finish_auth 0 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: _check_auth_tickets 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:55:00.767+0000 7fc1e7d46800 5 monclient: authenticate success, global_id 6032 2024-09-12T17:55:00.917 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:55:00.767+0000 7fc0b77fe640 10 monclient: dump: 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.918 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:55:00.767+0000 7fc0c97fa640 4 set_mon_vals no callback set 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _renew_subs 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 1 librados: init done 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:55:00.768+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cr dump hook 0x560590f07e58 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:55:00.769+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:55:00.770+0000 7fc0b77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:55:00.770+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc0b00764a0 auth_method 0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:55:00.770+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590f2b970 auth_method 0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 realm 2024-09-12T17:55:00.919 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:55:00.770+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:55:00.771+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:55:00.771+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590f2fc30 auth_method 0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:55:00.772+0000 7fc1e7d46800 20 searching for the correct realm 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:55:00.772+0000 7fc1dd036640 10 monclient: get_auth_request con 0x560590f34ec0 auth_method 0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:55:00.773+0000 7fc1e6038640 10 monclient: get_auth_request con 0x7fc1d001e040 auth_method 0 2024-09-12T17:55:00.920 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:55:00.774+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc1e0061070 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:55:00.775+0000 7fc1dd036640 10 monclient: get_auth_request con 0x7fc1d804e040 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:55:00.775+0000 7fc1dd036640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x560590f34ec0 msgr2=0x560590f37380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 1 client.6032.objecter ms_handle_reset 0x560590f34ec0 session 0x560590f34840 osd.3 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 10 monclient: _renew_subs 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:55:00.776+0000 7fc0b77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:55:00.776+0000 7fc1dd036640 10 monclient: get_auth_request con 0x7fc0b0086bc0 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:55:00.776+0000 7fc1e6038640 10 monclient: get_auth_request con 0x7fc1d008d130 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:55:00.778+0000 7fc1e5837640 10 monclient: get_auth_request con 0x7fc1d009d150 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:55:00.779+0000 7fc1e5837640 0 -- 172.21.15.94:0/1040716579 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc1d009d150 msgr2=0x7fc1d0089780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:55:00.779+0000 7fc0b77fe640 1 client.6032.objecter ms_handle_reset 0x7fc1d009d150 session 0x7fc1d0089460 osd.0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:55:00.779+0000 7fc1e5837640 10 monclient: get_auth_request con 0x560590f34ec0 auth_method 0 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:00.921 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:55:00.783+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zone default found 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Realm: () 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:00.922 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 zonegroup default 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started sync module instance, tier type = 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:55:00.784+0000 7fc1e7d46800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=0 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=1 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=2 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=3 2024-09-12T17:55:00.923 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=4 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=5 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:55:00.793+0000 7fc1e7d46800 20 add_watcher() i=6 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:55:00.794+0000 7fc1e7d46800 20 add_watcher() i=7 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:55:00.794+0000 7fc1e7d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding auth protocol: cephx 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:55:00.795+0000 7fc09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:00.924 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: crc 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 5 AuthRegistry(0x7ffe2e708a10) adding con mode: secure 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:55:00.795+0000 7fc1e7d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache list hook 0x560590f085e0 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache inspect hook 0x560590f085e0 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache erase hook 0x560590f085e0 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command cache zap hook 0x560590f085e0 2024-09-12T17:55:00.925 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 note: GC not initialized 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:55:00.796+0000 7fc09afe5640 20 reqs_thread_entry: start 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace show hook 0x7fc1d8029040 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace history hook 0x7fc1d8029040 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace active hook 0x7fc1d8029040 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 5 asok(0x560590c1e730) register_command sync trace active_short hook 0x7fc1d8029040 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 Filter name: none 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:55:00.796+0000 7fc098fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:00.926 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : miss 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:55:00.796+0000 7fc1e7d46800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:55:00.797+0000 7fc1e7d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:55:00.799+0000 7fc1e7d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc1e7d46800 time 2024-09-12T17:55:00.799496+0000 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc1eb38c71a] 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.927 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:55:00.800+0000 7fc1e7d46800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc1e7d46800 thread_name:radosgw-admin 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc1ea03e6f0] 2024-09-12T17:55:00.928 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc1ea08b99c] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc1eb38c774] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc1eb38c8d8] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56058fa15841] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73b64) [0x56058ff22b64] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56058fa2550d] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc1ea029590] 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:00.929 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:55:00.930 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:55:00.931 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:55:00.932 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:55:00.933 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:00.934 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:55:00.935 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc098fe1640 / http_manager 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc09afe5640 / http_manager 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc09bfe7640 / rgw_dt_lg_renew 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0b77fe640 / ms_dispatch 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0c97fa640 / io_context_pool 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0cb7fe640 / ms_dispatch 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0d2604640 / ms_dispatch 2024-09-12T17:55:00.936 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc0d3e07640 / io_context_pool 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1dd036640 / msgr-worker-2 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e5837640 / msgr-worker-1 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e6038640 / msgr-worker-0 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e6839640 / io_context_pool 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc1e7d46800 / radosgw-admin 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:55:00.801138Z_01b49edc-ae87-4dd5-a7df-ef1c816ddcb1/log 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:55:00.937 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.875+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 realm 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.877+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.878+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:00.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.878+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:00.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.878+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:00.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.878+0000 7fe49fd26800 20 searching for the correct realm 2024-09-12T17:55:00.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:00.879+0000 7fe49b9d9640 0 -- 172.21.15.94:0/31181416 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x55fe89c0eff0 msgr2=0x7fe4940a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:01.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.084+0000 7fe49c1da640 0 -- 172.21.15.94:0/31181416 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe490038070 msgr2=0x7fe490038960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.089+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 zone default found 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 4 Realm: () 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 zonegroup default 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.090+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.091+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.091+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.091+0000 7fe49fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.091+0000 7fe49fd26800 20 started sync module instance, tier type = 2024-09-12T17:55:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.091+0000 7fe49fd26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:01.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=0 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=1 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=2 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=3 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=4 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=5 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.099+0000 7fe49fd26800 20 add_watcher() i=6 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.100+0000 7fe49fd26800 20 add_watcher() i=7 2024-09-12T17:55:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.100+0000 7fe49fd26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:01.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.102+0000 7fe351fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 5 note: GC not initialized 2024-09-12T17:55:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe350fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 20 Filter name: none 2024-09-12T17:55:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe2ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:55:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.103+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.104+0000 7fe49fd26800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.105+0000 7fe49fd26800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.105+0000 7fe49fd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:01.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.107+0000 7fe351fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:01.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.109+0000 7fe49fd26800 20 remove_watcher() i=0 2024-09-12T17:55:01.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.109+0000 7fe49fd26800 2 removed watcher, disabling cache 2024-09-12T17:55:01.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.110+0000 7fe49fd26800 20 remove_watcher() i=1 2024-09-12T17:55:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.111+0000 7fe49fd26800 20 remove_watcher() i=2 2024-09-12T17:55:01.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.112+0000 7fe49fd26800 20 remove_watcher() i=3 2024-09-12T17:55:01.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.113+0000 7fe49fd26800 20 remove_watcher() i=4 2024-09-12T17:55:01.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.114+0000 7fe49fd26800 20 remove_watcher() i=5 2024-09-12T17:55:01.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.115+0000 7fe49fd26800 20 remove_watcher() i=6 2024-09-12T17:55:01.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.116+0000 7fe49fd26800 20 remove_watcher() i=7 2024-09-12T17:55:01.127 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:01.127 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:01.216 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.283+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 realm 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.284+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.285+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.285+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.286+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.286+0000 7f3e4a337800 20 searching for the correct realm 2024-09-12T17:55:01.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.289+0000 7f3e3d820640 0 -- 172.21.15.94:0/389130502 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3e38044900 msgr2=0x7f3e3802b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.292+0000 7f3e3d820640 0 -- 172.21.15.94:0/389130502 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3d10086b90 msgr2=0x7f3d10088fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 zone default found 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 4 Realm: () 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 zonegroup default 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.296+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:01.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 started sync module instance, tier type = 2024-09-12T17:55:01.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.297+0000 7f3e4a337800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:01.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=0 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=1 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=2 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=3 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=4 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=5 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=6 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 20 add_watcher() i=7 2024-09-12T17:55:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.306+0000 7f3e4a337800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:01.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.308+0000 7f3cfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.308+0000 7f3e4a337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.308+0000 7f3e4a337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.308+0000 7f3e4a337800 5 note: GC not initialized 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3c777fe640 20 reqs_thread_entry: start 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 20 Filter name: none 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3c757fa640 20 reqs_thread_entry: start 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : miss 2024-09-12T17:55:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.309+0000 7f3e4a337800 20 rados->read ofs=0 len=0 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.310+0000 7f3e4a337800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.311+0000 7f3e4a337800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to be held by another RGW process; skipping for now 2024-09-12T17:55:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.312+0000 7f3cfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.314+0000 7f3e4a337800 20 remove_watcher() i=0 2024-09-12T17:55:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.314+0000 7f3e4a337800 2 removed watcher, disabling cache 2024-09-12T17:55:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.315+0000 7f3e4a337800 20 remove_watcher() i=1 2024-09-12T17:55:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.316+0000 7f3e4a337800 20 remove_watcher() i=2 2024-09-12T17:55:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.317+0000 7f3e4a337800 20 remove_watcher() i=3 2024-09-12T17:55:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.318+0000 7f3e4a337800 20 remove_watcher() i=4 2024-09-12T17:55:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.319+0000 7f3e4a337800 20 remove_watcher() i=5 2024-09-12T17:55:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.319+0000 7f3e4a337800 20 remove_watcher() i=6 2024-09-12T17:55:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:01.320+0000 7f3e4a337800 20 remove_watcher() i=7 2024-09-12T17:55:01.331 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:55:31.362 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:31.396 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:31.397 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:31.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.437+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 realm 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.439+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.440+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.440+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.441+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:31.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.441+0000 7f03c5d25800 20 searching for the correct realm 2024-09-12T17:55:31.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.444+0000 7f03c2134640 0 -- 172.21.15.94:0/2280451413 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f03ac01a040 msgr2=0x7f03ac019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.448+0000 7f03c1933640 0 -- 172.21.15.94:0/2280451413 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f03ac04b450 msgr2=0x7f03ac04b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.655+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 zone default found 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 4 Realm: () 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 zonegroup default 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.656+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.657+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.657+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.657+0000 7f03c5d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.657+0000 7f03c5d25800 20 started sync module instance, tier type = 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.657+0000 7f03c5d25800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=0 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=1 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=2 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=3 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=4 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=5 2024-09-12T17:55:31.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.667+0000 7f03c5d25800 20 add_watcher() i=6 2024-09-12T17:55:31.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.668+0000 7f03c5d25800 20 add_watcher() i=7 2024-09-12T17:55:31.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.668+0000 7f03c5d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:31.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.669+0000 7f0273fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:31.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 5 note: GC not initialized 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f0272ffd640 20 reqs_thread_entry: start 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 20 Filter name: none 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f0270ff9640 20 reqs_thread_entry: start 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:31.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.670+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:31.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : miss 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.671+0000 7f03c5d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:31.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f03c5d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f03c5d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f03c5d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f03c5d25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21, ofs0, ns] 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f02a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 94159287072416 notifier 6080 bl.length()=913 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f02a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f02a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.677+0000 7f02a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.679+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_sources= new_sources= 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.679+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential sources added=[] removed=[] 2024-09-12T17:55:31.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.679+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_dests= new_dests= 2024-09-12T17:55:31.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.679+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential dests added=[] removed=[] 2024-09-12T17:55:31.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.0 2024-09-12T17:55:31.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.0 2024-09-12T17:55:31.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.1 2024-09-12T17:55:31.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.1 2024-09-12T17:55:31.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.2 2024-09-12T17:55:31.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.2 2024-09-12T17:55:31.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.3 2024-09-12T17:55:31.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.3 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.4 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.4 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.5 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.5 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.6 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.6 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.7 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.7 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.8 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.8 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.9 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.9 2024-09-12T17:55:31.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.10 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.10 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.11 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1.11 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.0 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.684+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1 2024-09-12T17:55:31.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.685+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.2 2024-09-12T17:55:31.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.686+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.3 2024-09-12T17:55:31.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.686+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.4 2024-09-12T17:55:31.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.687+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.5 2024-09-12T17:55:31.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.688+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.6 2024-09-12T17:55:31.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.688+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.7 2024-09-12T17:55:31.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.689+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.8 2024-09-12T17:55:31.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.690+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.9 2024-09-12T17:55:31.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.690+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.10 2024-09-12T17:55:31.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.693+0000 7f03c5d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:31.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.693+0000 7f03c5d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f03c5d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f03c5d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f03c5d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f03c5d25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21, ofs0, ns] 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f02a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529696 cookie 94159287072416 notifier 6080 bl.length()=913 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f02a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f02a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.695+0000 7f02a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.696+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_sources= new_sources= 2024-09-12T17:55:31.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.696+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential sources added=[] removed=[] 2024-09-12T17:55:31.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.696+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_dests= new_dests= 2024-09-12T17:55:31.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.696+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential dests added=[] removed=[] 2024-09-12T17:55:31.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.699+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.0 2024-09-12T17:55:31.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.699+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.1 2024-09-12T17:55:31.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.700+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.2 2024-09-12T17:55:31.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.700+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.3 2024-09-12T17:55:31.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.700+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.4 2024-09-12T17:55:31.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.701+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.5 2024-09-12T17:55:31.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.701+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.6 2024-09-12T17:55:31.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.701+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.7 2024-09-12T17:55:31.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.702+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.8 2024-09-12T17:55:31.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.702+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.9 2024-09-12T17:55:31.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.703+0000 7f03c5d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21.10 2024-09-12T17:55:31.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.703+0000 7f03c5d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:31.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.703+0000 7f03c5d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 2024-09-12T17:55:31.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.704+0000 7f03c5d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.704+0000 7f03c5d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.704+0000 7f03c5d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.704+0000 7f03c5d25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21, ofs0, ns] 2024-09-12T17:55:31.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.705+0000 7f02a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529697 cookie 94159287072416 notifier 6080 bl.length()=881 2024-09-12T17:55:31.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.705+0000 7f02a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 info.flags=0x17 2024-09-12T17:55:31.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.705+0000 7f02a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 to cache LRU end 2024-09-12T17:55:31.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.705+0000 7f02a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.706+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_sources= new_sources= 2024-09-12T17:55:31.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.706+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential sources added=[] removed=[] 2024-09-12T17:55:31.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.706+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): orig_dests= new_dests= 2024-09-12T17:55:31.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.706+0000 7f03c5d25800 20 handle_bi_update(): bucket=:abort-at-init-indext[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21]): potential dests added=[] removed=[] 2024-09-12T17:55:31.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.710+0000 7f03c5d25800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:31.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.712+0000 7f0273fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.714+0000 7f03c5d25800 20 remove_watcher() i=0 2024-09-12T17:55:31.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.714+0000 7f03c5d25800 2 removed watcher, disabling cache 2024-09-12T17:55:31.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.716+0000 7f03c5d25800 20 remove_watcher() i=1 2024-09-12T17:55:31.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.716+0000 7f03c5d25800 20 remove_watcher() i=2 2024-09-12T17:55:31.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.717+0000 7f03c5d25800 20 remove_watcher() i=3 2024-09-12T17:55:31.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.718+0000 7f03c5d25800 20 remove_watcher() i=4 2024-09-12T17:55:31.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.719+0000 7f03c5d25800 20 remove_watcher() i=5 2024-09-12T17:55:31.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.720+0000 7f03c5d25800 20 remove_watcher() i=6 2024-09-12T17:55:31.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.721+0000 7f03c5d25800 20 remove_watcher() i=7 2024-09-12T17:55:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:55:31.763 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:31.763 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:31.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.798+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 realm 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.800+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.801+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.801+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.801+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.801+0000 7fb68e414800 20 searching for the correct realm 2024-09-12T17:55:31.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.805+0000 7fb6812ca640 0 -- 172.21.15.94:0/1242670563 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56275f6106b0 msgr2=0x56275f612aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.808+0000 7fb689acb640 0 -- 172.21.15.94:0/1242670563 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fb674066430 msgr2=0x7fb6740a39e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.812+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 zone default found 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 4 Realm: () 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 zonegroup default 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.813+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.814+0000 7fb68e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.814+0000 7fb68e414800 20 started sync module instance, tier type = 2024-09-12T17:55:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.814+0000 7fb68e414800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=0 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=1 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=2 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=3 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=4 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=5 2024-09-12T17:55:31.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.823+0000 7fb68e414800 20 add_watcher() i=6 2024-09-12T17:55:31.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.824+0000 7fb68e414800 20 add_watcher() i=7 2024-09-12T17:55:31.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.824+0000 7fb68e414800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.825+0000 7fb53b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.825+0000 7fb68e414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.825+0000 7fb68e414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.825+0000 7fb68e414800 5 note: GC not initialized 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb53a7fc640 20 reqs_thread_entry: start 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb68e414800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb68e414800 20 Filter name: none 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb4abfff640 20 reqs_thread_entry: start 2024-09-12T17:55:31.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.826+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:31.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.827+0000 7fb68e414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:31.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.829+0000 7fb53b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.832+0000 7fb68e414800 20 remove_watcher() i=0 2024-09-12T17:55:31.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.832+0000 7fb68e414800 2 removed watcher, disabling cache 2024-09-12T17:55:31.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.833+0000 7fb68e414800 20 remove_watcher() i=1 2024-09-12T17:55:31.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.834+0000 7fb68e414800 20 remove_watcher() i=2 2024-09-12T17:55:31.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.835+0000 7fb68e414800 20 remove_watcher() i=3 2024-09-12T17:55:31.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.836+0000 7fb68e414800 20 remove_watcher() i=4 2024-09-12T17:55:31.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.837+0000 7fb68e414800 20 remove_watcher() i=5 2024-09-12T17:55:31.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.838+0000 7fb68e414800 20 remove_watcher() i=6 2024-09-12T17:55:31.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:31.839+0000 7fb68e414800 20 remove_watcher() i=7 2024-09-12T17:55:31.850 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:31.851 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:31.851 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:55:31.851 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:32.216 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:55:32.216 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:33.031 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:55:33.059 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:33.059 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:33.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.094+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.096+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.096+0000 7f11f320f800 20 realm 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.096+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.096+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.097+0000 7f11f320f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.097+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.097+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.097+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.098+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.098+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.098+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:33.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.098+0000 7f11f320f800 20 searching for the correct realm 2024-09-12T17:55:33.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.101+0000 7f11f1501640 0 -- 172.21.15.94:0/1788398114 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f11d8008070 msgr2=0x7f11d80480a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.104+0000 7f11f0d00640 0 -- 172.21.15.94:0/1788398114 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f11d80239b0 msgr2=0x7f11d8049a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 zone default found 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 4 Realm: () 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.109+0000 7f11f320f800 20 zonegroup default 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 started sync module instance, tier type = 2024-09-12T17:55:33.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.110+0000 7f11f320f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=0 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=1 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=2 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=3 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=4 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=5 2024-09-12T17:55:33.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.119+0000 7f11f320f800 20 add_watcher() i=6 2024-09-12T17:55:33.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.120+0000 7f11f320f800 20 add_watcher() i=7 2024-09-12T17:55:33.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.120+0000 7f11f320f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:33.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.121+0000 7f10a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:33.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:33.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 5 note: GC not initialized 2024-09-12T17:55:33.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f10a5fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:33.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 20 Filter name: none 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f10177fe640 20 reqs_thread_entry: start 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.122+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.123+0000 7f11f320f800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.124+0000 7f11f320f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:33.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.124+0000 7f11f320f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:33.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.125+0000 7f10a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.127+0000 7f11f320f800 20 remove_watcher() i=0 2024-09-12T17:55:33.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.127+0000 7f11f320f800 2 removed watcher, disabling cache 2024-09-12T17:55:33.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.128+0000 7f11f320f800 20 remove_watcher() i=1 2024-09-12T17:55:33.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.129+0000 7f11f320f800 20 remove_watcher() i=2 2024-09-12T17:55:33.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.130+0000 7f11f320f800 20 remove_watcher() i=3 2024-09-12T17:55:33.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.131+0000 7f11f320f800 20 remove_watcher() i=4 2024-09-12T17:55:33.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.132+0000 7f11f320f800 20 remove_watcher() i=5 2024-09-12T17:55:33.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.133+0000 7f11f320f800 20 remove_watcher() i=6 2024-09-12T17:55:33.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.134+0000 7f11f320f800 20 remove_watcher() i=7 2024-09-12T17:55:33.145 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:33.145 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:33.145 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:33.145 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:33.146 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:55:33.180 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:33.180 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:33.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.417+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 realm 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:33.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.419+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.420+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.420+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.420+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:33.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.420+0000 7fdd3b12e800 20 searching for the correct realm 2024-09-12T17:55:33.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.422+0000 7fdd36d64640 0 -- 172.21.15.94:0/179795407 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x55fffc9f0960 msgr2=0x7fdd30019930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.626+0000 7fdd37565640 0 -- 172.21.15.94:0/179795407 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fdd2001c040 msgr2=0x7fdd20030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:33.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.632+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 zone default found 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 4 Realm: () 2024-09-12T17:55:33.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 zonegroup default 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 started sync module instance, tier type = 2024-09-12T17:55:33.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.633+0000 7fdd3b12e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:33.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=0 2024-09-12T17:55:33.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=1 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=2 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=3 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=4 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=5 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.642+0000 7fdd3b12e800 20 add_watcher() i=6 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.643+0000 7fdd3b12e800 20 add_watcher() i=7 2024-09-12T17:55:33.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.643+0000 7fdd3b12e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:33.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdbed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdd3b12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:33.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdd3b12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdd3b12e800 5 note: GC not initialized 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdb67fff640 20 reqs_thread_entry: start 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.645+0000 7fdd3b12e800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 20 Filter name: none 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdb65ffb640 20 reqs_thread_entry: start 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:55:33.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 : miss 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:33.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.646+0000 7fdd3b12e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 2024-09-12T17:55:33.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.650+0000 7fdd3b12e800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:55:33.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.650+0000 7fdd3b12e800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:55:33.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.655+0000 7fdbed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.657+0000 7fdd3b12e800 20 remove_watcher() i=0 2024-09-12T17:55:33.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.657+0000 7fdd3b12e800 2 removed watcher, disabling cache 2024-09-12T17:55:33.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.658+0000 7fdd3b12e800 20 remove_watcher() i=1 2024-09-12T17:55:33.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.659+0000 7fdd3b12e800 20 remove_watcher() i=2 2024-09-12T17:55:33.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.660+0000 7fdd3b12e800 20 remove_watcher() i=3 2024-09-12T17:55:33.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.661+0000 7fdd3b12e800 20 remove_watcher() i=4 2024-09-12T17:55:33.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.662+0000 7fdd3b12e800 20 remove_watcher() i=5 2024-09-12T17:55:33.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.663+0000 7fdd3b12e800 20 remove_watcher() i=6 2024-09-12T17:55:33.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.664+0000 7fdd3b12e800 20 remove_watcher() i=7 2024-09-12T17:55:33.678 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:55:33.707 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:33.707 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:33.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.742+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 realm 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.744+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.745+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.745+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.745+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:33.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.745+0000 7fa1bbc0e800 20 searching for the correct realm 2024-09-12T17:55:33.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.747+0000 7fa1b7259640 0 -- 172.21.15.94:0/3820591239 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fa1b0028020 msgr2=0x7fa1b0064450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.953+0000 7fa1b7a5a640 0 -- 172.21.15.94:0/3820591239 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa1a0018070 msgr2=0x7fa1a0043910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:33.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.958+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:33.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:33.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 zone default found 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 4 Realm: () 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 zonegroup default 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.959+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.960+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.960+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.960+0000 7fa1bbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.960+0000 7fa1bbc0e800 20 started sync module instance, tier type = 2024-09-12T17:55:33.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.960+0000 7fa1bbc0e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:33.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=0 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=1 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=2 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=3 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=4 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=5 2024-09-12T17:55:33.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.969+0000 7fa1bbc0e800 20 add_watcher() i=6 2024-09-12T17:55:33.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.970+0000 7fa1bbc0e800 20 add_watcher() i=7 2024-09-12T17:55:33.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.970+0000 7fa1bbc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:33.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.972+0000 7fa06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.972+0000 7fa1bbc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:33.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.972+0000 7fa1bbc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:33.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.972+0000 7fa1bbc0e800 5 note: GC not initialized 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.972+0000 7fa06cfe1640 20 reqs_thread_entry: start 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 Filter name: none 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7f9fe67fc640 20 reqs_thread_entry: start 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:33.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.973+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:33.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:33.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:33.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:33.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:33.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.974+0000 7fa1bbc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:33.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.976+0000 7fa06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:33.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.978+0000 7fa1bbc0e800 20 remove_watcher() i=0 2024-09-12T17:55:33.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.978+0000 7fa1bbc0e800 2 removed watcher, disabling cache 2024-09-12T17:55:33.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.979+0000 7fa1bbc0e800 20 remove_watcher() i=1 2024-09-12T17:55:33.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.980+0000 7fa1bbc0e800 20 remove_watcher() i=2 2024-09-12T17:55:33.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.981+0000 7fa1bbc0e800 20 remove_watcher() i=3 2024-09-12T17:55:33.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.983+0000 7fa1bbc0e800 20 remove_watcher() i=4 2024-09-12T17:55:33.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.984+0000 7fa1bbc0e800 20 remove_watcher() i=5 2024-09-12T17:55:33.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.985+0000 7fa1bbc0e800 20 remove_watcher() i=6 2024-09-12T17:55:33.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:33.985+0000 7fa1bbc0e800 20 remove_watcher() i=7 2024-09-12T17:55:33.998 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:33.998 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:33.998 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:33.998 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:34.088 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:34.120 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:34.120 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:34.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.156+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.157+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.157+0000 7f0089d3d800 20 realm 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.157+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.157+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.157+0000 7f0089d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.158+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.158+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.158+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.159+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:34.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.159+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.159+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:34.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.159+0000 7f0089d3d800 20 searching for the correct realm 2024-09-12T17:55:34.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.163+0000 7f008622b640 0 -- 172.21.15.94:0/3518747463 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f007002d050 msgr2=0x7f0070084190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:34.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.370+0000 7f0085a2a640 0 -- 172.21.15.94:0/3518747463 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x5622bc59fa40 msgr2=0x5622bc5a1e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 zone default found 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 4 Realm: () 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.373+0000 7f0089d3d800 20 zonegroup default 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 started sync module instance, tier type = 2024-09-12T17:55:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.374+0000 7f0089d3d800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:34.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=0 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=1 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=2 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=3 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=4 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=5 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=6 2024-09-12T17:55:34.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 20 add_watcher() i=7 2024-09-12T17:55:34.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.384+0000 7f0089d3d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:34.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.386+0000 7eff377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.386+0000 7f0089d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.386+0000 7f0089d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7f0089d3d800 5 note: GC not initialized 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7eff367fc640 20 reqs_thread_entry: start 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7f0089d3d800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7f0089d3d800 20 Filter name: none 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7efea7fff640 20 reqs_thread_entry: start 2024-09-12T17:55:34.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7f0089d3d800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:55:34.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.387+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 : miss 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.388+0000 7f0089d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7f0089d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7f0089d3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7f0089d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7f0089d3d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22, ofs0, ns] 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7eff697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 94707188940784 notifier 6161 bl.length()=925 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7eff697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7eff697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.396+0000 7eff697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.398+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_sources= new_sources= 2024-09-12T17:55:34.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.398+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential sources added=[] removed=[] 2024-09-12T17:55:34.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.398+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_dests= new_dests= 2024-09-12T17:55:34.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.398+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential dests added=[] removed=[] 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.0 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.0 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.1 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.1 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.2 2024-09-12T17:55:34.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.2 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.3 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.3 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.4 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.4 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.5 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.5 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.6 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.6 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.7 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.7 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.8 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.8 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.9 2024-09-12T17:55:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.9 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.10 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.10 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.11 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1.11 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.0 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.402+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1 2024-09-12T17:55:34.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.403+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.2 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.403+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.3 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.404+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.4 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.405+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.5 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.405+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.6 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.406+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.7 2024-09-12T17:55:34.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.406+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.8 2024-09-12T17:55:34.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.407+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.9 2024-09-12T17:55:34.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.408+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.10 2024-09-12T17:55:34.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.412+0000 7f0089d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:34.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.412+0000 7f0089d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 2024-09-12T17:55:34.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7f0089d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7f0089d3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7f0089d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7f0089d3d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22, ofs0, ns] 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7eff68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 94707188940784 notifier 6161 bl.length()=925 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7eff68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7eff68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.414+0000 7eff68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.416+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_sources= new_sources= 2024-09-12T17:55:34.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.416+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential sources added=[] removed=[] 2024-09-12T17:55:34.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.416+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_dests= new_dests= 2024-09-12T17:55:34.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.416+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential dests added=[] removed=[] 2024-09-12T17:55:34.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.418+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.0 2024-09-12T17:55:34.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.418+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.1 2024-09-12T17:55:34.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.419+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.2 2024-09-12T17:55:34.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.419+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.3 2024-09-12T17:55:34.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.419+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.4 2024-09-12T17:55:34.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.420+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.5 2024-09-12T17:55:34.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.420+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.6 2024-09-12T17:55:34.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.420+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.7 2024-09-12T17:55:34.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.421+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.8 2024-09-12T17:55:34.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.421+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.9 2024-09-12T17:55:34.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.421+0000 7f0089d3d800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22.10 2024-09-12T17:55:34.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.422+0000 7f0089d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:34.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.422+0000 7f0089d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7f0089d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7f0089d3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7f0089d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7f0089d3d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22, ofs0, ns] 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7eff697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 94707188940784 notifier 6161 bl.length()=893 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7eff697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 info.flags=0x17 2024-09-12T17:55:34.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7eff697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 to cache LRU end 2024-09-12T17:55:34.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.423+0000 7eff697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:34.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.424+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_sources= new_sources= 2024-09-12T17:55:34.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.424+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential sources added=[] removed=[] 2024-09-12T17:55:34.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.424+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): orig_dests= new_dests= 2024-09-12T17:55:34.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.424+0000 7f0089d3d800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22]): potential dests added=[] removed=[] 2024-09-12T17:55:34.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.428+0000 7f0089d3d800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:34.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.430+0000 7eff377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:34.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.433+0000 7f0089d3d800 20 remove_watcher() i=0 2024-09-12T17:55:34.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.433+0000 7f0089d3d800 2 removed watcher, disabling cache 2024-09-12T17:55:34.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.434+0000 7f0089d3d800 20 remove_watcher() i=1 2024-09-12T17:55:34.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.435+0000 7f0089d3d800 20 remove_watcher() i=2 2024-09-12T17:55:34.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.436+0000 7f0089d3d800 20 remove_watcher() i=3 2024-09-12T17:55:34.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.437+0000 7f0089d3d800 20 remove_watcher() i=4 2024-09-12T17:55:34.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.437+0000 7f0089d3d800 20 remove_watcher() i=5 2024-09-12T17:55:34.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.438+0000 7f0089d3d800 20 remove_watcher() i=6 2024-09-12T17:55:34.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.439+0000 7f0089d3d800 20 remove_watcher() i=7 2024-09-12T17:55:34.452 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:55:34.481 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:34.481 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:34.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.516+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 realm 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.518+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.519+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:34.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.519+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.519+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:34.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.519+0000 7f70a4d2b800 20 searching for the correct realm 2024-09-12T17:55:34.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.521+0000 7f70a0a73640 0 -- 172.21.15.94:0/2581767248 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f708c003bd0 msgr2=0x7f709c026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:34.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.727+0000 7f70a1274640 0 -- 172.21.15.94:0/2581767248 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f7088029040 msgr2=0x7f7088028920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:34.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:34.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:34.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.733+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 zone default found 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 4 Realm: () 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:34.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 zonegroup default 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.734+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.735+0000 7f70a4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.735+0000 7f70a4d2b800 20 started sync module instance, tier type = 2024-09-12T17:55:34.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.735+0000 7f70a4d2b800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=0 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=1 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=2 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=3 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=4 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=5 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.743+0000 7f70a4d2b800 20 add_watcher() i=6 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.744+0000 7f70a4d2b800 20 add_watcher() i=7 2024-09-12T17:55:34.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.744+0000 7f70a4d2b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:34.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.746+0000 7f6f56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.746+0000 7f70a4d2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.746+0000 7f70a4d2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.746+0000 7f70a4d2b800 5 note: GC not initialized 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f6f55fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f70a4d2b800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f70a4d2b800 20 Filter name: none 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f6ec77fe640 20 reqs_thread_entry: start 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.747+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.748+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.748+0000 7f70a4d2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.748+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.748+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:34.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.748+0000 7f70a4d2b800 20 rados->read ofs=0 len=0 2024-09-12T17:55:34.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.749+0000 7f70a4d2b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:34.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.749+0000 7f70a4d2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:34.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.750+0000 7f6f56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:34.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.753+0000 7f70a4d2b800 20 remove_watcher() i=0 2024-09-12T17:55:34.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.753+0000 7f70a4d2b800 2 removed watcher, disabling cache 2024-09-12T17:55:34.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.753+0000 7f70a4d2b800 20 remove_watcher() i=1 2024-09-12T17:55:34.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.754+0000 7f70a4d2b800 20 remove_watcher() i=2 2024-09-12T17:55:34.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.755+0000 7f70a4d2b800 20 remove_watcher() i=3 2024-09-12T17:55:34.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.756+0000 7f70a4d2b800 20 remove_watcher() i=4 2024-09-12T17:55:34.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.757+0000 7f70a4d2b800 20 remove_watcher() i=5 2024-09-12T17:55:34.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.758+0000 7f70a4d2b800 20 remove_watcher() i=6 2024-09-12T17:55:34.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:34.759+0000 7f70a4d2b800 20 remove_watcher() i=7 2024-09-12T17:55:34.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:34.771 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:34.771 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:55:34.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:35.142 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:55:35.142 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:55:35.969 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:35.969 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:36.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.004+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 realm 2024-09-12T17:55:36.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:36.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.006+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.007+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.007+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.007+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:36.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.008+0000 7f369a8bb800 20 searching for the correct realm 2024-09-12T17:55:36.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.011+0000 7f368ffff640 0 -- 172.21.15.94:0/4198582027 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5650d2c20cf0 msgr2=0x5650d2c231b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.014+0000 7f368ffff640 0 -- 172.21.15.94:0/4198582027 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f368802a070 msgr2=0x7f3688050910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.018+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 zone default found 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 4 Realm: () 2024-09-12T17:55:36.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 zonegroup default 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 started sync module instance, tier type = 2024-09-12T17:55:36.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.019+0000 7f369a8bb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:36.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=0 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=1 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=2 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=3 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=4 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=5 2024-09-12T17:55:36.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=6 2024-09-12T17:55:36.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 20 add_watcher() i=7 2024-09-12T17:55:36.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.028+0000 7f369a8bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:36.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.030+0000 7f354f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:36.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:36.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 5 note: GC not initialized 2024-09-12T17:55:36.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f354e7dc640 20 reqs_thread_entry: start 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 20 Filter name: none 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f35477fe640 20 reqs_thread_entry: start 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.031+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.032+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:36.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.032+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.032+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:36.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.032+0000 7f369a8bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:36.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.032+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.033+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:36.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.033+0000 7f369a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.033+0000 7f369a8bb800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:36.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.033+0000 7f369a8bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:36.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.035+0000 7f354f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.037+0000 7f369a8bb800 20 remove_watcher() i=0 2024-09-12T17:55:36.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.037+0000 7f369a8bb800 2 removed watcher, disabling cache 2024-09-12T17:55:36.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.038+0000 7f369a8bb800 20 remove_watcher() i=1 2024-09-12T17:55:36.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.039+0000 7f369a8bb800 20 remove_watcher() i=2 2024-09-12T17:55:36.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.040+0000 7f369a8bb800 20 remove_watcher() i=3 2024-09-12T17:55:36.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.041+0000 7f369a8bb800 20 remove_watcher() i=4 2024-09-12T17:55:36.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.042+0000 7f369a8bb800 20 remove_watcher() i=5 2024-09-12T17:55:36.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.043+0000 7f369a8bb800 20 remove_watcher() i=6 2024-09-12T17:55:36.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.044+0000 7f369a8bb800 20 remove_watcher() i=7 2024-09-12T17:55:36.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:36.055 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:36.055 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:36.056 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:36.057 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:55:36.092 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:36.092 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:36.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.127+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 realm 2024-09-12T17:55:36.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.128+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.129+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.129+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.130+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:36.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.130+0000 7fe7b2342800 20 searching for the correct realm 2024-09-12T17:55:36.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.132+0000 7fe7ae887640 0 -- 172.21.15.94:0/3205939585 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe798092440 msgr2=0x7fe798092860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.136+0000 7fe7ae086640 0 -- 172.21.15.94:0/3205939585 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fe79806c410 msgr2=0x7fe79806c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.140+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 zone default found 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 4 Realm: () 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 zonegroup default 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.141+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.142+0000 7fe7b2342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.142+0000 7fe7b2342800 20 started sync module instance, tier type = 2024-09-12T17:55:36.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.142+0000 7fe7b2342800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=0 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=1 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=2 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=3 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=4 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=5 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.150+0000 7fe7b2342800 20 add_watcher() i=6 2024-09-12T17:55:36.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.151+0000 7fe7b2342800 20 add_watcher() i=7 2024-09-12T17:55:36.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.151+0000 7fe7b2342800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:36.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.152+0000 7fe664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 5 note: GC not initialized 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe5df7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 20 Filter name: none 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe5dd7fa640 20 reqs_thread_entry: start 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:55:36.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.153+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 : miss 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.154+0000 7fe7b2342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 2024-09-12T17:55:36.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.157+0000 7fe7b2342800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe7b2342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe7b2342800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe7b2342800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe7b2342800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23, ofs0, ns] 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe691ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529698 cookie 94203613395296 notifier 6561 bl.length()=925 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe691ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe691ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.159+0000 7fe691ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.161+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_sources= new_sources= 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.161+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential sources added=[] removed=[] 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.161+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_dests= new_dests= 2024-09-12T17:55:36.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.161+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential dests added=[] removed=[] 2024-09-12T17:55:36.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.0 2024-09-12T17:55:36.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.0 2024-09-12T17:55:36.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.1 2024-09-12T17:55:36.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.1 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.2 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.2 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.3 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.3 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.4 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.4 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.5 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.5 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.6 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.6 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.7 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.7 2024-09-12T17:55:36.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.8 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.8 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.9 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.9 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.10 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.10 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.11 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1.11 2024-09-12T17:55:36.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.165+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.0 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.166+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.166+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.2 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.167+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.3 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.167+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.4 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.167+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.5 2024-09-12T17:55:36.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.168+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.6 2024-09-12T17:55:36.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.168+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.7 2024-09-12T17:55:36.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.169+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.8 2024-09-12T17:55:36.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.170+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.9 2024-09-12T17:55:36.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.170+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.10 2024-09-12T17:55:36.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.173+0000 7fe7b2342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:36.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.173+0000 7fe7b2342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 2024-09-12T17:55:36.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe7b2342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe7b2342800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe7b2342800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe7b2342800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23, ofs0, ns] 2024-09-12T17:55:36.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe691ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 94203613395296 notifier 6561 bl.length()=925 2024-09-12T17:55:36.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe691ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe691ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.174+0000 7fe691ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.176+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_sources= new_sources= 2024-09-12T17:55:36.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.176+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential sources added=[] removed=[] 2024-09-12T17:55:36.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.176+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_dests= new_dests= 2024-09-12T17:55:36.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.176+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential dests added=[] removed=[] 2024-09-12T17:55:36.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.179+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.0 2024-09-12T17:55:36.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.179+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.1 2024-09-12T17:55:36.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.179+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.2 2024-09-12T17:55:36.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.180+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.3 2024-09-12T17:55:36.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.180+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.4 2024-09-12T17:55:36.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.180+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.5 2024-09-12T17:55:36.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.180+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.6 2024-09-12T17:55:36.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.181+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.7 2024-09-12T17:55:36.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.181+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.8 2024-09-12T17:55:36.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.181+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.9 2024-09-12T17:55:36.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.182+0000 7fe7b2342800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23.10 2024-09-12T17:55:36.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.182+0000 7fe7b2342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:36.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.182+0000 7fe7b2342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 2024-09-12T17:55:36.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.183+0000 7fe7b2342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.183+0000 7fe7b2342800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.183+0000 7fe7b2342800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.183+0000 7fe7b2342800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23, ofs0, ns] 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.184+0000 7fe6917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94203613395296 notifier 6561 bl.length()=893 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.184+0000 7fe6917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 info.flags=0x17 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.184+0000 7fe6917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 to cache LRU end 2024-09-12T17:55:36.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.184+0000 7fe6917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.185+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_sources= new_sources= 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.185+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential sources added=[] removed=[] 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.185+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): orig_dests= new_dests= 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.185+0000 7fe7b2342800 20 handle_bi_update(): bucket=:error-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23]): potential dests added=[] removed=[] 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.188+0000 7fe7b2342800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:36.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.189+0000 7fe664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.191+0000 7fe7b2342800 20 remove_watcher() i=0 2024-09-12T17:55:36.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.191+0000 7fe7b2342800 2 removed watcher, disabling cache 2024-09-12T17:55:36.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.193+0000 7fe7b2342800 20 remove_watcher() i=1 2024-09-12T17:55:36.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.193+0000 7fe7b2342800 20 remove_watcher() i=2 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.194+0000 7fe7b2342800 20 remove_watcher() i=3 2024-09-12T17:55:36.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.195+0000 7fe7b2342800 20 remove_watcher() i=4 2024-09-12T17:55:36.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.196+0000 7fe7b2342800 20 remove_watcher() i=5 2024-09-12T17:55:36.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.197+0000 7fe7b2342800 20 remove_watcher() i=6 2024-09-12T17:55:36.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.198+0000 7fe7b2342800 20 remove_watcher() i=7 2024-09-12T17:55:36.211 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:55:36.241 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:36.241 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:36.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.276+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.277+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.277+0000 7f03a4924800 20 realm 2024-09-12T17:55:36.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.278+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.279+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.279+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.279+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:36.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.279+0000 7f03a4924800 20 searching for the correct realm 2024-09-12T17:55:36.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.283+0000 7f0397d55640 0 -- 172.21.15.94:0/2480822033 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f039001e060 msgr2=0x7f039008a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:36.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.287+0000 7f0397d55640 0 -- 172.21.15.94:0/2480822033 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f0268086bc0 msgr2=0x7f0268088ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:36.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.290+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 zone default found 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 4 Realm: () 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 zonegroup default 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.291+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.292+0000 7f03a4924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.292+0000 7f03a4924800 20 started sync module instance, tier type = 2024-09-12T17:55:36.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.292+0000 7f03a4924800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:36.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=0 2024-09-12T17:55:36.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=1 2024-09-12T17:55:36.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=2 2024-09-12T17:55:36.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=3 2024-09-12T17:55:36.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=4 2024-09-12T17:55:36.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=5 2024-09-12T17:55:36.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=6 2024-09-12T17:55:36.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.300+0000 7f03a4924800 20 add_watcher() i=7 2024-09-12T17:55:36.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.301+0000 7f03a4924800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:36.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.302+0000 7f0256fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.302+0000 7f03a4924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:36.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.302+0000 7f03a4924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:36.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.302+0000 7f03a4924800 5 note: GC not initialized 2024-09-12T17:55:36.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f0255fdb640 20 reqs_thread_entry: start 2024-09-12T17:55:36.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f03a4924800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:36.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f03a4924800 20 Filter name: none 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f01c77fe640 20 reqs_thread_entry: start 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.303+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:36.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:36.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:36.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:36.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.304+0000 7f03a4924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:36.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.306+0000 7f0256fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.308+0000 7f03a4924800 20 remove_watcher() i=0 2024-09-12T17:55:36.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.308+0000 7f03a4924800 2 removed watcher, disabling cache 2024-09-12T17:55:36.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.309+0000 7f03a4924800 20 remove_watcher() i=1 2024-09-12T17:55:36.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.310+0000 7f03a4924800 20 remove_watcher() i=2 2024-09-12T17:55:36.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.311+0000 7f03a4924800 20 remove_watcher() i=3 2024-09-12T17:55:36.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.312+0000 7f03a4924800 20 remove_watcher() i=4 2024-09-12T17:55:36.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.313+0000 7f03a4924800 20 remove_watcher() i=5 2024-09-12T17:55:36.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.314+0000 7f03a4924800 20 remove_watcher() i=6 2024-09-12T17:55:36.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:36.315+0000 7f03a4924800 20 remove_watcher() i=7 2024-09-12T17:55:36.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:36.326 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:36.326 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:55:36.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:36.705 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:55:36.705 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.525 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:55:37.545 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:37.545 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:37.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.581+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 20 realm 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.582+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.583+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.583+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.584+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.584+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.584+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:37.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.584+0000 7fb870d23800 20 searching for the correct realm 2024-09-12T17:55:37.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.587+0000 7fb867fff640 0 -- 172.21.15.94:0/4615964 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fb86006d070 msgr2=0x7fb8600a54a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:37.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.590+0000 7fb86d214640 0 -- 172.21.15.94:0/4615964 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fb858009040 msgr2=0x7fb858072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:37.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:37.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:37.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.594+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 zone default found 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 4 Realm: () 2024-09-12T17:55:37.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 zonegroup default 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.595+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.596+0000 7fb870d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.596+0000 7fb870d23800 20 started sync module instance, tier type = 2024-09-12T17:55:37.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.596+0000 7fb870d23800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=0 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=1 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=2 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=3 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=4 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=5 2024-09-12T17:55:37.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.604+0000 7fb870d23800 20 add_watcher() i=6 2024-09-12T17:55:37.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.605+0000 7fb870d23800 20 add_watcher() i=7 2024-09-12T17:55:37.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.605+0000 7fb870d23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.606+0000 7fb722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 5 note: GC not initialized 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb721fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 20 Filter name: none 2024-09-12T17:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb6937fe640 20 reqs_thread_entry: start 2024-09-12T17:55:37.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.607+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.608+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.608+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.608+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.608+0000 7fb870d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.608+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.609+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.609+0000 7fb870d23800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.609+0000 7fb870d23800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:37.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.609+0000 7fb870d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:37.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.611+0000 7fb722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:37.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.613+0000 7fb870d23800 20 remove_watcher() i=0 2024-09-12T17:55:37.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.613+0000 7fb870d23800 2 removed watcher, disabling cache 2024-09-12T17:55:37.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.614+0000 7fb870d23800 20 remove_watcher() i=1 2024-09-12T17:55:37.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.615+0000 7fb870d23800 20 remove_watcher() i=2 2024-09-12T17:55:37.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.616+0000 7fb870d23800 20 remove_watcher() i=3 2024-09-12T17:55:37.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.617+0000 7fb870d23800 20 remove_watcher() i=4 2024-09-12T17:55:37.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.618+0000 7fb870d23800 20 remove_watcher() i=5 2024-09-12T17:55:37.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.619+0000 7fb870d23800 20 remove_watcher() i=6 2024-09-12T17:55:37.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.620+0000 7fb870d23800 20 remove_watcher() i=7 2024-09-12T17:55:37.631 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.631 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:37.631 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:37.631 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.632 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:55:37.666 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:37.667 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:37.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.703+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 realm 2024-09-12T17:55:37.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:37.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.706+0000 7f8e77240800 20 searching for the correct realm 2024-09-12T17:55:37.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.708+0000 7f8e74d2a640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f8e7001f060 msgr2=0x7f8e7005eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:37.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.913+0000 7f8e7552b640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f8e5c071040 msgr2=0x7f8e5c08d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.918+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:37.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 zone default found 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 4 Realm: () 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 zonegroup default 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:37.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.920+0000 7f8e77240800 20 started sync module instance, tier type = 2024-09-12T17:55:37.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.920+0000 7f8e77240800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=0 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=1 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=2 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=3 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=4 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=5 2024-09-12T17:55:37.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=6 2024-09-12T17:55:37.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.930+0000 7f8e77240800 20 add_watcher() i=7 2024-09-12T17:55:37.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.930+0000 7f8e77240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:37.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.931+0000 7f8d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:37.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 5 note: GC not initialized 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8d29fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 20 Filter name: none 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8c9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.932+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : miss 2024-09-12T17:55:37.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:37.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:37.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:55:37.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:55:37.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:37.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:37.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.933+0000 7f8e77240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:55:37.937 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e77240800 time 2024-09-12T17:55:37.937989+0000 2024-09-12T17:55:37.937 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:37.938 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:37.938 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e7a78c71a] 2024-09-12T17:55:37.938 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:37.938 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8e77240800 thread_name:radosgw-admin 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.937+0000 7f8e77240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e77240800 time 2024-09-12T17:55:37.937989+0000 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e7a78c71a] 2024-09-12T17:55:37.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:37.940 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.961 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:37.961 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e7943e6f0] 2024-09-12T17:55:37.961 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e7948b99c] 2024-09-12T17:55:37.961 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:37.961 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e7a78c774] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:37.938+0000 7f8e77240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:37.962 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8e77240800 thread_name:radosgw-admin 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e7943e6f0] 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e7948b99c] 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e7a78c774] 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:37.963 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:55:37.686+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:55:37.686+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.964 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_done global_id 6606 payload 274 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient: _finish_hunting 0 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 1 monclient: found mon.noname-a 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:55:37.686+0000 7f8e7552b640 10 monclient: get_auth_request con 0x558b4313eca0 auth_method 0 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: dump: 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.965 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: _finish_auth 0 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: _check_auth_tickets 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: dump: 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.966 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:55:37.686+0000 7f8e77240800 5 monclient: authenticate success, global_id 6606 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:55:37.686+0000 7f8e77240800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:55:37.686+0000 7f8e77240800 4 set_mon_vals no callback set 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: shutdown 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 asok(0x558b42ef0730) unregister_commands rotate-key 2024-09-12T17:55:37.967 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:37.968 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:37.969 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:55:37.687+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: starting msgr at 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: starting objecter 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests hook 0x558b43119710 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: setting wanted keys 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: calling monclient init 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.970 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:55:37.688+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:55:37.688+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:55:37.688+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key hook 0x558b431147a8 2024-09-12T17:55:37.971 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b4313e340 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b4313eca0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x7f8e600030f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.202433s 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b4313e340 auth_method 0 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.972 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.973 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.973 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x7f8e600030f0 auth_method 0 2024-09-12T17:55:37.973 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.973 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.973 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient: _finish_hunting 0 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:55:37.688+0000 7f8e7552b640 1 monclient: found mon.noname-c 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.974 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: dump: 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: _finish_auth 0 2024-09-12T17:55:37.975 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: _check_auth_tickets 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: dump: 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.976 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:55:37.689+0000 7f8e77240800 5 monclient: authenticate success, global_id 6251 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:55:37.689+0000 7f8d62e0d640 4 set_mon_vals no callback set 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:55:37.689+0000 7f8e77240800 1 librados: init done 2024-09-12T17:55:37.977 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:55:37.691+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8d5c076470 auth_method 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:55:37.691+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b4313cfd0 auth_method 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:55:37.692+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x558b43160280 auth_method 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:55:37.693+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b43165500 auth_method 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:55:37.694+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:37.978 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.979 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:55:37.694+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests cmddesc objecter_requests hook 0x558b4316ced0 EEXIST 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:37.980 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.981 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:55:37.694+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:55:37.695+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:55:37.695+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x558b43168640 EEXIST 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b43190bc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b43192e90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b4318f390 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:37.982 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.209241s 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b43190bc0 auth_method 0 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b4318f390 auth_method 0 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.983 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b43192e90 auth_method 0 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.984 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_done global_id 6254 payload 824 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient: _finish_hunting 0 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 1 monclient: found mon.noname-c 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: dump: 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.985 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:55:37.695+0000 7f8e77240800 5 monclient: authenticate success, global_id 6254 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: dump: 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.986 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:55:37.695+0000 7f8e75d2c640 4 set_mon_vals no callback set 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:55:37.696+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:55:37.696+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:37.987 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:55:37.698+0000 7f8e6c529640 10 monclient: get_auth_request con 0x7f8d4c076380 auth_method 0 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: get_monmap_and_config 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:55:37.698+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.988 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.989 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:55:37.698+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.990 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:55:37.698+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:55:37.699+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:55:37.699+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x7ffc63ba32e8 EEXIST 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:37.991 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b431e50f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b431d5a40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b431e0520 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.213315s 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b431d5a40 auth_method 0 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.992 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b431e50f0 auth_method 0 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b431e0520 auth_method 0 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:37.993 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_done global_id 6257 payload 274 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient: _finish_hunting 0 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:55:37.699+0000 7f8e6c529640 1 monclient: found mon.noname-c 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: dump: 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: _finish_auth 0 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:55:37.699+0000 7f8e77240800 5 monclient: authenticate success, global_id 6257 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: dump: 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.995 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:55:37.699+0000 7f8e77240800 4 set_mon_vals no callback set 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: shutdown 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:37.996 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:37.997 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:55:37.700+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:37.998 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 librados: starting msgr at 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 librados: starting objecter 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests cmddesc objecter_requests hook 0x558b431df810 EEXIST 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:55:37.701+0000 7f8e77240800 1 librados: setting wanted keys 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:55:37.701+0000 7f8e77240800 1 librados: calling monclient init 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:37.999 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:55:37.701+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.000 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:55:37.701+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x558b431a8ab8 EEXIST 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b431d5a40 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b431e0520 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b431e50f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.215731s 2024-09-12T17:55:38.001 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b431e0520 auth_method 0 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b431e50f0 auth_method 0 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.002 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b431d5a40 auth_method 0 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:55:37.702+0000 7f8e6c529640 1 monclient: found mon.noname-c 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: dump: 2024-09-12T17:55:38.003 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.004 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: dump: 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:55:37.702+0000 7f8e77240800 5 monclient: authenticate success, global_id 6260 2024-09-12T17:55:38.005 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:55:37.702+0000 7f8d4bfff640 4 set_mon_vals no callback set 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:55:37.702+0000 7f8e77240800 1 librados: init done 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:55:37.702+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cr dump hook 0x558b431e1038 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:55:37.703+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:55:37.704+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8d40076470 auth_method 0 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:55:37.704+0000 7f8e7552b640 10 monclient: get_auth_request con 0x558b431ff590 auth_method 0 2024-09-12T17:55:38.006 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 realm 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:55:37.705+0000 7f8e77240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:55:37.706+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x558b43203780 auth_method 0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 searching for the correct realm 2024-09-12T17:55:38.007 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:55:37.707+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b432089f0 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:55:37.707+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8e5c071040 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:55:37.708+0000 7f8e74d2a640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f8e7001f060 msgr2=0x7f8e7005eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:55:37.909+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8e7001f060 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:55:37.910+0000 7f8e6c529640 10 monclient: get_auth_request con 0x7f8e64040020 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:55:37.912+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8e5c060040 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:55:37.913+0000 7f8e7552b640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f8e5c071040 msgr2=0x7f8e5c08d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 1 client.6260.objecter ms_handle_reset 0x7f8e5c071040 session 0x7f8e5c068040 osd.7 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 10 monclient: _renew_subs 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:55:37.914+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8d40086bf0 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:55:37.914+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8e5c0b9070 auth_method 0 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:38.008 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 zone default found 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 Realm: () 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:38.009 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:55:37.919+0000 7f8e77240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 zonegroup default 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 started sync module instance, tier type = 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=0 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=1 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=2 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=3 2024-09-12T17:55:38.010 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=4 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=5 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=6 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:55:37.930+0000 7f8e77240800 20 add_watcher() i=7 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:55:37.930+0000 7f8e77240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.011 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:55:37.931+0000 7f8d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:55:37.932+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache list hook 0x558b431d9ba0 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache inspect hook 0x558b431d9ba0 2024-09-12T17:55:38.012 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache erase hook 0x558b431d9ba0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache zap hook 0x558b431d9ba0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 note: GC not initialized 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:55:37.932+0000 7f8d29fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace show hook 0x7f8e6000a8c0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace history hook 0x7f8e6000a8c0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace active hook 0x7f8e6000a8c0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace active_short hook 0x7f8e6000a8c0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 Filter name: none 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:55:37.932+0000 7f8c9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:55:37.932+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:38.013 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : miss 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:55:37.937+0000 7f8e77240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e77240800 time 2024-09-12T17:55:37.937989+0000 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.014 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e7a78c71a] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:55:37.938+0000 7f8e77240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8e77240800 thread_name:radosgw-admin 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.015 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e7943e6f0] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e7948b99c] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e7a78c774] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:38.016 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:38.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:38.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:55:38.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:38.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:55:38.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:55:38.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:55:38.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8c9b7fe640 / http_manager 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d29fe3640 / http_manager 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d2afe5640 / rgw_dt_lg_renew 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d4a7fc640 / ms_dispatch 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d4bfff640 / io_context_pool 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d5a7fc640 / ms_dispatch 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d6160a640 / ms_dispatch 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d62e0d640 / io_context_pool 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e6c529640 / msgr-worker-2 2024-09-12T17:55:38.024 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e74d2a640 / msgr-worker-1 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e7552b640 / msgr-worker-0 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e75d2c640 / io_context_pool 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e77240800 / radosgw-admin 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.98248.log 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:55:37.686+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:55:37.686+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_done global_id 6606 payload 274 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 1 monclient: found mon.noname-a 2024-09-12T17:55:38.025 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:55:37.686+0000 7f8e74d2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:55:37.686+0000 7f8e7552b640 10 monclient: get_auth_request con 0x558b4313eca0 auth_method 0 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: dump: 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.026 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:55:37.686+0000 7f8d62e0d640 10 monclient: dump: 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.027 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:55:37.686+0000 7f8e77240800 5 monclient: authenticate success, global_id 6606 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:55:37.686+0000 7f8e77240800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:55:37.686+0000 7f8e77240800 4 set_mon_vals no callback set 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: shutdown 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 asok(0x558b42ef0730) unregister_commands rotate-key 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:38.028 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding auth protocol: cephx 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.029 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: crc 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43119ce0) adding con mode: secure 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:55:37.687+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: starting msgr at 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: starting objecter 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests hook 0x558b43119710 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: setting wanted keys 2024-09-12T17:55:38.030 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:55:37.687+0000 7f8e77240800 1 librados: calling monclient init 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:55:37.687+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding auth protocol: cephx 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.031 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: crc 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:55:37.687+0000 7f8e77240800 5 AuthRegistry(0x558b43114660) adding con mode: secure 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:55:37.688+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:55:37.688+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:55:37.688+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key hook 0x558b431147a8 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b4313e340 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b4313eca0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x7f8e600030f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.032 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:55:37.688+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.202433s 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b4313e340 auth_method 0 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x7f8e600030f0 auth_method 0 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.033 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:55:37.688+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:55:37.688+0000 7f8e7552b640 1 monclient: found mon.noname-c 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:55:37.688+0000 7f8e7552b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: dump: 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.034 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.035 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:55:37.689+0000 7f8d6160a640 10 monclient: dump: 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.036 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:55:37.689+0000 7f8e77240800 5 monclient: authenticate success, global_id 6251 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:55:37.689+0000 7f8d62e0d640 4 set_mon_vals no callback set 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:55:37.689+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:55:37.689+0000 7f8e77240800 1 librados: init done 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:55:37.690+0000 7f8d6160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:55:37.691+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8d5c076470 auth_method 0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:55:37.691+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b4313cfd0 auth_method 0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:55:37.692+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x558b43160280 auth_method 0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:55:37.693+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b43165500 auth_method 0 2024-09-12T17:55:38.037 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:55:37.694+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.038 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding auth protocol: cephx 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.040 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: crc 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b43169540) adding con mode: secure 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:55:37.694+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests cmddesc objecter_requests hook 0x558b4316ced0 EEXIST 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:55:37.694+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding auth protocol: cephx 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.041 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: crc 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:55:37.694+0000 7f8e77240800 5 AuthRegistry(0x558b431684f8) adding con mode: secure 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:55:37.694+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:55:37.695+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:55:37.695+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x558b43168640 EEXIST 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b43190bc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b43192e90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:38.042 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b4318f390 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.209241s 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b43190bc0 auth_method 0 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b4318f390 auth_method 0 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.043 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:55:37.695+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b43192e90 auth_method 0 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:55:37.695+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_done global_id 6254 payload 824 2024-09-12T17:55:38.044 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 1 monclient: found mon.noname-c 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:55:37.695+0000 7f8e74d2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: dump: 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.045 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:55:37.695+0000 7f8e77240800 5 monclient: authenticate success, global_id 6254 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:55:37.695+0000 7f8d5a7fc640 10 monclient: dump: 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.046 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:55:37.695+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:55:37.695+0000 7f8e75d2c640 4 set_mon_vals no callback set 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:55:37.696+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:55:37.696+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:55:37.697+0000 7f8d5a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:55:37.698+0000 7f8e6c529640 10 monclient: get_auth_request con 0x7f8d4c076380 auth_method 0 2024-09-12T17:55:38.047 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: get_monmap_and_config 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:55:37.698+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:38.048 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding auth protocol: cephx 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.049 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: crc 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x558b431b0ad0) adding con mode: secure 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:55:37.698+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:55:37.698+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding auth protocol: cephx 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.050 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: crc 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:55:37.698+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba31a0) adding con mode: secure 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:55:37.698+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:55:37.699+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:55:37.699+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x7ffc63ba32e8 EEXIST 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b431e50f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:38.051 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b431d5a40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b431e0520 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.213315s 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b431d5a40 auth_method 0 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b431e50f0 auth_method 0 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.052 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:55:37.699+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b431e0520 auth_method 0 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:55:37.699+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient(hunting): handle_auth_done global_id 6257 payload 274 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.053 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:55:37.699+0000 7f8e6c529640 1 monclient: found mon.noname-c 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:55:37.699+0000 7f8e6c529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: dump: 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.054 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:55:37.699+0000 7f8e77240800 5 monclient: authenticate success, global_id 6257 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:55:37.699+0000 7f8d4bfff640 10 monclient: dump: 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.055 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:55:37.699+0000 7f8e77240800 10 monclient: get_monmap_and_config success 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:55:37.699+0000 7f8e77240800 4 set_mon_vals no callback set 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: shutdown 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: build_initial_monmap 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 build_initial for_mkfs: 0 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:55:37.700+0000 7f8e77240800 10 monclient: monmap: 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:55:38.056 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding auth protocol: cephx 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.057 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: crc 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 AuthRegistry(0x558b431b5880) adding con mode: secure 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:55:37.700+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 librados: starting msgr at 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:55:37.700+0000 7f8e77240800 1 librados: starting objecter 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:55:37.700+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command objecter_requests cmddesc objecter_requests hook 0x558b431df810 EEXIST 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:55:37.701+0000 7f8e77240800 1 librados: setting wanted keys 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:55:37.701+0000 7f8e77240800 1 librados: calling monclient init 2024-09-12T17:55:38.058 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: init 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding auth protocol: cephx 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.059 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: crc 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 AuthRegistry(0x558b431a8970) adding con mode: secure 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:55:37.701+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:55:37.701+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:55:37.701+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command rotate-key cmddesc rotate-key hook 0x558b431a8ab8 EEXIST 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: _reopen_session rank -1 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-b con 0x558b431d5a40 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-c con 0x558b431e0520 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): picked mon.noname-a con 0x558b431e50f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:38.060 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): _renew_subs 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:55:37.701+0000 7f8e77240800 10 monclient(hunting): authenticate will time out at 2011.215731s 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): get_auth_request con 0x558b431e0520 auth_method 0 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): get_auth_request con 0x558b431e50f0 auth_method 0 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:55:37.701+0000 7f8e6c529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.061 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:55:37.701+0000 7f8e7552b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request con 0x558b431d5a40 auth_method 0 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:55:37.701+0000 7f8e74d2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient: _finish_hunting 0 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:55:37.702+0000 7f8e6c529640 1 monclient: found mon.noname-c 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:55:37.702+0000 7f8e6c529640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.062 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: dump: 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:55:38.063 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:55:37.702+0000 7f8d4a7fc640 10 monclient: dump: 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:55:38.064 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:55:37.702+0000 7f8e77240800 5 monclient: authenticate success, global_id 6260 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:55:37.702+0000 7f8d4bfff640 4 set_mon_vals no callback set 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _renew_subs 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:55:37.702+0000 7f8e77240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:55:37.702+0000 7f8e77240800 1 librados: init done 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:55:37.702+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cr dump hook 0x558b431e1038 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:55:37.703+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:55:37.704+0000 7f8d4a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:55:38.065 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:55:37.704+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8d40076470 auth_method 0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:55:37.704+0000 7f8e7552b640 10 monclient: get_auth_request con 0x558b431ff590 auth_method 0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 realm 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:55:37.705+0000 7f8e77240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:55:37.705+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:55:37.706+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x558b43203780 auth_method 0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:38.066 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:55:37.706+0000 7f8e77240800 20 searching for the correct realm 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:55:37.707+0000 7f8e6c529640 10 monclient: get_auth_request con 0x558b432089f0 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:55:37.707+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8e5c071040 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:55:37.708+0000 7f8e74d2a640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f8e7001f060 msgr2=0x7f8e7005eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:55:37.909+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8e7001f060 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:55:37.910+0000 7f8e6c529640 10 monclient: get_auth_request con 0x7f8e64040020 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:55:37.912+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8e5c060040 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:55:37.913+0000 7f8e7552b640 0 -- 172.21.15.94:0/3964770231 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f8e5c071040 msgr2=0x7f8e5c08d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 1 client.6260.objecter ms_handle_reset 0x7f8e5c071040 session 0x7f8e5c068040 osd.7 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 10 monclient: _renew_subs 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:55:37.913+0000 7f8d4a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:55:37.914+0000 7f8e7552b640 10 monclient: get_auth_request con 0x7f8d40086bf0 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:55:37.914+0000 7f8e74d2a640 10 monclient: get_auth_request con 0x7f8e5c0b9070 auth_method 0 2024-09-12T17:55:38.067 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:55:37.918+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 zone default found 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 Realm: () 2024-09-12T17:55:38.068 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:55:37.919+0000 7f8e77240800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:55:37.919+0000 7f8e77240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 zonegroup default 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:55:37.919+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 started sync module instance, tier type = 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:55:37.920+0000 7f8e77240800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=0 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=1 2024-09-12T17:55:38.069 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=2 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=3 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=4 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=5 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:55:37.929+0000 7f8e77240800 20 add_watcher() i=6 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:55:37.930+0000 7f8e77240800 20 add_watcher() i=7 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:55:37.930+0000 7f8e77240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding auth protocol: cephx 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.070 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:55:37.931+0000 7f8d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: crc 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:55:37.931+0000 7f8e77240800 5 AuthRegistry(0x7ffc63ba3670) adding con mode: secure 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:55:37.932+0000 7f8e77240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache list hook 0x558b431d9ba0 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache inspect hook 0x558b431d9ba0 2024-09-12T17:55:38.071 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache erase hook 0x558b431d9ba0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command cache zap hook 0x558b431d9ba0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 note: GC not initialized 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:55:37.932+0000 7f8d29fe3640 20 reqs_thread_entry: start 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace show hook 0x7f8e6000a8c0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace history hook 0x7f8e6000a8c0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace active hook 0x7f8e6000a8c0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:55:37.932+0000 7f8e77240800 5 asok(0x558b42ef0730) register_command sync trace active_short hook 0x7f8e6000a8c0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 Filter name: none 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:55:37.932+0000 7f8c9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:55:37.932+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:55:37.932+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.072 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : miss 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:55:37.933+0000 7f8e77240800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:38.073 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:55:37.933+0000 7f8e77240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:55:37.937+0000 7f8e77240800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e77240800 time 2024-09-12T17:55:37.937989+0000 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e7a78c71a] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:38.074 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:55:37.938+0000 7f8e77240800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8e77240800 thread_name:radosgw-admin 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e7943e6f0] 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e7948b99c] 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e7a78c774] 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e7a78c8d8] 2024-09-12T17:55:38.075 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558b42133841] 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73ca8) [0x558b42640ca8] 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558b4214350d] 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e79429590] 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:55:38.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:55:38.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:55:38.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:55:38.079 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:55:38.080 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:55:38.081 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:38.082 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:38.083 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8c9b7fe640 / http_manager 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d29fe3640 / http_manager 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d2afe5640 / rgw_dt_lg_renew 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d4a7fc640 / ms_dispatch 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d4bfff640 / io_context_pool 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d5a7fc640 / ms_dispatch 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d6160a640 / ms_dispatch 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d62e0d640 / io_context_pool 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e6c529640 / msgr-worker-2 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e74d2a640 / msgr-worker-1 2024-09-12T17:55:38.084 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e7552b640 / msgr-worker-0 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e75d2c640 / io_context_pool 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e77240800 / radosgw-admin 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:55:37.939635Z_d52aa3c6-d91b-476d-a8b9-0cb44fde2b1c/log 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:55:38.085 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:55:38.090 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:38.090 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.013+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 realm 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.015+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.016+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.016+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.016+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.016+0000 7f3b79d2e800 20 searching for the correct realm 2024-09-12T17:55:38.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.019+0000 7f3b75163640 0 -- 172.21.15.94:0/1052074245 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55ba9fa83660 msgr2=0x55ba9fa85a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.022+0000 7f3b75964640 0 -- 172.21.15.94:0/1052074245 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3b6c0c60c0 msgr2=0x7f3b6c0d2320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.027+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 zone default found 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 4 Realm: () 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 zonegroup default 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 started sync module instance, tier type = 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.028+0000 7f3b79d2e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=0 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=1 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=2 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=3 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=4 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=5 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=6 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 20 add_watcher() i=7 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.037+0000 7f3b79d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.039+0000 7f3a277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.039+0000 7f3b79d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.039+0000 7f3b79d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.039+0000 7f3b79d2e800 5 note: GC not initialized 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.039+0000 7f3a267fc640 20 reqs_thread_entry: start 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3b79d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3b79d2e800 20 Filter name: none 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3997fff640 20 reqs_thread_entry: start 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.040+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:38.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.041+0000 7f3b79d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.043+0000 7f3a277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.045+0000 7f3b79d2e800 20 remove_watcher() i=0 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.045+0000 7f3b79d2e800 2 removed watcher, disabling cache 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.046+0000 7f3b79d2e800 20 remove_watcher() i=1 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.046+0000 7f3b79d2e800 20 remove_watcher() i=2 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.048+0000 7f3b79d2e800 20 remove_watcher() i=3 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.048+0000 7f3b79d2e800 20 remove_watcher() i=4 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.049+0000 7f3b79d2e800 20 remove_watcher() i=5 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.050+0000 7f3b79d2e800 20 remove_watcher() i=6 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.051+0000 7f3b79d2e800 20 remove_watcher() i=7 2024-09-12T17:55:38.096 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.097 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:55:38.097 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:38.097 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:55:38.151 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:38.182 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:38.182 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:38.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.217+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 realm 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.219+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.220+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.220+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.220+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:38.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.220+0000 7fabbb325800 20 searching for the correct realm 2024-09-12T17:55:38.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.223+0000 7fabae732640 0 -- 172.21.15.94:0/3963136472 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5573a019fb70 msgr2=0x5573a01a2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.227+0000 7fabb6f33640 0 -- 172.21.15.94:0/3963136472 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7faba00aaa70 msgr2=0x7faba00db540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:38.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:55:38.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:38.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:38.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:55:38.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:38.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.231+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 zone default found 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 4 Realm: () 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:55:38.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 zonegroup default 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 started sync module instance, tier type = 2024-09-12T17:55:38.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.232+0000 7fabbb325800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=0 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=1 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=2 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=3 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=4 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=5 2024-09-12T17:55:38.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.240+0000 7fabbb325800 20 add_watcher() i=6 2024-09-12T17:55:38.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.241+0000 7fabbb325800 20 add_watcher() i=7 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.241+0000 7fabbb325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7faa6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7fabbb325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7fabbb325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7fabbb325800 5 note: GC not initialized 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7fa9e7fff640 20 reqs_thread_entry: start 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.243+0000 7fabbb325800 20 init_complete bucket index max shards: 11 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 20 Filter name: none 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fa9e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:55:38.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : miss 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 20 rados->read ofs=0 len=0 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.244+0000 7fabbb325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:55:38.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.246+0000 7fabbb325800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to be held by another RGW process; skipping for now 2024-09-12T17:55:38.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.246+0000 7faa6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:38.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.248+0000 7fabbb325800 20 remove_watcher() i=0 2024-09-12T17:55:38.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.248+0000 7fabbb325800 2 removed watcher, disabling cache 2024-09-12T17:55:38.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.249+0000 7fabbb325800 20 remove_watcher() i=1 2024-09-12T17:55:38.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.250+0000 7fabbb325800 20 remove_watcher() i=2 2024-09-12T17:55:38.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.251+0000 7fabbb325800 20 remove_watcher() i=3 2024-09-12T17:55:38.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.252+0000 7fabbb325800 20 remove_watcher() i=4 2024-09-12T17:55:38.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.253+0000 7fabbb325800 20 remove_watcher() i=5 2024-09-12T17:55:38.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.254+0000 7fabbb325800 20 remove_watcher() i=6 2024-09-12T17:55:38.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:55:38.255+0000 7fabbb325800 20 remove_watcher() i=7 2024-09-12T17:55:38.266 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:56:08.274 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:08.310 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:08.310 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:08.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.350+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 realm 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.352+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.353+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:08.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.353+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.353+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:08.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.353+0000 7f458c298800 20 searching for the correct realm 2024-09-12T17:56:08.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.357+0000 7f458a583640 0 -- 172.21.15.94:0/2256749125 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x559136874e90 msgr2=0x559136877280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:08.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.361+0000 7f4589d82640 0 -- 172.21.15.94:0/2256749125 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f458008f5a0 msgr2=0x7f458007a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:08.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:08.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.366+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:08.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 zone default found 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 4 Realm: () 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 zonegroup default 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.367+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.368+0000 7f458c298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.368+0000 7f458c298800 20 started sync module instance, tier type = 2024-09-12T17:56:08.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.368+0000 7f458c298800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=0 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=1 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=2 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=3 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=4 2024-09-12T17:56:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=5 2024-09-12T17:56:08.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.377+0000 7f458c298800 20 add_watcher() i=6 2024-09-12T17:56:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.378+0000 7f458c298800 20 add_watcher() i=7 2024-09-12T17:56:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.378+0000 7f458c298800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.380+0000 7f443b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 5 note: GC not initialized 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f443a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:08.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 20 Filter name: none 2024-09-12T17:56:08.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f43abfff640 20 reqs_thread_entry: start 2024-09-12T17:56:08.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:08.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.381+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:08.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:08.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:08.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : miss 2024-09-12T17:56:08.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.382+0000 7f458c298800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:56:08.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f458c298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f458c298800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f458c298800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f458c298800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24, ofs0, ns] 2024-09-12T17:56:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f446cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94082173511808 notifier 6672 bl.length()=925 2024-09-12T17:56:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f446cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f446cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.387+0000 7f446cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.389+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_sources= new_sources= 2024-09-12T17:56:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.389+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential sources added=[] removed=[] 2024-09-12T17:56:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.389+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_dests= new_dests= 2024-09-12T17:56:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.389+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential dests added=[] removed=[] 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.0 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.0 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.1 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.1 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.2 2024-09-12T17:56:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.2 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.3 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.3 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.4 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.4 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.5 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.5 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.6 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.6 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.7 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.7 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.8 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.8 2024-09-12T17:56:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.9 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.9 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.10 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.10 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.11 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1.11 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.0 2024-09-12T17:56:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.394+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1 2024-09-12T17:56:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.395+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.2 2024-09-12T17:56:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.395+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.3 2024-09-12T17:56:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.396+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.4 2024-09-12T17:56:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.396+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.5 2024-09-12T17:56:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.397+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.6 2024-09-12T17:56:08.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.397+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.7 2024-09-12T17:56:08.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.398+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.8 2024-09-12T17:56:08.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.398+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.9 2024-09-12T17:56:08.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.399+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.10 2024-09-12T17:56:08.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.402+0000 7f458c298800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:08.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.402+0000 7f458c298800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f458c298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f458c298800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f458c298800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f458c298800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24, ofs0, ns] 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f446cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94082173511808 notifier 6672 bl.length()=925 2024-09-12T17:56:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f446cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f446cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.404+0000 7f446cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.406+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_sources= new_sources= 2024-09-12T17:56:08.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.406+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential sources added=[] removed=[] 2024-09-12T17:56:08.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.406+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_dests= new_dests= 2024-09-12T17:56:08.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.406+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential dests added=[] removed=[] 2024-09-12T17:56:08.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.409+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.0 2024-09-12T17:56:08.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.410+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.1 2024-09-12T17:56:08.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.410+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.2 2024-09-12T17:56:08.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.411+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.3 2024-09-12T17:56:08.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.411+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.4 2024-09-12T17:56:08.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.411+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.5 2024-09-12T17:56:08.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.412+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.6 2024-09-12T17:56:08.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.412+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.7 2024-09-12T17:56:08.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.413+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.8 2024-09-12T17:56:08.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.413+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.9 2024-09-12T17:56:08.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.413+0000 7f458c298800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24.10 2024-09-12T17:56:08.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.414+0000 7f458c298800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:08.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.414+0000 7f458c298800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.415+0000 7f458c298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.415+0000 7f458c298800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.415+0000 7f458c298800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.415+0000 7f458c298800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24, ofs0, ns] 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.416+0000 7f446d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529741 cookie 94082173511808 notifier 6672 bl.length()=893 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.416+0000 7f446d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 info.flags=0x17 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.416+0000 7f446d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 to cache LRU end 2024-09-12T17:56:08.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.416+0000 7f446d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:08.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.418+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_sources= new_sources= 2024-09-12T17:56:08.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.418+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential sources added=[] removed=[] 2024-09-12T17:56:08.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.418+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): orig_dests= new_dests= 2024-09-12T17:56:08.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.418+0000 7f458c298800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24]): potential dests added=[] removed=[] 2024-09-12T17:56:08.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.420+0000 7f458c298800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:08.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.422+0000 7f443b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:08.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.424+0000 7f458c298800 20 remove_watcher() i=0 2024-09-12T17:56:08.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.424+0000 7f458c298800 2 removed watcher, disabling cache 2024-09-12T17:56:08.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.425+0000 7f458c298800 20 remove_watcher() i=1 2024-09-12T17:56:08.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.426+0000 7f458c298800 20 remove_watcher() i=2 2024-09-12T17:56:08.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.427+0000 7f458c298800 20 remove_watcher() i=3 2024-09-12T17:56:08.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.428+0000 7f458c298800 20 remove_watcher() i=4 2024-09-12T17:56:08.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.429+0000 7f458c298800 20 remove_watcher() i=5 2024-09-12T17:56:08.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.430+0000 7f458c298800 20 remove_watcher() i=6 2024-09-12T17:56:08.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.431+0000 7f458c298800 20 remove_watcher() i=7 2024-09-12T17:56:08.444 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:56:08.473 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:08.474 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:08.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.507+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 realm 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.509+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.510+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:08.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.510+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.510+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:08.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.510+0000 7fdb10535800 20 searching for the correct realm 2024-09-12T17:56:08.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.514+0000 7fdb0cae5640 0 -- 172.21.15.94:0/1677226247 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fdaf4015070 msgr2=0x7fdaf4064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:08.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.517+0000 7fdb0c2e4640 0 -- 172.21.15.94:0/1677226247 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fdaf409ab60 msgr2=0x7fdaf40a9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:08.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:08.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:08.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:08.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.723+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:08.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 zone default found 2024-09-12T17:56:08.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 4 Realm: () 2024-09-12T17:56:08.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:08.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 zonegroup default 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.724+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.725+0000 7fdb10535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.725+0000 7fdb10535800 20 started sync module instance, tier type = 2024-09-12T17:56:08.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.725+0000 7fdb10535800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:08.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=0 2024-09-12T17:56:08.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=1 2024-09-12T17:56:08.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=2 2024-09-12T17:56:08.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=3 2024-09-12T17:56:08.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=4 2024-09-12T17:56:08.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=5 2024-09-12T17:56:08.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=6 2024-09-12T17:56:08.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 20 add_watcher() i=7 2024-09-12T17:56:08.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.734+0000 7fdb10535800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:08.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fd9c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:08.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fdb10535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:08.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fdb10535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fdb10535800 5 note: GC not initialized 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fd9c1fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fdb10535800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fdb10535800 20 Filter name: none 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.737+0000 7fd9337fe640 20 reqs_thread_entry: start 2024-09-12T17:56:08.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.738+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.739+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:08.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.739+0000 7fdb10535800 20 rados->read ofs=0 len=0 2024-09-12T17:56:08.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.739+0000 7fdb10535800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:08.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.739+0000 7fdb10535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:08.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.741+0000 7fd9c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:08.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.743+0000 7fdb10535800 20 remove_watcher() i=0 2024-09-12T17:56:08.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.743+0000 7fdb10535800 2 removed watcher, disabling cache 2024-09-12T17:56:08.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.744+0000 7fdb10535800 20 remove_watcher() i=1 2024-09-12T17:56:08.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.745+0000 7fdb10535800 20 remove_watcher() i=2 2024-09-12T17:56:08.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.747+0000 7fdb10535800 20 remove_watcher() i=3 2024-09-12T17:56:08.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.747+0000 7fdb10535800 20 remove_watcher() i=4 2024-09-12T17:56:08.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.748+0000 7fdb10535800 20 remove_watcher() i=5 2024-09-12T17:56:08.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.749+0000 7fdb10535800 20 remove_watcher() i=6 2024-09-12T17:56:08.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:08.750+0000 7fdb10535800 20 remove_watcher() i=7 2024-09-12T17:56:08.762 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:08.762 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:08.762 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:08.762 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:09.139 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:56:09.139 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:09.940 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:09.968 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:09.968 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.002+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 realm 2024-09-12T17:56:10.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.004+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.005+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.005+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.005+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.005+0000 7ff673810800 20 searching for the correct realm 2024-09-12T17:56:10.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.009+0000 7ff6667df640 0 -- 172.21.15.94:0/2684190699 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7ff66001e040 msgr2=0x7ff66007f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.012+0000 7ff66f7e1640 0 -- 172.21.15.94:0/2684190699 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7ff6580a1920 msgr2=0x7ff658064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:10.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.016+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 zone default found 2024-09-12T17:56:10.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 4 Realm: () 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 zonegroup default 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.017+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.018+0000 7ff673810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.018+0000 7ff673810800 20 started sync module instance, tier type = 2024-09-12T17:56:10.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.018+0000 7ff673810800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=0 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=1 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=2 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=3 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=4 2024-09-12T17:56:10.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=5 2024-09-12T17:56:10.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.026+0000 7ff673810800 20 add_watcher() i=6 2024-09-12T17:56:10.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.027+0000 7ff673810800 20 add_watcher() i=7 2024-09-12T17:56:10.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.027+0000 7ff673810800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.028+0000 7ff5257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 5 note: GC not initialized 2024-09-12T17:56:10.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff49ffff640 20 reqs_thread_entry: start 2024-09-12T17:56:10.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 20 Filter name: none 2024-09-12T17:56:10.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff49dffb640 20 reqs_thread_entry: start 2024-09-12T17:56:10.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.029+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.030+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.030+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.030+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.030+0000 7ff673810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.030+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.031+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.031+0000 7ff673810800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.031+0000 7ff673810800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:10.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.031+0000 7ff673810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.033+0000 7ff5257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.034+0000 7ff673810800 20 remove_watcher() i=0 2024-09-12T17:56:10.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.034+0000 7ff673810800 2 removed watcher, disabling cache 2024-09-12T17:56:10.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.035+0000 7ff673810800 20 remove_watcher() i=1 2024-09-12T17:56:10.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.036+0000 7ff673810800 20 remove_watcher() i=2 2024-09-12T17:56:10.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.037+0000 7ff673810800 20 remove_watcher() i=3 2024-09-12T17:56:10.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.038+0000 7ff673810800 20 remove_watcher() i=4 2024-09-12T17:56:10.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.039+0000 7ff673810800 20 remove_watcher() i=5 2024-09-12T17:56:10.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.040+0000 7ff673810800 20 remove_watcher() i=6 2024-09-12T17:56:10.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.041+0000 7ff673810800 20 remove_watcher() i=7 2024-09-12T17:56:10.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:10.052 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:10.052 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:10.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:10.053 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:56:10.089 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.089 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.124+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 realm 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.126+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.127+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.127+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.128+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.128+0000 7fd603135800 20 searching for the correct realm 2024-09-12T17:56:10.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.131+0000 7fd5f7fff640 0 -- 172.21.15.94:0/388829434 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fd5f006c440 msgr2=0x7fd5f006c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.135+0000 7fd5ff5c4640 0 -- 172.21.15.94:0/388829434 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fd5e806bb60 msgr2=0x7fd5e8069050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.138+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 zone default found 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 4 Realm: () 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 zonegroup default 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 started sync module instance, tier type = 2024-09-12T17:56:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.139+0000 7fd603135800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=0 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=1 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=2 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=3 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=4 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=5 2024-09-12T17:56:10.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=6 2024-09-12T17:56:10.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 20 add_watcher() i=7 2024-09-12T17:56:10.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.148+0000 7fd603135800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.150+0000 7fd4b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.150+0000 7fd603135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.150+0000 7fd603135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.150+0000 7fd603135800 5 note: GC not initialized 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd42ffff640 20 reqs_thread_entry: start 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 20 Filter name: none 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd42dffb640 20 reqs_thread_entry: start 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:10.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:10.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:10.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 : miss 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.151+0000 7fd603135800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.152+0000 7fd603135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.159+0000 7fd603135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.159+0000 7fd603135800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.159+0000 7fd603135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.159+0000 7fd603135800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25, ofs0, ns] 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.160+0000 7fd4e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94359439581664 notifier 6359 bl.length()=939 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.160+0000 7fd4e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.160+0000 7fd4e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.160+0000 7fd4e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_sources= new_sources= 2024-09-12T17:56:10.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential sources added=[] removed=[] 2024-09-12T17:56:10.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_dests= new_dests= 2024-09-12T17:56:10.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential dests added=[] removed=[] 2024-09-12T17:56:10.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:56:10.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.161+0000 7fd603135800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:56:10.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.163+0000 7fd4b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.166+0000 7fd603135800 20 remove_watcher() i=0 2024-09-12T17:56:10.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.166+0000 7fd603135800 2 removed watcher, disabling cache 2024-09-12T17:56:10.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.167+0000 7fd603135800 20 remove_watcher() i=1 2024-09-12T17:56:10.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.168+0000 7fd603135800 20 remove_watcher() i=2 2024-09-12T17:56:10.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.169+0000 7fd603135800 20 remove_watcher() i=3 2024-09-12T17:56:10.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.169+0000 7fd603135800 20 remove_watcher() i=4 2024-09-12T17:56:10.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.170+0000 7fd603135800 20 remove_watcher() i=5 2024-09-12T17:56:10.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.171+0000 7fd603135800 20 remove_watcher() i=6 2024-09-12T17:56:10.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.172+0000 7fd603135800 20 remove_watcher() i=7 2024-09-12T17:56:10.185 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:10.214 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.215 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.250+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 20 realm 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.251+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.252+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.252+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.253+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.253+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.253+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.253+0000 7ff99f019800 20 searching for the correct realm 2024-09-12T17:56:10.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.256+0000 7ff999fea640 0 -- 172.21.15.94:0/3707850329 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55ee8f170810 msgr2=0x55ee8f172c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.259+0000 7ff99a7eb640 0 -- 172.21.15.94:0/3707850329 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7ff990063400 msgr2=0x7ff990063880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.263+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 zone default found 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 4 Realm: () 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 zonegroup default 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.264+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.265+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.265+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.265+0000 7ff99f019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.265+0000 7ff99f019800 20 started sync module instance, tier type = 2024-09-12T17:56:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.265+0000 7ff99f019800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=0 2024-09-12T17:56:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=1 2024-09-12T17:56:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=2 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=3 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=4 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=5 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.273+0000 7ff99f019800 20 add_watcher() i=6 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.274+0000 7ff99f019800 20 add_watcher() i=7 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.274+0000 7ff99f019800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff99f019800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff99f019800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff99f019800 5 note: GC not initialized 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff7cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.276+0000 7ff99f019800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 Filter name: none 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff7c97fa640 20 reqs_thread_entry: start 2024-09-12T17:56:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.277+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.278+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.278+0000 7ff99f019800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.279+0000 7ff99f019800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:10.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.279+0000 7ff99f019800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.280+0000 7ff850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.282+0000 7ff99f019800 20 remove_watcher() i=0 2024-09-12T17:56:10.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.282+0000 7ff99f019800 2 removed watcher, disabling cache 2024-09-12T17:56:10.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.283+0000 7ff99f019800 20 remove_watcher() i=1 2024-09-12T17:56:10.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.284+0000 7ff99f019800 20 remove_watcher() i=2 2024-09-12T17:56:10.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.285+0000 7ff99f019800 20 remove_watcher() i=3 2024-09-12T17:56:10.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.286+0000 7ff99f019800 20 remove_watcher() i=4 2024-09-12T17:56:10.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.287+0000 7ff99f019800 20 remove_watcher() i=5 2024-09-12T17:56:10.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.288+0000 7ff99f019800 20 remove_watcher() i=6 2024-09-12T17:56:10.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.289+0000 7ff99f019800 20 remove_watcher() i=7 2024-09-12T17:56:10.299 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:10.391 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:10.422 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.423 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.458+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 realm 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.460+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.461+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.461+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.461+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.461+0000 7fa1f9f23800 20 searching for the correct realm 2024-09-12T17:56:10.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.464+0000 7fa1f6414640 0 -- 172.21.15.94:0/968954769 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa1e00032f0 msgr2=0x7fa1e0007390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.467+0000 7fa1f5c13640 0 -- 172.21.15.94:0/968954769 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa1e004d8e0 msgr2=0x7fa1e0003790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.673+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 zone default found 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 4 Realm: () 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 zonegroup default 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.674+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 started sync module instance, tier type = 2024-09-12T17:56:10.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.675+0000 7fa1f9f23800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=0 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=1 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=2 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=3 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=4 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=5 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.684+0000 7fa1f9f23800 20 add_watcher() i=6 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.685+0000 7fa1f9f23800 20 add_watcher() i=7 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.685+0000 7fa1f9f23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa0a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa1f9f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa1f9f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa1f9f23800 5 note: GC not initialized 2024-09-12T17:56:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa0a67fc640 20 reqs_thread_entry: start 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.687+0000 7fa1f9f23800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 20 Filter name: none 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa017fff640 20 reqs_thread_entry: start 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 : miss 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.688+0000 7fa1f9f23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:10.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.689+0000 7fa1f9f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 2024-09-12T17:56:10.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.690+0000 7fa1f9f23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:56:10.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa1f9f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa1f9f23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa1f9f23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa1f9f23800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25, ofs0, ns] 2024-09-12T17:56:10.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa0d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94822715050784 notifier 6765 bl.length()=939 2024-09-12T17:56:10.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa0d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa0d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.696+0000 7fa0d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.698+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_sources= new_sources= 2024-09-12T17:56:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.698+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential sources added=[] removed=[] 2024-09-12T17:56:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.698+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_dests= new_dests= 2024-09-12T17:56:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.698+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential dests added=[] removed=[] 2024-09-12T17:56:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.0 2024-09-12T17:56:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.0 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.1 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.1 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.2 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.2 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.3 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.3 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.4 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.4 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.5 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.5 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.6 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.6 2024-09-12T17:56:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.7 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.7 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.8 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.8 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.9 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.9 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.10 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.10 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.11 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2.11 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.702+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.0 2024-09-12T17:56:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.703+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.1 2024-09-12T17:56:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.703+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2 2024-09-12T17:56:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.703+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.3 2024-09-12T17:56:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.704+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.4 2024-09-12T17:56:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.704+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.5 2024-09-12T17:56:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.705+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.6 2024-09-12T17:56:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.706+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.7 2024-09-12T17:56:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.706+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.8 2024-09-12T17:56:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.707+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.9 2024-09-12T17:56:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.708+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.10 2024-09-12T17:56:10.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.711+0000 7fa1f9f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:10.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.711+0000 7fa1f9f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 2024-09-12T17:56:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa1f9f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa1f9f23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa1f9f23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa1f9f23800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25, ofs0, ns] 2024-09-12T17:56:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa0d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 94822715050784 notifier 6765 bl.length()=939 2024-09-12T17:56:10.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa0d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa0d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.712+0000 7fa0d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.714+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_sources= new_sources= 2024-09-12T17:56:10.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.714+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential sources added=[] removed=[] 2024-09-12T17:56:10.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.714+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_dests= new_dests= 2024-09-12T17:56:10.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.714+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential dests added=[] removed=[] 2024-09-12T17:56:10.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.716+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.0 2024-09-12T17:56:10.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.717+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.1 2024-09-12T17:56:10.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.717+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.2 2024-09-12T17:56:10.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.717+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.3 2024-09-12T17:56:10.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.717+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.4 2024-09-12T17:56:10.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.718+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.5 2024-09-12T17:56:10.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.718+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.6 2024-09-12T17:56:10.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.718+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.7 2024-09-12T17:56:10.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.719+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.8 2024-09-12T17:56:10.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.719+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.9 2024-09-12T17:56:10.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.719+0000 7fa1f9f23800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25.10 2024-09-12T17:56:10.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.719+0000 7fa1f9f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:10.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.719+0000 7fa1f9f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 2024-09-12T17:56:10.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa1f9f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa1f9f23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa1f9f23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa1f9f23800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25, ofs0, ns] 2024-09-12T17:56:10.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa0d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 94822715050784 notifier 6765 bl.length()=907 2024-09-12T17:56:10.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa0d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 info.flags=0x17 2024-09-12T17:56:10.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa0d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 to cache LRU end 2024-09-12T17:56:10.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.721+0000 7fa0d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.723+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_sources= new_sources= 2024-09-12T17:56:10.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.723+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential sources added=[] removed=[] 2024-09-12T17:56:10.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.723+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): orig_dests= new_dests= 2024-09-12T17:56:10.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.723+0000 7fa1f9f23800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25]): potential dests added=[] removed=[] 2024-09-12T17:56:10.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.725+0000 7fa1f9f23800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:10.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.727+0000 7fa0a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.729+0000 7fa1f9f23800 20 remove_watcher() i=0 2024-09-12T17:56:10.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.729+0000 7fa1f9f23800 2 removed watcher, disabling cache 2024-09-12T17:56:10.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.729+0000 7fa1f9f23800 20 remove_watcher() i=1 2024-09-12T17:56:10.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.730+0000 7fa1f9f23800 20 remove_watcher() i=2 2024-09-12T17:56:10.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.731+0000 7fa1f9f23800 20 remove_watcher() i=3 2024-09-12T17:56:10.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.732+0000 7fa1f9f23800 20 remove_watcher() i=4 2024-09-12T17:56:10.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.733+0000 7fa1f9f23800 20 remove_watcher() i=5 2024-09-12T17:56:10.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.734+0000 7fa1f9f23800 20 remove_watcher() i=6 2024-09-12T17:56:10.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.735+0000 7fa1f9f23800 20 remove_watcher() i=7 2024-09-12T17:56:10.748 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:10.777 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.777 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.812+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 realm 2024-09-12T17:56:10.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.814+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.815+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.815+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.816+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.816+0000 7f760020e800 20 searching for the correct realm 2024-09-12T17:56:10.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.818+0000 7f75fc05a640 0 -- 172.21.15.94:0/1679912333 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f75e402c070 msgr2=0x7f75e400b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:10.823+0000 7f75fb859640 0 -- 172.21.15.94:0/1679912333 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f75e402e410 msgr2=0x7f75e402e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:11.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.028+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:11.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 zone default found 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 4 Realm: () 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 zonegroup default 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.029+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 started sync module instance, tier type = 2024-09-12T17:56:11.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.030+0000 7f760020e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=0 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=1 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=2 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=3 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=4 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=5 2024-09-12T17:56:11.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.039+0000 7f760020e800 20 add_watcher() i=6 2024-09-12T17:56:11.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.040+0000 7f760020e800 20 add_watcher() i=7 2024-09-12T17:56:11.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.040+0000 7f760020e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:11.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.041+0000 7f74b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 5 note: GC not initialized 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f74b17e2640 20 reqs_thread_entry: start 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 20 Filter name: none 2024-09-12T17:56:11.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f74aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:11.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.042+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:11.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.043+0000 7f760020e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.044+0000 7f760020e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:11.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.044+0000 7f760020e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:11.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.046+0000 7f74b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.047+0000 7f760020e800 20 remove_watcher() i=0 2024-09-12T17:56:11.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.047+0000 7f760020e800 2 removed watcher, disabling cache 2024-09-12T17:56:11.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.048+0000 7f760020e800 20 remove_watcher() i=1 2024-09-12T17:56:11.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.049+0000 7f760020e800 20 remove_watcher() i=2 2024-09-12T17:56:11.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.050+0000 7f760020e800 20 remove_watcher() i=3 2024-09-12T17:56:11.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.051+0000 7f760020e800 20 remove_watcher() i=4 2024-09-12T17:56:11.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.052+0000 7f760020e800 20 remove_watcher() i=5 2024-09-12T17:56:11.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.053+0000 7f760020e800 20 remove_watcher() i=6 2024-09-12T17:56:11.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:11.054+0000 7f760020e800 20 remove_watcher() i=7 2024-09-12T17:56:11.066 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:11.066 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:11.066 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:11.066 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:11.438 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:56:11.438 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:12.271 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:12.299 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:12.299 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:12.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.529+0000 7fd9e3fff640 0 --2- 172.21.15.94:0/2942764843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d63e2e3180 0x55d63e2e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:56:12.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.536+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 realm 2024-09-12T17:56:12.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.538+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.539+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:12.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.539+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.539+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:12.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.539+0000 7fd9ee335800 20 searching for the correct realm 2024-09-12T17:56:12.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.542+0000 7fd9e3fff640 0 -- 172.21.15.94:0/2308208977 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fd9dc069390 msgr2=0x7fd9dc020400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:12.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.748+0000 7fd9e9fc3640 0 -- 172.21.15.94:0/2308208977 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fd9d40564f0 msgr2=0x7fd9d406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:12.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.954+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:12.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 zone default found 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 4 Realm: () 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 zonegroup default 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.955+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.956+0000 7fd9ee335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.956+0000 7fd9ee335800 20 started sync module instance, tier type = 2024-09-12T17:56:12.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.956+0000 7fd9ee335800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:12.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=0 2024-09-12T17:56:12.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=1 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=2 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=3 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=4 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=5 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.964+0000 7fd9ee335800 20 add_watcher() i=6 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.965+0000 7fd9ee335800 20 add_watcher() i=7 2024-09-12T17:56:12.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.965+0000 7fd9ee335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:12.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd89b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 5 note: GC not initialized 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd89a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 20 Filter name: none 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd80bfff640 20 reqs_thread_entry: start 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.967+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.968+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.968+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.968+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.968+0000 7fd9ee335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.968+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.969+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.969+0000 7fd9ee335800 20 rados->read ofs=0 len=0 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.969+0000 7fd9ee335800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:12.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.969+0000 7fd9ee335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:12.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.971+0000 7fd89b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:12.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.973+0000 7fd9ee335800 20 remove_watcher() i=0 2024-09-12T17:56:12.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.973+0000 7fd9ee335800 2 removed watcher, disabling cache 2024-09-12T17:56:12.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.974+0000 7fd9ee335800 20 remove_watcher() i=1 2024-09-12T17:56:12.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.975+0000 7fd9ee335800 20 remove_watcher() i=2 2024-09-12T17:56:12.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.976+0000 7fd9ee335800 20 remove_watcher() i=3 2024-09-12T17:56:12.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.977+0000 7fd9ee335800 20 remove_watcher() i=4 2024-09-12T17:56:12.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.978+0000 7fd9ee335800 20 remove_watcher() i=5 2024-09-12T17:56:12.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.979+0000 7fd9ee335800 20 remove_watcher() i=6 2024-09-12T17:56:12.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:12.980+0000 7fd9ee335800 20 remove_watcher() i=7 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:12.993 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:56:13.029 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:13.029 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:13.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.065+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 realm 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.067+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.068+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:13.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.068+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.069+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:13.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.069+0000 7f51c6813800 20 searching for the correct realm 2024-09-12T17:56:13.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.071+0000 7f51bbfff640 0 -- 172.21.15.94:0/1846965432 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f51b4087040 msgr2=0x7f51b40673b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:13.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.075+0000 7f51c1f22640 0 -- 172.21.15.94:0/1846965432 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f51ac082150 msgr2=0x7f51ac082740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:13.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:13.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.281+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:13.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 zone default found 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 4 Realm: () 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:13.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 zonegroup default 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.282+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 started sync module instance, tier type = 2024-09-12T17:56:13.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.283+0000 7f51c6813800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=0 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=1 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=2 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=3 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=4 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=5 2024-09-12T17:56:13.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=6 2024-09-12T17:56:13.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 20 add_watcher() i=7 2024-09-12T17:56:13.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.292+0000 7f51c6813800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:13.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.294+0000 7f50737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.294+0000 7f51c6813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.294+0000 7f51c6813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.294+0000 7f51c6813800 5 note: GC not initialized 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f50727fc640 20 reqs_thread_entry: start 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f51c6813800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f51c6813800 20 Filter name: none 2024-09-12T17:56:13.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f4fe3fff640 20 reqs_thread_entry: start 2024-09-12T17:56:13.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f51c6813800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:13.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.295+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 : miss 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 info.flags=0x17 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 to cache LRU end 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.296+0000 7f51c6813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 2024-09-12T17:56:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f51c6813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 info.flags=0x17 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f51c6813800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 to cache LRU end 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f51c6813800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f51c6813800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26, ofs0, ns] 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f50a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 94675048660304 notifier 6449 bl.length()=939 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f50a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 info.flags=0x17 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f50a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 to cache LRU end 2024-09-12T17:56:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.301+0000 7f50a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): orig_sources= new_sources= 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): potential sources added=[] removed=[] 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): orig_dests= new_dests= 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): potential dests added=[] removed=[] 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:56:13.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.303+0000 7f51c6813800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:56:13.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.0 2024-09-12T17:56:13.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.0 2024-09-12T17:56:13.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.1 2024-09-12T17:56:13.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.1 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.2 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.2 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.3 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.3 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.4 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.4 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.5 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.5 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.6 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.6 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.7 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.7 2024-09-12T17:56:13.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.8 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.8 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.9 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.9 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.10 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.10 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.11 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1.11 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.0 2024-09-12T17:56:13.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.305+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.1 2024-09-12T17:56:13.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.306+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.2 2024-09-12T17:56:13.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.306+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.3 2024-09-12T17:56:13.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.307+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.4 2024-09-12T17:56:13.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.307+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.5 2024-09-12T17:56:13.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.307+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.6 2024-09-12T17:56:13.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.308+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.7 2024-09-12T17:56:13.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.308+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.8 2024-09-12T17:56:13.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.309+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.9 2024-09-12T17:56:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.309+0000 7f51c6813800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26.10 2024-09-12T17:56:13.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.312+0000 7f51c6813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:13.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.312+0000 7f51c6813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 2024-09-12T17:56:13.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.313+0000 7f51c6813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 info.flags=0x17 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.313+0000 7f51c6813800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 to cache LRU end 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.313+0000 7f51c6813800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.313+0000 7f51c6813800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26, ofs0, ns] 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.313+0000 7f50a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94675048660304 notifier 6449 bl.length()=907 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.314+0000 7f50a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 info.flags=0x17 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.314+0000 7f50a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 to cache LRU end 2024-09-12T17:56:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.314+0000 7f50a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.315+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): orig_sources= new_sources= 2024-09-12T17:56:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.315+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): potential sources added=[] removed=[] 2024-09-12T17:56:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.315+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): orig_dests= new_dests= 2024-09-12T17:56:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.315+0000 7f51c6813800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26]): potential dests added=[] removed=[] 2024-09-12T17:56:13.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.317+0000 7f51c6813800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:13.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.319+0000 7f50737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:13.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.321+0000 7f51c6813800 20 remove_watcher() i=0 2024-09-12T17:56:13.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.321+0000 7f51c6813800 2 removed watcher, disabling cache 2024-09-12T17:56:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.322+0000 7f51c6813800 20 remove_watcher() i=1 2024-09-12T17:56:13.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.323+0000 7f51c6813800 20 remove_watcher() i=2 2024-09-12T17:56:13.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.325+0000 7f51c6813800 20 remove_watcher() i=3 2024-09-12T17:56:13.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.326+0000 7f51c6813800 20 remove_watcher() i=4 2024-09-12T17:56:13.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.327+0000 7f51c6813800 20 remove_watcher() i=5 2024-09-12T17:56:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.328+0000 7f51c6813800 20 remove_watcher() i=6 2024-09-12T17:56:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.328+0000 7f51c6813800 20 remove_watcher() i=7 2024-09-12T17:56:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:13.370 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:13.371 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:13.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.404+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 realm 2024-09-12T17:56:13.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:13.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.406+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.407+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:13.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.407+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.407+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:13.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.407+0000 7f823892e800 20 searching for the correct realm 2024-09-12T17:56:13.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.410+0000 7f822bfff640 0 -- 172.21.15.94:0/3775782367 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x562b8bb18ce0 msgr2=0x562b8bb1b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:13.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.414+0000 7f82346b0640 0 -- 172.21.15.94:0/3775782367 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f821c02cb90 msgr2=0x7f821c00e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:13.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:13.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:13.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 zone default found 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 4 Realm: () 2024-09-12T17:56:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 zonegroup default 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.418+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:13.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 started sync module instance, tier type = 2024-09-12T17:56:13.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.419+0000 7f823892e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:13.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=0 2024-09-12T17:56:13.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=1 2024-09-12T17:56:13.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=2 2024-09-12T17:56:13.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=3 2024-09-12T17:56:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=4 2024-09-12T17:56:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=5 2024-09-12T17:56:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=6 2024-09-12T17:56:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 20 add_watcher() i=7 2024-09-12T17:56:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.429+0000 7f823892e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.431+0000 7f80eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.431+0000 7f823892e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.431+0000 7f823892e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.431+0000 7f823892e800 5 note: GC not initialized 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f80e9fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f823892e800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f823892e800 20 Filter name: none 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f805b7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.432+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.433+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.433+0000 7f823892e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.433+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.433+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.433+0000 7f823892e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.434+0000 7f823892e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.434+0000 7f823892e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:13.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.435+0000 7f80eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:13.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.437+0000 7f823892e800 20 remove_watcher() i=0 2024-09-12T17:56:13.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.437+0000 7f823892e800 2 removed watcher, disabling cache 2024-09-12T17:56:13.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.438+0000 7f823892e800 20 remove_watcher() i=1 2024-09-12T17:56:13.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.439+0000 7f823892e800 20 remove_watcher() i=2 2024-09-12T17:56:13.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.440+0000 7f823892e800 20 remove_watcher() i=3 2024-09-12T17:56:13.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.441+0000 7f823892e800 20 remove_watcher() i=4 2024-09-12T17:56:13.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.442+0000 7f823892e800 20 remove_watcher() i=5 2024-09-12T17:56:13.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.443+0000 7f823892e800 20 remove_watcher() i=6 2024-09-12T17:56:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:13.444+0000 7f823892e800 20 remove_watcher() i=7 2024-09-12T17:56:13.455 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:13.455 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:13.455 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:56:13.456 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:13.829 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:56:13.829 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:14.653 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:56:14.680 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:14.680 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:14.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.716+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.717+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.717+0000 7f1aecb28800 20 realm 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.717+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.718+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.718+0000 7f1aecb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.718+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.718+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.718+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.719+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.719+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.719+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.719+0000 7f1aecb28800 20 searching for the correct realm 2024-09-12T17:56:14.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.722+0000 7f1ae3fff640 0 -- 172.21.15.94:0/1138598244 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f1adc036060 msgr2=0x7f1adc066900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:14.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:14.928+0000 7f1ae884b640 0 -- 172.21.15.94:0/1138598244 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f1ad4048950 msgr2=0x7f1ad401e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.133+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 zone default found 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 4 Realm: () 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 zonegroup default 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.134+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 started sync module instance, tier type = 2024-09-12T17:56:15.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.135+0000 7f1aecb28800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:15.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=0 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=1 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=2 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=3 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=4 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=5 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.144+0000 7f1aecb28800 20 add_watcher() i=6 2024-09-12T17:56:15.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.145+0000 7f1aecb28800 20 add_watcher() i=7 2024-09-12T17:56:15.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.145+0000 7f1aecb28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f199efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f1aecb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f1aecb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f1aecb28800 5 note: GC not initialized 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f199dfe3640 20 reqs_thread_entry: start 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f1aecb28800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.147+0000 7f1aecb28800 20 Filter name: none 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.148+0000 7f190f7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:15.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.148+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.148+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.148+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.149+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:15.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.149+0000 7f1aecb28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.149+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.149+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.149+0000 7f1aecb28800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.150+0000 7f1aecb28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:15.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.150+0000 7f1aecb28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.152+0000 7f199efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.154+0000 7f1aecb28800 20 remove_watcher() i=0 2024-09-12T17:56:15.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.154+0000 7f1aecb28800 2 removed watcher, disabling cache 2024-09-12T17:56:15.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.155+0000 7f1aecb28800 20 remove_watcher() i=1 2024-09-12T17:56:15.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.156+0000 7f1aecb28800 20 remove_watcher() i=2 2024-09-12T17:56:15.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.158+0000 7f1aecb28800 20 remove_watcher() i=3 2024-09-12T17:56:15.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.159+0000 7f1aecb28800 20 remove_watcher() i=4 2024-09-12T17:56:15.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.159+0000 7f1aecb28800 20 remove_watcher() i=5 2024-09-12T17:56:15.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.160+0000 7f1aecb28800 20 remove_watcher() i=6 2024-09-12T17:56:15.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.161+0000 7f1aecb28800 20 remove_watcher() i=7 2024-09-12T17:56:15.172 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.172 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:15.172 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:15.172 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.174 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:56:15.208 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.208 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:15.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.244+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 realm 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.247+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.247+0000 7f3800815800 20 searching for the correct realm 2024-09-12T17:56:15.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.450+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f37e4033520 msgr2=0x7f37e4033960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.453+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f37e4053960 msgr2=0x7f37e4040440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:15.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 zone default found 2024-09-12T17:56:15.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 4 Realm: () 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 zonegroup default 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.664+0000 7f3800815800 20 started sync module instance, tier type = 2024-09-12T17:56:15.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.665+0000 7f3800815800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=0 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=1 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=2 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=3 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=4 2024-09-12T17:56:15.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=5 2024-09-12T17:56:15.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=6 2024-09-12T17:56:15.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.675+0000 7f3800815800 20 add_watcher() i=7 2024-09-12T17:56:15.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.675+0000 7f3800815800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f36b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f3800815800 5 note: GC not initialized 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f36b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f3800815800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.677+0000 7f3800815800 20 Filter name: none 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f362a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:56:15.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : miss 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.679+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.679+0000 7f3800815800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:15.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.679+0000 7f3800815800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:15.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.684+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.684+0000 7f3800815800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.684+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.684+0000 7f3800815800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:15.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529745 cookie 94156895484736 notifier 6876 bl.length()=939 2024-09-12T17:56:15.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3800815800 time 2024-09-12T17:56:15.687837+0000 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f380198c71a] 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.688 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.687+0000 7f3800815800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3800815800 time 2024-09-12T17:56:15.687837+0000 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f380198c71a] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.689 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:56:15.690 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3800815800 thread_name:radosgw-admin 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f380063e6f0] 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f380068b99c] 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f380198c774] 2024-09-12T17:56:15.714 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.688+0000 7f3800815800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3800815800 thread_name:radosgw-admin 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f380063e6f0] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f380068b99c] 2024-09-12T17:56:15.715 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f380198c774] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.716 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: dump: 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.717 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:56:15.228+0000 7f3800815800 5 monclient: authenticate success, global_id 6482 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:56:15.228+0000 7f3800815800 4 set_mon_vals no callback set 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: shutdown 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:56:15.228+0000 7f3800815800 5 asok(0x55a29c1d5730) unregister_commands rotate-key 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:56:15.228+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.718 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.719 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: starting msgr at 2024-09-12T17:56:15.720 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: starting objecter 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:56:15.229+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests hook 0x55a29c3fa830 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: setting wanted keys 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: calling monclient init 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.721 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:56:15.229+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key hook 0x55a29c3f76b8 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c421210 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c421b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.722 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x7f37e8002340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.743913s 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c421210 auth_method 0 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x7f37e8002340 auth_method 0 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.723 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_done global_id 6485 payload 824 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:56:15.230+0000 7f37fc793640 1 monclient: found mon.noname-c 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.724 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: dump: 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.725 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: dump: 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.726 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:56:15.230+0000 7f3800815800 5 monclient: authenticate success, global_id 6485 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:56:15.230+0000 7f36e9e0b640 4 set_mon_vals no callback set 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:56:15.230+0000 7f3800815800 1 librados: init done 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:56:15.232+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f36e4076470 auth_method 0 2024-09-12T17:56:15.727 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:56:15.232+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c41ee10 auth_method 0 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:56:15.233+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c4434f0 auth_method 0 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:56:15.235+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c448580 auth_method 0 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:56:15.235+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:56:15.235+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:56:15.235+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.728 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.729 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:56:15.236+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55a29c44fee0 EEXIST 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.730 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:56:15.236+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x55a29c44b670 EEXIST 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c473bd0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.731 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c475ea0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c4723a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.750864s 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c473bd0 auth_method 0 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c475ea0 auth_method 0 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.732 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4723a0 auth_method 0 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.733 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_done global_id 6870 payload 824 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:56:15.237+0000 7f37fbf92640 1 monclient: found mon.noname-a 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: dump: 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.734 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: dump: 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.735 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:56:15.237+0000 7f3800815800 5 monclient: authenticate success, global_id 6870 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:56:15.237+0000 7f37fcf94640 4 set_mon_vals no callback set 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.736 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:56:15.239+0000 7f37f3fff640 10 monclient: get_auth_request con 0x7f36d4076380 auth_method 0 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: get_monmap_and_config 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:56:15.239+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.737 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.738 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.739 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:56:15.240+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x7ffe16fe43f8 EEXIST 2024-09-12T17:56:15.740 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c4c8030 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c497e40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c4c33f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.754667s 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c497e40 auth_method 0 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.741 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c4c8030 auth_method 0 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4c33f0 auth_method 0 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.742 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_done global_id 6491 payload 274 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:56:15.240+0000 7f37fbf92640 1 monclient: found mon.noname-c 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: dump: 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.743 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:56:15.241+0000 7f3800815800 5 monclient: authenticate success, global_id 6491 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: dump: 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.744 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:56:15.241+0000 7f3800815800 4 set_mon_vals no callback set 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: shutdown 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:56:15.241+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.745 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.746 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: starting msgr at 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: starting objecter 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:56:15.242+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55a29c4c51f0 EEXIST 2024-09-12T17:56:15.747 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: setting wanted keys 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: calling monclient init 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.748 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:56:15.242+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x55a29c48bac8 EEXIST 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c497e40 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c4c33f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c4c8030 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.749 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.756828s 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c4c33f0 auth_method 0 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4c8030 auth_method 0 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.750 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:56:15.243+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c497e40 auth_method 0 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_done global_id 6876 payload 824 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:56:15.243+0000 7f37fc793640 1 monclient: found mon.noname-a 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:15.751 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: dump: 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.752 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: dump: 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:56:15.243+0000 7f36daffd640 4 set_mon_vals no callback set 2024-09-12T17:56:15.753 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:56:15.243+0000 7f3800815800 5 monclient: authenticate success, global_id 6876 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:56:15.243+0000 7f3800815800 1 librados: init done 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:56:15.243+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cr dump hook 0x55a29c4bdfc8 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:56:15.244+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:56:15.245+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f36c4076470 auth_method 0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:56:15.245+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c4e2450 auth_method 0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.754 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:56:15.246+0000 7f3800815800 20 realm 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:56:15.246+0000 7f3800815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:56:15.246+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c4e66b0 auth_method 0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:56:15.247+0000 7f3800815800 20 searching for the correct realm 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:56:15.248+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c4eb940 auth_method 0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:56:15.248+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4033520 auth_method 0 2024-09-12T17:56:15.755 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:56:15.449+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4033520 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:56:15.450+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f37e4033520 msgr2=0x7f37e4033960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:56:15.450+0000 7f36d97fa640 1 client.6876.objecter ms_handle_reset 0x7f37e4033520 session 0x7f37e4022e80 osd.7 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:56:15.450+0000 7f36d97fa640 10 monclient: _renew_subs 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:56:15.450+0000 7f36d97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:56:15.450+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c2a43c0 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:56:15.450+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f36c4086bf0 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:56:15.451+0000 7f37f3fff640 10 monclient: get_auth_request con 0x7f37ec0db070 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:56:15.453+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4053960 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:56:15.453+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f37e4053960 msgr2=0x7f37e4040440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:56:15.654+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4053960 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:56:15.658+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f37e4031410 auth_method 0 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:15.756 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:56:15.664+0000 7f3800815800 20 zone default found 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:56:15.664+0000 7f3800815800 4 Realm: () 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:56:15.664+0000 7f3800815800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:15.757 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:56:15.664+0000 7f3800815800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:56:15.664+0000 7f3800815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:56:15.664+0000 7f3800815800 20 zonegroup default 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:56:15.664+0000 7f3800815800 20 started sync module instance, tier type = 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:56:15.665+0000 7f3800815800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=0 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=1 2024-09-12T17:56:15.758 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=2 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=3 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=4 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=5 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=6 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:56:15.675+0000 7f3800815800 20 add_watcher() i=7 2024-09-12T17:56:15.759 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:56:15.675+0000 7f3800815800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.760 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:56:15.677+0000 7f36b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:56:15.677+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache list hook 0x55a29c497790 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache inspect hook 0x55a29c497790 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache erase hook 0x55a29c497790 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache zap hook 0x55a29c497790 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:56:15.677+0000 7f3800815800 5 note: GC not initialized 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:56:15.677+0000 7f36b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace show hook 0x7f37e8003ab0 2024-09-12T17:56:15.761 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace history hook 0x7f37e8003ab0 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace active hook 0x7f37e8003ab0 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace active_short hook 0x7f37e8003ab0 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:56:15.677+0000 7f3800815800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:56:15.677+0000 7f3800815800 20 Filter name: none 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:56:15.678+0000 7f362a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:56:15.678+0000 7f3800815800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : miss 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:15.762 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:56:15.679+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:56:15.679+0000 7f3800815800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:56:15.679+0000 7f3800815800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:56:15.684+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:56:15.684+0000 7f3800815800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:56:15.684+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:56:15.684+0000 7f3800815800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529745 cookie 94156895484736 notifier 6876 bl.length()=939 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.763 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:56:15.687+0000 7f3800815800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3800815800 time 2024-09-12T17:56:15.687837+0000 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f380198c71a] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:15.764 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:56:15.688+0000 7f3800815800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3800815800 thread_name:radosgw-admin 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f380063e6f0] 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f380068b99c] 2024-09-12T17:56:15.765 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:15.766 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:15.766 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f380198c774] 2024-09-12T17:56:15.766 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.766 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:56:15.767 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:56:15.768 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:56:15.769 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:15.770 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:56:15.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:15.772 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:56:15.773 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f362a7fc640 / http_manager 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36b0fe1640 / http_manager 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36b1fe3640 / rgw_dt_lg_renew 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36d97fa640 / ms_dispatch 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36da7fc640 / io_context_pool 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36daffd640 / io_context_pool 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e17fa640 / ms_dispatch 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e3fff640 / ms_dispatch 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e9e0b640 / io_context_pool 2024-09-12T17:56:15.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37f3fff640 / msgr-worker-2 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fbf92640 / msgr-worker-1 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fc793640 / msgr-worker-0 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fcf94640 / io_context_pool 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3800815800 / radosgw-admin 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.106494.log 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.775 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:56:15.228+0000 7f36e9e0b640 10 monclient: dump: 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:56:15.228+0000 7f3800815800 5 monclient: authenticate success, global_id 6482 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:15.776 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:56:15.228+0000 7f3800815800 4 set_mon_vals no callback set 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: shutdown 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:56:15.228+0000 7f3800815800 5 asok(0x55a29c1d5730) unregister_commands rotate-key 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:56:15.228+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:56:15.228+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding auth protocol: cephx 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.778 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: crc 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:56:15.228+0000 7f3800815800 5 AuthRegistry(0x55a29c3fcbb0) adding con mode: secure 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: starting msgr at 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: starting objecter 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:56:15.229+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests hook 0x55a29c3fa830 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: setting wanted keys 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:56:15.229+0000 7f3800815800 1 librados: calling monclient init 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding auth protocol: cephx 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.779 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: crc 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:56:15.229+0000 7f3800815800 5 AuthRegistry(0x55a29c3f7570) adding con mode: secure 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:56:15.229+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:56:15.229+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key hook 0x55a29c3f76b8 2024-09-12T17:56:15.780 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c421210 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c421b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x7f37e8002340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:56:15.229+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.743913s 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c421210 auth_method 0 2024-09-12T17:56:15.781 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x7f37e8002340 auth_method 0 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:56:15.230+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.782 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient(hunting): handle_auth_done global_id 6485 payload 824 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:56:15.230+0000 7f37fc793640 1 monclient: found mon.noname-c 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:56:15.230+0000 7f37fc793640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: dump: 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.783 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:56:15.230+0000 7f36e3fff640 10 monclient: dump: 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:56:15.230+0000 7f3800815800 5 monclient: authenticate success, global_id 6485 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:56:15.230+0000 7f36e9e0b640 4 set_mon_vals no callback set 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:56:15.230+0000 7f3800815800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:56:15.230+0000 7f3800815800 1 librados: init done 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.785 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:56:15.232+0000 7f36e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:56:15.232+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f36e4076470 auth_method 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:56:15.232+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c41ee10 auth_method 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:56:15.233+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c4434f0 auth_method 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:56:15.235+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c448580 auth_method 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:56:15.235+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:56:15.235+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:56:15.235+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.786 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding auth protocol: cephx 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.787 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: crc 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:56:15.235+0000 7f3800815800 5 AuthRegistry(0x55a29c44c570) adding con mode: secure 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:56:15.236+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55a29c44fee0 EEXIST 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding auth protocol: cephx 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.788 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: crc 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:56:15.236+0000 7f3800815800 5 AuthRegistry(0x55a29c44b528) adding con mode: secure 2024-09-12T17:56:15.789 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:56:15.236+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:56:15.236+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x55a29c44b670 EEXIST 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c473bd0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.790 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c475ea0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c4723a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:56:15.236+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.750864s 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c473bd0 auth_method 0 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:56:15.236+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c475ea0 auth_method 0 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.791 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:56:15.236+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4723a0 auth_method 0 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:56:15.237+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.792 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:56:15.237+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient(hunting): handle_auth_done global_id 6870 payload 824 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:56:15.237+0000 7f37fbf92640 1 monclient: found mon.noname-a 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:56:15.237+0000 7f37fbf92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: dump: 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:56:15.237+0000 7f36e17fa640 10 monclient: dump: 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:56:15.237+0000 7f3800815800 5 monclient: authenticate success, global_id 6870 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:56:15.237+0000 7f37fcf94640 4 set_mon_vals no callback set 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:56:15.237+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.795 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:56:15.239+0000 7f36e17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:56:15.239+0000 7f37f3fff640 10 monclient: get_auth_request con 0x7f36d4076380 auth_method 0 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: get_monmap_and_config 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:56:15.239+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:56:15.239+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.796 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding auth protocol: cephx 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.797 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: crc 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:56:15.239+0000 7f3800815800 5 AuthRegistry(0x55a29c4939b0) adding con mode: secure 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding auth protocol: cephx 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.798 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: crc 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:56:15.240+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe42b0) adding con mode: secure 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:56:15.240+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:56:15.240+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x7ffe16fe43f8 EEXIST 2024-09-12T17:56:15.799 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c4c8030 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c497e40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c4c33f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:56:15.240+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.754667s 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c497e40 auth_method 0 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.800 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c4c8030 auth_method 0 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:56:15.240+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4c33f0 auth_method 0 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:56:15.240+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.801 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient(hunting): handle_auth_done global_id 6491 payload 274 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:56:15.240+0000 7f37fbf92640 1 monclient: found mon.noname-c 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:56:15.240+0000 7f37fbf92640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: dump: 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:56:15.241+0000 7f3800815800 5 monclient: authenticate success, global_id 6491 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:56:15.241+0000 7f36daffd640 10 monclient: dump: 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:56:15.241+0000 7f3800815800 4 set_mon_vals no callback set 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: shutdown 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: build_initial_monmap 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:56:15.241+0000 7f3800815800 1 build_initial for_mkfs: 0 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:56:15.241+0000 7f3800815800 10 monclient: monmap: 2024-09-12T17:56:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding auth protocol: cephx 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.805 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: crc 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:56:15.241+0000 7f3800815800 5 AuthRegistry(0x55a29c4ba2c0) adding con mode: secure 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: starting msgr at 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: starting objecter 2024-09-12T17:56:15.806 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:56:15.242+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command objecter_requests cmddesc objecter_requests hook 0x55a29c4c51f0 EEXIST 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: setting wanted keys 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:56:15.242+0000 7f3800815800 1 librados: calling monclient init 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: init 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding auth protocol: cephx 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.807 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: crc 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:56:15.242+0000 7f3800815800 5 AuthRegistry(0x55a29c48b980) adding con mode: secure 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:56:15.242+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:56:15.242+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command rotate-key cmddesc rotate-key hook 0x55a29c48bac8 EEXIST 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-b con 0x55a29c497e40 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-c con 0x55a29c4c33f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): picked mon.noname-a con 0x55a29c4c8030 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.808 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:56:15.242+0000 7f3800815800 10 monclient(hunting): authenticate will time out at 2048.756828s 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): get_auth_request con 0x55a29c4c33f0 auth_method 0 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): get_auth_request con 0x55a29c4c8030 auth_method 0 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:56:15.242+0000 7f37fc793640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.809 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:56:15.242+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:56:15.243+0000 7f37f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): get_auth_request con 0x55a29c497e40 auth_method 0 2024-09-12T17:56:15.810 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:15.811 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:15.811 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:56:15.243+0000 7f37fbf92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:15.811 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient(hunting): handle_auth_done global_id 6876 payload 824 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient: _finish_hunting 0 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:56:15.243+0000 7f37fc793640 1 monclient: found mon.noname-a 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:56:15.243+0000 7f37fc793640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: dump: 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: _finish_auth 0 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:56:15.243+0000 7f36d97fa640 10 monclient: dump: 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:56:15.243+0000 7f36daffd640 4 set_mon_vals no callback set 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:56:15.243+0000 7f3800815800 5 monclient: authenticate success, global_id 6876 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _renew_subs 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:56:15.243+0000 7f3800815800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:56:15.243+0000 7f3800815800 1 librados: init done 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:56:15.243+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cr dump hook 0x55a29c4bdfc8 2024-09-12T17:56:15.814 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:56:15.244+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:56:15.245+0000 7f36d97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:56:15.245+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f36c4076470 auth_method 0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:56:15.245+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c4e2450 auth_method 0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:56:15.246+0000 7f3800815800 20 realm 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:56:15.246+0000 7f3800815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:56:15.246+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.815 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:56:15.246+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c4e66b0 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:56:15.247+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:56:15.247+0000 7f3800815800 20 searching for the correct realm 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:56:15.248+0000 7f37f3fff640 10 monclient: get_auth_request con 0x55a29c4eb940 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:56:15.248+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4033520 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:56:15.449+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4033520 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:56:15.450+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f37e4033520 msgr2=0x7f37e4033960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:56:15.450+0000 7f36d97fa640 1 client.6876.objecter ms_handle_reset 0x7f37e4033520 session 0x7f37e4022e80 osd.7 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:56:15.450+0000 7f36d97fa640 10 monclient: _renew_subs 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:56:15.450+0000 7f36d97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:56:15.450+0000 7f37fbf92640 10 monclient: get_auth_request con 0x55a29c2a43c0 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:56:15.450+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f36c4086bf0 auth_method 0 2024-09-12T17:56:15.816 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:56:15.451+0000 7f37f3fff640 10 monclient: get_auth_request con 0x7f37ec0db070 auth_method 0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:56:15.453+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4053960 auth_method 0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:56:15.453+0000 7f37fc793640 0 -- 172.21.15.94:0/3781864031 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f37e4053960 msgr2=0x7f37e4040440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:56:15.654+0000 7f37fc793640 10 monclient: get_auth_request con 0x7f37e4053960 auth_method 0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:56:15.658+0000 7f37fbf92640 10 monclient: get_auth_request con 0x7f37e4031410 auth_method 0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:56:15.663+0000 7f3800815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.817 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:56:15.663+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:56:15.664+0000 7f3800815800 20 zone default found 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:56:15.664+0000 7f3800815800 4 Realm: () 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:56:15.664+0000 7f3800815800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:56:15.664+0000 7f3800815800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:56:15.664+0000 7f3800815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:56:15.664+0000 7f3800815800 20 zonegroup default 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.818 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:56:15.664+0000 7f3800815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:56:15.664+0000 7f3800815800 20 started sync module instance, tier type = 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:56:15.665+0000 7f3800815800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=0 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=1 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=2 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=3 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=4 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=5 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:56:15.674+0000 7f3800815800 20 add_watcher() i=6 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:56:15.675+0000 7f3800815800 20 add_watcher() i=7 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:56:15.675+0000 7f3800815800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.819 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding auth protocol: cephx 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.820 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: crc 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:56:15.677+0000 7f3800815800 5 AuthRegistry(0x7ffe16fe4780) adding con mode: secure 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:56:15.677+0000 7f36b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:56:15.677+0000 7f3800815800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:56:15.677+0000 7f3800815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache list hook 0x55a29c497790 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache inspect hook 0x55a29c497790 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache erase hook 0x55a29c497790 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command cache zap hook 0x55a29c497790 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:56:15.677+0000 7f3800815800 5 note: GC not initialized 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:56:15.677+0000 7f36b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:15.821 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace show hook 0x7f37e8003ab0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace history hook 0x7f37e8003ab0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace active hook 0x7f37e8003ab0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:56:15.677+0000 7f3800815800 5 asok(0x55a29c1d5730) register_command sync trace active_short hook 0x7f37e8003ab0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:56:15.677+0000 7f3800815800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:56:15.677+0000 7f3800815800 20 Filter name: none 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:56:15.678+0000 7f362a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:56:15.678+0000 7f3800815800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:56:15.678+0000 7f3800815800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : miss 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.822 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:56:15.678+0000 7f3800815800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:56:15.679+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:56:15.679+0000 7f3800815800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:56:15.679+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:56:15.679+0000 7f3800815800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:56:15.684+0000 7f3800815800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:56:15.684+0000 7f3800815800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:56:15.684+0000 7f3800815800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:56:15.684+0000 7f3800815800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529745 cookie 94156895484736 notifier 6876 bl.length()=939 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:56:15.685+0000 7f36da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.823 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:56:15.686+0000 7f3800815800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:56:15.687+0000 7f3800815800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3800815800 time 2024-09-12T17:56:15.687837+0000 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f380198c71a] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.824 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:56:15.688+0000 7f3800815800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3800815800 thread_name:radosgw-admin 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f380063e6f0] 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f380068b99c] 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f380198c774] 2024-09-12T17:56:15.825 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f380198c8d8] 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a29ab7c841] 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7489e) [0x55a29b08a89e] 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29ab8c50d] 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3800629590] 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:56:15.826 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:56:15.827 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:56:15.828 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:15.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:56:15.830 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:15.831 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:15.832 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f362a7fc640 / http_manager 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36b0fe1640 / http_manager 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36b1fe3640 / rgw_dt_lg_renew 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36d97fa640 / ms_dispatch 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36da7fc640 / io_context_pool 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36daffd640 / io_context_pool 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e17fa640 / ms_dispatch 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e3fff640 / ms_dispatch 2024-09-12T17:56:15.833 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36e9e0b640 / io_context_pool 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37f3fff640 / msgr-worker-2 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fbf92640 / msgr-worker-1 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fc793640 / msgr-worker-0 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7f37fcf94640 / io_context_pool 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3800815800 / radosgw-admin 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:56:15.689652Z_00d1be98-e7c0-4aac-8cfd-b18a3eb2639c/log 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:56:15.834 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.773+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.774+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.774+0000 7f001f91f800 20 realm 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.774+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.775+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.775+0000 7f001f91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.775+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.775+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.775+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.776+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.776+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.776+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.776+0000 7f001f91f800 20 searching for the correct realm 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.780+0000 7f001aea1640 0 -- 172.21.15.94:0/1926677385 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x556838373ec0 msgr2=0x5568383762b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.784+0000 7f001aea1640 0 -- 172.21.15.94:0/1926677385 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f000c078040 msgr2=0x7f000c061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.788+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 zone default found 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 4 Realm: () 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 zonegroup default 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.789+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.790+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.790+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.790+0000 7f001f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.790+0000 7f001f91f800 20 started sync module instance, tier type = 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.790+0000 7f001f91f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=0 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=1 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=2 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=3 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=4 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=5 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.799+0000 7f001f91f800 20 add_watcher() i=6 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.800+0000 7f001f91f800 20 add_watcher() i=7 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.800+0000 7f001f91f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.801+0000 7efed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7f001f91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7f001f91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7f001f91f800 5 note: GC not initialized 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7efed0fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7f001f91f800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7f001f91f800 20 Filter name: none 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.802+0000 7efe4a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.803+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.803+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.803+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.805+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.805+0000 7f001f91f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.805+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.806+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.806+0000 7f001f91f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.807+0000 7f001f91f800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.807+0000 7f001f91f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.809+0000 7efed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.811+0000 7f001f91f800 20 remove_watcher() i=0 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.811+0000 7f001f91f800 2 removed watcher, disabling cache 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.812+0000 7f001f91f800 20 remove_watcher() i=1 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.813+0000 7f001f91f800 20 remove_watcher() i=2 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.814+0000 7f001f91f800 20 remove_watcher() i=3 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.816+0000 7f001f91f800 20 remove_watcher() i=4 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.817+0000 7f001f91f800 20 remove_watcher() i=5 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.818+0000 7f001f91f800 20 remove_watcher() i=6 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:15.819+0000 7f001f91f800 20 remove_watcher() i=7 2024-09-12T17:56:15.845 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.846 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:15.846 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:15.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:15.928 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:15.966 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.966 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:16.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.007+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 20 realm 2024-09-12T17:56:16.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:16.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.008+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.009+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.009+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.009+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.010+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.010+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:16.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.010+0000 7efdc532c800 20 searching for the correct realm 2024-09-12T17:56:16.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.013+0000 7efdbbfff640 0 -- 172.21.15.94:0/650566579 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55db25b224d0 msgr2=0x55db25b24990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:16.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.017+0000 7efdc0f3e640 0 -- 172.21.15.94:0/650566579 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7efdac0d3110 msgr2=0x7efdac0aeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.021+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:16.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 zone default found 2024-09-12T17:56:16.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 4 Realm: () 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 zonegroup default 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.022+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.023+0000 7efdc532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.023+0000 7efdc532c800 20 started sync module instance, tier type = 2024-09-12T17:56:16.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.023+0000 7efdc532c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:16.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=0 2024-09-12T17:56:16.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=1 2024-09-12T17:56:16.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=2 2024-09-12T17:56:16.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=3 2024-09-12T17:56:16.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=4 2024-09-12T17:56:16.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.033+0000 7efdc532c800 20 add_watcher() i=5 2024-09-12T17:56:16.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.034+0000 7efdc532c800 20 add_watcher() i=6 2024-09-12T17:56:16.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.035+0000 7efdc532c800 20 add_watcher() i=7 2024-09-12T17:56:16.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.035+0000 7efdc532c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:16.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.037+0000 7efc76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.037+0000 7efdc532c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.037+0000 7efdc532c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.037+0000 7efdc532c800 5 note: GC not initialized 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efc75fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efdc532c800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efdc532c800 20 Filter name: none 2024-09-12T17:56:16.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efbe77fe640 20 reqs_thread_entry: start 2024-09-12T17:56:16.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efdc532c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:56:16.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.038+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:16.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:16.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:16.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : miss 2024-09-12T17:56:16.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.039+0000 7efdc532c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.040+0000 7efdc532c800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to be held by another RGW process; skipping for now 2024-09-12T17:56:16.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.041+0000 7efc76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.043+0000 7efdc532c800 20 remove_watcher() i=0 2024-09-12T17:56:16.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.043+0000 7efdc532c800 2 removed watcher, disabling cache 2024-09-12T17:56:16.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.044+0000 7efdc532c800 20 remove_watcher() i=1 2024-09-12T17:56:16.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.045+0000 7efdc532c800 20 remove_watcher() i=2 2024-09-12T17:56:16.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.046+0000 7efdc532c800 20 remove_watcher() i=3 2024-09-12T17:56:16.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.047+0000 7efdc532c800 20 remove_watcher() i=4 2024-09-12T17:56:16.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.049+0000 7efdc532c800 20 remove_watcher() i=5 2024-09-12T17:56:16.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.050+0000 7efdc532c800 20 remove_watcher() i=6 2024-09-12T17:56:16.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:16.051+0000 7efdc532c800 20 remove_watcher() i=7 2024-09-12T17:56:16.064 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:56:46.097 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:46.133 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:46.133 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:46.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.174+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.175+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.175+0000 7fabc4e13800 20 realm 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.175+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.175+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.175+0000 7fabc4e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.176+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.176+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.176+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.177+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:46.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.177+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.177+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:46.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.177+0000 7fabc4e13800 20 searching for the correct realm 2024-09-12T17:56:46.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.182+0000 7fabc0d49640 0 -- 172.21.15.94:0/2847251127 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7faba805c4a0 msgr2=0x7faba80860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:46.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.388+0000 7fabc0548640 0 -- 172.21.15.94:0/2847251127 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x5644430656e0 msgr2=0x564443067b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.391+0000 7fabc4e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 zone default found 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 4 Realm: () 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 zonegroup default 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.392+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 started sync module instance, tier type = 2024-09-12T17:56:46.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.393+0000 7fabc4e13800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:46.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=0 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=1 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=2 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=3 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=4 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=5 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.403+0000 7fabc4e13800 20 add_watcher() i=6 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.405+0000 7fabc4e13800 20 add_watcher() i=7 2024-09-12T17:56:46.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.405+0000 7fabc4e13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:46.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.406+0000 7faa76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:46.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:46.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:46.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 5 note: GC not initialized 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7faa75fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 20 Filter name: none 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.407+0000 7faa6effd640 20 reqs_thread_entry: start 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : miss 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:46.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.408+0000 7fabc4e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:46.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.410+0000 7fabc4e13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:56:46.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.419+0000 7fabc4e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.419+0000 7fabc4e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.419+0000 7fabc4e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.419+0000 7fabc4e13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:46.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.420+0000 7faa9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529746 cookie 94851182289952 notifier 6933 bl.length()=939 2024-09-12T17:56:46.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.420+0000 7faa9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.420+0000 7faa9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.420+0000 7faa9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.421+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:46.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.421+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:46.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.421+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:46.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.421+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:46.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.0 2024-09-12T17:56:46.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.0 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.1 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.1 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.2 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.2 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.3 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.3 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.4 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.4 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.5 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.5 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.6 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.6 2024-09-12T17:56:46.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.7 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.7 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.8 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.8 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.9 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.9 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.10 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.10 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.11 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2.11 2024-09-12T17:56:46.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.427+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.0 2024-09-12T17:56:46.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.428+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.1 2024-09-12T17:56:46.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.428+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2 2024-09-12T17:56:46.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.429+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.3 2024-09-12T17:56:46.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.430+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.4 2024-09-12T17:56:46.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.430+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.5 2024-09-12T17:56:46.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.431+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.6 2024-09-12T17:56:46.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.431+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.7 2024-09-12T17:56:46.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.432+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.8 2024-09-12T17:56:46.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.432+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.9 2024-09-12T17:56:46.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.432+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.10 2024-09-12T17:56:46.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.436+0000 7fabc4e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:46.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.436+0000 7fabc4e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:46.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.437+0000 7fabc4e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.437+0000 7fabc4e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.437+0000 7fabc4e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.437+0000 7fabc4e13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.438+0000 7faa9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94851182289952 notifier 6933 bl.length()=939 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.438+0000 7faa9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.438+0000 7faa9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.438+0000 7faa9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.439+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:46.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.439+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:46.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.439+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:46.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.439+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:46.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.442+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.0 2024-09-12T17:56:46.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.442+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.1 2024-09-12T17:56:46.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.442+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.2 2024-09-12T17:56:46.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.443+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.3 2024-09-12T17:56:46.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.443+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.4 2024-09-12T17:56:46.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.443+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.5 2024-09-12T17:56:46.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.444+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.6 2024-09-12T17:56:46.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.444+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.7 2024-09-12T17:56:46.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.445+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.8 2024-09-12T17:56:46.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.445+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.9 2024-09-12T17:56:46.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.445+0000 7fabc4e13800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27.10 2024-09-12T17:56:46.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.446+0000 7fabc4e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:46.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.446+0000 7fabc4e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 2024-09-12T17:56:46.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.447+0000 7fabc4e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.447+0000 7fabc4e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.447+0000 7fabc4e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.447+0000 7fabc4e13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27, ofs0, ns] 2024-09-12T17:56:46.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.448+0000 7faa9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529748 cookie 94851182289952 notifier 6933 bl.length()=907 2024-09-12T17:56:46.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.448+0000 7faa9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 info.flags=0x17 2024-09-12T17:56:46.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.448+0000 7faa9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 to cache LRU end 2024-09-12T17:56:46.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.448+0000 7faa9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:46.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.449+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_sources= new_sources= 2024-09-12T17:56:46.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.449+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential sources added=[] removed=[] 2024-09-12T17:56:46.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.449+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): orig_dests= new_dests= 2024-09-12T17:56:46.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.449+0000 7fabc4e13800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27]): potential dests added=[] removed=[] 2024-09-12T17:56:46.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.452+0000 7fabc4e13800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:46.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.454+0000 7faa76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:46.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.456+0000 7fabc4e13800 20 remove_watcher() i=0 2024-09-12T17:56:46.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.456+0000 7fabc4e13800 2 removed watcher, disabling cache 2024-09-12T17:56:46.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.457+0000 7fabc4e13800 20 remove_watcher() i=1 2024-09-12T17:56:46.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.458+0000 7fabc4e13800 20 remove_watcher() i=2 2024-09-12T17:56:46.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.459+0000 7fabc4e13800 20 remove_watcher() i=3 2024-09-12T17:56:46.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.460+0000 7fabc4e13800 20 remove_watcher() i=4 2024-09-12T17:56:46.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.461+0000 7fabc4e13800 20 remove_watcher() i=5 2024-09-12T17:56:46.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.462+0000 7fabc4e13800 20 remove_watcher() i=6 2024-09-12T17:56:46.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.463+0000 7fabc4e13800 20 remove_watcher() i=7 2024-09-12T17:56:46.477 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:56:46.506 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:46.506 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:46.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.541+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 realm 2024-09-12T17:56:46.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:46.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.543+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.544+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:46.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.544+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.544+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:46.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.544+0000 7f8ac1140800 20 searching for the correct realm 2024-09-12T17:56:46.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.548+0000 7f8abd6c1640 0 -- 172.21.15.94:0/448639907 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5600f6ee9710 msgr2=0x5600f6eebb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:46.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.551+0000 7f8abcec0640 0 -- 172.21.15.94:0/448639907 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8aa406d070 msgr2=0x7f8aa4088930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:46.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:46.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:46.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:46.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:46.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:46.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:46.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.555+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:46.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 zone default found 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 4 Realm: () 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 zonegroup default 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.556+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:46.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 started sync module instance, tier type = 2024-09-12T17:56:46.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.557+0000 7f8ac1140800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=0 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=1 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=2 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=3 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=4 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=5 2024-09-12T17:56:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.566+0000 7f8ac1140800 20 add_watcher() i=6 2024-09-12T17:56:46.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.567+0000 7f8ac1140800 20 add_watcher() i=7 2024-09-12T17:56:46.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.567+0000 7f8ac1140800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:46.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.568+0000 7f8972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:46.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:46.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 5 note: GC not initialized 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8971fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 Filter name: none 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f88e37fe640 20 reqs_thread_entry: start 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:46.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.569+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.570+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.570+0000 7f8ac1140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.570+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.571+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.571+0000 7f8ac1140800 20 rados->read ofs=0 len=0 2024-09-12T17:56:46.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.571+0000 7f8ac1140800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:46.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.571+0000 7f8ac1140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:46.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.573+0000 7f8972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:46.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.575+0000 7f8ac1140800 20 remove_watcher() i=0 2024-09-12T17:56:46.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.575+0000 7f8ac1140800 2 removed watcher, disabling cache 2024-09-12T17:56:46.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.576+0000 7f8ac1140800 20 remove_watcher() i=1 2024-09-12T17:56:46.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.577+0000 7f8ac1140800 20 remove_watcher() i=2 2024-09-12T17:56:46.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.579+0000 7f8ac1140800 20 remove_watcher() i=3 2024-09-12T17:56:46.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.579+0000 7f8ac1140800 20 remove_watcher() i=4 2024-09-12T17:56:46.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.580+0000 7f8ac1140800 20 remove_watcher() i=5 2024-09-12T17:56:46.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.581+0000 7f8ac1140800 20 remove_watcher() i=6 2024-09-12T17:56:46.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:46.582+0000 7f8ac1140800 20 remove_watcher() i=7 2024-09-12T17:56:46.593 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:46.594 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:46.594 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:46.594 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:46.960 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:56:46.960 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:47.767 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:56:47.796 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:47.796 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:47.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.831+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 20 realm 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.832+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.833+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:47.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.833+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:47.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.833+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:47.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.833+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:47.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.834+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:47.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.834+0000 7fab73930800 20 searching for the correct realm 2024-09-12T17:56:47.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.837+0000 7fab6feb1640 0 -- 172.21.15.94:0/1764715814 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fab58035060 msgr2=0x7fab58081ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:47.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:47.840+0000 7fab6f6b0640 0 -- 172.21.15.94:0/1764715814 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fab5800c9c0 msgr2=0x7fab5806d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.046+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.047+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.047+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 zone default found 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 4 Realm: () 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 zonegroup default 2024-09-12T17:56:48.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.048+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.049+0000 7fab73930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.049+0000 7fab73930800 20 started sync module instance, tier type = 2024-09-12T17:56:48.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.049+0000 7fab73930800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=0 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=1 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=2 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=3 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=4 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=5 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.057+0000 7fab73930800 20 add_watcher() i=6 2024-09-12T17:56:48.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.058+0000 7fab73930800 20 add_watcher() i=7 2024-09-12T17:56:48.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.058+0000 7fab73930800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:48.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.059+0000 7faa25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.059+0000 7fab73930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.059+0000 7fab73930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:48.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.059+0000 7fab73930800 5 note: GC not initialized 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.060+0000 7faa24fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.060+0000 7fab73930800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.060+0000 7fab73930800 20 Filter name: none 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.060+0000 7fa99e7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.060+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.061+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.061+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.061+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.061+0000 7fab73930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.061+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.062+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.062+0000 7fab73930800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.062+0000 7fab73930800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:48.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.062+0000 7fab73930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:48.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.064+0000 7faa25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.066+0000 7fab73930800 20 remove_watcher() i=0 2024-09-12T17:56:48.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.066+0000 7fab73930800 2 removed watcher, disabling cache 2024-09-12T17:56:48.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.067+0000 7fab73930800 20 remove_watcher() i=1 2024-09-12T17:56:48.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.068+0000 7fab73930800 20 remove_watcher() i=2 2024-09-12T17:56:48.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.069+0000 7fab73930800 20 remove_watcher() i=3 2024-09-12T17:56:48.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.070+0000 7fab73930800 20 remove_watcher() i=4 2024-09-12T17:56:48.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.071+0000 7fab73930800 20 remove_watcher() i=5 2024-09-12T17:56:48.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.071+0000 7fab73930800 20 remove_watcher() i=6 2024-09-12T17:56:48.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.072+0000 7fab73930800 20 remove_watcher() i=7 2024-09-12T17:56:48.084 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:48.084 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:48.084 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:48.084 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:48.085 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:56:48.119 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:48.119 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:48.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.356+0000 7f9e846de640 0 --2- 172.21.15.94:0/1927823586 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564bc87256a0 0x564bc872fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:56:48.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.359+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 realm 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.360+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.361+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:48.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.361+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.361+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:48.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.361+0000 7f9e8812e800 20 searching for the correct realm 2024-09-12T17:56:48.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.363+0000 7f9e83edd640 0 -- 172.21.15.94:0/1927823586 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f9e7c061980 msgr2=0x7f9e7c096940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:48.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.568+0000 7f9e846de640 0 -- 172.21.15.94:0/1927823586 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f9e6c01f030 msgr2=0x7f9e6c067150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.573+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 zone default found 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 4 Realm: () 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 zonegroup default 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 started sync module instance, tier type = 2024-09-12T17:56:48.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.574+0000 7f9e8812e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=0 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=1 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=2 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=3 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=4 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=5 2024-09-12T17:56:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.584+0000 7f9e8812e800 20 add_watcher() i=6 2024-09-12T17:56:48.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.585+0000 7f9e8812e800 20 add_watcher() i=7 2024-09-12T17:56:48.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.585+0000 7f9e8812e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:48.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.586+0000 7f9d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.586+0000 7f9e8812e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.586+0000 7f9e8812e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 5 note: GC not initialized 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9d38fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 20 Filter name: none 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9cb27fc640 20 reqs_thread_entry: start 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:56:48.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : miss 2024-09-12T17:56:48.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.587+0000 7f9e8812e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:48.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:48.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.588+0000 7f9e8812e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:48.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9e8812e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9e8812e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9e8812e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9e8812e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:48.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9d62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 94883485619360 notifier 6990 bl.length()=915 2024-09-12T17:56:48.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9d62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9d62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.593+0000 7f9d62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.595+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:48.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.595+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:48.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.595+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:48.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.595+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.0 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.0 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.1 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.1 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.2 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.2 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.3 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.3 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.4 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.4 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.5 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.5 2024-09-12T17:56:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.6 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.6 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.7 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.7 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.8 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.8 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.9 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.9 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.10 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.10 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.11 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.11 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.599+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.0 2024-09-12T17:56:48.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.600+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1 2024-09-12T17:56:48.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.600+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.2 2024-09-12T17:56:48.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.601+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.3 2024-09-12T17:56:48.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.601+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.4 2024-09-12T17:56:48.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.602+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.5 2024-09-12T17:56:48.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.602+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.6 2024-09-12T17:56:48.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.603+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.7 2024-09-12T17:56:48.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.603+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.8 2024-09-12T17:56:48.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.604+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.9 2024-09-12T17:56:48.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.604+0000 7f9e8812e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.10 2024-09-12T17:56:48.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.607+0000 7f9e8812e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:48.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.607+0000 7f9e8812e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:48.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9e8812e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9e8812e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9e8812e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9e8812e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:48.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9d62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 94883485619360 notifier 6990 bl.length()=915 2024-09-12T17:56:48.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9d62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9d62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.608+0000 7f9d62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:48.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:48.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:48.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:48.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:56:48.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.610+0000 7f9e8812e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:56:48.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.614+0000 7f9e8812e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:48.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.614+0000 7f9e8812e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:48.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.615+0000 7f9e8812e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.615+0000 7f9e8812e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.615+0000 7f9e8812e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.615+0000 7f9e8812e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.616+0000 7f9d627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94883485619360 notifier 6990 bl.length()=883 2024-09-12T17:56:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.616+0000 7f9d627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.616+0000 7f9d627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:48.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.616+0000 7f9d627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.617+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.617+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.617+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:48.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.617+0000 7f9e8812e800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:48.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.619+0000 7f9e8812e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:56:48.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.621+0000 7f9d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.623+0000 7f9e8812e800 20 remove_watcher() i=0 2024-09-12T17:56:48.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.623+0000 7f9e8812e800 2 removed watcher, disabling cache 2024-09-12T17:56:48.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.624+0000 7f9e8812e800 20 remove_watcher() i=1 2024-09-12T17:56:48.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.625+0000 7f9e8812e800 20 remove_watcher() i=2 2024-09-12T17:56:48.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.626+0000 7f9e8812e800 20 remove_watcher() i=3 2024-09-12T17:56:48.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.627+0000 7f9e8812e800 20 remove_watcher() i=4 2024-09-12T17:56:48.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.627+0000 7f9e8812e800 20 remove_watcher() i=5 2024-09-12T17:56:48.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.628+0000 7f9e8812e800 20 remove_watcher() i=6 2024-09-12T17:56:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.629+0000 7f9e8812e800 20 remove_watcher() i=7 2024-09-12T17:56:48.643 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:56:48.672 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:48.672 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:48.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.707+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 realm 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.709+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.710+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:48.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.710+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.710+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:48.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.710+0000 7f33b7c98800 20 searching for the correct realm 2024-09-12T17:56:48.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.713+0000 7f33acf88640 0 -- 172.21.15.94:0/1418380402 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f33a804d760 msgr2=0x7f33a806c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:48.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.716+0000 7f33b5789640 0 -- 172.21.15.94:0/1418380402 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f33a0068440 msgr2=0x7f33a0019700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:48.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:48.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:48.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:48.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:48.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:48.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:48.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.923+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:48.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 zone default found 2024-09-12T17:56:48.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 4 Realm: () 2024-09-12T17:56:48.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:48.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:48.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:48.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 zonegroup default 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.924+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.925+0000 7f33b7c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:48.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.925+0000 7f33b7c98800 20 started sync module instance, tier type = 2024-09-12T17:56:48.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.925+0000 7f33b7c98800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=0 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=1 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=2 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=3 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=4 2024-09-12T17:56:48.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=5 2024-09-12T17:56:48.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.933+0000 7f33b7c98800 20 add_watcher() i=6 2024-09-12T17:56:48.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.934+0000 7f33b7c98800 20 add_watcher() i=7 2024-09-12T17:56:48.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.934+0000 7f33b7c98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:48.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f326bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f33b7c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f33b7c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f33b7c98800 5 note: GC not initialized 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f326afe5640 20 reqs_thread_entry: start 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.936+0000 7f33b7c98800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.937+0000 7f33b7c98800 20 Filter name: none 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.937+0000 7f3268fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.937+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.937+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:48.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.937+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.938+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:48.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.938+0000 7f33b7c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:48.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.938+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.938+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:48.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.938+0000 7f33b7c98800 20 rados->read ofs=0 len=0 2024-09-12T17:56:48.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.939+0000 7f33b7c98800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:48.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.939+0000 7f33b7c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:48.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.941+0000 7f326bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.943+0000 7f33b7c98800 20 remove_watcher() i=0 2024-09-12T17:56:48.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.943+0000 7f33b7c98800 2 removed watcher, disabling cache 2024-09-12T17:56:48.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.944+0000 7f33b7c98800 20 remove_watcher() i=1 2024-09-12T17:56:48.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.945+0000 7f33b7c98800 20 remove_watcher() i=2 2024-09-12T17:56:48.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.947+0000 7f33b7c98800 20 remove_watcher() i=3 2024-09-12T17:56:48.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.948+0000 7f33b7c98800 20 remove_watcher() i=4 2024-09-12T17:56:48.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.949+0000 7f33b7c98800 20 remove_watcher() i=5 2024-09-12T17:56:48.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.950+0000 7f33b7c98800 20 remove_watcher() i=6 2024-09-12T17:56:48.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:48.951+0000 7f33b7c98800 20 remove_watcher() i=7 2024-09-12T17:56:48.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:48.962 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:48.962 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:48.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:49.083 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:49.084 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:49.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.118+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 realm 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.120+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.121+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.121+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.121+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:49.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.121+0000 7f5d03616800 20 searching for the correct realm 2024-09-12T17:56:49.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.125+0000 7f5cf65e6640 0 -- 172.21.15.94:0/1341773378 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x555f211bc0e0 msgr2=0x555f211be5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.128+0000 7f5cfede7640 0 -- 172.21.15.94:0/1341773378 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f5ce803a3a0 msgr2=0x7f5ce803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:49.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.132+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 zone default found 2024-09-12T17:56:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 4 Realm: () 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 zonegroup default 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.133+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.134+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.134+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.134+0000 7f5d03616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.134+0000 7f5d03616800 20 started sync module instance, tier type = 2024-09-12T17:56:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.134+0000 7f5d03616800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:49.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=0 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=1 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=2 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=3 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=4 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=5 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.142+0000 7f5d03616800 20 add_watcher() i=6 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.143+0000 7f5d03616800 20 add_watcher() i=7 2024-09-12T17:56:49.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.143+0000 7f5d03616800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.145+0000 7f5bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 5 note: GC not initialized 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5b2ffff640 20 reqs_thread_entry: start 2024-09-12T17:56:49.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:49.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 Filter name: none 2024-09-12T17:56:49.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5b2dffb640 20 reqs_thread_entry: start 2024-09-12T17:56:49.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:56:49.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : miss 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.146+0000 7f5d03616800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.147+0000 7f5d03616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:49.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.151+0000 7f5d03616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.151+0000 7f5d03616800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.151+0000 7f5d03616800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.151+0000 7f5d03616800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.152+0000 7f5be1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529708 cookie 93867065738448 notifier 6629 bl.length()=915 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.152+0000 7f5be1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.152+0000 7f5be1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.152+0000 7f5be1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.153+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:49.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.153+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:49.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.153+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:49.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.153+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:49.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.0 2024-09-12T17:56:49.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.0 2024-09-12T17:56:49.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.1 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.1 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.2 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.2 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.3 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.3 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.4 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.4 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.5 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.5 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.6 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.6 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.7 2024-09-12T17:56:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.7 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.8 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.8 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.9 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.9 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.10 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.10 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.11 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1.11 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.0 2024-09-12T17:56:49.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.158+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.159+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.2 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.159+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.3 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.160+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.4 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.160+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.5 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.161+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.6 2024-09-12T17:56:49.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.161+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.7 2024-09-12T17:56:49.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.162+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.8 2024-09-12T17:56:49.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.162+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.9 2024-09-12T17:56:49.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.162+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.10 2024-09-12T17:56:49.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.165+0000 7f5d03616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:49.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.165+0000 7f5d03616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5d03616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5d03616800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5d03616800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5d03616800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5be27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529709 cookie 93867065738448 notifier 6629 bl.length()=915 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5be27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5be27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.167+0000 7f5be27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.169+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:49.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.169+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:49.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.169+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:49.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.169+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:49.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.171+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.0 2024-09-12T17:56:49.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.171+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.1 2024-09-12T17:56:49.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.171+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.2 2024-09-12T17:56:49.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.172+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.3 2024-09-12T17:56:49.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.172+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.4 2024-09-12T17:56:49.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.172+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.5 2024-09-12T17:56:49.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.173+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.6 2024-09-12T17:56:49.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.173+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.7 2024-09-12T17:56:49.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.173+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.8 2024-09-12T17:56:49.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.173+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.9 2024-09-12T17:56:49.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.174+0000 7f5d03616800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28.10 2024-09-12T17:56:49.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.174+0000 7f5d03616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:49.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.174+0000 7f5d03616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5d03616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5d03616800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5d03616800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5d03616800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28, ofs0, ns] 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5be1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529710 cookie 93867065738448 notifier 6629 bl.length()=883 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5be1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 info.flags=0x17 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5be1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 to cache LRU end 2024-09-12T17:56:49.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.176+0000 7f5be1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.177+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_sources= new_sources= 2024-09-12T17:56:49.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.177+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential sources added=[] removed=[] 2024-09-12T17:56:49.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.177+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): orig_dests= new_dests= 2024-09-12T17:56:49.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.177+0000 7f5d03616800 20 handle_bi_update(): bucket=:error-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28]): potential dests added=[] removed=[] 2024-09-12T17:56:49.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.179+0000 7f5d03616800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:49.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.181+0000 7f5bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.183+0000 7f5d03616800 20 remove_watcher() i=0 2024-09-12T17:56:49.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.183+0000 7f5d03616800 2 removed watcher, disabling cache 2024-09-12T17:56:49.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.184+0000 7f5d03616800 20 remove_watcher() i=1 2024-09-12T17:56:49.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.186+0000 7f5d03616800 20 remove_watcher() i=2 2024-09-12T17:56:49.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.187+0000 7f5d03616800 20 remove_watcher() i=3 2024-09-12T17:56:49.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.187+0000 7f5d03616800 20 remove_watcher() i=4 2024-09-12T17:56:49.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.188+0000 7f5d03616800 20 remove_watcher() i=5 2024-09-12T17:56:49.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.189+0000 7f5d03616800 20 remove_watcher() i=6 2024-09-12T17:56:49.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.190+0000 7f5d03616800 20 remove_watcher() i=7 2024-09-12T17:56:49.203 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:56:49.232 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:49.232 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:49.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.267+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.268+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.268+0000 7f95e1975800 20 realm 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.268+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.268+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.268+0000 7f95e1975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.269+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.269+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.269+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.269+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.269+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.270+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:49.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.270+0000 7f95e1975800 20 searching for the correct realm 2024-09-12T17:56:49.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.273+0000 7f95d6c5e640 0 -- 172.21.15.94:0/1187949055 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f95d0018070 msgr2=0x7f95d0088590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.276+0000 7f95dfc60640 0 -- 172.21.15.94:0/1187949055 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f95c806d040 msgr2=0x7f95c8084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.280+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 zone default found 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 4 Realm: () 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 zonegroup default 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.281+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.282+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.282+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.282+0000 7f95e1975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.282+0000 7f95e1975800 20 started sync module instance, tier type = 2024-09-12T17:56:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.282+0000 7f95e1975800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=0 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=1 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=2 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=3 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=4 2024-09-12T17:56:49.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=5 2024-09-12T17:56:49.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.290+0000 7f95e1975800 20 add_watcher() i=6 2024-09-12T17:56:49.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.291+0000 7f95e1975800 20 add_watcher() i=7 2024-09-12T17:56:49.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.291+0000 7f95e1975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.292+0000 7f9495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 5 note: GC not initialized 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f9494fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 20 Filter name: none 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f940e7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.293+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.294+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:49.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.294+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.295+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.295+0000 7f95e1975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.295+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.295+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.295+0000 7f95e1975800 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.296+0000 7f95e1975800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.296+0000 7f95e1975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:49.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.298+0000 7f9495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.300+0000 7f95e1975800 20 remove_watcher() i=0 2024-09-12T17:56:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.300+0000 7f95e1975800 2 removed watcher, disabling cache 2024-09-12T17:56:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.301+0000 7f95e1975800 20 remove_watcher() i=1 2024-09-12T17:56:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.302+0000 7f95e1975800 20 remove_watcher() i=2 2024-09-12T17:56:49.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.303+0000 7f95e1975800 20 remove_watcher() i=3 2024-09-12T17:56:49.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.304+0000 7f95e1975800 20 remove_watcher() i=4 2024-09-12T17:56:49.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.305+0000 7f95e1975800 20 remove_watcher() i=5 2024-09-12T17:56:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.306+0000 7f95e1975800 20 remove_watcher() i=6 2024-09-12T17:56:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:49.306+0000 7f95e1975800 20 remove_watcher() i=7 2024-09-12T17:56:49.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:49.318 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:49.318 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:49.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:49.676 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:56:49.676 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.486 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:56:50.515 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:50.515 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:50.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.549+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 realm 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:50.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.551+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.552+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:50.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.552+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.552+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:50.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.552+0000 7f2845a13800 20 searching for the correct realm 2024-09-12T17:56:50.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.555+0000 7f2840947640 0 -- 172.21.15.94:0/2579899846 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55f52336c620 msgr2=0x55f52336ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:50.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.559+0000 7f2841148640 0 -- 172.21.15.94:0/2579899846 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2838018930 msgr2=0x7f28380153c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:50.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.563+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 zone default found 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 4 Realm: () 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 zonegroup default 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 started sync module instance, tier type = 2024-09-12T17:56:50.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.564+0000 7f2845a13800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=0 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=1 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=2 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=3 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=4 2024-09-12T17:56:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=5 2024-09-12T17:56:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.572+0000 7f2845a13800 20 add_watcher() i=6 2024-09-12T17:56:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.573+0000 7f2845a13800 20 add_watcher() i=7 2024-09-12T17:56:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.573+0000 7f2845a13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:50.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f26f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:50.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f2845a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:50.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f2845a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:50.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f2845a13800 5 note: GC not initialized 2024-09-12T17:56:50.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f26f67e4640 20 reqs_thread_entry: start 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f2845a13800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.575+0000 7f2845a13800 20 Filter name: none 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.576+0000 7f2667fff640 20 reqs_thread_entry: start 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.576+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.576+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:50.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.576+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.577+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:50.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.577+0000 7f2845a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:50.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.577+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.577+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:50.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.577+0000 7f2845a13800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.578+0000 7f2845a13800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:50.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.578+0000 7f2845a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:50.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.579+0000 7f26f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:50.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.581+0000 7f2845a13800 20 remove_watcher() i=0 2024-09-12T17:56:50.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.581+0000 7f2845a13800 2 removed watcher, disabling cache 2024-09-12T17:56:50.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.582+0000 7f2845a13800 20 remove_watcher() i=1 2024-09-12T17:56:50.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.583+0000 7f2845a13800 20 remove_watcher() i=2 2024-09-12T17:56:50.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.584+0000 7f2845a13800 20 remove_watcher() i=3 2024-09-12T17:56:50.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.585+0000 7f2845a13800 20 remove_watcher() i=4 2024-09-12T17:56:50.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.586+0000 7f2845a13800 20 remove_watcher() i=5 2024-09-12T17:56:50.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.587+0000 7f2845a13800 20 remove_watcher() i=6 2024-09-12T17:56:50.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.588+0000 7f2845a13800 20 remove_watcher() i=7 2024-09-12T17:56:50.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.599 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:50.599 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:50.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.600 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:56:50.634 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:50.635 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:50.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.670+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 realm 2024-09-12T17:56:50.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.673+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:50.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.673+0000 7f3888926800 20 searching for the correct realm 2024-09-12T17:56:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.676+0000 7f3884dda640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f3874037070 msgr2=0x7f3874039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.680+0000 7f38845d9640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f387405c920 msgr2=0x7f3874046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:50.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:50.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:50.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:50.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 zone default found 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 4 Realm: () 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 zonegroup default 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.889+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:50.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.889+0000 7f3888926800 20 started sync module instance, tier type = 2024-09-12T17:56:50.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.889+0000 7f3888926800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=0 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=1 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=2 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=3 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=4 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=5 2024-09-12T17:56:50.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=6 2024-09-12T17:56:50.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.898+0000 7f3888926800 20 add_watcher() i=7 2024-09-12T17:56:50.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.898+0000 7f3888926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:50.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f373afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:50.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:50.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:50.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3888926800 5 note: GC not initialized 2024-09-12T17:56:50.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3739fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:50.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3888926800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:50.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.900+0000 7f3888926800 20 Filter name: none 2024-09-12T17:56:50.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f36ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:50.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:56:50.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:50.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:56:50.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:56:50.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : miss 2024-09-12T17:56:50.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:50.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:50.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:50.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:50.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:50.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.901+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:50.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:50.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:50.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:50.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:50.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:50.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:50.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:50.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:50.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:50.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:50.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:50.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:50.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:50.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:50.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:50.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:50.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.0 2024-09-12T17:56:50.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1 2024-09-12T17:56:50.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.3 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.4 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.5 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.6 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.7 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.8 2024-09-12T17:56:50.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.9 2024-09-12T17:56:50.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.10 2024-09-12T17:56:50.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.921+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:50.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.921+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:50.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:50.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:50.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:50.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:50.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:50.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:50.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:50.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:50.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:50.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:50.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:50.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:50.926 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3888926800 time 2024-09-12T17:56:50.926074+0000 2024-09-12T17:56:50.927 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:50.954 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:50.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3889f8c71a] 2024-09-12T17:56:50.955 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:50.955 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:50.955 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:50.955 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:50.955 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.925+0000 7f3888926800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3888926800 time 2024-09-12T17:56:50.926074+0000 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:50.956 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3889f8c71a] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:50.957 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3888926800 thread_name:radosgw-admin 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3888c3e6f0] 2024-09-12T17:56:50.958 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3888c8b99c] 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3889f8c774] 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:50.959 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:50.926+0000 7f3888926800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3888926800 thread_name:radosgw-admin 2024-09-12T17:56:50.960 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3888c3e6f0] 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3888c8b99c] 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3889f8c774] 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:50.961 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:50.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:56:50.654+0000 7f3888926800 5 AuthRegistry(0x564920ddd600) adding con mode: crc 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:56:50.654+0000 7f3888926800 5 AuthRegistry(0x564920ddd600) adding con mode: secure 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:56:50.655+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:56:50.655+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:56:50.655+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key hook 0x564920ddd748 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:50.963 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920c90c20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920d244e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920d265e0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.169474s 2024-09-12T17:56:50.964 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920c90c20 auth_method 0 2024-09-12T17:56:50.965 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.965 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.965 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.965 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920d265e0 auth_method 0 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.966 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920d244e0 auth_method 0 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient: _finish_hunting 0 2024-09-12T17:56:50.967 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:56:50.655+0000 7f3884dda640 1 monclient: found mon.noname-a 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: dump: 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.968 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.969 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: _finish_auth 0 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: _check_auth_tickets 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: dump: 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.970 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.971 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.971 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.971 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:56:50.656+0000 7f3888926800 5 monclient: authenticate success, global_id 7068 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:56:50.656+0000 7f377260c640 4 set_mon_vals no callback set 2024-09-12T17:56:50.972 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:56:50.656+0000 7f3888926800 1 librados: init done 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:56:50.658+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f376c076470 auth_method 0 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:56:50.658+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920e03f90 auth_method 0 2024-09-12T17:56:50.973 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:56:50.659+0000 7f38845d9640 10 monclient: get_auth_request con 0x564920e288f0 auth_method 0 2024-09-12T17:56:50.974 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:56:50.660+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920e2d980 auth_method 0 2024-09-12T17:56:50.974 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:50.974 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:56:50.661+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:50.974 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.976 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:56:50.661+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:56:50.661+0000 7f3888926800 5 asok(0x564920bb9730) register_command objecter_requests cmddesc objecter_requests hook 0x564920e34ca0 EEXIST 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:50.977 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:56:50.662+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.978 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:56:50.662+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:56:50.662+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x564920e30990 EEXIST 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920e58fc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920e593a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920e57cd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.176377s 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920e58fc0 auth_method 0 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.979 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920e593a0 auth_method 0 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920e57cd0 auth_method 0 2024-09-12T17:56:50.980 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_done global_id 6674 payload 824 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient: _finish_hunting 0 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:56:50.662+0000 7f38845d9640 1 monclient: found mon.noname-c 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: dump: 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: _finish_auth 0 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: dump: 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:56:50.663+0000 7f3888926800 5 monclient: authenticate success, global_id 6674 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:56:50.663+0000 7f38855db640 4 set_mon_vals no callback set 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:56:50.665+0000 7f3883dd8640 10 monclient: get_auth_request con 0x7f375c076380 auth_method 0 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: get_monmap_and_config 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:56:50.665+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.985 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:56:50.665+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:50.986 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.987 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:56:50.666+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:56:50.666+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:56:50.666+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x7fff374adeb8 EEXIST 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920ead570 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920e7d380 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:50.988 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920ea8930 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.180314s 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920e7d380 auth_method 0 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920ea8930 auth_method 0 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.989 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920ead570 auth_method 0 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:50.990 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_done global_id 7074 payload 274 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient: _finish_hunting 0 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:56:50.666+0000 7f3883dd8640 1 monclient: found mon.noname-a 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:50.991 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: dump: 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:50.993 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: dump: 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:56:50.667+0000 7f3888926800 5 monclient: authenticate success, global_id 7074 2024-09-12T17:56:50.994 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:56:50.667+0000 7f3888926800 4 set_mon_vals no callback set 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: shutdown 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:56:50.667+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:50.996 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:50.997 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:56:50.667+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:56:50.667+0000 7f3888926800 1 librados: starting msgr at 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:56:50.667+0000 7f3888926800 1 librados: starting objecter 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:56:50.668+0000 7f3888926800 5 asok(0x564920bb9730) register_command objecter_requests cmddesc objecter_requests hook 0x564920e7d780 EEXIST 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:56:50.668+0000 7f3888926800 1 librados: setting wanted keys 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:56:50.668+0000 7f3888926800 1 librados: calling monclient init 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:50.998 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:50.999 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.000 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.000 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:56:50.668+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.000 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:56:50.668+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.000 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:56:50.668+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x564920e6d9c8 EEXIST 2024-09-12T17:56:51.000 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:51.001 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:51.001 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920e7d380 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:51.001 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920ea8930 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:51.001 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920ead570 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:51.001 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.002 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.002 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.002 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:51.002 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.182607s 2024-09-12T17:56:51.002 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920ead570 auth_method 0 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920ea8930 auth_method 0 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.003 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.004 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.005 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.005 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_done global_id 7077 payload 824 2024-09-12T17:56:51.005 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient: _finish_hunting 0 2024-09-12T17:56:51.005 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:56:50.668+0000 7f3884dda640 1 monclient: found mon.noname-a 2024-09-12T17:56:51.005 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.006 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.006 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:51.006 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: dump: 2024-09-12T17:56:51.006 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.006 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.007 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.007 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.007 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.007 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.007 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: _finish_auth 0 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:56:51.008 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:51.009 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.009 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:51.009 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: dump: 2024-09-12T17:56:51.009 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.009 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.010 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.010 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.010 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.010 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.010 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.011 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.011 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.011 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.011 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:56:50.669+0000 7f3888926800 5 monclient: authenticate success, global_id 7077 2024-09-12T17:56:51.011 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.012 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:56:50.669+0000 7f375b7fe640 4 set_mon_vals no callback set 2024-09-12T17:56:51.012 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.012 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.012 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.012 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:56:50.669+0000 7f3888926800 1 librados: init done 2024-09-12T17:56:51.013 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:56:50.669+0000 7f3888926800 5 asok(0x564920bb9730) register_command cr dump hook 0x564920ea5278 2024-09-12T17:56:51.013 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:56:50.670+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.013 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:51.013 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.013 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.014 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:56:50.671+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f374c076470 auth_method 0 2024-09-12T17:56:51.014 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:56:50.671+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920ec78b0 auth_method 0 2024-09-12T17:56:51.014 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.014 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:56:50.672+0000 7f3888926800 20 realm 2024-09-12T17:56:51.014 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.015 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.015 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:56:50.672+0000 7f3888926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:51.015 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.015 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.015 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:56:50.672+0000 7f38845d9640 10 monclient: get_auth_request con 0x564920ecbaf0 auth_method 0 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:56:50.673+0000 7f3888926800 20 searching for the correct realm 2024-09-12T17:56:51.016 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:56:50.673+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920ed09b0 auth_method 0 2024-09-12T17:56:51.017 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:56:50.674+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f3874037070 auth_method 0 2024-09-12T17:56:51.017 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:56:50.675+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387c06c050 auth_method 0 2024-09-12T17:56:51.020 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:56:50.675+0000 7f3883dd8640 10 monclient: get_auth_request con 0x7f386c085060 auth_method 0 2024-09-12T17:56:51.020 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:56:50.676+0000 7f3884dda640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f3874037070 msgr2=0x7f3874039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:51.021 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:56:50.676+0000 7f3759ffb640 1 client.7077.objecter ms_handle_reset 0x7f3874037070 session 0x7f3874053040 osd.7 2024-09-12T17:56:51.021 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:56:50.676+0000 7f3759ffb640 10 monclient: _renew_subs 2024-09-12T17:56:51.021 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:56:50.676+0000 7f3759ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.021 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:56:50.676+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f374c086b90 auth_method 0 2024-09-12T17:56:51.021 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:56:50.677+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f3874020040 auth_method 0 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:56:50.679+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387405c920 auth_method 0 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:56:50.680+0000 7f38845d9640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f387405c920 msgr2=0x7f3874046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:56:50.881+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387405c920 auth_method 0 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:51.022 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:51.023 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:51.023 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:51.023 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:51.023 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.024 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.024 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.024 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.024 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.024 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:51.025 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:56:50.888+0000 7f3888926800 20 zone default found 2024-09-12T17:56:51.025 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:56:50.888+0000 7f3888926800 4 Realm: () 2024-09-12T17:56:51.025 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:56:50.888+0000 7f3888926800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:51.025 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:56:50.888+0000 7f3888926800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:51.025 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:56:50.888+0000 7f3888926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:56:50.888+0000 7f3888926800 20 zonegroup default 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.026 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.027 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:56:50.889+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.027 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:56:50.889+0000 7f3888926800 20 started sync module instance, tier type = 2024-09-12T17:56:51.027 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:56:50.889+0000 7f3888926800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:51.027 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=0 2024-09-12T17:56:51.027 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=1 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=2 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=3 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=4 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=5 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=6 2024-09-12T17:56:51.028 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:56:50.898+0000 7f3888926800 20 add_watcher() i=7 2024-09-12T17:56:51.029 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:56:50.898+0000 7f3888926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:51.029 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.029 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.029 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.029 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.030 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.030 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.030 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.030 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.030 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.031 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.031 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.031 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.031 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.031 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:56:50.900+0000 7f373afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.032 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.032 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.032 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:56:50.900+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.032 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:51.032 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:51.033 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache list hook 0x564920ea2db0 2024-09-12T17:56:51.033 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache inspect hook 0x564920ea2db0 2024-09-12T17:56:51.033 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache erase hook 0x564920ea2db0 2024-09-12T17:56:51.033 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache zap hook 0x564920ea2db0 2024-09-12T17:56:51.033 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:56:50.900+0000 7f3888926800 5 note: GC not initialized 2024-09-12T17:56:51.034 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:56:50.900+0000 7f3739fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:51.034 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace show hook 0x7f387c0054e0 2024-09-12T17:56:51.034 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace history hook 0x7f387c0054e0 2024-09-12T17:56:51.034 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace active hook 0x7f387c0054e0 2024-09-12T17:56:51.034 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace active_short hook 0x7f387c0054e0 2024-09-12T17:56:51.035 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:56:50.900+0000 7f3888926800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:51.035 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:56:50.900+0000 7f3888926800 20 Filter name: none 2024-09-12T17:56:51.035 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:56:50.901+0000 7f36ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:51.035 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:56:51.036 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.037 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:51.037 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:56:51.037 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:56:51.037 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : miss 2024-09-12T17:56:51.037 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.038 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:51.038 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.038 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.038 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:51.039 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.039 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:56:50.901+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:51.039 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:56:50.907+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.039 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:56:50.907+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.039 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:56:50.907+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.040 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:56:50.907+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:51.040 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:51.040 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.040 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.041 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.041 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:51.041 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:51.041 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:51.041 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:51.042 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:51.042 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:51.042 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:51.042 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:51.043 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:51.043 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:51.043 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:51.043 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:51.043 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:51.044 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:51.044 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:51.044 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:51.044 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:51.044 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:51.045 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:51.045 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:51.045 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:51.045 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:51.045 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:51.046 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:51.046 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:51.046 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:51.046 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:51.047 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:51.047 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.0 2024-09-12T17:56:51.047 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1 2024-09-12T17:56:51.047 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2 2024-09-12T17:56:51.048 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.3 2024-09-12T17:56:51.048 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.4 2024-09-12T17:56:51.048 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.5 2024-09-12T17:56:51.048 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.6 2024-09-12T17:56:51.048 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.7 2024-09-12T17:56:51.049 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.8 2024-09-12T17:56:51.049 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.9 2024-09-12T17:56:51.049 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.10 2024-09-12T17:56:51.049 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:56:50.921+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:51.050 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:56:50.921+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:51.050 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:56:50.923+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.050 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:56:50.923+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.051 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:56:50.923+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.051 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:56:50.923+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:51.051 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:51.051 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.051 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:56:50.925+0000 7f3888926800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3888926800 time 2024-09-12T17:56:50.926074+0000 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3889f8c71a] 2024-09-12T17:56:51.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:56:50.926+0000 7f3888926800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3888926800 thread_name:radosgw-admin 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.053 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3888c3e6f0] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3888c8b99c] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3889f8c774] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:51.054 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:56:51.055 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:56:51.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:56:51.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:51.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:56:51.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:56:51.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:51.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:56:51.062 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36ab7fe640 / http_manager 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3739fdb640 / http_manager 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f373afdd640 / rgw_dt_lg_renew 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3759ffb640 / ms_dispatch 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f375affd640 / io_context_pool 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f375b7fe640 / io_context_pool 2024-09-12T17:56:51.063 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3769ffb640 / ms_dispatch 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3770e09640 / ms_dispatch 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f377260c640 / io_context_pool 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3883dd8640 / msgr-worker-2 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38845d9640 / msgr-worker-1 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3884dda640 / msgr-worker-0 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38855db640 / io_context_pool 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3888926800 / radosgw-admin 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.112973.log 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:56:51.064 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:56:50.654+0000 7f3888926800 5 AuthRegistry(0x564920ddd600) adding con mode: crc 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:56:50.654+0000 7f3888926800 5 AuthRegistry(0x564920ddd600) adding con mode: secure 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:56:50.655+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:56:50.655+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:56:50.655+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key hook 0x564920ddd748 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920c90c20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920d244e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920d265e0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.065 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:56:50.655+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.169474s 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920c90c20 auth_method 0 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920d265e0 auth_method 0 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.066 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:56:50.655+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920d244e0 auth_method 0 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:56:50.655+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient: _finish_hunting 0 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:56:50.655+0000 7f3884dda640 1 monclient: found mon.noname-a 2024-09-12T17:56:51.067 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:56:50.655+0000 7f3884dda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: dump: 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.068 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: _finish_auth 0 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: _check_auth_tickets 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:56:50.656+0000 7f3770e09640 10 monclient: dump: 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.069 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:56:50.656+0000 7f3888926800 5 monclient: authenticate success, global_id 7068 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:56:50.656+0000 7f377260c640 4 set_mon_vals no callback set 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:56:50.656+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.070 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:56:50.656+0000 7f3888926800 1 librados: init done 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:56:50.657+0000 7f3770e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:56:50.658+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f376c076470 auth_method 0 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:56:50.658+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920e03f90 auth_method 0 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:56:50.659+0000 7f38845d9640 10 monclient: get_auth_request con 0x564920e288f0 auth_method 0 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:56:50.660+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920e2d980 auth_method 0 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:56:50.661+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:51.071 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:51.072 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding auth protocol: cephx 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: crc 2024-09-12T17:56:51.073 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e317f0) adding con mode: secure 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:56:50.661+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:56:50.661+0000 7f3888926800 5 asok(0x564920bb9730) register_command objecter_requests cmddesc objecter_requests hook 0x564920e34ca0 EEXIST 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:56:50.661+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding auth protocol: cephx 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.074 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: crc 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:56:50.661+0000 7f3888926800 5 AuthRegistry(0x564920e30848) adding con mode: secure 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:56:50.662+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:56:50.662+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:56:50.662+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x564920e30990 EEXIST 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:56:51.075 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920e58fc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920e593a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920e57cd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:56:50.662+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.176377s 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920e58fc0 auth_method 0 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920e593a0 auth_method 0 2024-09-12T17:56:51.076 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:56:50.662+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920e57cd0 auth_method 0 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.077 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:56:50.662+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient(hunting): handle_auth_done global_id 6674 payload 824 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient: _finish_hunting 0 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:56:50.662+0000 7f38845d9640 1 monclient: found mon.noname-c 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:56:50.662+0000 7f38845d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: dump: 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: _finish_auth 0 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:56:50.663+0000 7f3769ffb640 10 monclient: dump: 2024-09-12T17:56:51.079 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:56:50.663+0000 7f3888926800 5 monclient: authenticate success, global_id 6674 2024-09-12T17:56:51.080 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:56:50.663+0000 7f38855db640 4 set_mon_vals no callback set 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:56:50.663+0000 7f3888926800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:56:50.664+0000 7f3769ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:56:50.665+0000 7f3883dd8640 10 monclient: get_auth_request con 0x7f375c076380 auth_method 0 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: get_monmap_and_config 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:56:50.665+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:51.081 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding auth protocol: cephx 2024-09-12T17:56:51.082 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: crc 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x564920e78ed0) adding con mode: secure 2024-09-12T17:56:51.083 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:56:50.665+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:56:50.665+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding auth protocol: cephx 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: crc 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:56:50.665+0000 7f3888926800 5 AuthRegistry(0x7fff374add70) adding con mode: secure 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:56:50.666+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:56:50.666+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:56:50.666+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x7fff374adeb8 EEXIST 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920ead570 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:51.085 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920e7d380 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920ea8930 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:56:50.666+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.180314s 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920e7d380 auth_method 0 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920ea8930 auth_method 0 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.086 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:56:50.666+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): get_auth_request con 0x564920ead570 auth_method 0 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.087 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:56:50.666+0000 7f38845d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient(hunting): handle_auth_done global_id 7074 payload 274 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient: _finish_hunting 0 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:56:50.666+0000 7f3883dd8640 1 monclient: found mon.noname-a 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:56:50.666+0000 7f3883dd8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: dump: 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:51.089 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:56:50.666+0000 7f375b7fe640 10 monclient: dump: 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.090 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:56:50.667+0000 7f3888926800 5 monclient: authenticate success, global_id 7074 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: get_monmap_and_config success 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:56:50.667+0000 7f3888926800 4 set_mon_vals no callback set 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: shutdown 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: build_initial_monmap 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:56:50.667+0000 7f3888926800 1 build_initial for_mkfs: 0 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:56:50.667+0000 7f3888926800 10 monclient: monmap: 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding auth protocol: cephx 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.092 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: crc 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:56:50.667+0000 7f3888926800 5 AuthRegistry(0x564920e7e1c0) adding con mode: secure 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:56:50.667+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:56:50.667+0000 7f3888926800 1 librados: starting msgr at 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:56:50.667+0000 7f3888926800 1 librados: starting objecter 2024-09-12T17:56:51.093 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:56:50.668+0000 7f3888926800 5 asok(0x564920bb9730) register_command objecter_requests cmddesc objecter_requests hook 0x564920e7d780 EEXIST 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:56:50.668+0000 7f3888926800 1 librados: setting wanted keys 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:56:50.668+0000 7f3888926800 1 librados: calling monclient init 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: init 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding auth protocol: cephx 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.094 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: crc 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:56:50.668+0000 7f3888926800 5 AuthRegistry(0x564920e6d880) adding con mode: secure 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:56:50.668+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:56:50.668+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:56:50.668+0000 7f3888926800 5 asok(0x564920bb9730) register_command rotate-key cmddesc rotate-key hook 0x564920e6d9c8 EEXIST 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: _reopen_session rank -1 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:51.095 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-b con 0x564920e7d380 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-c con 0x564920ea8930 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): picked mon.noname-a con 0x564920ead570 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): _renew_subs 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:56:50.668+0000 7f3888926800 10 monclient(hunting): authenticate will time out at 2084.182607s 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): get_auth_request con 0x564920ead570 auth_method 0 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.096 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): get_auth_request con 0x564920ea8930 auth_method 0 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:56:50.668+0000 7f3883dd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient(hunting): handle_auth_done global_id 7077 payload 824 2024-09-12T17:56:51.097 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient: _finish_hunting 0 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:56:50.668+0000 7f3884dda640 1 monclient: found mon.noname-a 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:56:50.668+0000 7f3884dda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: dump: 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: _finish_auth 0 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:56:50.669+0000 7f3759ffb640 10 monclient: dump: 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:56:51.099 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:56:50.669+0000 7f3888926800 5 monclient: authenticate success, global_id 7077 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:56:50.669+0000 7f375b7fe640 4 set_mon_vals no callback set 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.100 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _renew_subs 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:56:50.669+0000 7f3888926800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:56:50.669+0000 7f3888926800 1 librados: init done 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:56:50.669+0000 7f3888926800 5 asok(0x564920bb9730) register_command cr dump hook 0x564920ea5278 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:56:50.670+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:56:50.671+0000 7f3759ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:56:50.671+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f374c076470 auth_method 0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:56:50.671+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920ec78b0 auth_method 0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:56:50.672+0000 7f3888926800 20 realm 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.101 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:56:50.672+0000 7f3888926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:56:50.672+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:56:50.672+0000 7f38845d9640 10 monclient: get_auth_request con 0x564920ecbaf0 auth_method 0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:56:50.673+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:56:50.673+0000 7f3888926800 20 searching for the correct realm 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:56:50.673+0000 7f3883dd8640 10 monclient: get_auth_request con 0x564920ed09b0 auth_method 0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:56:50.674+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f3874037070 auth_method 0 2024-09-12T17:56:51.102 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:56:50.675+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387c06c050 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:56:50.675+0000 7f3883dd8640 10 monclient: get_auth_request con 0x7f386c085060 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:56:50.676+0000 7f3884dda640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f3874037070 msgr2=0x7f3874039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:56:50.676+0000 7f3759ffb640 1 client.7077.objecter ms_handle_reset 0x7f3874037070 session 0x7f3874053040 osd.7 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:56:50.676+0000 7f3759ffb640 10 monclient: _renew_subs 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:56:50.676+0000 7f3759ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:56:50.676+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f374c086b90 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:56:50.677+0000 7f3884dda640 10 monclient: get_auth_request con 0x7f3874020040 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:56:50.679+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387405c920 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:56:50.680+0000 7f38845d9640 0 -- 172.21.15.94:0/1953183563 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f387405c920 msgr2=0x7f3874046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:56:50.881+0000 7f38845d9640 10 monclient: get_auth_request con 0x7f387405c920 auth_method 0 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:51.103 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:56:50.887+0000 7f3888926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:56:50.887+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:56:50.888+0000 7f3888926800 20 zone default found 2024-09-12T17:56:51.104 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:56:50.888+0000 7f3888926800 4 Realm: () 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:56:50.888+0000 7f3888926800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:56:50.888+0000 7f3888926800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:56:50.888+0000 7f3888926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:56:50.888+0000 7f3888926800 20 zonegroup default 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:56:50.888+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:56:50.889+0000 7f3888926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.105 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:56:50.889+0000 7f3888926800 20 started sync module instance, tier type = 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:56:50.889+0000 7f3888926800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=0 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=1 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=2 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=3 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=4 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=5 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:56:50.897+0000 7f3888926800 20 add_watcher() i=6 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:56:50.898+0000 7f3888926800 20 add_watcher() i=7 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:56:50.898+0000 7f3888926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:51.106 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding auth protocol: cephx 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.107 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:56:50.900+0000 7f373afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: crc 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:56:50.900+0000 7f3888926800 5 AuthRegistry(0x7fff374ae240) adding con mode: secure 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:56:50.900+0000 7f3888926800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:56:50.900+0000 7f3888926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache list hook 0x564920ea2db0 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache inspect hook 0x564920ea2db0 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache erase hook 0x564920ea2db0 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command cache zap hook 0x564920ea2db0 2024-09-12T17:56:51.108 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:56:50.900+0000 7f3888926800 5 note: GC not initialized 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:56:50.900+0000 7f3739fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace show hook 0x7f387c0054e0 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace history hook 0x7f387c0054e0 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace active hook 0x7f387c0054e0 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:56:50.900+0000 7f3888926800 5 asok(0x564920bb9730) register_command sync trace active_short hook 0x7f387c0054e0 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:56:50.900+0000 7f3888926800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:56:50.900+0000 7f3888926800 20 Filter name: none 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:56:50.901+0000 7f36ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:51.109 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : miss 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:56:50.901+0000 7f3888926800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:56:50.901+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:56:50.901+0000 7f3888926800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:56:50.901+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:56:50.901+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:56:50.907+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:56:50.907+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:56:50.907+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.110 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:56:50.907+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:56:50.907+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:56:50.909+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.0 2024-09-12T17:56:51.111 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.1 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.2 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.3 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.4 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.5 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:51.112 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.6 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.7 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.8 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.9 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.10 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:56:50.913+0000 7f3888926800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1.11 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:56:50.913+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.0 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1 2024-09-12T17:56:51.113 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:56:50.914+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.3 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:56:50.915+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.4 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.5 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:56:50.916+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.6 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.7 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:56:50.917+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.8 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.9 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:56:50.918+0000 7f3888926800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.10 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:56:50.921+0000 7f3888926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:56:50.921+0000 7f3888926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:56:50.923+0000 7f3888926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.114 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:56:50.923+0000 7f3888926800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:56:50.923+0000 7f3888926800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:56:50.923+0000 7f3888926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94872085031088 notifier 7077 bl.length()=915 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:56:50.923+0000 7f375affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:56:50.925+0000 7f3888926800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:56:50.925+0000 7f3888926800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3888926800 time 2024-09-12T17:56:50.926074+0000 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:51.115 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3889f8c71a] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.116 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:56:50.926+0000 7f3888926800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3888926800 thread_name:radosgw-admin 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3888c3e6f0] 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3888c8b99c] 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3889f8c774] 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3889f8c8d8] 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56491f1c0841] 2024-09-12T17:56:51.117 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56491f1cf79e] 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56491f1d05d4] 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3888c29590] 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:56:51.118 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:56:51.119 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:56:51.120 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:56:51.121 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:56:51.122 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:56:51.123 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:51.124 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:56:51.125 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f36ab7fe640 / http_manager 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3739fdb640 / http_manager 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f373afdd640 / rgw_dt_lg_renew 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3759ffb640 / ms_dispatch 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f375affd640 / io_context_pool 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f375b7fe640 / io_context_pool 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3769ffb640 / ms_dispatch 2024-09-12T17:56:51.126 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3770e09640 / ms_dispatch 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f377260c640 / io_context_pool 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3883dd8640 / msgr-worker-2 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38845d9640 / msgr-worker-1 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3884dda640 / msgr-worker-0 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38855db640 / io_context_pool 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3888926800 / radosgw-admin 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:56:50.927676Z_d93165b9-43c9-4975-917b-b2a81c06d155/log 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:56:51.127 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:56:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.000+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 20 realm 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.001+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.002+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.002+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.003+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.003+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.003+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.003+0000 7fbaf7d26800 20 searching for the correct realm 2024-09-12T17:56:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.006+0000 7fbaebfff640 0 -- 172.21.15.94:0/2244680265 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55aaab6fb740 msgr2=0x55aaab6fdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.009+0000 7fbaf3909640 0 -- 172.21.15.94:0/2244680265 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbadc036450 msgr2=0x7fbadc0368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:51.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.215+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 zone default found 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 4 Realm: () 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 zonegroup default 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 started sync module instance, tier type = 2024-09-12T17:56:51.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.216+0000 7fbaf7d26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=0 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=1 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=2 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=3 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=4 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=5 2024-09-12T17:56:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.225+0000 7fbaf7d26800 20 add_watcher() i=6 2024-09-12T17:56:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.226+0000 7fbaf7d26800 20 add_watcher() i=7 2024-09-12T17:56:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.226+0000 7fbaf7d26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.227+0000 7fb9a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.227+0000 7fbaf7d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.227+0000 7fbaf7d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.227+0000 7fbaf7d26800 5 note: GC not initialized 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fb9a8fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fbaf7d26800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fbaf7d26800 20 Filter name: none 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fb9227fc640 20 reqs_thread_entry: start 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.228+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.229+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:56:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.229+0000 7fbaf7d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.229+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.229+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.229+0000 7fbaf7d26800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.230+0000 7fbaf7d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:56:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.230+0000 7fbaf7d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.231+0000 7fb9a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.233+0000 7fbaf7d26800 20 remove_watcher() i=0 2024-09-12T17:56:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.233+0000 7fbaf7d26800 2 removed watcher, disabling cache 2024-09-12T17:56:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.234+0000 7fbaf7d26800 20 remove_watcher() i=1 2024-09-12T17:56:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.235+0000 7fbaf7d26800 20 remove_watcher() i=2 2024-09-12T17:56:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.236+0000 7fbaf7d26800 20 remove_watcher() i=3 2024-09-12T17:56:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.237+0000 7fbaf7d26800 20 remove_watcher() i=4 2024-09-12T17:56:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.238+0000 7fbaf7d26800 20 remove_watcher() i=5 2024-09-12T17:56:51.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.239+0000 7fbaf7d26800 20 remove_watcher() i=6 2024-09-12T17:56:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.240+0000 7fbaf7d26800 20 remove_watcher() i=7 2024-09-12T17:56:51.250 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.251 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:56:51.251 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:51.251 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:56:51.341 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:51.372 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:51.372 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:51.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.407+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.408+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.408+0000 7f31266b9800 20 realm 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.408+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.409+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.409+0000 7f31266b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.409+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.409+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.409+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.410+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.410+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.410+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:51.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.410+0000 7f31266b9800 20 searching for the correct realm 2024-09-12T17:56:51.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.413+0000 7f311b9a2640 0 -- 172.21.15.94:0/668276950 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f311404ec20 msgr2=0x7f311409a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:51.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.416+0000 7f31241a3640 0 -- 172.21.15.94:0/668276950 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f310c0a0260 msgr2=0x7f310c02b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:51.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:56:51.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:51.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:51.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:56:51.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:51.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:51.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.622+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 zone default found 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 4 Realm: () 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:56:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 zonegroup default 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.623+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.624+0000 7f31266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.624+0000 7f31266b9800 20 started sync module instance, tier type = 2024-09-12T17:56:51.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.624+0000 7f31266b9800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:56:51.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=0 2024-09-12T17:56:51.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=1 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=2 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=3 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=4 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=5 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.632+0000 7f31266b9800 20 add_watcher() i=6 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.633+0000 7f31266b9800 20 add_watcher() i=7 2024-09-12T17:56:51.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.633+0000 7f31266b9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:51.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f2fda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f31266b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f31266b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f31266b9800 5 note: GC not initialized 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f2fd97e2640 20 reqs_thread_entry: start 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.635+0000 7f31266b9800 20 init_complete bucket index max shards: 11 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 20 Filter name: none 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f2f4affd640 20 reqs_thread_entry: start 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:56:51.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : miss 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.636+0000 7f31266b9800 20 rados->read ofs=0 len=0 2024-09-12T17:56:51.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.637+0000 7f31266b9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.638+0000 7f31266b9800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to be held by another RGW process; skipping for now 2024-09-12T17:56:51.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.639+0000 7f2fda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:51.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.641+0000 7f31266b9800 20 remove_watcher() i=0 2024-09-12T17:56:51.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.641+0000 7f31266b9800 2 removed watcher, disabling cache 2024-09-12T17:56:51.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.642+0000 7f31266b9800 20 remove_watcher() i=1 2024-09-12T17:56:51.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.643+0000 7f31266b9800 20 remove_watcher() i=2 2024-09-12T17:56:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.644+0000 7f31266b9800 20 remove_watcher() i=3 2024-09-12T17:56:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.645+0000 7f31266b9800 20 remove_watcher() i=4 2024-09-12T17:56:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.646+0000 7f31266b9800 20 remove_watcher() i=5 2024-09-12T17:56:51.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.646+0000 7f31266b9800 20 remove_watcher() i=6 2024-09-12T17:56:51.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:56:51.647+0000 7f31266b9800 20 remove_watcher() i=7 2024-09-12T17:56:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:57:21.679 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:21.714 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:21.714 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:21.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.755+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.756+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.756+0000 7f3c35f35800 20 realm 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.756+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.757+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.757+0000 7f3c35f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.757+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.757+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.757+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.758+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:21.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.758+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.758+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:21.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.758+0000 7f3c35f35800 20 searching for the correct realm 2024-09-12T17:57:21.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.762+0000 7f3c2bfff640 0 -- 172.21.15.94:0/3493924993 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55a2b4ddbf10 msgr2=0x55a2b4dde3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:21.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.766+0000 7f3c31ce4640 0 -- 172.21.15.94:0/3493924993 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3c1c018400 msgr2=0x7f3c1c018860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:21.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:21.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.770+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 zone default found 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 4 Realm: () 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 zonegroup default 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.771+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.772+0000 7f3c35f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.772+0000 7f3c35f35800 20 started sync module instance, tier type = 2024-09-12T17:57:21.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.772+0000 7f3c35f35800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=0 2024-09-12T17:57:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=1 2024-09-12T17:57:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=2 2024-09-12T17:57:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=3 2024-09-12T17:57:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=4 2024-09-12T17:57:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=5 2024-09-12T17:57:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.781+0000 7f3c35f35800 20 add_watcher() i=6 2024-09-12T17:57:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.782+0000 7f3c35f35800 20 add_watcher() i=7 2024-09-12T17:57:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.782+0000 7f3c35f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3c35f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3c35f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3c35f35800 5 note: GC not initialized 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3ae27fc640 20 reqs_thread_entry: start 2024-09-12T17:57:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.784+0000 7f3c35f35800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 20 Filter name: none 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3a53fff640 20 reqs_thread_entry: start 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : miss 2024-09-12T17:57:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.785+0000 7f3c35f35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.786+0000 7f3c35f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:57:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.787+0000 7f3c35f35800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:57:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3c35f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3c35f35800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3c35f35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3c35f35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:57:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3b14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 94157307507856 notifier 7131 bl.length()=915 2024-09-12T17:57:21.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3b14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3b14ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.794+0000 7f3b14ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.796+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:57:21.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.796+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:57:21.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.796+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:57:21.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.796+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.0 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.0 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.1 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.1 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.2 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.2 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.3 2024-09-12T17:57:21.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.3 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.4 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.4 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.5 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.5 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.6 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.6 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.7 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.7 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.8 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.8 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.9 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.9 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.10 2024-09-12T17:57:21.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.10 2024-09-12T17:57:21.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.11 2024-09-12T17:57:21.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2.11 2024-09-12T17:57:21.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.0 2024-09-12T17:57:21.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.802+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.803+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.803+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.3 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.804+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.4 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.804+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.5 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.805+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.6 2024-09-12T17:57:21.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.805+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.7 2024-09-12T17:57:21.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.806+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.8 2024-09-12T17:57:21.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.806+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.9 2024-09-12T17:57:21.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.806+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.10 2024-09-12T17:57:21.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.809+0000 7f3c35f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:21.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.809+0000 7f3c35f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:57:21.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.811+0000 7f3c35f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.811+0000 7f3c35f35800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.811+0000 7f3c35f35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.811+0000 7f3c35f35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:57:21.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.812+0000 7f3b14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529754 cookie 94157307507856 notifier 7131 bl.length()=915 2024-09-12T17:57:21.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.812+0000 7f3b14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.812+0000 7f3b14ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.812+0000 7f3b14ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.814+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:57:21.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.814+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:57:21.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.814+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:57:21.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.814+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:57:21.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.816+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.0 2024-09-12T17:57:21.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.816+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.1 2024-09-12T17:57:21.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.816+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.2 2024-09-12T17:57:21.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.817+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.3 2024-09-12T17:57:21.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.817+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.4 2024-09-12T17:57:21.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.817+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.5 2024-09-12T17:57:21.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.818+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.6 2024-09-12T17:57:21.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.818+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.7 2024-09-12T17:57:21.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.818+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.8 2024-09-12T17:57:21.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.818+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.9 2024-09-12T17:57:21.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.819+0000 7f3c35f35800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29.10 2024-09-12T17:57:21.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.819+0000 7f3c35f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:21.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.819+0000 7f3c35f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3c35f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3c35f35800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3c35f35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3c35f35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29, ofs0, ns] 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3b157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529755 cookie 94157307507856 notifier 7131 bl.length()=883 2024-09-12T17:57:21.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3b157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 info.flags=0x17 2024-09-12T17:57:21.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3b157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 to cache LRU end 2024-09-12T17:57:21.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.821+0000 7f3b157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:21.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.823+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_sources= new_sources= 2024-09-12T17:57:21.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.823+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential sources added=[] removed=[] 2024-09-12T17:57:21.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.823+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): orig_dests= new_dests= 2024-09-12T17:57:21.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.823+0000 7f3c35f35800 20 handle_bi_update(): bucket=:abort-at-block-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29]): potential dests added=[] removed=[] 2024-09-12T17:57:21.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.825+0000 7f3c35f35800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:21.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.828+0000 7f3ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:21.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.830+0000 7f3c35f35800 20 remove_watcher() i=0 2024-09-12T17:57:21.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.830+0000 7f3c35f35800 2 removed watcher, disabling cache 2024-09-12T17:57:21.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.831+0000 7f3c35f35800 20 remove_watcher() i=1 2024-09-12T17:57:21.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.832+0000 7f3c35f35800 20 remove_watcher() i=2 2024-09-12T17:57:21.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.833+0000 7f3c35f35800 20 remove_watcher() i=3 2024-09-12T17:57:21.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.834+0000 7f3c35f35800 20 remove_watcher() i=4 2024-09-12T17:57:21.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.835+0000 7f3c35f35800 20 remove_watcher() i=5 2024-09-12T17:57:21.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.836+0000 7f3c35f35800 20 remove_watcher() i=6 2024-09-12T17:57:21.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.837+0000 7f3c35f35800 20 remove_watcher() i=7 2024-09-12T17:57:21.850 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:57:21.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:21.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:21.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.914+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 realm 2024-09-12T17:57:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.916+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.917+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.917+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.917+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.917+0000 7ff3ac0b7800 20 searching for the correct realm 2024-09-12T17:57:21.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.921+0000 7ff3a93a0640 0 -- 172.21.15.94:0/720856645 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x558991b90600 msgr2=0x558991b929f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:21.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.924+0000 7ff3a93a0640 0 -- 172.21.15.94:0/720856645 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7ff39c0b6070 msgr2=0x7ff39c0da1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:21.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.928+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 zone default found 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 4 Realm: () 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 zonegroup default 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.929+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 started sync module instance, tier type = 2024-09-12T17:57:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.930+0000 7ff3ac0b7800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=0 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=1 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=2 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=3 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=4 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=5 2024-09-12T17:57:21.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.939+0000 7ff3ac0b7800 20 add_watcher() i=6 2024-09-12T17:57:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.940+0000 7ff3ac0b7800 20 add_watcher() i=7 2024-09-12T17:57:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.940+0000 7ff3ac0b7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:21.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.941+0000 7ff25bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 5 note: GC not initialized 2024-09-12T17:57:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff25affd640 20 reqs_thread_entry: start 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 20 Filter name: none 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff258ff9640 20 reqs_thread_entry: start 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.942+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.943+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.943+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.943+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.943+0000 7ff3ac0b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.943+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.944+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.944+0000 7ff3ac0b7800 20 rados->read ofs=0 len=0 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.944+0000 7ff3ac0b7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.944+0000 7ff3ac0b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.946+0000 7ff25bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.948+0000 7ff3ac0b7800 20 remove_watcher() i=0 2024-09-12T17:57:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.948+0000 7ff3ac0b7800 2 removed watcher, disabling cache 2024-09-12T17:57:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.949+0000 7ff3ac0b7800 20 remove_watcher() i=1 2024-09-12T17:57:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.950+0000 7ff3ac0b7800 20 remove_watcher() i=2 2024-09-12T17:57:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.951+0000 7ff3ac0b7800 20 remove_watcher() i=3 2024-09-12T17:57:21.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.952+0000 7ff3ac0b7800 20 remove_watcher() i=4 2024-09-12T17:57:21.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.953+0000 7ff3ac0b7800 20 remove_watcher() i=5 2024-09-12T17:57:21.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.954+0000 7ff3ac0b7800 20 remove_watcher() i=6 2024-09-12T17:57:21.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:21.955+0000 7ff3ac0b7800 20 remove_watcher() i=7 2024-09-12T17:57:21.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:21.966 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:21.966 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:57:21.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:22.325 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:57:22.325 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:23.137 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:57:23.165 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:23.165 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:23.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.385+0000 7f1043fff640 0 --2- 172.21.15.94:0/3586592914 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0f30004560 0x7f0f300069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:23.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.401+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 realm 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.403+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.404+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:23.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.404+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.404+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:23.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.404+0000 7f104f02f800 20 searching for the correct realm 2024-09-12T17:57:23.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.406+0000 7f104ab8c640 0 -- 172.21.15.94:0/1807157561 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f1034072040 msgr2=0x7f10340649d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:23.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.409+0000 7f104ab8c640 0 -- 172.21.15.94:0/1807157561 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f1034073940 msgr2=0x7f103407e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:23.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.617+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:23.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 zone default found 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 4 Realm: () 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 zonegroup default 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.618+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.619+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.619+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.619+0000 7f104f02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.619+0000 7f104f02f800 20 started sync module instance, tier type = 2024-09-12T17:57:23.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.619+0000 7f104f02f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=0 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=1 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=2 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=3 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=4 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=5 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=6 2024-09-12T17:57:23.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 20 add_watcher() i=7 2024-09-12T17:57:23.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.628+0000 7f104f02f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:23.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.630+0000 7f0f00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.630+0000 7f104f02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.630+0000 7f104f02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f104f02f800 5 note: GC not initialized 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f0e7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f104f02f800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f104f02f800 20 Filter name: none 2024-09-12T17:57:23.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f0e797fa640 20 reqs_thread_entry: start 2024-09-12T17:57:23.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.631+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.632+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:23.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.632+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.632+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:23.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.632+0000 7f104f02f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:23.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.632+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.633+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:23.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.633+0000 7f104f02f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.633+0000 7f104f02f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:23.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.633+0000 7f104f02f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:23.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.635+0000 7f0f00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:23.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.637+0000 7f104f02f800 20 remove_watcher() i=0 2024-09-12T17:57:23.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.637+0000 7f104f02f800 2 removed watcher, disabling cache 2024-09-12T17:57:23.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.638+0000 7f104f02f800 20 remove_watcher() i=1 2024-09-12T17:57:23.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.638+0000 7f104f02f800 20 remove_watcher() i=2 2024-09-12T17:57:23.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.639+0000 7f104f02f800 20 remove_watcher() i=3 2024-09-12T17:57:23.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.640+0000 7f104f02f800 20 remove_watcher() i=4 2024-09-12T17:57:23.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.641+0000 7f104f02f800 20 remove_watcher() i=5 2024-09-12T17:57:23.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.642+0000 7f104f02f800 20 remove_watcher() i=6 2024-09-12T17:57:23.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.643+0000 7f104f02f800 20 remove_watcher() i=7 2024-09-12T17:57:23.654 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:23.654 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:23.654 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:23.654 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:23.655 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:57:23.689 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:23.690 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:23.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.725+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 20 realm 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.726+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.727+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.727+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.728+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:23.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.728+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.728+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:23.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.728+0000 7f0af3687800 20 searching for the correct realm 2024-09-12T17:57:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.732+0000 7f0aebfff640 0 -- 172.21.15.94:0/1374703474 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f0ae4063070 msgr2=0x7f0ae407e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.734+0000 7f0aebfff640 0 -- 172.21.15.94:0/1374703474 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f09bc086bf0 msgr2=0x7f09bc089020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.738+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 zone default found 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 4 Realm: () 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 zonegroup default 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 started sync module instance, tier type = 2024-09-12T17:57:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.739+0000 7f0af3687800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=0 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=1 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=2 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=3 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=4 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.747+0000 7f0af3687800 20 add_watcher() i=5 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.748+0000 7f0af3687800 20 add_watcher() i=6 2024-09-12T17:57:23.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.748+0000 7f0af3687800 20 add_watcher() i=7 2024-09-12T17:57:23.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.748+0000 7f0af3687800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:23.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.750+0000 7f09a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:23.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:23.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:23.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 5 note: GC not initialized 2024-09-12T17:57:23.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f09a67e4640 20 reqs_thread_entry: start 2024-09-12T17:57:23.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:23.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 20 Filter name: none 2024-09-12T17:57:23.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0917fff640 20 reqs_thread_entry: start 2024-09-12T17:57:23.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:57:23.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.751+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 : miss 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:23.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.752+0000 7f0af3687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.757+0000 7f0af3687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.757+0000 7f0af3687800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.757+0000 7f0af3687800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.757+0000 7f0af3687800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30, ofs0, ns] 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.758+0000 7f09c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 94316617827936 notifier 6782 bl.length()=931 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.758+0000 7f09c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.758+0000 7f09c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:23.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.758+0000 7f09c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.759+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_sources= new_sources= 2024-09-12T17:57:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.759+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential sources added=[] removed=[] 2024-09-12T17:57:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.759+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_dests= new_dests= 2024-09-12T17:57:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.759+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential dests added=[] removed=[] 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.0 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.0 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.1 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.1 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.2 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.2 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.3 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.3 2024-09-12T17:57:23.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.4 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.4 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.5 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.5 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.6 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.6 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.7 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.7 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.8 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.8 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.9 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.9 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.10 2024-09-12T17:57:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.10 2024-09-12T17:57:23.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.11 2024-09-12T17:57:23.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.763+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1.11 2024-09-12T17:57:23.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.764+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.0 2024-09-12T17:57:23.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.764+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1 2024-09-12T17:57:23.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.764+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2 2024-09-12T17:57:23.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.765+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.3 2024-09-12T17:57:23.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.765+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.4 2024-09-12T17:57:23.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.766+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.5 2024-09-12T17:57:23.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.767+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.6 2024-09-12T17:57:23.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.767+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.7 2024-09-12T17:57:23.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.768+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.8 2024-09-12T17:57:23.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.768+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.9 2024-09-12T17:57:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.769+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.10 2024-09-12T17:57:23.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.772+0000 7f0af3687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:23.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.772+0000 7f0af3687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 2024-09-12T17:57:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f0af3687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f0af3687800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f0af3687800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f0af3687800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30, ofs0, ns] 2024-09-12T17:57:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f09c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 94316617827936 notifier 6782 bl.length()=931 2024-09-12T17:57:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f09c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f09c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.773+0000 7f09c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.775+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_sources= new_sources= 2024-09-12T17:57:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.775+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential sources added=[] removed=[] 2024-09-12T17:57:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.775+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_dests= new_dests= 2024-09-12T17:57:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.775+0000 7f0af3687800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential dests added=[] removed=[] 2024-09-12T17:57:23.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.777+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.0 2024-09-12T17:57:23.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.777+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.778+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.778+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.3 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.778+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.4 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.779+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.5 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.779+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.6 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.779+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.7 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.779+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.8 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.780+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.9 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.780+0000 7f0af3687800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.10 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.780+0000 7f0af3687800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:57:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.780+0000 7f0af3687800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:57:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.784+0000 7f09a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:23.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.786+0000 7f0af3687800 20 remove_watcher() i=0 2024-09-12T17:57:23.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.786+0000 7f0af3687800 2 removed watcher, disabling cache 2024-09-12T17:57:23.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.787+0000 7f0af3687800 20 remove_watcher() i=1 2024-09-12T17:57:23.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.788+0000 7f0af3687800 20 remove_watcher() i=2 2024-09-12T17:57:23.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.789+0000 7f0af3687800 20 remove_watcher() i=3 2024-09-12T17:57:23.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.790+0000 7f0af3687800 20 remove_watcher() i=4 2024-09-12T17:57:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.791+0000 7f0af3687800 20 remove_watcher() i=5 2024-09-12T17:57:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.792+0000 7f0af3687800 20 remove_watcher() i=6 2024-09-12T17:57:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.793+0000 7f0af3687800 20 remove_watcher() i=7 2024-09-12T17:57:23.805 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:57:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:23.834 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:23.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.869+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 realm 2024-09-12T17:57:23.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.871+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.872+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.872+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:23.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.872+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:23.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.872+0000 7f6ea952e800 20 searching for the correct realm 2024-09-12T17:57:23.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.875+0000 7f6ea596c640 0 -- 172.21.15.94:0/2849381113 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f6e9007d070 msgr2=0x7f6e9007e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:23.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:23.878+0000 7f6ea516b640 0 -- 172.21.15.94:0/2849381113 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6e900933d0 msgr2=0x7f6e90093810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.085+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 zone default found 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 4 Realm: () 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 zonegroup default 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.086+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 started sync module instance, tier type = 2024-09-12T17:57:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.087+0000 7f6ea952e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=0 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=1 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=2 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=3 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=4 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=5 2024-09-12T17:57:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=6 2024-09-12T17:57:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 20 add_watcher() i=7 2024-09-12T17:57:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.096+0000 7f6ea952e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.098+0000 7f6d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.098+0000 7f6ea952e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.098+0000 7f6ea952e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.098+0000 7f6ea952e800 5 note: GC not initialized 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6d5a7e4640 20 reqs_thread_entry: start 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ea952e800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ea952e800 20 Filter name: none 2024-09-12T17:57:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ccbfff640 20 reqs_thread_entry: start 2024-09-12T17:57:24.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.099+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:57:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.100+0000 7f6ea952e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:24.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.102+0000 7f6d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.104+0000 7f6ea952e800 20 remove_watcher() i=0 2024-09-12T17:57:24.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.104+0000 7f6ea952e800 2 removed watcher, disabling cache 2024-09-12T17:57:24.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.105+0000 7f6ea952e800 20 remove_watcher() i=1 2024-09-12T17:57:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.106+0000 7f6ea952e800 20 remove_watcher() i=2 2024-09-12T17:57:24.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.107+0000 7f6ea952e800 20 remove_watcher() i=3 2024-09-12T17:57:24.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.108+0000 7f6ea952e800 20 remove_watcher() i=4 2024-09-12T17:57:24.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.109+0000 7f6ea952e800 20 remove_watcher() i=5 2024-09-12T17:57:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.110+0000 7f6ea952e800 20 remove_watcher() i=6 2024-09-12T17:57:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.111+0000 7f6ea952e800 20 remove_watcher() i=7 2024-09-12T17:57:24.122 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:24.122 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:24.122 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:24.122 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:24.212 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.280+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 realm 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.281+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.282+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.282+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:24.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.283+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.283+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:24.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.283+0000 7f5e9552f800 20 searching for the correct realm 2024-09-12T17:57:24.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.287+0000 7f5e8bfff640 0 -- 172.21.15.94:0/3356847034 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f5e84054940 msgr2=0x7f5e84025410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:24.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.290+0000 7f5e91a1b640 0 -- 172.21.15.94:0/3356847034 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f5e7c013030 msgr2=0x7f5e7c08e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:24.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:24.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.293+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 zone default found 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 4 Realm: () 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 zonegroup default 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.294+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.295+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.295+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.295+0000 7f5e9552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.295+0000 7f5e9552f800 20 started sync module instance, tier type = 2024-09-12T17:57:24.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.295+0000 7f5e9552f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=0 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=1 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=2 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=3 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=4 2024-09-12T17:57:24.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=5 2024-09-12T17:57:24.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.303+0000 7f5e9552f800 20 add_watcher() i=6 2024-09-12T17:57:24.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.304+0000 7f5e9552f800 20 add_watcher() i=7 2024-09-12T17:57:24.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.304+0000 7f5e9552f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:24.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.305+0000 7f5d477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:24.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 5 note: GC not initialized 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5d467e4640 20 reqs_thread_entry: start 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 20 Filter name: none 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5cb7fff640 20 reqs_thread_entry: start 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:57:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.306+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 : miss 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.307+0000 7f5e9552f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 2024-09-12T17:57:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.308+0000 7f5e9552f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5e9552f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5e9552f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5e9552f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5e9552f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30, ofs0, ns] 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5d74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 93903443138224 notifier 6818 bl.length()=931 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5d74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5d74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.315+0000 7f5d74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.317+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_sources= new_sources= 2024-09-12T17:57:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.317+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential sources added=[] removed=[] 2024-09-12T17:57:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.317+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_dests= new_dests= 2024-09-12T17:57:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.317+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential dests added=[] removed=[] 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.0 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.0 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.1 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.1 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.2 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.2 2024-09-12T17:57:24.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.3 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.3 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.4 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.4 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.5 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.5 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.6 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.6 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.7 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.7 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.8 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.8 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.9 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.9 2024-09-12T17:57:24.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.10 2024-09-12T17:57:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.10 2024-09-12T17:57:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.11 2024-09-12T17:57:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2.11 2024-09-12T17:57:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.0 2024-09-12T17:57:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.321+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.322+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.322+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.3 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.323+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.4 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.323+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.5 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.324+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.6 2024-09-12T17:57:24.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.324+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.7 2024-09-12T17:57:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.324+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.8 2024-09-12T17:57:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.325+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.9 2024-09-12T17:57:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.326+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.10 2024-09-12T17:57:24.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.329+0000 7f5e9552f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:24.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.329+0000 7f5e9552f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 2024-09-12T17:57:24.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5e9552f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5e9552f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5e9552f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5e9552f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30, ofs0, ns] 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5d63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 93903443138224 notifier 6818 bl.length()=931 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5d63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5d63fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.330+0000 7f5d63fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.332+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_sources= new_sources= 2024-09-12T17:57:24.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.332+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential sources added=[] removed=[] 2024-09-12T17:57:24.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.332+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_dests= new_dests= 2024-09-12T17:57:24.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.332+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential dests added=[] removed=[] 2024-09-12T17:57:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.334+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.0 2024-09-12T17:57:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.334+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.1 2024-09-12T17:57:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.335+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.2 2024-09-12T17:57:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.335+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.3 2024-09-12T17:57:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.335+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.4 2024-09-12T17:57:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.335+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.5 2024-09-12T17:57:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.336+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.6 2024-09-12T17:57:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.336+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.7 2024-09-12T17:57:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.337+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.8 2024-09-12T17:57:24.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.337+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.9 2024-09-12T17:57:24.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.337+0000 7f5e9552f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30.10 2024-09-12T17:57:24.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.337+0000 7f5e9552f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:24.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.337+0000 7f5e9552f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.338+0000 7f5e9552f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.338+0000 7f5e9552f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.338+0000 7f5e9552f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.339+0000 7f5e9552f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30, ofs0, ns] 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.339+0000 7f5d74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 93903443138224 notifier 6818 bl.length()=899 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.339+0000 7f5d74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 info.flags=0x17 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.339+0000 7f5d74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 to cache LRU end 2024-09-12T17:57:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.339+0000 7f5d74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:24.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.340+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_sources= new_sources= 2024-09-12T17:57:24.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.340+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential sources added=[] removed=[] 2024-09-12T17:57:24.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.340+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): orig_dests= new_dests= 2024-09-12T17:57:24.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.340+0000 7f5e9552f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30]): potential dests added=[] removed=[] 2024-09-12T17:57:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.342+0000 7f5e9552f800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:24.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.344+0000 7f5d477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.346+0000 7f5e9552f800 20 remove_watcher() i=0 2024-09-12T17:57:24.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.346+0000 7f5e9552f800 2 removed watcher, disabling cache 2024-09-12T17:57:24.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.347+0000 7f5e9552f800 20 remove_watcher() i=1 2024-09-12T17:57:24.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.348+0000 7f5e9552f800 20 remove_watcher() i=2 2024-09-12T17:57:24.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.350+0000 7f5e9552f800 20 remove_watcher() i=3 2024-09-12T17:57:24.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.351+0000 7f5e9552f800 20 remove_watcher() i=4 2024-09-12T17:57:24.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.352+0000 7f5e9552f800 20 remove_watcher() i=5 2024-09-12T17:57:24.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.353+0000 7f5e9552f800 20 remove_watcher() i=6 2024-09-12T17:57:24.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.354+0000 7f5e9552f800 20 remove_watcher() i=7 2024-09-12T17:57:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:57:24.395 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:24.395 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:24.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.432+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 realm 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.434+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.435+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:24.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.435+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.435+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:24.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.435+0000 7f930eb2e800 20 searching for the correct realm 2024-09-12T17:57:24.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.439+0000 7f930af65640 0 -- 172.21.15.94:0/3468862236 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55daa849b670 msgr2=0x55daa849da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:24.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.441+0000 7f930a764640 0 -- 172.21.15.94:0/3468862236 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f92f4090e80 msgr2=0x7f92f406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:24.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:24.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:24.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.646+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 zone default found 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 4 Realm: () 2024-09-12T17:57:24.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 zonegroup default 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.647+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.648+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.648+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.648+0000 7f930eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.648+0000 7f930eb2e800 20 started sync module instance, tier type = 2024-09-12T17:57:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.648+0000 7f930eb2e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.656+0000 7f930eb2e800 20 add_watcher() i=0 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.656+0000 7f930eb2e800 20 add_watcher() i=1 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.656+0000 7f930eb2e800 20 add_watcher() i=2 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.656+0000 7f930eb2e800 20 add_watcher() i=3 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.657+0000 7f930eb2e800 20 add_watcher() i=4 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.657+0000 7f930eb2e800 20 add_watcher() i=5 2024-09-12T17:57:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.657+0000 7f930eb2e800 20 add_watcher() i=6 2024-09-12T17:57:24.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.657+0000 7f930eb2e800 20 add_watcher() i=7 2024-09-12T17:57:24.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.657+0000 7f930eb2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.659+0000 7f91c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 5 note: GC not initialized 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f913b7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 20 Filter name: none 2024-09-12T17:57:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f91397fa640 20 reqs_thread_entry: start 2024-09-12T17:57:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.660+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.661+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.661+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.662+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.662+0000 7f930eb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.662+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.662+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.662+0000 7f930eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:24.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.663+0000 7f930eb2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:24.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.663+0000 7f930eb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:24.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.664+0000 7f91c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:24.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.667+0000 7f930eb2e800 20 remove_watcher() i=0 2024-09-12T17:57:24.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.667+0000 7f930eb2e800 2 removed watcher, disabling cache 2024-09-12T17:57:24.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.668+0000 7f930eb2e800 20 remove_watcher() i=1 2024-09-12T17:57:24.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.669+0000 7f930eb2e800 20 remove_watcher() i=2 2024-09-12T17:57:24.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.670+0000 7f930eb2e800 20 remove_watcher() i=3 2024-09-12T17:57:24.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.670+0000 7f930eb2e800 20 remove_watcher() i=4 2024-09-12T17:57:24.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.671+0000 7f930eb2e800 20 remove_watcher() i=5 2024-09-12T17:57:24.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.672+0000 7f930eb2e800 20 remove_watcher() i=6 2024-09-12T17:57:24.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:24.673+0000 7f930eb2e800 20 remove_watcher() i=7 2024-09-12T17:57:24.684 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:24.684 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:24.684 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:57:24.684 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:25.045 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:57:25.045 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:25.853 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:57:25.881 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:25.882 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:25.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.917+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 20 realm 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.918+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:25.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.919+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:25.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.919+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:25.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.920+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:25.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.920+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:25.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.920+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:25.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.920+0000 7fa9e1640800 20 searching for the correct realm 2024-09-12T17:57:25.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:25.924+0000 7fa9df92b640 0 -- 172.21.15.94:0/2409915781 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fa9c801f040 msgr2=0x7fa9c80a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:26.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.130+0000 7fa9df12a640 0 -- 172.21.15.94:0/2409915781 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x561961a16a20 msgr2=0x561961a18e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:26.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:26.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.132+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:26.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:26.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 zone default found 2024-09-12T17:57:26.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 4 Realm: () 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 zonegroup default 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.133+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.134+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.134+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.134+0000 7fa9e1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.134+0000 7fa9e1640800 20 started sync module instance, tier type = 2024-09-12T17:57:26.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.134+0000 7fa9e1640800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:26.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=0 2024-09-12T17:57:26.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=1 2024-09-12T17:57:26.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=2 2024-09-12T17:57:26.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=3 2024-09-12T17:57:26.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=4 2024-09-12T17:57:26.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=5 2024-09-12T17:57:26.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.142+0000 7fa9e1640800 20 add_watcher() i=6 2024-09-12T17:57:26.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.143+0000 7fa9e1640800 20 add_watcher() i=7 2024-09-12T17:57:26.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.143+0000 7fa9e1640800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:26.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 5 note: GC not initialized 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa894fe1640 20 reqs_thread_entry: start 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 20 Filter name: none 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa80e7fc640 20 reqs_thread_entry: start 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.145+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.146+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:26.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.146+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.147+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:26.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.147+0000 7fa9e1640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:26.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.147+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.147+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:26.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.147+0000 7fa9e1640800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.148+0000 7fa9e1640800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:26.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.148+0000 7fa9e1640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:26.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.149+0000 7fa895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.151+0000 7fa9e1640800 20 remove_watcher() i=0 2024-09-12T17:57:26.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.151+0000 7fa9e1640800 2 removed watcher, disabling cache 2024-09-12T17:57:26.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.152+0000 7fa9e1640800 20 remove_watcher() i=1 2024-09-12T17:57:26.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.153+0000 7fa9e1640800 20 remove_watcher() i=2 2024-09-12T17:57:26.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.154+0000 7fa9e1640800 20 remove_watcher() i=3 2024-09-12T17:57:26.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.155+0000 7fa9e1640800 20 remove_watcher() i=4 2024-09-12T17:57:26.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.156+0000 7fa9e1640800 20 remove_watcher() i=5 2024-09-12T17:57:26.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.157+0000 7fa9e1640800 20 remove_watcher() i=6 2024-09-12T17:57:26.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.158+0000 7fa9e1640800 20 remove_watcher() i=7 2024-09-12T17:57:26.169 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:26.169 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:26.170 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:26.170 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:26.171 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:57:26.207 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:26.207 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:26.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.242+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 20 realm 2024-09-12T17:57:26.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:26.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.244+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.245+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.245+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.245+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:26.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.245+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.246+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:26.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.246+0000 7f5adaebb800 20 searching for the correct realm 2024-09-12T17:57:26.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.249+0000 7f5ad3fff640 0 -- 172.21.15.94:0/759593547 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f5acc072040 msgr2=0x7f5acc0af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:26.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.253+0000 7f5ad91a6640 0 -- 172.21.15.94:0/759593547 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f5ac400e070 msgr2=0x7f5ac4097a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.256+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:26.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 zone default found 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 4 Realm: () 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 zonegroup default 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.257+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 started sync module instance, tier type = 2024-09-12T17:57:26.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.258+0000 7f5adaebb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:26.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=0 2024-09-12T17:57:26.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=1 2024-09-12T17:57:26.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=2 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=3 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=4 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=5 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.267+0000 7f5adaebb800 20 add_watcher() i=6 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.268+0000 7f5adaebb800 20 add_watcher() i=7 2024-09-12T17:57:26.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.268+0000 7f5adaebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:26.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.270+0000 7f598efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 5 note: GC not initialized 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f598dfe3640 20 reqs_thread_entry: start 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 20 Filter name: none 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f58ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.271+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:26.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 : miss 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:26.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.272+0000 7f5adaebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 2024-09-12T17:57:26.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f5adaebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f5adaebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f5adaebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f5adaebb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31, ofs0, ns] 2024-09-12T17:57:26.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f59affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529710 cookie 94389648893552 notifier 6860 bl.length()=931 2024-09-12T17:57:26.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f59affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f59affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.277+0000 7f59affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.279+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_sources= new_sources= 2024-09-12T17:57:26.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.279+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential sources added=[] removed=[] 2024-09-12T17:57:26.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.279+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_dests= new_dests= 2024-09-12T17:57:26.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.279+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential dests added=[] removed=[] 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.0 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.0 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.1 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.1 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.2 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.2 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.3 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.3 2024-09-12T17:57:26.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.4 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.4 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.5 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.5 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.6 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.6 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.7 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.7 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.8 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.8 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.9 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.9 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.10 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.10 2024-09-12T17:57:26.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.11 2024-09-12T17:57:26.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1.11 2024-09-12T17:57:26.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.283+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.0 2024-09-12T17:57:26.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.284+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.284+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.2 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.285+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.3 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.285+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.4 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.286+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.5 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.286+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.6 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.286+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.7 2024-09-12T17:57:26.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.287+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.8 2024-09-12T17:57:26.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.287+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.9 2024-09-12T17:57:26.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.288+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.10 2024-09-12T17:57:26.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.290+0000 7f5adaebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:26.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.291+0000 7f5adaebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 2024-09-12T17:57:26.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f5adaebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f5adaebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f5adaebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f5adaebb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31, ofs0, ns] 2024-09-12T17:57:26.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f59affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 94389648893552 notifier 6860 bl.length()=931 2024-09-12T17:57:26.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f59affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f59affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.292+0000 7f59affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.294+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_sources= new_sources= 2024-09-12T17:57:26.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.294+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential sources added=[] removed=[] 2024-09-12T17:57:26.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.294+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_dests= new_dests= 2024-09-12T17:57:26.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.294+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential dests added=[] removed=[] 2024-09-12T17:57:26.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.296+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.0 2024-09-12T17:57:26.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.296+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.1 2024-09-12T17:57:26.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.297+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.2 2024-09-12T17:57:26.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.297+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.3 2024-09-12T17:57:26.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.297+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.4 2024-09-12T17:57:26.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.298+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.5 2024-09-12T17:57:26.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.298+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.6 2024-09-12T17:57:26.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.298+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.7 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.298+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.8 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.299+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.9 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.299+0000 7f5adaebb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31.10 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.299+0000 7f5adaebb800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.299+0000 7f5adaebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:26.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.299+0000 7f5adaebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 2024-09-12T17:57:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f5adaebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f5adaebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f5adaebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f5adaebb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31, ofs0, ns] 2024-09-12T17:57:26.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f59affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529712 cookie 94389648893552 notifier 6860 bl.length()=899 2024-09-12T17:57:26.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f59affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 info.flags=0x17 2024-09-12T17:57:26.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f59affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 to cache LRU end 2024-09-12T17:57:26.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.301+0000 7f59affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:26.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.303+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_sources= new_sources= 2024-09-12T17:57:26.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.303+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential sources added=[] removed=[] 2024-09-12T17:57:26.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.303+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): orig_dests= new_dests= 2024-09-12T17:57:26.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.303+0000 7f5adaebb800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31]): potential dests added=[] removed=[] 2024-09-12T17:57:26.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.305+0000 7f5adaebb800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:26.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.307+0000 7f598efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.309+0000 7f5adaebb800 20 remove_watcher() i=0 2024-09-12T17:57:26.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.309+0000 7f5adaebb800 2 removed watcher, disabling cache 2024-09-12T17:57:26.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.310+0000 7f5adaebb800 20 remove_watcher() i=1 2024-09-12T17:57:26.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.311+0000 7f5adaebb800 20 remove_watcher() i=2 2024-09-12T17:57:26.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.312+0000 7f5adaebb800 20 remove_watcher() i=3 2024-09-12T17:57:26.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.313+0000 7f5adaebb800 20 remove_watcher() i=4 2024-09-12T17:57:26.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.314+0000 7f5adaebb800 20 remove_watcher() i=5 2024-09-12T17:57:26.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.315+0000 7f5adaebb800 20 remove_watcher() i=6 2024-09-12T17:57:26.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.316+0000 7f5adaebb800 20 remove_watcher() i=7 2024-09-12T17:57:26.329 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:57:26.358 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:26.358 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:26.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.394+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 realm 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:26.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.396+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.397+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:26.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.397+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.397+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:26.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.397+0000 7f93c7728800 20 searching for the correct realm 2024-09-12T17:57:26.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.399+0000 7f93c346f640 0 -- 172.21.15.94:0/604119952 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f93bc025040 msgr2=0x7f93bc00e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.604+0000 7f93c3c70640 0 -- 172.21.15.94:0/604119952 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f93ac048410 msgr2=0x7f93ac048830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:26.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.609+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 zone default found 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 4 Realm: () 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 zonegroup default 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.610+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.611+0000 7f93c7728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.611+0000 7f93c7728800 20 started sync module instance, tier type = 2024-09-12T17:57:26.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.611+0000 7f93c7728800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=0 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=1 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=2 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=3 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=4 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=5 2024-09-12T17:57:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.619+0000 7f93c7728800 20 add_watcher() i=6 2024-09-12T17:57:26.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.620+0000 7f93c7728800 20 add_watcher() i=7 2024-09-12T17:57:26.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.620+0000 7f93c7728800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.621+0000 7f9279fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 5 note: GC not initialized 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f9278fe1640 20 reqs_thread_entry: start 2024-09-12T17:57:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 20 Filter name: none 2024-09-12T17:57:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f91f27fc640 20 reqs_thread_entry: start 2024-09-12T17:57:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.622+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.623+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.623+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.623+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.623+0000 7f93c7728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.623+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.624+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.624+0000 7f93c7728800 20 rados->read ofs=0 len=0 2024-09-12T17:57:26.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.624+0000 7f93c7728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:26.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.624+0000 7f93c7728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:26.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.626+0000 7f9279fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.628+0000 7f93c7728800 20 remove_watcher() i=0 2024-09-12T17:57:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.628+0000 7f93c7728800 2 removed watcher, disabling cache 2024-09-12T17:57:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.629+0000 7f93c7728800 20 remove_watcher() i=1 2024-09-12T17:57:26.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.630+0000 7f93c7728800 20 remove_watcher() i=2 2024-09-12T17:57:26.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.631+0000 7f93c7728800 20 remove_watcher() i=3 2024-09-12T17:57:26.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.632+0000 7f93c7728800 20 remove_watcher() i=4 2024-09-12T17:57:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.633+0000 7f93c7728800 20 remove_watcher() i=5 2024-09-12T17:57:26.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.634+0000 7f93c7728800 20 remove_watcher() i=6 2024-09-12T17:57:26.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:26.635+0000 7f93c7728800 20 remove_watcher() i=7 2024-09-12T17:57:26.646 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:26.646 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:26.646 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:57:26.646 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:27.019 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:57:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:27.827 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:57:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:27.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.892+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:27.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:27.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 20 realm 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.893+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.894+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:27.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.894+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:27.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.894+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:27.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.894+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:27.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.895+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:27.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.895+0000 7fba0d60f800 20 searching for the correct realm 2024-09-12T17:57:27.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:27.896+0000 7fba0b0f9640 0 -- 172.21.15.94:0/2297284287 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fba04004040 msgr2=0x7fba04066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.101+0000 7fba0b8fa640 0 -- 172.21.15.94:0/2297284287 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fb9f4061040 msgr2=0x7fb9f4062430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:28.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:28.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:28.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.106+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.107+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.107+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.107+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.107+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:28.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 zone default found 2024-09-12T17:57:28.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 4 Realm: () 2024-09-12T17:57:28.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 zonegroup default 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.108+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.109+0000 7fba0d60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.109+0000 7fba0d60f800 20 started sync module instance, tier type = 2024-09-12T17:57:28.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.109+0000 7fba0d60f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:28.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=0 2024-09-12T17:57:28.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=1 2024-09-12T17:57:28.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=2 2024-09-12T17:57:28.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=3 2024-09-12T17:57:28.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=4 2024-09-12T17:57:28.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=5 2024-09-12T17:57:28.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.117+0000 7fba0d60f800 20 add_watcher() i=6 2024-09-12T17:57:28.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.118+0000 7fba0d60f800 20 add_watcher() i=7 2024-09-12T17:57:28.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.118+0000 7fba0d60f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:28.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.120+0000 7fb8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.120+0000 7fba0d60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.120+0000 7fba0d60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.120+0000 7fba0d60f800 5 note: GC not initialized 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fb8c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fba0d60f800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fba0d60f800 20 Filter name: none 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fb83a7fc640 20 reqs_thread_entry: start 2024-09-12T17:57:28.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.121+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:28.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.122+0000 7fba0d60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:28.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.124+0000 7fb8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.126+0000 7fba0d60f800 20 remove_watcher() i=0 2024-09-12T17:57:28.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.126+0000 7fba0d60f800 2 removed watcher, disabling cache 2024-09-12T17:57:28.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.127+0000 7fba0d60f800 20 remove_watcher() i=1 2024-09-12T17:57:28.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.128+0000 7fba0d60f800 20 remove_watcher() i=2 2024-09-12T17:57:28.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.129+0000 7fba0d60f800 20 remove_watcher() i=3 2024-09-12T17:57:28.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.130+0000 7fba0d60f800 20 remove_watcher() i=4 2024-09-12T17:57:28.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.131+0000 7fba0d60f800 20 remove_watcher() i=5 2024-09-12T17:57:28.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.132+0000 7fba0d60f800 20 remove_watcher() i=6 2024-09-12T17:57:28.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.133+0000 7fba0d60f800 20 remove_watcher() i=7 2024-09-12T17:57:28.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.144 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:28.144 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:28.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.146 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:57:28.180 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:28.180 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:28.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.216+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 realm 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:28.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:28.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.218+0000 7f6b18d75800 20 searching for the correct realm 2024-09-12T17:57:28.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.221+0000 7f6b16065640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6b08044060 msgr2=0x7f6b0809b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.225+0000 7f6b16866640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6b0c096330 msgr2=0x7f6b0c04c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:28.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:28.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:28.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:28.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zone default found 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Realm: () 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zonegroup default 2024-09-12T17:57:28.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.432+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started sync module instance, tier type = 2024-09-12T17:57:28.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=0 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=1 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=2 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=3 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=4 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=5 2024-09-12T17:57:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=6 2024-09-12T17:57:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.441+0000 7f6b18d75800 20 add_watcher() i=7 2024-09-12T17:57:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.441+0000 7f6b18d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.443+0000 7f69cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 5 note: GC not initialized 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6947fff640 20 reqs_thread_entry: start 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 20 Filter name: none 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6945ffb640 20 reqs_thread_entry: start 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:57:28.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : miss 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.445+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.449+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.449+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.449+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.449+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.463+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:28.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.463+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.464+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.464+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.464+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.464+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.472+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.473 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b18d75800 time 2024-09-12T17:57:28.473282+0000 2024-09-12T17:57:28.473 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b1c38c71a] 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.472+0000 7f6b18d75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b18d75800 time 2024-09-12T17:57:28.473282+0000 2024-09-12T17:57:28.474 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b1c38c71a] 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:57:28.475 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f6b18d75800 thread_name:radosgw-admin 2024-09-12T17:57:28.492 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.492 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b1b03e6f0] 2024-09-12T17:57:28.492 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b1b08b99c] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b1c38c774] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.473+0000 7f6b18d75800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f6b18d75800 thread_name:radosgw-admin 2024-09-12T17:57:28.493 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b1b03e6f0] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b1b08b99c] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b1c38c774] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:28.494 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc1cb440 auth_method 0 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.495 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_done global_id 7317 payload 824 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:57:28.201+0000 7f6b16065640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: dump: 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.496 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: dump: 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.497 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:57:28.202+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7317 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:57:28.201+0000 7f6a04e09640 4 set_mon_vals no callback set 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.498 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:57:28.202+0000 7f6b18d75800 1 librados: init done 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:57:28.204+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f69fc076470 auth_method 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:57:28.204+0000 7f6b17067640 10 monclient: get_auth_request con 0x55f4fc2ad8d0 auth_method 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:57:28.205+0000 7f6b16866640 10 monclient: get_auth_request con 0x55f4fc2d0820 auth_method 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:57:28.206+0000 7f6b16065640 10 monclient: get_auth_request con 0x55f4fc2d5db0 auth_method 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:57:28.207+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.499 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.500 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command objecter_requests cmddesc objecter_requests hook 0x55f4fc2dd170 EEXIST 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.501 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.502 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:57:28.208+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x55f4fc2d8da0 EEXIST 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc301490 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc301870 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc3001a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.722098s 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc301490 auth_method 0 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.503 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc3001a0 auth_method 0 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc301870 auth_method 0 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.504 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 6902 payload 824 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:57:28.208+0000 7f6b16866640 1 monclient: found mon.noname-c 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: dump: 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.505 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: dump: 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.506 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:57:28.208+0000 7f6b18d75800 5 monclient: authenticate success, global_id 6902 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:57:28.208+0000 7f6b17868640 4 set_mon_vals no callback set 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.507 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:57:28.210+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69f0076380 auth_method 0 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: get_monmap_and_config 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:57:28.210+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.508 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.509 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.510 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x7ffd13c90478 EEXIST 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.511 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc355740 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc346090 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc350b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.725789s 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc355740 auth_method 0 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc346090 auth_method 0 2024-09-12T17:57:28.512 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc350b70 auth_method 0 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.513 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 7323 payload 274 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:57:28.212+0000 7f6b16866640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: dump: 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.514 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: dump: 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.515 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:57:28.212+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7323 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: get_monmap_and_config success 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:57:28.212+0000 7f6b18d75800 4 set_mon_vals no callback set 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: shutdown 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:57:28.212+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.516 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.517 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: starting msgr at 2024-09-12T17:57:28.518 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: starting objecter 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command objecter_requests cmddesc objecter_requests hook 0x55f4fc327170 EEXIST 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: setting wanted keys 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: calling monclient init 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.519 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x55f4fc315e98 EEXIST 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc346090 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc350b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.520 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc355740 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.727950s 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc346090 auth_method 0 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc355740 auth_method 0 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.521 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc350b70 auth_method 0 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.522 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 7326 payload 824 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:57:28.214+0000 7f6b16866640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: dump: 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.523 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: dump: 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.524 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:57:28.214+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7326 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:57:28.214+0000 7f69fa7fc640 4 set_mon_vals no callback set 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:57:28.214+0000 7f6b18d75800 1 librados: init done 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:57:28.214+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cr dump hook 0x55f4fc345d18 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:57:28.216+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.525 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:57:28.216+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69e0076470 auth_method 0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:57:28.216+0000 7f6b17067640 10 monclient: get_auth_request con 0x55f4fc36f290 auth_method 0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 realm 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:57:28.217+0000 7f6b18d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.526 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:57:28.217+0000 7f6b16866640 10 monclient: get_auth_request con 0x55f4fc373570 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 searching for the correct realm 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:57:28.218+0000 7f6b16065640 10 monclient: get_auth_request con 0x55f4fc378810 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:57:28.219+0000 7f6b17067640 10 monclient: get_auth_request con 0x7f6b0c05fb90 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:57:28.220+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b10078040 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:57:28.220+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f6b08044060 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:57:28.221+0000 7f6b16065640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6b08044060 msgr2=0x7f6b0809b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 1 client.7326.objecter ms_handle_reset 0x7f6b08044060 session 0x7f6b0801d040 osd.4 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 10 monclient: _renew_subs 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:57:28.221+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69e0086b90 auth_method 0 2024-09-12T17:57:28.527 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:57:28.222+0000 7f6b17067640 10 monclient: get_auth_request con 0x7f6b0c05c040 auth_method 0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:57:28.224+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b0c096330 auth_method 0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:57:28.225+0000 7f6b16866640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6b0c096330 msgr2=0x7f6b0c04c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:57:28.426+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b0c096330 auth_method 0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.528 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zone default found 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Realm: () 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:57:28.431+0000 7f6b18d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zonegroup default 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.529 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started sync module instance, tier type = 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=0 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=1 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=2 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=3 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=4 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=5 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=6 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:57:28.441+0000 7f6b18d75800 20 add_watcher() i=7 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:57:28.441+0000 7f6b18d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.530 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.531 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:57:28.443+0000 7f69cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:57:28.443+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache list hook 0x55f4fc34dcc0 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache inspect hook 0x55f4fc34dcc0 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache erase hook 0x55f4fc34dcc0 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache zap hook 0x55f4fc34dcc0 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 note: GC not initialized 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:57:28.444+0000 7f6947fff640 20 reqs_thread_entry: start 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace show hook 0x7f6b10065040 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace history hook 0x7f6b10065040 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace active hook 0x7f6b10065040 2024-09-12T17:57:28.532 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace active_short hook 0x7f6b10065040 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 Filter name: none 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:57:28.444+0000 7f6945ffb640 20 reqs_thread_entry: start 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : miss 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:57:28.445+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.533 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.534 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.535 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.536 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:57:28.463+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:57:28.463+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.537 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.538 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:57:28.472+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:57:28.472+0000 7f6b18d75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b18d75800 time 2024-09-12T17:57:28.473282+0000 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.539 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b1c38c71a] 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:57:28.473+0000 7f6b18d75800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f6b18d75800 thread_name:radosgw-admin 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.540 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b1b03e6f0] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b1b08b99c] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b1c38c774] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:28.541 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:57:28.542 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:57:28.543 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:28.544 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:57:28.545 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:28.546 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:28.547 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6945ffb640 / http_manager 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6947fff640 / http_manager 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69cd7e2640 / rgw_dt_lg_renew 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69f8ff9640 / ms_dispatch 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69f9ffb640 / io_context_pool 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69fa7fc640 / io_context_pool 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a00e01640 / ms_dispatch 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a03606640 / ms_dispatch 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a04e09640 / io_context_pool 2024-09-12T17:57:28.548 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b16065640 / msgr-worker-2 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b16866640 / msgr-worker-1 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b17067640 / msgr-worker-0 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b17868640 / io_context_pool 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b18d75800 / radosgw-admin 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.121219.log 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.549 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:57:28.201+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc1cb440 auth_method 0 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:57:28.201+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient(hunting): handle_auth_done global_id 7317 payload 824 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.550 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:57:28.201+0000 7f6b16065640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:57:28.201+0000 7f6b16065640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: dump: 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.551 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:57:28.201+0000 7f6a03606640 10 monclient: dump: 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.552 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:57:28.202+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7317 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:57:28.201+0000 7f6a04e09640 4 set_mon_vals no callback set 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:57:28.202+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:57:28.202+0000 7f6b18d75800 1 librados: init done 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:57:28.203+0000 7f6a03606640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:57:28.204+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f69fc076470 auth_method 0 2024-09-12T17:57:28.553 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:57:28.204+0000 7f6b17067640 10 monclient: get_auth_request con 0x55f4fc2ad8d0 auth_method 0 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:57:28.205+0000 7f6b16866640 10 monclient: get_auth_request con 0x55f4fc2d0820 auth_method 0 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:57:28.206+0000 7f6b16065640 10 monclient: get_auth_request con 0x55f4fc2d5db0 auth_method 0 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:57:28.207+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.554 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding auth protocol: cephx 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.555 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: crc 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d9ca0) adding con mode: secure 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command objecter_requests cmddesc objecter_requests hook 0x55f4fc2dd170 EEXIST 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:57:28.207+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding auth protocol: cephx 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.556 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: crc 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:57:28.207+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc2d8c58) adding con mode: secure 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:57:28.207+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:57:28.208+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x55f4fc2d8da0 EEXIST 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc301490 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc301870 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.557 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc3001a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.722098s 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc301490 auth_method 0 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc3001a0 auth_method 0 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.558 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:57:28.208+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc301870 auth_method 0 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.559 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:57:28.208+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 6902 payload 824 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:57:28.208+0000 7f6b16866640 1 monclient: found mon.noname-c 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:57:28.208+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: dump: 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.560 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:57:28.208+0000 7f6a00e01640 10 monclient: dump: 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.561 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:57:28.208+0000 7f6b18d75800 5 monclient: authenticate success, global_id 6902 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.562 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:57:28.208+0000 7f6b17868640 4 set_mon_vals no callback set 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:57:28.208+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:57:28.210+0000 7f6a00e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:57:28.210+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69f0076380 auth_method 0 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: get_monmap_and_config 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:57:28.210+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:57:28.210+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.563 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding auth protocol: cephx 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.564 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: crc 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:57:28.210+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc321180) adding con mode: secure 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.565 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding auth protocol: cephx 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: crc 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90330) adding con mode: secure 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.566 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:57:28.211+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:57:28.211+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x7ffd13c90478 EEXIST 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc355740 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc346090 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc350b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:57:28.211+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.725789s 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc355740 auth_method 0 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.567 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc346090 auth_method 0 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:57:28.211+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:57:28.211+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc350b70 auth_method 0 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.568 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:57:28.211+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 7323 payload 274 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:57:28.212+0000 7f6b16866640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:57:28.212+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: dump: 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.569 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.570 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:57:28.212+0000 7f69fa7fc640 10 monclient: dump: 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:57:28.212+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7323 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: get_monmap_and_config success 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:57:28.212+0000 7f6b18d75800 4 set_mon_vals no callback set 2024-09-12T17:57:28.571 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: shutdown 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:57:28.212+0000 7f6b18d75800 10 monclient: build_initial_monmap 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:57:28.212+0000 7f6b18d75800 1 build_initial for_mkfs: 0 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: monmap: 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:57:28.572 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding auth protocol: cephx 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.573 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: crc 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc324ca0) adding con mode: secure 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: starting msgr at 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: starting objecter 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command objecter_requests cmddesc objecter_requests hook 0x55f4fc327170 EEXIST 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: setting wanted keys 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:57:28.213+0000 7f6b18d75800 1 librados: calling monclient init 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: init 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding auth protocol: cephx 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.574 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: crc 2024-09-12T17:57:28.575 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 AuthRegistry(0x55f4fc315d50) adding con mode: secure 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:57:28.213+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:57:28.213+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command rotate-key cmddesc rotate-key hook 0x55f4fc315e98 EEXIST 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: _reopen_session rank -1 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-a con 0x55f4fc346090 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-b con 0x55f4fc350b70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): picked mon.noname-c con 0x55f4fc355740 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): _renew_subs 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:57:28.213+0000 7f6b18d75800 10 monclient(hunting): authenticate will time out at 2121.727950s 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): get_auth_request con 0x55f4fc346090 auth_method 0 2024-09-12T17:57:28.576 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): get_auth_request con 0x55f4fc355740 auth_method 0 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:57:28.214+0000 7f6b17067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): get_auth_request con 0x55f4fc350b70 auth_method 0 2024-09-12T17:57:28.577 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:57:28.214+0000 7f6b16065640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient(hunting): handle_auth_done global_id 7326 payload 824 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient: _finish_hunting 0 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:57:28.214+0000 7f6b16866640 1 monclient: found mon.noname-a 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:57:28.214+0000 7f6b16866640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: dump: 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.578 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:57:28.214+0000 7f69f8ff9640 10 monclient: dump: 2024-09-12T17:57:28.579 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:57:28.214+0000 7f6b18d75800 5 monclient: authenticate success, global_id 7326 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:57:28.214+0000 7f69fa7fc640 4 set_mon_vals no callback set 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.580 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _renew_subs 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:57:28.214+0000 7f6b18d75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:57:28.214+0000 7f6b18d75800 1 librados: init done 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:57:28.214+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cr dump hook 0x55f4fc345d18 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:57:28.216+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:57:28.216+0000 7f69f8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:57:28.216+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69e0076470 auth_method 0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:57:28.216+0000 7f6b17067640 10 monclient: get_auth_request con 0x55f4fc36f290 auth_method 0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 realm 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:57:28.217+0000 7f6b18d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:28.581 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:57:28.217+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:57:28.217+0000 7f6b16866640 10 monclient: get_auth_request con 0x55f4fc373570 auth_method 0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:57:28.218+0000 7f6b18d75800 20 searching for the correct realm 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:57:28.218+0000 7f6b16065640 10 monclient: get_auth_request con 0x55f4fc378810 auth_method 0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:57:28.219+0000 7f6b17067640 10 monclient: get_auth_request con 0x7f6b0c05fb90 auth_method 0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:57:28.220+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b10078040 auth_method 0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:57:28.220+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f6b08044060 auth_method 0 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:57:28.221+0000 7f6b16065640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6b08044060 msgr2=0x7f6b0809b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 1 client.7326.objecter ms_handle_reset 0x7f6b08044060 session 0x7f6b0801d040 osd.4 2024-09-12T17:57:28.582 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 10 monclient: _renew_subs 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:57:28.221+0000 7f69f8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:57:28.221+0000 7f6b16065640 10 monclient: get_auth_request con 0x7f69e0086b90 auth_method 0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:57:28.222+0000 7f6b17067640 10 monclient: get_auth_request con 0x7f6b0c05c040 auth_method 0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:57:28.224+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b0c096330 auth_method 0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:57:28.225+0000 7f6b16866640 0 -- 172.21.15.94:0/2432608326 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6b0c096330 msgr2=0x7f6b0c04c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:57:28.426+0000 7f6b16866640 10 monclient: get_auth_request con 0x7f6b0c096330 auth_method 0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.583 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:57:28.430+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zone default found 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Realm: () 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:57:28.431+0000 7f6b18d75800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:57:28.431+0000 7f6b18d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 zonegroup default 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.584 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:57:28.431+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started sync module instance, tier type = 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:57:28.432+0000 7f6b18d75800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=0 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=1 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=2 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=3 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=4 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=5 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:57:28.440+0000 7f6b18d75800 20 add_watcher() i=6 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:57:28.441+0000 7f6b18d75800 20 add_watcher() i=7 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:57:28.441+0000 7f6b18d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.585 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding auth protocol: cephx 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: crc 2024-09-12T17:57:28.586 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 AuthRegistry(0x7ffd13c90800) adding con mode: secure 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:57:28.443+0000 7f69cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:57:28.443+0000 7f6b18d75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:57:28.443+0000 7f6b18d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache list hook 0x55f4fc34dcc0 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache inspect hook 0x55f4fc34dcc0 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache erase hook 0x55f4fc34dcc0 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:57:28.443+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command cache zap hook 0x55f4fc34dcc0 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 note: GC not initialized 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:57:28.444+0000 7f6947fff640 20 reqs_thread_entry: start 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace show hook 0x7f6b10065040 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace history hook 0x7f6b10065040 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace active hook 0x7f6b10065040 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:57:28.444+0000 7f6b18d75800 5 asok(0x55f4fc063730) register_command sync trace active_short hook 0x7f6b10065040 2024-09-12T17:57:28.587 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 Filter name: none 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:57:28.444+0000 7f6945ffb640 20 reqs_thread_entry: start 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:57:28.444+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : miss 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:57:28.444+0000 7f6b18d75800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:57:28.445+0000 7f6b18d75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.588 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:57:28.445+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:57:28.449+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:57:28.450+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.589 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:57:28.451+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:57:28.455+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.590 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:57:28.455+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:57:28.456+0000 7f6b18d75800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.591 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:57:28.456+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:57:28.457+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:57:28.458+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:57:28.459+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:57:28.460+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:57:28.463+0000 7f6b18d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:57:28.463+0000 7f6b18d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:57:28.464+0000 7f6b18d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:28.592 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94510691911280 notifier 7326 bl.length()=931 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:57:28.465+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:57:28.466+0000 7f6b18d75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:57:28.469+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:57:28.470+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:28.593 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:57:28.471+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:57:28.472+0000 7f6b18d75800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:57:28.472+0000 7f6b18d75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b18d75800 time 2024-09-12T17:57:28.473282+0000 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b1c38c71a] 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:57:28.594 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:57:28.473+0000 7f6b18d75800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f6b18d75800 thread_name:radosgw-admin 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b1b03e6f0] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b1b08b99c] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b1c38c774] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6b1c38c8d8] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f4fa6db841] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f4fa6eb827] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b1b029590] 2024-09-12T17:57:28.595 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:28.596 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:57:28.597 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:57:28.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:57:28.599 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:57:28.600 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:28.601 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6945ffb640 / http_manager 2024-09-12T17:57:28.602 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6947fff640 / http_manager 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69cd7e2640 / rgw_dt_lg_renew 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69f8ff9640 / ms_dispatch 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69f9ffb640 / io_context_pool 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f69fa7fc640 / io_context_pool 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a00e01640 / ms_dispatch 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a03606640 / ms_dispatch 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6a04e09640 / io_context_pool 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b16065640 / msgr-worker-2 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b16866640 / msgr-worker-1 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b17067640 / msgr-worker-0 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b17868640 / io_context_pool 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: 7f6b18d75800 / radosgw-admin 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:57:28.603 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:57:28.474650Z_a47373e7-164f-409e-8bb7-96e4f8abc811/log 2024-09-12T17:57:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:57:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:57:28.608 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.548+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 realm 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.550+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.551+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.551+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.551+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.551+0000 7f936d52e800 20 searching for the correct realm 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.554+0000 7f9369ade640 0 -- 172.21.15.94:0/2710802488 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55beff06c100 msgr2=0x55beff06e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.558+0000 7f9363fff640 0 -- 172.21.15.94:0/2710802488 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f935c07b400 msgr2=0x7f935c07b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.561+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:28.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 zone default found 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 4 Realm: () 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 zonegroup default 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.562+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.563+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.563+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.563+0000 7f936d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.563+0000 7f936d52e800 20 started sync module instance, tier type = 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.563+0000 7f936d52e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=0 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=1 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=2 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=3 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=4 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=5 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.571+0000 7f936d52e800 20 add_watcher() i=6 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.572+0000 7f936d52e800 20 add_watcher() i=7 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.572+0000 7f936d52e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.574+0000 7f921f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.574+0000 7f936d52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.574+0000 7f936d52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.574+0000 7f936d52e800 5 note: GC not initialized 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f921e7e4640 20 reqs_thread_entry: start 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f936d52e800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f936d52e800 20 Filter name: none 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f918ffff640 20 reqs_thread_entry: start 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.575+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.576+0000 7f936d52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:28.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.578+0000 7f921f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.580+0000 7f936d52e800 20 remove_watcher() i=0 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.580+0000 7f936d52e800 2 removed watcher, disabling cache 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.581+0000 7f936d52e800 20 remove_watcher() i=1 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.582+0000 7f936d52e800 20 remove_watcher() i=2 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.583+0000 7f936d52e800 20 remove_watcher() i=3 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.584+0000 7f936d52e800 20 remove_watcher() i=4 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.585+0000 7f936d52e800 20 remove_watcher() i=5 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.586+0000 7f936d52e800 20 remove_watcher() i=6 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:28.586+0000 7f936d52e800 20 remove_watcher() i=7 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:28.614 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:58.807 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:58.839 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:58.839 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.876+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 realm 2024-09-12T17:57:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.878+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.879+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.879+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.880+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.880+0000 7f5242e20800 20 searching for the correct realm 2024-09-12T17:57:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.883+0000 7f5241112640 0 -- 172.21.15.94:0/2116063972 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f522c06b8d0 msgr2=0x7f522c061850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:58.887+0000 7f5240911640 0 -- 172.21.15.94:0/2116063972 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f522c07c050 msgr2=0x7f522c098210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 zone default found 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 4 Realm: () 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 zonegroup default 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.094+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 started sync module instance, tier type = 2024-09-12T17:57:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.095+0000 7f5242e20800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=0 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=1 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=2 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=3 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=4 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=5 2024-09-12T17:57:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=6 2024-09-12T17:57:59.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 20 add_watcher() i=7 2024-09-12T17:57:59.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.105+0000 7f5242e20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:59.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.107+0000 7f50f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.107+0000 7f5242e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.107+0000 7f5242e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 5 note: GC not initialized 2024-09-12T17:57:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f50f67e4640 20 reqs_thread_entry: start 2024-09-12T17:57:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 20 Filter name: none 2024-09-12T17:57:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f50ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : miss 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.108+0000 7f5242e20800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:59.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.109+0000 7f5242e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:59.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f5242e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f5242e20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f5242e20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f5242e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f51177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94215346779664 notifier 7362 bl.length()=931 2024-09-12T17:57:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f51177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f51177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.114+0000 7f51177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.116+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.116+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.116+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.116+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.0 2024-09-12T17:57:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.1 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.2 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.3 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.4 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.5 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.6 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.7 2024-09-12T17:57:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.8 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.9 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.10 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1.11 2024-09-12T17:57:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.120+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.121+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.121+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.122+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.122+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.123+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:59.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.123+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:59.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.124+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.124+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.124+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.125+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:59.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.128+0000 7f5242e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:59.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.128+0000 7f5242e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.129+0000 7f5242e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.129+0000 7f5242e20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.129+0000 7f5242e20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.129+0000 7f5242e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.130+0000 7f51177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94215346779664 notifier 7362 bl.length()=931 2024-09-12T17:57:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.130+0000 7f51177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.130+0000 7f51177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.130+0000 7f51177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.131+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.131+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.131+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.131+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.133+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.0 2024-09-12T17:57:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.134+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.1 2024-09-12T17:57:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.134+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.2 2024-09-12T17:57:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.134+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.3 2024-09-12T17:57:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.135+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.4 2024-09-12T17:57:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.135+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.5 2024-09-12T17:57:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.135+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.6 2024-09-12T17:57:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.136+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.7 2024-09-12T17:57:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.136+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.8 2024-09-12T17:57:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.136+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.9 2024-09-12T17:57:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.136+0000 7f5242e20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32.10 2024-09-12T17:57:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.137+0000 7f5242e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.137+0000 7f5242e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 2024-09-12T17:57:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5242e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5242e20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5242e20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5242e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32, ofs0, ns] 2024-09-12T17:57:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94215346779664 notifier 7362 bl.length()=899 2024-09-12T17:57:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 info.flags=0x17 2024-09-12T17:57:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 to cache LRU end 2024-09-12T17:57:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.138+0000 7f5117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.140+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_sources= new_sources= 2024-09-12T17:57:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.140+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential sources added=[] removed=[] 2024-09-12T17:57:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.140+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): orig_dests= new_dests= 2024-09-12T17:57:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.140+0000 7f5242e20800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32]): potential dests added=[] removed=[] 2024-09-12T17:57:59.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.142+0000 7f5242e20800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.144+0000 7f50f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.146+0000 7f5242e20800 20 remove_watcher() i=0 2024-09-12T17:57:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.146+0000 7f5242e20800 2 removed watcher, disabling cache 2024-09-12T17:57:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.147+0000 7f5242e20800 20 remove_watcher() i=1 2024-09-12T17:57:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.148+0000 7f5242e20800 20 remove_watcher() i=2 2024-09-12T17:57:59.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.149+0000 7f5242e20800 20 remove_watcher() i=3 2024-09-12T17:57:59.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.150+0000 7f5242e20800 20 remove_watcher() i=4 2024-09-12T17:57:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.151+0000 7f5242e20800 20 remove_watcher() i=5 2024-09-12T17:57:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.152+0000 7f5242e20800 20 remove_watcher() i=6 2024-09-12T17:57:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.153+0000 7f5242e20800 20 remove_watcher() i=7 2024-09-12T17:57:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:57:59.194 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:59.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.423+0000 7f0f2028c640 0 --2- 172.21.15.94:0/2606018295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560202a274d0 0x560202a27950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:59.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.431+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 realm 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.433+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.434+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.434+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.434+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:59.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.434+0000 7f0f2cd42800 20 searching for the correct realm 2024-09-12T17:57:59.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.437+0000 7f0f2028c640 0 -- 172.21.15.94:0/248167955 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f0f18031030 msgr2=0x7f0f1806c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:59.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.643+0000 7f0f28a8d640 0 -- 172.21.15.94:0/248167955 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f0f100c6130 msgr2=0x7f0f10075040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.850+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 zone default found 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 4 Realm: () 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 zonegroup default 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.851+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.852+0000 7f0f2cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.852+0000 7f0f2cd42800 20 started sync module instance, tier type = 2024-09-12T17:57:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.852+0000 7f0f2cd42800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=0 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=1 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=2 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=3 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=4 2024-09-12T17:57:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=5 2024-09-12T17:57:59.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.862+0000 7f0f2cd42800 20 add_watcher() i=6 2024-09-12T17:57:59.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.863+0000 7f0f2cd42800 20 add_watcher() i=7 2024-09-12T17:57:59.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.863+0000 7f0f2cd42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:59.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0ddefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:59.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 5 note: GC not initialized 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0dddfe3640 20 reqs_thread_entry: start 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 20 init_complete bucket index max shards: 11 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 20 Filter name: none 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0d4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.865+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.866+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.866+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.866+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.866+0000 7f0f2cd42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.866+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.867+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:57:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.867+0000 7f0f2cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:57:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.867+0000 7f0f2cd42800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:57:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.867+0000 7f0f2cd42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.869+0000 7f0ddefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:59.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.871+0000 7f0f2cd42800 20 remove_watcher() i=0 2024-09-12T17:57:59.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.871+0000 7f0f2cd42800 2 removed watcher, disabling cache 2024-09-12T17:57:59.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.872+0000 7f0f2cd42800 20 remove_watcher() i=1 2024-09-12T17:57:59.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.873+0000 7f0f2cd42800 20 remove_watcher() i=2 2024-09-12T17:57:59.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.875+0000 7f0f2cd42800 20 remove_watcher() i=3 2024-09-12T17:57:59.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.876+0000 7f0f2cd42800 20 remove_watcher() i=4 2024-09-12T17:57:59.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.877+0000 7f0f2cd42800 20 remove_watcher() i=5 2024-09-12T17:57:59.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.878+0000 7f0f2cd42800 20 remove_watcher() i=6 2024-09-12T17:57:59.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:57:59.879+0000 7f0f2cd42800 20 remove_watcher() i=7 2024-09-12T17:57:59.890 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:57:59.890 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:57:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:57:59.891 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:58:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:01.058 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:58:01.086 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:01.086 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:01.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.120+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 20 realm 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.122+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.123+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.123+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.123+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.123+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.124+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.124+0000 7f9b1bf3d800 20 searching for the correct realm 2024-09-12T17:58:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.127+0000 7f9b0ffff640 0 -- 172.21.15.94:0/145521667 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55e67bb906c0 msgr2=0x55e67bb92ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:01.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.130+0000 7f9b17c2a640 0 -- 172.21.15.94:0/145521667 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f9b000b1bf0 msgr2=0x7f9b000b5650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.135+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 zone default found 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 4 Realm: () 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 zonegroup default 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.136+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.137+0000 7f9b1bf3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.137+0000 7f9b1bf3d800 20 started sync module instance, tier type = 2024-09-12T17:58:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.137+0000 7f9b1bf3d800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=0 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=1 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=2 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=3 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=4 2024-09-12T17:58:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=5 2024-09-12T17:58:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.145+0000 7f9b1bf3d800 20 add_watcher() i=6 2024-09-12T17:58:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.146+0000 7f9b1bf3d800 20 add_watcher() i=7 2024-09-12T17:58:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.146+0000 7f9b1bf3d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:01.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.147+0000 7f99cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:01.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:01.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 5 note: GC not initialized 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f99ccfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 Filter name: none 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f99467fc640 20 reqs_thread_entry: start 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.148+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.149+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.149+0000 7f9b1bf3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.149+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.150+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.150+0000 7f9b1bf3d800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.150+0000 7f9b1bf3d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.150+0000 7f9b1bf3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:01.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.152+0000 7f99cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:01.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.154+0000 7f9b1bf3d800 20 remove_watcher() i=0 2024-09-12T17:58:01.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.154+0000 7f9b1bf3d800 2 removed watcher, disabling cache 2024-09-12T17:58:01.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.155+0000 7f9b1bf3d800 20 remove_watcher() i=1 2024-09-12T17:58:01.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.156+0000 7f9b1bf3d800 20 remove_watcher() i=2 2024-09-12T17:58:01.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.157+0000 7f9b1bf3d800 20 remove_watcher() i=3 2024-09-12T17:58:01.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.158+0000 7f9b1bf3d800 20 remove_watcher() i=4 2024-09-12T17:58:01.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.158+0000 7f9b1bf3d800 20 remove_watcher() i=5 2024-09-12T17:58:01.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.159+0000 7f9b1bf3d800 20 remove_watcher() i=6 2024-09-12T17:58:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.160+0000 7f9b1bf3d800 20 remove_watcher() i=7 2024-09-12T17:58:01.171 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:01.171 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:01.172 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:01.172 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:01.173 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:58:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:01.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.443+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 realm 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.445+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.446+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.446+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.446+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:01.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.446+0000 7fae99098800 20 searching for the correct realm 2024-09-12T17:58:01.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.449+0000 7fae8ffff640 0 -- 172.21.15.94:0/2306444668 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fae88030040 msgr2=0x7fae88068180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:01.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.655+0000 7fae96b82640 0 -- 172.21.15.94:0/2306444668 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fae800a93a0 msgr2=0x7fae80074720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.860+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 zone default found 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 4 Realm: () 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 zonegroup default 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.861+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 started sync module instance, tier type = 2024-09-12T17:58:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.862+0000 7fae99098800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=0 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=1 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=2 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=3 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=4 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=5 2024-09-12T17:58:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.871+0000 7fae99098800 20 add_watcher() i=6 2024-09-12T17:58:01.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.872+0000 7fae99098800 20 add_watcher() i=7 2024-09-12T17:58:01.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.872+0000 7fae99098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:01.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.873+0000 7fad4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:01.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 5 note: GC not initialized 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7facc7fff640 20 reqs_thread_entry: start 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 20 Filter name: none 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7facc5ffb640 20 reqs_thread_entry: start 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.874+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:58:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 : miss 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:01.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:01.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.875+0000 7fae99098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 2024-09-12T17:58:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fae99098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fae99098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fae99098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fae99098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33, ofs0, ns] 2024-09-12T17:58:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fad79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529758 cookie 93958702510960 notifier 7413 bl.length()=911 2024-09-12T17:58:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fad79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fad79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.880+0000 7fad79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:01.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.882+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_sources= new_sources= 2024-09-12T17:58:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.882+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential sources added=[] removed=[] 2024-09-12T17:58:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.882+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_dests= new_dests= 2024-09-12T17:58:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.882+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential dests added=[] removed=[] 2024-09-12T17:58:01.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.888+0000 7fae99098800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:58:01.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.894+0000 7fae99098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:01.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.894+0000 7fae99098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 2024-09-12T17:58:01.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.895+0000 7fae99098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.895+0000 7fae99098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.895+0000 7fae99098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.895+0000 7fae99098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33, ofs0, ns] 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.896+0000 7fad7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529759 cookie 93958702510960 notifier 7413 bl.length()=879 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.896+0000 7fad7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.896+0000 7fad7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.896+0000 7fad7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.897+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_sources= new_sources= 2024-09-12T17:58:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.897+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential sources added=[] removed=[] 2024-09-12T17:58:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.897+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_dests= new_dests= 2024-09-12T17:58:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.897+0000 7fae99098800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential dests added=[] removed=[] 2024-09-12T17:58:01.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.897+0000 7fae99098800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:58:01.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.899+0000 7fad4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:01.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.901+0000 7fae99098800 20 remove_watcher() i=0 2024-09-12T17:58:01.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.901+0000 7fae99098800 2 removed watcher, disabling cache 2024-09-12T17:58:01.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.902+0000 7fae99098800 20 remove_watcher() i=1 2024-09-12T17:58:01.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.903+0000 7fae99098800 20 remove_watcher() i=2 2024-09-12T17:58:01.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.904+0000 7fae99098800 20 remove_watcher() i=3 2024-09-12T17:58:01.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.905+0000 7fae99098800 20 remove_watcher() i=4 2024-09-12T17:58:01.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.906+0000 7fae99098800 20 remove_watcher() i=5 2024-09-12T17:58:01.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.907+0000 7fae99098800 20 remove_watcher() i=6 2024-09-12T17:58:01.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.908+0000 7fae99098800 20 remove_watcher() i=7 2024-09-12T17:58:01.920 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:58:01.949 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:01.949 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:01.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.984+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 realm 2024-09-12T17:58:01.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.986+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.987+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.987+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:01.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.987+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:01.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:01.987+0000 7f8fbd80e800 20 searching for the correct realm 2024-09-12T17:58:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.191+0000 7f8fb0658640 0 -- 172.21.15.94:0/2766598076 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f8fa8001000 msgr2=0x7f8fa80639a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:02.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.195+0000 7f8fb8e59640 0 -- 172.21.15.94:0/2766598076 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8fa00697a0 msgr2=0x7f8fa0097150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.401+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:02.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 zone default found 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 4 Realm: () 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 zonegroup default 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.402+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.403+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.403+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.403+0000 7f8fbd80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.403+0000 7f8fbd80e800 20 started sync module instance, tier type = 2024-09-12T17:58:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.403+0000 7f8fbd80e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=0 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=1 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=2 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=3 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=4 2024-09-12T17:58:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=5 2024-09-12T17:58:02.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.412+0000 7f8fbd80e800 20 add_watcher() i=6 2024-09-12T17:58:02.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.413+0000 7f8fbd80e800 20 add_watcher() i=7 2024-09-12T17:58:02.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.413+0000 7f8fbd80e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:02.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.415+0000 7f8e6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.415+0000 7f8fbd80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.415+0000 7f8fbd80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.415+0000 7f8fbd80e800 5 note: GC not initialized 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.415+0000 7f8e6dfe3640 20 reqs_thread_entry: start 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8fbd80e800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8fbd80e800 20 Filter name: none 2024-09-12T17:58:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8ddf7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.416+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.417+0000 7f8fbd80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:02.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.419+0000 7f8e6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:02.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.421+0000 7f8fbd80e800 20 remove_watcher() i=0 2024-09-12T17:58:02.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.421+0000 7f8fbd80e800 2 removed watcher, disabling cache 2024-09-12T17:58:02.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.422+0000 7f8fbd80e800 20 remove_watcher() i=1 2024-09-12T17:58:02.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.423+0000 7f8fbd80e800 20 remove_watcher() i=2 2024-09-12T17:58:02.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.424+0000 7f8fbd80e800 20 remove_watcher() i=3 2024-09-12T17:58:02.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.425+0000 7f8fbd80e800 20 remove_watcher() i=4 2024-09-12T17:58:02.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.426+0000 7f8fbd80e800 20 remove_watcher() i=5 2024-09-12T17:58:02.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.427+0000 7f8fbd80e800 20 remove_watcher() i=6 2024-09-12T17:58:02.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.428+0000 7f8fbd80e800 20 remove_watcher() i=7 2024-09-12T17:58:02.438 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:02.439 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:02.530 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:02.561 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:02.561 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:02.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.597+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 realm 2024-09-12T17:58:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.599+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.600+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:02.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.600+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.600+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:02.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.600+0000 7f0a44146800 20 searching for the correct realm 2024-09-12T17:58:02.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.604+0000 7f0a41436640 0 -- 172.21.15.94:0/942526613 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f0a34094040 msgr2=0x7f0a34090e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:02.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.608+0000 7f0a41436640 0 -- 172.21.15.94:0/942526613 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f090c086b40 msgr2=0x7f090c088f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.611+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 zone default found 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 4 Realm: () 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 zonegroup default 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.612+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.613+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.613+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.613+0000 7f0a44146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.613+0000 7f0a44146800 20 started sync module instance, tier type = 2024-09-12T17:58:02.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.613+0000 7f0a44146800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=0 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=1 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=2 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=3 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=4 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=5 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.621+0000 7f0a44146800 20 add_watcher() i=6 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.622+0000 7f0a44146800 20 add_watcher() i=7 2024-09-12T17:58:02.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.622+0000 7f0a44146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:02.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.624+0000 7f08f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.624+0000 7f0a44146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.624+0000 7f0a44146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.624+0000 7f0a44146800 5 note: GC not initialized 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.624+0000 7f08f27fc640 20 reqs_thread_entry: start 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 20 Filter name: none 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0863fff640 20 reqs_thread_entry: start 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 : miss 2024-09-12T17:58:02.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.625+0000 7f0a44146800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.626+0000 7f0a44146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 2024-09-12T17:58:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f0a44146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f0a44146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f0a44146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f0a44146800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33, ofs0, ns] 2024-09-12T17:58:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f09257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529760 cookie 94703489030336 notifier 7028 bl.length()=911 2024-09-12T17:58:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f09257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f09257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.631+0000 7f09257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.633+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_sources= new_sources= 2024-09-12T17:58:02.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.633+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential sources added=[] removed=[] 2024-09-12T17:58:02.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.633+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_dests= new_dests= 2024-09-12T17:58:02.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.633+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential dests added=[] removed=[] 2024-09-12T17:58:02.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.0 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.0 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.1 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.1 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.2 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.2 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.3 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.3 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.4 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.4 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.5 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.5 2024-09-12T17:58:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.6 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.6 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.7 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.7 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.8 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.8 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.9 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.9 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.10 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.10 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.11 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1.11 2024-09-12T17:58:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.638+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.0 2024-09-12T17:58:02.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.639+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1 2024-09-12T17:58:02.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.639+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.2 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.639+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.3 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.640+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.4 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.640+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.5 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.641+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.6 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.642+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.7 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.642+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.8 2024-09-12T17:58:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.642+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.9 2024-09-12T17:58:02.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.643+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.10 2024-09-12T17:58:02.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.646+0000 7f0a44146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:02.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.646+0000 7f0a44146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 2024-09-12T17:58:02.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f0a44146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f0a44146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f0a44146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f0a44146800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33, ofs0, ns] 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f09257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529761 cookie 94703489030336 notifier 7028 bl.length()=911 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f09257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f09257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.647+0000 7f09257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.649+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_sources= new_sources= 2024-09-12T17:58:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.649+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential sources added=[] removed=[] 2024-09-12T17:58:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.649+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_dests= new_dests= 2024-09-12T17:58:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.649+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential dests added=[] removed=[] 2024-09-12T17:58:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.651+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.0 2024-09-12T17:58:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.651+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.1 2024-09-12T17:58:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.652+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.2 2024-09-12T17:58:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.652+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.3 2024-09-12T17:58:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.652+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.4 2024-09-12T17:58:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.653+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.5 2024-09-12T17:58:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.653+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.6 2024-09-12T17:58:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.653+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.7 2024-09-12T17:58:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.653+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.8 2024-09-12T17:58:02.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.654+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.9 2024-09-12T17:58:02.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.654+0000 7f0a44146800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33.10 2024-09-12T17:58:02.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.654+0000 7f0a44146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:02.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.655+0000 7f0a44146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 2024-09-12T17:58:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0a44146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0a44146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0a44146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0a44146800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33, ofs0, ns] 2024-09-12T17:58:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0924ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529762 cookie 94703489030336 notifier 7028 bl.length()=879 2024-09-12T17:58:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0924ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 info.flags=0x17 2024-09-12T17:58:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0924ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 to cache LRU end 2024-09-12T17:58:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.656+0000 7f0924ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.658+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_sources= new_sources= 2024-09-12T17:58:02.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.658+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential sources added=[] removed=[] 2024-09-12T17:58:02.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.658+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): orig_dests= new_dests= 2024-09-12T17:58:02.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.658+0000 7f0a44146800 20 handle_bi_update(): bucket=:error-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33]): potential dests added=[] removed=[] 2024-09-12T17:58:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.660+0000 7f0a44146800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:02.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.661+0000 7f08f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.664+0000 7f0a44146800 20 remove_watcher() i=0 2024-09-12T17:58:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.664+0000 7f0a44146800 2 removed watcher, disabling cache 2024-09-12T17:58:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.664+0000 7f0a44146800 20 remove_watcher() i=1 2024-09-12T17:58:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.665+0000 7f0a44146800 20 remove_watcher() i=2 2024-09-12T17:58:02.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.666+0000 7f0a44146800 20 remove_watcher() i=3 2024-09-12T17:58:02.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.667+0000 7f0a44146800 20 remove_watcher() i=4 2024-09-12T17:58:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.668+0000 7f0a44146800 20 remove_watcher() i=5 2024-09-12T17:58:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.669+0000 7f0a44146800 20 remove_watcher() i=6 2024-09-12T17:58:02.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.670+0000 7f0a44146800 20 remove_watcher() i=7 2024-09-12T17:58:02.683 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:58:02.712 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:02.712 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:02.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.945+0000 7fc6c94b8640 0 --2- 172.21.15.94:0/1784044480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x5645ac2d4d50 0x5645ac2d5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:58:02.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.949+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 realm 2024-09-12T17:58:02.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.951+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.952+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.952+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.952+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:02.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.952+0000 7fc6ccf36800 20 searching for the correct realm 2024-09-12T17:58:02.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:02.954+0000 7fc6c8cb7640 0 -- 172.21.15.94:0/4218721994 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fc6c402d060 msgr2=0x7fc6c4063a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:03.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.160+0000 7fc6c94b8640 0 -- 172.21.15.94:0/4218721994 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fc6b406d060 msgr2=0x7fc6b40639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:03.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:03.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:03.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:03.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.166+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:03.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:03.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 zone default found 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 4 Realm: () 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 zonegroup default 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.167+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.168+0000 7fc6ccf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.168+0000 7fc6ccf36800 20 started sync module instance, tier type = 2024-09-12T17:58:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.168+0000 7fc6ccf36800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:03.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=0 2024-09-12T17:58:03.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=1 2024-09-12T17:58:03.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=2 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=3 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=4 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=5 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.176+0000 7fc6ccf36800 20 add_watcher() i=6 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.177+0000 7fc6ccf36800 20 add_watcher() i=7 2024-09-12T17:58:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.177+0000 7fc6ccf36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:03.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.179+0000 7fc57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.179+0000 7fc6ccf36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.179+0000 7fc6ccf36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.179+0000 7fc6ccf36800 5 note: GC not initialized 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.179+0000 7fc57e7e4640 20 reqs_thread_entry: start 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc6ccf36800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc6ccf36800 20 Filter name: none 2024-09-12T17:58:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc577fff640 20 reqs_thread_entry: start 2024-09-12T17:58:03.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:03.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.180+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.181+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.181+0000 7fc6ccf36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.181+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.181+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.181+0000 7fc6ccf36800 20 rados->read ofs=0 len=0 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.182+0000 7fc6ccf36800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.182+0000 7fc6ccf36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:03.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.183+0000 7fc57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:03.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.185+0000 7fc6ccf36800 20 remove_watcher() i=0 2024-09-12T17:58:03.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.185+0000 7fc6ccf36800 2 removed watcher, disabling cache 2024-09-12T17:58:03.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.186+0000 7fc6ccf36800 20 remove_watcher() i=1 2024-09-12T17:58:03.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.187+0000 7fc6ccf36800 20 remove_watcher() i=2 2024-09-12T17:58:03.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.188+0000 7fc6ccf36800 20 remove_watcher() i=3 2024-09-12T17:58:03.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.189+0000 7fc6ccf36800 20 remove_watcher() i=4 2024-09-12T17:58:03.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.190+0000 7fc6ccf36800 20 remove_watcher() i=5 2024-09-12T17:58:03.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.191+0000 7fc6ccf36800 20 remove_watcher() i=6 2024-09-12T17:58:03.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:03.192+0000 7fc6ccf36800 20 remove_watcher() i=7 2024-09-12T17:58:03.204 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:03.204 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:03.204 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:03.204 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:03.574 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:58:03.574 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:04.414 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:58:04.442 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:04.442 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:04.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.477+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 realm 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.479+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.480+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.480+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.481+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.481+0000 7f2e51c14800 20 searching for the correct realm 2024-09-12T17:58:04.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.484+0000 7f2e4dbe1640 0 -- 172.21.15.94:0/1882147392 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f2e38090630 msgr2=0x7f2e380824d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:04.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.487+0000 7f2e4d3e0640 0 -- 172.21.15.94:0/1882147392 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2e38088b60 msgr2=0x7f2e380918d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.693+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 zone default found 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 4 Realm: () 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 zonegroup default 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.694+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.695+0000 7f2e51c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.695+0000 7f2e51c14800 20 started sync module instance, tier type = 2024-09-12T17:58:04.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.695+0000 7f2e51c14800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:04.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=0 2024-09-12T17:58:04.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=1 2024-09-12T17:58:04.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=2 2024-09-12T17:58:04.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=3 2024-09-12T17:58:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=4 2024-09-12T17:58:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=5 2024-09-12T17:58:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.704+0000 7f2e51c14800 20 add_watcher() i=6 2024-09-12T17:58:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.705+0000 7f2e51c14800 20 add_watcher() i=7 2024-09-12T17:58:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.705+0000 7f2e51c14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:04.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2d03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2e51c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2e51c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2e51c14800 5 note: GC not initialized 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2d02fe5640 20 reqs_thread_entry: start 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2e51c14800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2e51c14800 20 Filter name: none 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.707+0000 7f2d00fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.708+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.708+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:04.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.708+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.709+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.709+0000 7f2e51c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.709+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.709+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.709+0000 7f2e51c14800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.710+0000 7f2e51c14800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.710+0000 7f2e51c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:04.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.711+0000 7f2d03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:04.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.714+0000 7f2e51c14800 20 remove_watcher() i=0 2024-09-12T17:58:04.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.714+0000 7f2e51c14800 2 removed watcher, disabling cache 2024-09-12T17:58:04.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.716+0000 7f2e51c14800 20 remove_watcher() i=1 2024-09-12T17:58:04.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.718+0000 7f2e51c14800 20 remove_watcher() i=2 2024-09-12T17:58:04.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.719+0000 7f2e51c14800 20 remove_watcher() i=3 2024-09-12T17:58:04.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.720+0000 7f2e51c14800 20 remove_watcher() i=4 2024-09-12T17:58:04.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.721+0000 7f2e51c14800 20 remove_watcher() i=5 2024-09-12T17:58:04.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.722+0000 7f2e51c14800 20 remove_watcher() i=6 2024-09-12T17:58:04.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.723+0000 7f2e51c14800 20 remove_watcher() i=7 2024-09-12T17:58:04.733 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:04.734 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:04.734 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:04.734 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:04.735 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:58:04.769 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:04.769 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:04.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.806+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 20 realm 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.809+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.809+0000 7fe4f6746800 20 searching for the correct realm 2024-09-12T17:58:04.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:04.811+0000 7fe4f4237640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fe4ec05b040 msgr2=0x7fe4ec008a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:05.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.017+0000 7fe4f4a38640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe4dc050070 msgr2=0x7fe4dc016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:05.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zone default found 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Realm: () 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zonegroup default 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:05.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started sync module instance, tier type = 2024-09-12T17:58:05.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=0 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=1 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=2 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=3 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=4 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=5 2024-09-12T17:58:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=6 2024-09-12T17:58:05.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.035+0000 7fe4f6746800 20 add_watcher() i=7 2024-09-12T17:58:05.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.035+0000 7fe4f6746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:05.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.037+0000 7fe3aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:05.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:05.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:05.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.037+0000 7fe4f6746800 5 note: GC not initialized 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe3a9fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 20 Filter name: none 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe31b7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : miss 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.039+0000 7fe4f6746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:05.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.044+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:05.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.044+0000 7fe4f6746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:05.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.044+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:05.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.044+0000 7fe4f6746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:05.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94449944923040 notifier 7503 bl.length()=911 2024-09-12T17:58:05.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:05.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:05.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:05.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:05.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:05.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:05.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:08.075 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4f6746800 time 2024-09-12T17:58:08.075541+0000 2024-09-12T17:58:08.075 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4f9d8c71a] 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.076 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe4f6746800 thread_name:radosgw-admin 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.075+0000 7fe4f6746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4f6746800 time 2024-09-12T17:58:08.075541+0000 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4f9d8c71a] 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.077 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:58:08.078 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:58:08.078 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4f8a3e6f0] 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4f8a8b99c] 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4f9d8c774] 2024-09-12T17:58:08.096 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.076+0000 7fe4f6746800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe4f6746800 thread_name:radosgw-admin 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4f8a3e6f0] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4f8a8b99c] 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4f9d8c774] 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 asok(0x55e6d738f730) unregister_commands rotate-key 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:58:04.789+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.098 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:58:04.789+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:58:04.789+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.099 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.100 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: starting msgr at 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: starting objecter 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests hook 0x55e6d75d9730 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: setting wanted keys 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: calling monclient init 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.101 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key hook 0x55e6d75b0388 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:08.102 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d75d9fa0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d75da900 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x7fe4e0003c90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.304904s 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d75da900 auth_method 0 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d75d9fa0 auth_method 0 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.103 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x7fe4e0003c90 auth_method 0 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.104 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:58:04.791+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: dump: 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: dump: 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.106 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:58:04.791+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7494 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:58:04.791+0000 7fe3e260c640 4 set_mon_vals no callback set 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:58:04.791+0000 7fe4f6746800 1 librados: init done 2024-09-12T17:58:08.107 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:58:04.793+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3dc076470 auth_method 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:58:04.793+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d75d86e0 auth_method 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:58:04.794+0000 7fe4f4237640 10 monclient: get_auth_request con 0x55e6d75fbf50 auth_method 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:58:04.796+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x55e6d7601170 auth_method 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:58:04.796+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:58:04.796+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:58:04.796+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.108 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.109 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests cmddesc objecter_requests hook 0x55e6d7608b10 EEXIST 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.110 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.111 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x55e6d76042a0 EEXIST 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7632750 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d762b140 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d762dc50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.311835s 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7632750 auth_method 0 2024-09-12T17:58:08.112 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x55e6d762dc50 auth_method 0 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d762b140 auth_method 0 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:58:04.798+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: dump: 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.114 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: dump: 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.115 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:58:04.798+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7497 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:58:04.798+0000 7fe4f5239640 4 set_mon_vals no callback set 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.116 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:58:04.800+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3cc0763b0 auth_method 0 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: get_monmap_and_config 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:58:04.800+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.117 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.118 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:58:04.800+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.119 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:58:04.801+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:58:04.801+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:58:04.801+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x7ffc308348e8 EEXIST 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d7681d00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7652b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d767d130 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.120 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.315444s 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d7652b20 auth_method 0 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x55e6d767d130 auth_method 0 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7681d00 auth_method 0 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_done global_id 7500 payload 274 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.122 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: dump: 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.123 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: dump: 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.124 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7500 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:58:04.802+0000 7fe4f6746800 4 set_mon_vals no callback set 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: shutdown 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:58:04.802+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.125 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.126 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: starting msgr at 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: starting objecter 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests cmddesc objecter_requests hook 0x55e6d767bb10 EEXIST 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: setting wanted keys 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: calling monclient init 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.127 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.128 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x55e6d743ab28 EEXIST 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7652b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d767d130 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d7681d00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.317769s 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7652b20 auth_method 0 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d767d130 auth_method 0 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.130 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:58:04.804+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:58:04.804+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d7681d00 auth_method 0 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: dump: 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.131 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: dump: 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.132 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:58:04.804+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7503 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:58:04.804+0000 7fe3cb7fe640 4 set_mon_vals no callback set 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:58:04.804+0000 7fe4f6746800 1 librados: init done 2024-09-12T17:58:08.133 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:58:04.804+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cr dump hook 0x55e6d767d7f8 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:58:04.806+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:58:04.806+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3bc076470 auth_method 0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:58:04.807+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d769ba20 auth_method 0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 realm 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:58:04.807+0000 7fe4f6746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.134 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:58:04.808+0000 7fe4f4237640 10 monclient: get_auth_request con 0x55e6d769fd70 auth_method 0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:58:04.809+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:58:04.809+0000 7fe4f6746800 20 searching for the correct realm 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:58:04.809+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x55e6d76a4ec0 auth_method 0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:58:04.810+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe4dc050070 auth_method 0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:58:04.811+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4ec05b040 auth_method 0 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:58:04.811+0000 7fe4f4237640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fe4ec05b040 msgr2=0x7fe4ec008a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.135 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:58:05.012+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4ec05b040 auth_method 0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:58:05.013+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe4e4047040 auth_method 0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:58:05.016+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe4dc021070 auth_method 0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:58:05.017+0000 7fe4f4a38640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe4dc050070 msgr2=0x7fe4dc016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 1 client.7503.objecter ms_handle_reset 0x7fe4dc050070 session 0x7fe4dc005040 osd.7 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 10 monclient: _renew_subs 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:58:05.017+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe3bc086bf0 auth_method 0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:58:05.018+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4dc05e3f0 auth_method 0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:08.136 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zone default found 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Realm: () 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:58:05.023+0000 7fe4f6746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zonegroup default 2024-09-12T17:58:08.137 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started sync module instance, tier type = 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=0 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=1 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=2 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=3 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=4 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=5 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=6 2024-09-12T17:58:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:58:05.035+0000 7fe4f6746800 20 add_watcher() i=7 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:58:05.035+0000 7fe4f6746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.139 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:58:05.037+0000 7fe3aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:58:05.037+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache list hook 0x55e6d767b2b0 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache inspect hook 0x55e6d767b2b0 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache erase hook 0x55e6d767b2b0 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache zap hook 0x55e6d767b2b0 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 note: GC not initialized 2024-09-12T17:58:08.140 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:58:05.038+0000 7fe3a9fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace show hook 0x7fe4e0001d30 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace history hook 0x7fe4e0001d30 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace active hook 0x7fe4e0001d30 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace active_short hook 0x7fe4e0001d30 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 Filter name: none 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:58:05.038+0000 7fe31b7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : miss 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.141 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:58:05.039+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94449944923040 notifier 7503 bl.length()=911 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.142 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:58:07.791+0000 7fe3db7fe640 10 monclient: tick 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:58:07.791+0000 7fe3db7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:58:07.797+0000 7fe3d8ff9640 10 monclient: tick 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:58:07.797+0000 7fe3d8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:58:07.803+0000 7fe3c8ff9640 10 monclient: tick 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:58:07.803+0000 7fe3c8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:58:08.075+0000 7fe4f6746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4f6746800 time 2024-09-12T17:58:08.075541+0000 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.143 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4f9d8c71a] 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:58:08.076+0000 7fe4f6746800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe4f6746800 thread_name:radosgw-admin 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.144 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4f8a3e6f0] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4f8a8b99c] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4f9d8c774] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:58:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:58:08.146 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:58:08.147 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:08.148 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:58:08.149 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:58:08.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:08.151 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:08.152 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe31b7fe640 / http_manager 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3a9fdb640 / http_manager 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3aafdd640 / rgw_dt_lg_renew 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3c8ff9640 / safe_timer 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3c9ffb640 / ms_dispatch 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3caffd640 / io_context_pool 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3cb7fe640 / io_context_pool 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3d8ff9640 / safe_timer 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3d9ffb640 / ms_dispatch 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3db7fe640 / safe_timer 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3e0e09640 / ms_dispatch 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3e260c640 / io_context_pool 2024-09-12T17:58:08.153 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4ebfff640 / msgr-worker-2 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f4237640 / msgr-worker-1 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f4a38640 / msgr-worker-0 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f5239640 / io_context_pool 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f6746800 / radosgw-admin 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.127110.log 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 asok(0x55e6d738f730) unregister_commands rotate-key 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:58:04.789+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:58:04.789+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:58:04.789+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.154 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding auth protocol: cephx 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.155 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: crc 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:58:04.789+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b58f0) adding con mode: secure 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: starting msgr at 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: starting objecter 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests hook 0x55e6d75d9730 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: setting wanted keys 2024-09-12T17:58:08.156 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:58:04.790+0000 7fe4f6746800 1 librados: calling monclient init 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding auth protocol: cephx 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.157 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: crc 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 AuthRegistry(0x55e6d75b0240) adding con mode: secure 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:58:04.790+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:58:04.790+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key hook 0x55e6d75b0388 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d75d9fa0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d75da900 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x7fe4e0003c90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.158 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:58:04.790+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.304904s 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d75da900 auth_method 0 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d75d9fa0 auth_method 0 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x7fe4e0003c90 auth_method 0 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.159 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:58:04.791+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:58:04.791+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:58:04.791+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:58:04.791+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.160 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: dump: 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.161 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:58:04.791+0000 7fe3e0e09640 10 monclient: dump: 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:58:04.791+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7494 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:58:04.791+0000 7fe3e260c640 4 set_mon_vals no callback set 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:58:04.791+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:58:04.791+0000 7fe4f6746800 1 librados: init done 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:58:04.793+0000 7fe3e0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:58:04.793+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3dc076470 auth_method 0 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:58:04.793+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d75d86e0 auth_method 0 2024-09-12T17:58:08.163 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:58:04.794+0000 7fe4f4237640 10 monclient: get_auth_request con 0x55e6d75fbf50 auth_method 0 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:58:04.796+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x55e6d7601170 auth_method 0 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:58:04.796+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:58:04.796+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:58:04.796+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.164 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding auth protocol: cephx 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.165 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: crc 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:58:04.796+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7605100) adding con mode: secure 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests cmddesc objecter_requests hook 0x55e6d7608b10 EEXIST 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding auth protocol: cephx 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.166 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: crc 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 AuthRegistry(0x55e6d7604158) adding con mode: secure 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:58:04.797+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:58:04.797+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x55e6d76042a0 EEXIST 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7632750 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.167 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d762b140 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d762dc50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:58:04.797+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.311835s 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7632750 auth_method 0 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x55e6d762dc50 auth_method 0 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.168 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:58:04.797+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:58:04.797+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:58:04.798+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d762b140 auth_method 0 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:58:04.798+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.169 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:58:04.798+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:58:04.798+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: dump: 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.170 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:58:04.798+0000 7fe3d9ffb640 10 monclient: dump: 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.171 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:58:04.798+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7497 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:58:04.798+0000 7fe4f5239640 4 set_mon_vals no callback set 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:58:04.798+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:58:04.800+0000 7fe3d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:58:04.800+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3cc0763b0 auth_method 0 2024-09-12T17:58:08.172 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: get_monmap_and_config 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:58:04.800+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.173 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding auth protocol: cephx 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: crc 2024-09-12T17:58:08.174 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x55e6d764d860) adding con mode: secure 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:58:04.800+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:58:04.800+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding auth protocol: cephx 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.175 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: crc 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:58:04.800+0000 7fe4f6746800 5 AuthRegistry(0x7ffc308347a0) adding con mode: secure 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:58:04.801+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:58:04.801+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:58:04.801+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x7ffc308348e8 EEXIST 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d7681d00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7652b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d767d130 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.176 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:58:04.801+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.315444s 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d7652b20 auth_method 0 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request con 0x55e6d767d130 auth_method 0 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.177 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7681d00 auth_method 0 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:58:04.801+0000 7fe4f4a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:58:04.801+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_done global_id 7500 payload 274 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:58:04.801+0000 7fe4ebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.178 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: dump: 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.179 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:58:04.802+0000 7fe3cb7fe640 10 monclient: dump: 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.180 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7500 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:58:04.802+0000 7fe4f6746800 4 set_mon_vals no callback set 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: shutdown 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: build_initial_monmap 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:58:04.802+0000 7fe4f6746800 1 build_initial for_mkfs: 0 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:58:04.802+0000 7fe4f6746800 10 monclient: monmap: 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding auth protocol: cephx 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.182 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: crc 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:58:04.802+0000 7fe4f6746800 5 AuthRegistry(0x55e6d767df30) adding con mode: secure 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: starting msgr at 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: starting objecter 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command objecter_requests cmddesc objecter_requests hook 0x55e6d767bb10 EEXIST 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: setting wanted keys 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:58:04.803+0000 7fe4f6746800 1 librados: calling monclient init 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: init 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding auth protocol: cephx 2024-09-12T17:58:08.183 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: crc 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 AuthRegistry(0x55e6d743a9e0) adding con mode: secure 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:58:04.803+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.184 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:58:04.803+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command rotate-key cmddesc rotate-key hook 0x55e6d743ab28 EEXIST 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-a con 0x55e6d7652b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-c con 0x55e6d767d130 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): picked mon.noname-b con 0x55e6d7681d00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:58:04.803+0000 7fe4f6746800 10 monclient(hunting): authenticate will time out at 2158.317769s 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): get_auth_request con 0x55e6d7652b20 auth_method 0 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.185 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request con 0x55e6d767d130 auth_method 0 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:58:04.803+0000 7fe4f4237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:08.186 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:58:04.803+0000 7fe4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient: _finish_hunting 0 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:58:04.804+0000 7fe4f4237640 1 monclient: found mon.noname-a 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:58:04.804+0000 7fe4f4237640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:58:04.804+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d7681d00 auth_method 0 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: dump: 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.187 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:58:04.804+0000 7fe3c9ffb640 10 monclient: dump: 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:08.188 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:58:04.804+0000 7fe4f6746800 5 monclient: authenticate success, global_id 7503 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:58:04.804+0000 7fe3cb7fe640 4 set_mon_vals no callback set 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _renew_subs 2024-09-12T17:58:08.189 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:58:04.804+0000 7fe4f6746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:58:04.804+0000 7fe4f6746800 1 librados: init done 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:58:04.804+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cr dump hook 0x55e6d767d7f8 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:58:04.806+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:58:04.806+0000 7fe3c9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:58:04.806+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe3bc076470 auth_method 0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:58:04.807+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x55e6d769ba20 auth_method 0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 realm 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:58:04.807+0000 7fe4f6746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:08.190 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:58:04.807+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:58:04.808+0000 7fe4f4237640 10 monclient: get_auth_request con 0x55e6d769fd70 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:58:04.808+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:58:04.809+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:58:04.809+0000 7fe4f6746800 20 searching for the correct realm 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:58:04.809+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x55e6d76a4ec0 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:58:04.810+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe4dc050070 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:58:04.811+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4ec05b040 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:58:04.811+0000 7fe4f4237640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fe4ec05b040 msgr2=0x7fe4ec008a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:58:05.012+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4ec05b040 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:58:05.013+0000 7fe4ebfff640 10 monclient: get_auth_request con 0x7fe4e4047040 auth_method 0 2024-09-12T17:58:08.191 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:58:05.016+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe4dc021070 auth_method 0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:58:05.017+0000 7fe4f4a38640 0 -- 172.21.15.94:0/3089736527 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe4dc050070 msgr2=0x7fe4dc016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 1 client.7503.objecter ms_handle_reset 0x7fe4dc050070 session 0x7fe4dc005040 osd.7 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 10 monclient: _renew_subs 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:58:05.017+0000 7fe3c9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:58:05.017+0000 7fe4f4a38640 10 monclient: get_auth_request con 0x7fe3bc086bf0 auth_method 0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:58:05.018+0000 7fe4f4237640 10 monclient: get_auth_request con 0x7fe4dc05e3f0 auth_method 0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.192 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:58:05.022+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zone default found 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Realm: () 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:58:05.023+0000 7fe4f6746800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:58:05.023+0000 7fe4f6746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 zonegroup default 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.193 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:58:05.023+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started sync module instance, tier type = 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:58:05.024+0000 7fe4f6746800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=0 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=1 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=2 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=3 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=4 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=5 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:58:05.034+0000 7fe4f6746800 20 add_watcher() i=6 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:58:05.035+0000 7fe4f6746800 20 add_watcher() i=7 2024-09-12T17:58:08.194 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:58:05.035+0000 7fe4f6746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding auth protocol: cephx 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.195 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: crc 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 AuthRegistry(0x7ffc30834c70) adding con mode: secure 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:58:05.037+0000 7fe3aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:58:05.037+0000 7fe4f6746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:58:05.037+0000 7fe4f6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache list hook 0x55e6d767b2b0 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache inspect hook 0x55e6d767b2b0 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache erase hook 0x55e6d767b2b0 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command cache zap hook 0x55e6d767b2b0 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:58:05.037+0000 7fe4f6746800 5 note: GC not initialized 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:58:05.038+0000 7fe3a9fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace show hook 0x7fe4e0001d30 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace history hook 0x7fe4e0001d30 2024-09-12T17:58:08.196 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace active hook 0x7fe4e0001d30 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:58:05.038+0000 7fe4f6746800 5 asok(0x55e6d738f730) register_command sync trace active_short hook 0x7fe4e0001d30 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 Filter name: none 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:58:05.038+0000 7fe31b7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:58:05.038+0000 7fe4f6746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : miss 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:58:05.038+0000 7fe4f6746800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:58:05.039+0000 7fe4f6746800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.197 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:58:05.039+0000 7fe4f6746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:58:05.044+0000 7fe4f6746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94449944923040 notifier 7503 bl.length()=911 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:58:05.045+0000 7fe3caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.198 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:58:05.046+0000 7fe4f6746800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:58:07.791+0000 7fe3db7fe640 10 monclient: tick 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:58:07.791+0000 7fe3db7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:58:07.797+0000 7fe3d8ff9640 10 monclient: tick 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:58:07.797+0000 7fe3d8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:58:07.803+0000 7fe3c8ff9640 10 monclient: tick 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:58:07.803+0000 7fe3c8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:58:08.075+0000 7fe4f6746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4f6746800 time 2024-09-12T17:58:08.075541+0000 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.199 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4f9d8c71a] 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:58:08.076+0000 7fe4f6746800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe4f6746800 thread_name:radosgw-admin 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.200 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4f8a3e6f0] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4f8a8b99c] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4f9d8c774] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe4f9d8c8d8] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e6d5c83841] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e6d5c9357a] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe4f8a29590] 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T17:58:08.201 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:08.202 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:58:08.203 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:58:08.204 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:58:08.205 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:58:08.206 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:08.207 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:08.208 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe31b7fe640 / http_manager 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3a9fdb640 / http_manager 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3aafdd640 / rgw_dt_lg_renew 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3c8ff9640 / safe_timer 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3c9ffb640 / ms_dispatch 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3caffd640 / io_context_pool 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3cb7fe640 / io_context_pool 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3d8ff9640 / safe_timer 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3d9ffb640 / ms_dispatch 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3db7fe640 / safe_timer 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3e0e09640 / ms_dispatch 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe3e260c640 / io_context_pool 2024-09-12T17:58:08.209 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4ebfff640 / msgr-worker-2 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f4237640 / msgr-worker-1 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f4a38640 / msgr-worker-0 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f5239640 / io_context_pool 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe4f6746800 / radosgw-admin 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:58:08.076998Z_887399f2-1c66-4649-9cb9-72fd619d10e7/log 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:58:08.210 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.160+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 20 realm 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.162+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.163+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.163+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.164+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.164+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.164+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:08.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.164+0000 7ffbc3f2e800 20 searching for the correct realm 2024-09-12T17:58:08.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.166+0000 7ffbbfcdd640 0 -- 172.21.15.94:0/1169962891 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7ffba8003b00 msgr2=0x7ffbb8063ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.371+0000 7ffbc04de640 0 -- 172.21.15.94:0/1169962891 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7ffba80030f0 msgr2=0x7ffbb40911d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:08.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:08.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:08.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:08.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.378+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 zone default found 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 4 Realm: () 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 zonegroup default 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.379+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 started sync module instance, tier type = 2024-09-12T17:58:08.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.380+0000 7ffbc3f2e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=0 2024-09-12T17:58:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=1 2024-09-12T17:58:08.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=2 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=3 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=4 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=5 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.390+0000 7ffbc3f2e800 20 add_watcher() i=6 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.391+0000 7ffbc3f2e800 20 add_watcher() i=7 2024-09-12T17:58:08.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.391+0000 7ffbc3f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:08.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.393+0000 7ffa75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 5 note: GC not initialized 2024-09-12T17:58:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffa74fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 20 Filter name: none 2024-09-12T17:58:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ff9ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:58:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.394+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.395+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.395+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:08.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:58:08.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.396+0000 7ffbc3f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:08.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.398+0000 7ffa75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.400+0000 7ffbc3f2e800 20 remove_watcher() i=0 2024-09-12T17:58:08.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.401+0000 7ffbc3f2e800 2 removed watcher, disabling cache 2024-09-12T17:58:08.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.402+0000 7ffbc3f2e800 20 remove_watcher() i=1 2024-09-12T17:58:08.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.403+0000 7ffbc3f2e800 20 remove_watcher() i=2 2024-09-12T17:58:08.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.404+0000 7ffbc3f2e800 20 remove_watcher() i=3 2024-09-12T17:58:08.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.405+0000 7ffbc3f2e800 20 remove_watcher() i=4 2024-09-12T17:58:08.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.406+0000 7ffbc3f2e800 20 remove_watcher() i=5 2024-09-12T17:58:08.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.407+0000 7ffbc3f2e800 20 remove_watcher() i=6 2024-09-12T17:58:08.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.408+0000 7ffbc3f2e800 20 remove_watcher() i=7 2024-09-12T17:58:08.420 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.420 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:08.420 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:08.420 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:08.511 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:08.542 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:08.542 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.578+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 20 realm 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.579+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.580+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.580+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.581+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.581+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.581+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.581+0000 7fc25c00f800 20 searching for the correct realm 2024-09-12T17:58:08.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.585+0000 7fc257f49640 0 -- 172.21.15.94:0/2405005434 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fc240047040 msgr2=0x7fc240046410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:08.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.791+0000 7fc257748640 0 -- 172.21.15.94:0/2405005434 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55fa0b763710 msgr2=0x55fa0b765b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:08.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.793+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:08.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 zone default found 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 4 Realm: () 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 zonegroup default 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.794+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.795+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.795+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.795+0000 7fc25c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:08.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.795+0000 7fc25c00f800 20 started sync module instance, tier type = 2024-09-12T17:58:08.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.795+0000 7fc25c00f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:08.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=0 2024-09-12T17:58:08.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=1 2024-09-12T17:58:08.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=2 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=3 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=4 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=5 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.805+0000 7fc25c00f800 20 add_watcher() i=6 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.806+0000 7fc25c00f800 20 add_watcher() i=7 2024-09-12T17:58:08.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.806+0000 7fc25c00f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:08.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc25c00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:08.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc25c00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:08.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc25c00f800 5 note: GC not initialized 2024-09-12T17:58:08.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc10cfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:08.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.808+0000 7fc25c00f800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 20 Filter name: none 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc0867fc640 20 reqs_thread_entry: start 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : miss 2024-09-12T17:58:08.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.809+0000 7fc25c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:08.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:58:08.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:08.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:08.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:08.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:08.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.810+0000 7fc25c00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:08.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.811+0000 7fc25c00f800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to be held by another RGW process; skipping for now 2024-09-12T17:58:08.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.811+0000 7fc10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:08.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.814+0000 7fc25c00f800 20 remove_watcher() i=0 2024-09-12T17:58:08.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.814+0000 7fc25c00f800 2 removed watcher, disabling cache 2024-09-12T17:58:08.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.815+0000 7fc25c00f800 20 remove_watcher() i=1 2024-09-12T17:58:08.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.816+0000 7fc25c00f800 20 remove_watcher() i=2 2024-09-12T17:58:08.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.817+0000 7fc25c00f800 20 remove_watcher() i=3 2024-09-12T17:58:08.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.818+0000 7fc25c00f800 20 remove_watcher() i=4 2024-09-12T17:58:08.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.819+0000 7fc25c00f800 20 remove_watcher() i=5 2024-09-12T17:58:08.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.820+0000 7fc25c00f800 20 remove_watcher() i=6 2024-09-12T17:58:08.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:08.821+0000 7fc25c00f800 20 remove_watcher() i=7 2024-09-12T17:58:08.832 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:58:38.845 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:38.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:38.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:38.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.922+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:38.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:38.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 realm 2024-09-12T17:58:38.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:38.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:38.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:38.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:38.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:38.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.924+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:38.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.925+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:38.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.925+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:38.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.926+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:38.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.926+0000 7f0f27725800 20 searching for the correct realm 2024-09-12T17:58:38.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.928+0000 7f0f22b32640 0 -- 172.21.15.94:0/921858382 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f0f14004040 msgr2=0x7f0f14051440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:38.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:38.933+0000 7f0f23333640 0 -- 172.21.15.94:0/921858382 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f0f1807a7c0 msgr2=0x7f0f1805f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:39.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.140+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:39.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 zone default found 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 4 Realm: () 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 zonegroup default 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.141+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 started sync module instance, tier type = 2024-09-12T17:58:39.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.142+0000 7f0f27725800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=0 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=1 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=2 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=3 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=4 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=5 2024-09-12T17:58:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.152+0000 7f0f27725800 20 add_watcher() i=6 2024-09-12T17:58:39.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.153+0000 7f0f27725800 20 add_watcher() i=7 2024-09-12T17:58:39.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.153+0000 7f0f27725800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0dda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0f27725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0f27725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0f27725800 5 note: GC not initialized 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0dd97e2640 20 reqs_thread_entry: start 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.155+0000 7f0f27725800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 20 Filter name: none 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0dd27fc640 20 reqs_thread_entry: start 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:39.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : miss 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.156+0000 7f0f27725800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.157+0000 7f0f27725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:39.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.158+0000 7f0f27725800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:58:39.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.165+0000 7f0f27725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.165+0000 7f0f27725800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.165+0000 7f0f27725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.165+0000 7f0f27725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:39.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.166+0000 7f0e06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94325931585520 notifier 7130 bl.length()=911 2024-09-12T17:58:39.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.166+0000 7f0e06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.166+0000 7f0e06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.166+0000 7f0e06ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.167+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:39.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.167+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:39.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.167+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:39.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.167+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:39.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.0 2024-09-12T17:58:39.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.0 2024-09-12T17:58:39.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.1 2024-09-12T17:58:39.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.1 2024-09-12T17:58:39.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.2 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.2 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.3 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.3 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.4 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.4 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.5 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.5 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.6 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.6 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.7 2024-09-12T17:58:39.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.7 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.8 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.8 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.9 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.9 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.10 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.10 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.11 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2.11 2024-09-12T17:58:39.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.0 2024-09-12T17:58:39.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.173+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.1 2024-09-12T17:58:39.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.174+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2 2024-09-12T17:58:39.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.174+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.3 2024-09-12T17:58:39.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.175+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.4 2024-09-12T17:58:39.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.176+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.5 2024-09-12T17:58:39.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.176+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.6 2024-09-12T17:58:39.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.177+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.7 2024-09-12T17:58:39.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.177+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.8 2024-09-12T17:58:39.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.178+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.9 2024-09-12T17:58:39.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.179+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.10 2024-09-12T17:58:39.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.182+0000 7f0f27725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:39.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.182+0000 7f0f27725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:39.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.183+0000 7f0f27725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.183+0000 7f0f27725800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.183+0000 7f0f27725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.183+0000 7f0f27725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.183+0000 7f0e06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94325931585520 notifier 7130 bl.length()=911 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.184+0000 7f0e06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.184+0000 7f0e06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.184+0000 7f0e06ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.186+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:39.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.186+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:39.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.186+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:39.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.186+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:39.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.189+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.0 2024-09-12T17:58:39.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.189+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.1 2024-09-12T17:58:39.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.190+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.2 2024-09-12T17:58:39.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.190+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.3 2024-09-12T17:58:39.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.190+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.4 2024-09-12T17:58:39.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.191+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.5 2024-09-12T17:58:39.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.191+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.6 2024-09-12T17:58:39.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.191+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.7 2024-09-12T17:58:39.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.191+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.8 2024-09-12T17:58:39.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.192+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.9 2024-09-12T17:58:39.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.192+0000 7f0f27725800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34.10 2024-09-12T17:58:39.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.193+0000 7f0f27725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:39.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.193+0000 7f0f27725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 2024-09-12T17:58:39.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0f27725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0f27725800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0f27725800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0f27725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34, ofs0, ns] 2024-09-12T17:58:39.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0e067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 94325931585520 notifier 7130 bl.length()=879 2024-09-12T17:58:39.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0e067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 info.flags=0x17 2024-09-12T17:58:39.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0e067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 to cache LRU end 2024-09-12T17:58:39.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.194+0000 7f0e067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:39.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.196+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_sources= new_sources= 2024-09-12T17:58:39.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.196+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential sources added=[] removed=[] 2024-09-12T17:58:39.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.196+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): orig_dests= new_dests= 2024-09-12T17:58:39.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.196+0000 7f0f27725800 20 handle_bi_update(): bucket=:abort-at-do-reshard[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34]): potential dests added=[] removed=[] 2024-09-12T17:58:39.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.199+0000 7f0f27725800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:39.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.200+0000 7f0dda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:39.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.203+0000 7f0f27725800 20 remove_watcher() i=0 2024-09-12T17:58:39.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.203+0000 7f0f27725800 2 removed watcher, disabling cache 2024-09-12T17:58:39.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.204+0000 7f0f27725800 20 remove_watcher() i=1 2024-09-12T17:58:39.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.205+0000 7f0f27725800 20 remove_watcher() i=2 2024-09-12T17:58:39.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.206+0000 7f0f27725800 20 remove_watcher() i=3 2024-09-12T17:58:39.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.207+0000 7f0f27725800 20 remove_watcher() i=4 2024-09-12T17:58:39.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.208+0000 7f0f27725800 20 remove_watcher() i=5 2024-09-12T17:58:39.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.209+0000 7f0f27725800 20 remove_watcher() i=6 2024-09-12T17:58:39.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.210+0000 7f0f27725800 20 remove_watcher() i=7 2024-09-12T17:58:39.223 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:58:39.252 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:39.252 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:39.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.288+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 realm 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.290+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.291+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:39.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.292+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.292+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:39.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.292+0000 7f6134d25800 20 searching for the correct realm 2024-09-12T17:58:39.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.296+0000 7f61281ad640 0 -- 172.21.15.94:0/2782011902 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6120066b20 msgr2=0x7f612006e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:39.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.299+0000 7f61311af640 0 -- 172.21.15.94:0/2782011902 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f611802b070 msgr2=0x7f61180a2840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:39.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:39.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.302+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 zone default found 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 4 Realm: () 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 zonegroup default 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.303+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.304+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.304+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.304+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:39.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.304+0000 7f6134d25800 20 started sync module instance, tier type = 2024-09-12T17:58:39.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.304+0000 7f6134d25800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:39.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=0 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=1 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=2 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=3 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=4 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=5 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.312+0000 7f6134d25800 20 add_watcher() i=6 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.313+0000 7f6134d25800 20 add_watcher() i=7 2024-09-12T17:58:39.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.313+0000 7f6134d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:39.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.315+0000 7f5fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:39.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.315+0000 7f6134d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:39.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.315+0000 7f6134d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:39.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.315+0000 7f6134d25800 5 note: GC not initialized 2024-09-12T17:58:39.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.315+0000 7f5fe67e4640 20 reqs_thread_entry: start 2024-09-12T17:58:39.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f6134d25800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:39.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f6134d25800 20 Filter name: none 2024-09-12T17:58:39.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f5fdffff640 20 reqs_thread_entry: start 2024-09-12T17:58:39.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:39.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.316+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.317+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.317+0000 7f6134d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.317+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.317+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.317+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.318+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:39.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.318+0000 7f6134d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:39.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.320+0000 7f5fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:39.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.322+0000 7f6134d25800 20 remove_watcher() i=0 2024-09-12T17:58:39.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.322+0000 7f6134d25800 2 removed watcher, disabling cache 2024-09-12T17:58:39.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.323+0000 7f6134d25800 20 remove_watcher() i=1 2024-09-12T17:58:39.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.324+0000 7f6134d25800 20 remove_watcher() i=2 2024-09-12T17:58:39.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.325+0000 7f6134d25800 20 remove_watcher() i=3 2024-09-12T17:58:39.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.326+0000 7f6134d25800 20 remove_watcher() i=4 2024-09-12T17:58:39.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.327+0000 7f6134d25800 20 remove_watcher() i=5 2024-09-12T17:58:39.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.328+0000 7f6134d25800 20 remove_watcher() i=6 2024-09-12T17:58:39.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:39.328+0000 7f6134d25800 20 remove_watcher() i=7 2024-09-12T17:58:39.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:39.339 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:39.339 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:39.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:39.729 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:58:39.729 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:40.545 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:58:40.576 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:40.576 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:40.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.608+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.609+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.609+0000 7f13e8e40800 20 realm 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.609+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.610+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.610+0000 7f13e8e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.610+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.610+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.610+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.611+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:40.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.611+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.611+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:40.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.611+0000 7f13e8e40800 20 searching for the correct realm 2024-09-12T17:58:40.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.614+0000 7f13e712b640 0 -- 172.21.15.94:0/1013299266 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5556aef12870 msgr2=0x5556aef14d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:40.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.617+0000 7f13dffff640 0 -- 172.21.15.94:0/1013299266 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f13d8077c20 msgr2=0x7f13d80259d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.622+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 zone default found 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 4 Realm: () 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 zonegroup default 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 started sync module instance, tier type = 2024-09-12T17:58:40.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.623+0000 7f13e8e40800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:40.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=0 2024-09-12T17:58:40.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=1 2024-09-12T17:58:40.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=2 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=3 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=4 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=5 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.631+0000 7f13e8e40800 20 add_watcher() i=6 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.632+0000 7f13e8e40800 20 add_watcher() i=7 2024-09-12T17:58:40.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.632+0000 7f13e8e40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:40.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f129dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:40.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f13e8e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f13e8e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f13e8e40800 5 note: GC not initialized 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f129cfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f13e8e40800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f13e8e40800 20 Filter name: none 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.634+0000 7f1295ffb640 20 reqs_thread_entry: start 2024-09-12T17:58:40.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.635+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.635+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.635+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.635+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:40.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:40.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.636+0000 7f13e8e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:40.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.638+0000 7f129dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:40.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.640+0000 7f13e8e40800 20 remove_watcher() i=0 2024-09-12T17:58:40.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.640+0000 7f13e8e40800 2 removed watcher, disabling cache 2024-09-12T17:58:40.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.640+0000 7f13e8e40800 20 remove_watcher() i=1 2024-09-12T17:58:40.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.642+0000 7f13e8e40800 20 remove_watcher() i=2 2024-09-12T17:58:40.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.642+0000 7f13e8e40800 20 remove_watcher() i=3 2024-09-12T17:58:40.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.643+0000 7f13e8e40800 20 remove_watcher() i=4 2024-09-12T17:58:40.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.644+0000 7f13e8e40800 20 remove_watcher() i=5 2024-09-12T17:58:40.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.645+0000 7f13e8e40800 20 remove_watcher() i=6 2024-09-12T17:58:40.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.646+0000 7f13e8e40800 20 remove_watcher() i=7 2024-09-12T17:58:40.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:40.657 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:40.657 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:40.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:40.658 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:58:40.692 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:40.693 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:40.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.729+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.730+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.730+0000 7f495c10c800 20 realm 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.730+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.731+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.731+0000 7f495c10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.731+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.731+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.731+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.732+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.732+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.732+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.732+0000 7f495c10c800 20 searching for the correct realm 2024-09-12T17:58:40.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.734+0000 7f4959bf6640 0 -- 172.21.15.94:0/76314163 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x556b9d2af140 msgr2=0x7f4954015430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:40.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.940+0000 7f495a3f7640 0 -- 172.21.15.94:0/76314163 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f4944082040 msgr2=0x7f494408ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.944+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:40.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 zone default found 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 4 Realm: () 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:40.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 zonegroup default 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.945+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.946+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.946+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.946+0000 7f495c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.946+0000 7f495c10c800 20 started sync module instance, tier type = 2024-09-12T17:58:40.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.946+0000 7f495c10c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:40.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=0 2024-09-12T17:58:40.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=1 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=2 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=3 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=4 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=5 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.954+0000 7f495c10c800 20 add_watcher() i=6 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.955+0000 7f495c10c800 20 add_watcher() i=7 2024-09-12T17:58:40.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.955+0000 7f495c10c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.957+0000 7f48037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.957+0000 7f495c10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.957+0000 7f495c10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.957+0000 7f495c10c800 5 note: GC not initialized 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.957+0000 7f48027fc640 20 reqs_thread_entry: start 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 20 Filter name: none 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f477bfff640 20 reqs_thread_entry: start 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:40.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 : miss 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.958+0000 7f495c10c800 20 rados->read ofs=0 len=0 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.959+0000 7f495c10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.963+0000 7f495c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.963+0000 7f495c10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.963+0000 7f495c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.963+0000 7f495c10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35, ofs0, ns] 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.964+0000 7f483cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 93920689076928 notifier 7175 bl.length()=923 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.964+0000 7f483cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.964+0000 7f483cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:40.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.964+0000 7f483cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:40.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.965+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_sources= new_sources= 2024-09-12T17:58:40.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.965+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential sources added=[] removed=[] 2024-09-12T17:58:40.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.965+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_dests= new_dests= 2024-09-12T17:58:40.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.965+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential dests added=[] removed=[] 2024-09-12T17:58:40.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.967+0000 7f495c10c800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:58:40.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.967+0000 7f495c10c800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:58:40.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.971+0000 7f495c10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:40.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.971+0000 7f495c10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 2024-09-12T17:58:40.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.972+0000 7f495c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:40.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.972+0000 7f495c10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.972+0000 7f495c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.972+0000 7f495c10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35, ofs0, ns] 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.973+0000 7f483d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 93920689076928 notifier 7175 bl.length()=891 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.973+0000 7f483d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.973+0000 7f483d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:40.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.973+0000 7f483d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:40.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.974+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_sources= new_sources= 2024-09-12T17:58:40.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.974+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential sources added=[] removed=[] 2024-09-12T17:58:40.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.974+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_dests= new_dests= 2024-09-12T17:58:40.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.974+0000 7f495c10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential dests added=[] removed=[] 2024-09-12T17:58:40.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.976+0000 7f48037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:40.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.978+0000 7f495c10c800 20 remove_watcher() i=0 2024-09-12T17:58:40.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.978+0000 7f495c10c800 2 removed watcher, disabling cache 2024-09-12T17:58:40.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.979+0000 7f495c10c800 20 remove_watcher() i=1 2024-09-12T17:58:40.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.980+0000 7f495c10c800 20 remove_watcher() i=2 2024-09-12T17:58:40.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.981+0000 7f495c10c800 20 remove_watcher() i=3 2024-09-12T17:58:40.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.981+0000 7f495c10c800 20 remove_watcher() i=4 2024-09-12T17:58:40.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.982+0000 7f495c10c800 20 remove_watcher() i=5 2024-09-12T17:58:40.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.983+0000 7f495c10c800 20 remove_watcher() i=6 2024-09-12T17:58:40.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:40.984+0000 7f495c10c800 20 remove_watcher() i=7 2024-09-12T17:58:40.997 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:58:41.026 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:41.026 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:41.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.061+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 20 realm 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.062+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.063+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.063+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.064+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.064+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.064+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:41.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.064+0000 7ff702f37800 20 searching for the correct realm 2024-09-12T17:58:41.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.067+0000 7ff6f6420640 0 -- 172.21.15.94:0/3421782610 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7ff6f0016020 msgr2=0x7ff6f0061a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:41.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.071+0000 7ff6ff422640 0 -- 172.21.15.94:0/3421782610 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7ff6e80822b0 msgr2=0x7ff6e807a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:41.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.074+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 zone default found 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 4 Realm: () 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 zonegroup default 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 started sync module instance, tier type = 2024-09-12T17:58:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.075+0000 7ff702f37800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=0 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=1 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=2 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=3 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=4 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=5 2024-09-12T17:58:41.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.084+0000 7ff702f37800 20 add_watcher() i=6 2024-09-12T17:58:41.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.085+0000 7ff702f37800 20 add_watcher() i=7 2024-09-12T17:58:41.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.085+0000 7ff702f37800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:41.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.086+0000 7ff5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.086+0000 7ff702f37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.086+0000 7ff702f37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.086+0000 7ff702f37800 5 note: GC not initialized 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff5b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff702f37800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:41.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff702f37800 20 Filter name: none 2024-09-12T17:58:41.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff5adffb640 20 reqs_thread_entry: start 2024-09-12T17:58:41.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.087+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.088+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.088+0000 7ff702f37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.088+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.089+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.089+0000 7ff702f37800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.089+0000 7ff702f37800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:41.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.089+0000 7ff702f37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:41.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.091+0000 7ff5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.093+0000 7ff702f37800 20 remove_watcher() i=0 2024-09-12T17:58:41.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.093+0000 7ff702f37800 2 removed watcher, disabling cache 2024-09-12T17:58:41.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.094+0000 7ff702f37800 20 remove_watcher() i=1 2024-09-12T17:58:41.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.095+0000 7ff702f37800 20 remove_watcher() i=2 2024-09-12T17:58:41.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.096+0000 7ff702f37800 20 remove_watcher() i=3 2024-09-12T17:58:41.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.096+0000 7ff702f37800 20 remove_watcher() i=4 2024-09-12T17:58:41.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.097+0000 7ff702f37800 20 remove_watcher() i=5 2024-09-12T17:58:41.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.098+0000 7ff702f37800 20 remove_watcher() i=6 2024-09-12T17:58:41.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.099+0000 7ff702f37800 20 remove_watcher() i=7 2024-09-12T17:58:41.111 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:41.111 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:41.111 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:41.111 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:41.200 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:41.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:41.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:41.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.267+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 realm 2024-09-12T17:58:41.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.268+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.269+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.269+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.269+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:41.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.269+0000 7f09c0535800 20 searching for the correct realm 2024-09-12T17:58:41.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.273+0000 7f09bca22640 0 -- 172.21.15.94:0/2748472352 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5561980af0b0 msgr2=0x5561980b14a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:41.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.276+0000 7f09bc221640 0 -- 172.21.15.94:0/2748472352 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f09a4042c10 msgr2=0x7f09a4041970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:41.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:41.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.280+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 zone default found 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 4 Realm: () 2024-09-12T17:58:41.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 zonegroup default 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.281+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.282+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.282+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.282+0000 7f09c0535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.282+0000 7f09c0535800 20 started sync module instance, tier type = 2024-09-12T17:58:41.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.282+0000 7f09c0535800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:41.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=0 2024-09-12T17:58:41.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=1 2024-09-12T17:58:41.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=2 2024-09-12T17:58:41.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=3 2024-09-12T17:58:41.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=4 2024-09-12T17:58:41.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=5 2024-09-12T17:58:41.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.290+0000 7f09c0535800 20 add_watcher() i=6 2024-09-12T17:58:41.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.291+0000 7f09c0535800 20 add_watcher() i=7 2024-09-12T17:58:41.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.291+0000 7f09c0535800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:41.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.292+0000 7f08737de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:41.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:41.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 5 note: GC not initialized 2024-09-12T17:58:41.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f08727dc640 20 reqs_thread_entry: start 2024-09-12T17:58:41.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:41.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 20 Filter name: none 2024-09-12T17:58:41.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f086b7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:41.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:58:41.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.293+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 : miss 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:41.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.294+0000 7f09c0535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f09c0535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f09c0535800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f09c0535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f09c0535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35, ofs0, ns] 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f08937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 93877651104288 notifier 7647 bl.length()=923 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f08937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f08937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.299+0000 7f08937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.301+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_sources= new_sources= 2024-09-12T17:58:41.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.301+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential sources added=[] removed=[] 2024-09-12T17:58:41.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.301+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_dests= new_dests= 2024-09-12T17:58:41.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.301+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential dests added=[] removed=[] 2024-09-12T17:58:41.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.0 2024-09-12T17:58:41.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.0 2024-09-12T17:58:41.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.1 2024-09-12T17:58:41.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.1 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.2 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.2 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.3 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.3 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.4 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.4 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.5 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.5 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.6 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.6 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.7 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.7 2024-09-12T17:58:41.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.8 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.8 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.9 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.9 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.10 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.10 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.11 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1.11 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.0 2024-09-12T17:58:41.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.306+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1 2024-09-12T17:58:41.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.307+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.2 2024-09-12T17:58:41.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.307+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.3 2024-09-12T17:58:41.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.308+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.4 2024-09-12T17:58:41.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.308+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.5 2024-09-12T17:58:41.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.309+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.6 2024-09-12T17:58:41.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.309+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.7 2024-09-12T17:58:41.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.310+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.8 2024-09-12T17:58:41.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.310+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.9 2024-09-12T17:58:41.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.311+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.10 2024-09-12T17:58:41.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.314+0000 7f09c0535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:41.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.314+0000 7f09c0535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 2024-09-12T17:58:41.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f09c0535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f09c0535800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f09c0535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f09c0535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35, ofs0, ns] 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f0892ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529728 cookie 93877651104288 notifier 7647 bl.length()=923 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f0892ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f0892ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.315+0000 7f0892ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.317+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_sources= new_sources= 2024-09-12T17:58:41.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.317+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential sources added=[] removed=[] 2024-09-12T17:58:41.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.317+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_dests= new_dests= 2024-09-12T17:58:41.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.317+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential dests added=[] removed=[] 2024-09-12T17:58:41.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.319+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.0 2024-09-12T17:58:41.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.319+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.1 2024-09-12T17:58:41.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.320+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.2 2024-09-12T17:58:41.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.320+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.3 2024-09-12T17:58:41.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.320+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.4 2024-09-12T17:58:41.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.321+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.5 2024-09-12T17:58:41.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.321+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.6 2024-09-12T17:58:41.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.321+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.7 2024-09-12T17:58:41.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.321+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.8 2024-09-12T17:58:41.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.322+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.9 2024-09-12T17:58:41.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.322+0000 7f09c0535800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35.10 2024-09-12T17:58:41.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.322+0000 7f09c0535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:41.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.322+0000 7f09c0535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 2024-09-12T17:58:41.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.323+0000 7f09c0535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.323+0000 7f09c0535800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.323+0000 7f09c0535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.323+0000 7f09c0535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35, ofs0, ns] 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.324+0000 7f0892ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529729 cookie 93877651104288 notifier 7647 bl.length()=891 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.324+0000 7f0892ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 info.flags=0x17 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.324+0000 7f0892ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 to cache LRU end 2024-09-12T17:58:41.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.324+0000 7f0892ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:41.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.325+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_sources= new_sources= 2024-09-12T17:58:41.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.325+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential sources added=[] removed=[] 2024-09-12T17:58:41.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.325+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): orig_dests= new_dests= 2024-09-12T17:58:41.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.325+0000 7f09c0535800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35]): potential dests added=[] removed=[] 2024-09-12T17:58:41.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.327+0000 7f09c0535800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:41.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.329+0000 7f08737de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.331+0000 7f09c0535800 20 remove_watcher() i=0 2024-09-12T17:58:41.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.331+0000 7f09c0535800 2 removed watcher, disabling cache 2024-09-12T17:58:41.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.332+0000 7f09c0535800 20 remove_watcher() i=1 2024-09-12T17:58:41.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.332+0000 7f09c0535800 20 remove_watcher() i=2 2024-09-12T17:58:41.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.333+0000 7f09c0535800 20 remove_watcher() i=3 2024-09-12T17:58:41.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.334+0000 7f09c0535800 20 remove_watcher() i=4 2024-09-12T17:58:41.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.335+0000 7f09c0535800 20 remove_watcher() i=5 2024-09-12T17:58:41.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.336+0000 7f09c0535800 20 remove_watcher() i=6 2024-09-12T17:58:41.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.337+0000 7f09c0535800 20 remove_watcher() i=7 2024-09-12T17:58:41.350 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:58:41.378 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:41.378 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:41.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.413+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 realm 2024-09-12T17:58:41.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:41.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.415+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.416+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.416+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.416+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:41.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.416+0000 7f5687f39800 20 searching for the correct realm 2024-09-12T17:58:41.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.420+0000 7f56843c8640 0 -- 172.21.15.94:0/1789804765 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5593aa25cd60 msgr2=0x5593aa25f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:41.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.423+0000 7f567bfff640 0 -- 172.21.15.94:0/1789804765 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f56740acbe0 msgr2=0x7f56740ab650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.426+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 zone default found 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 4 Realm: () 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 zonegroup default 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.427+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.428+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.428+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.428+0000 7f5687f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.428+0000 7f5687f39800 20 started sync module instance, tier type = 2024-09-12T17:58:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.428+0000 7f5687f39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=0 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=1 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=2 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=3 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=4 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=5 2024-09-12T17:58:41.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.436+0000 7f5687f39800 20 add_watcher() i=6 2024-09-12T17:58:41.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.437+0000 7f5687f39800 20 add_watcher() i=7 2024-09-12T17:58:41.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.437+0000 7f5687f39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:41.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.438+0000 7f5539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 5 note: GC not initialized 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5538fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 20 Filter name: none 2024-09-12T17:58:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f54b27fc640 20 reqs_thread_entry: start 2024-09-12T17:58:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.439+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.440+0000 7f5687f39800 20 rados->read ofs=0 len=0 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.441+0000 7f5687f39800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.441+0000 7f5687f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.442+0000 7f5539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.444+0000 7f5687f39800 20 remove_watcher() i=0 2024-09-12T17:58:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.444+0000 7f5687f39800 2 removed watcher, disabling cache 2024-09-12T17:58:41.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.445+0000 7f5687f39800 20 remove_watcher() i=1 2024-09-12T17:58:41.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.446+0000 7f5687f39800 20 remove_watcher() i=2 2024-09-12T17:58:41.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.447+0000 7f5687f39800 20 remove_watcher() i=3 2024-09-12T17:58:41.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.448+0000 7f5687f39800 20 remove_watcher() i=4 2024-09-12T17:58:41.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.449+0000 7f5687f39800 20 remove_watcher() i=5 2024-09-12T17:58:41.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.450+0000 7f5687f39800 20 remove_watcher() i=6 2024-09-12T17:58:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:41.451+0000 7f5687f39800 20 remove_watcher() i=7 2024-09-12T17:58:41.462 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:41.462 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:41.462 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:41.462 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:41.827 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:58:41.828 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:42.678 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:58:42.706 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:42.706 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.741+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 realm 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.743+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.744+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:42.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.744+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.744+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:42.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.744+0000 7f2216040800 20 searching for the correct realm 2024-09-12T17:58:42.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.747+0000 7f2213329640 0 -- 172.21.15.94:0/1403733327 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f2204024070 msgr2=0x7f2204099740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:42.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.751+0000 7f2213b2a640 0 -- 172.21.15.94:0/1403733327 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2208035b80 msgr2=0x7f2208046920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:42.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.957+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:42.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 zone default found 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 4 Realm: () 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 zonegroup default 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.958+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.959+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.959+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.959+0000 7f2216040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:42.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.959+0000 7f2216040800 20 started sync module instance, tier type = 2024-09-12T17:58:42.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.959+0000 7f2216040800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:42.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=0 2024-09-12T17:58:42.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=1 2024-09-12T17:58:42.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=2 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=3 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=4 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=5 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.967+0000 7f2216040800 20 add_watcher() i=6 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.968+0000 7f2216040800 20 add_watcher() i=7 2024-09-12T17:58:42.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.968+0000 7f2216040800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:42.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f20c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:42.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:42.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 5 note: GC not initialized 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f20c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 20 Filter name: none 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f20427fc640 20 reqs_thread_entry: start 2024-09-12T17:58:42.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.970+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.971+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:42.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.971+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:42.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:42.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:42.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 rados->read ofs=0 len=0 2024-09-12T17:58:42.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.972+0000 7f2216040800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:42.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.973+0000 7f2216040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:42.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.974+0000 7f20c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:42.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.976+0000 7f2216040800 20 remove_watcher() i=0 2024-09-12T17:58:42.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.976+0000 7f2216040800 2 removed watcher, disabling cache 2024-09-12T17:58:42.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.978+0000 7f2216040800 20 remove_watcher() i=1 2024-09-12T17:58:42.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.978+0000 7f2216040800 20 remove_watcher() i=2 2024-09-12T17:58:42.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.979+0000 7f2216040800 20 remove_watcher() i=3 2024-09-12T17:58:42.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.980+0000 7f2216040800 20 remove_watcher() i=4 2024-09-12T17:58:42.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.981+0000 7f2216040800 20 remove_watcher() i=5 2024-09-12T17:58:42.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.982+0000 7f2216040800 20 remove_watcher() i=6 2024-09-12T17:58:42.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:42.983+0000 7f2216040800 20 remove_watcher() i=7 2024-09-12T17:58:42.994 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:42.994 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:42.994 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:42.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:42.996 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:58:43.031 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:43.031 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:43.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.065+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 realm 2024-09-12T17:58:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.068+0000 7fa33622f800 20 searching for the correct realm 2024-09-12T17:58:43.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.071+0000 7fa334521640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa31c03b070 msgr2=0x7fa31c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.074+0000 7fa333d20640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa31c02e910 msgr2=0x7fa31c008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:43.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:43.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 zone default found 2024-09-12T17:58:43.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 4 Realm: () 2024-09-12T17:58:43.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:43.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 zonegroup default 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.282+0000 7fa33622f800 20 started sync module instance, tier type = 2024-09-12T17:58:43.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.282+0000 7fa33622f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:43.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=0 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=1 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=2 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=3 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=4 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=5 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=6 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.291+0000 7fa33622f800 20 add_watcher() i=7 2024-09-12T17:58:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.291+0000 7fa33622f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:43.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.293+0000 7fa1e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.293+0000 7fa33622f800 5 note: GC not initialized 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa1e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa33622f800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa33622f800 20 Filter name: none 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa1627fc640 20 reqs_thread_entry: start 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:58:43.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.294+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:43.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:58:43.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : miss 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.295+0000 7fa33622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.299+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.299+0000 7fa33622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.299+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.299+0000 7fa33622f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 93838531648912 notifier 7695 bl.length()=923 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:58:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:58:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:58:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:58:43.305 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa33622f800 time 2024-09-12T17:58:43.305764+0000 2024-09-12T17:58:43.305 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa33978c71a] 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.305+0000 7fa33622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa33622f800 time 2024-09-12T17:58:43.305764+0000 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa33978c71a] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:58:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa33622f800 thread_name:radosgw-admin 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33843e6f0] 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa33848b99c] 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa33978c774] 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.306+0000 7fa33622f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa33622f800 thread_name:radosgw-admin 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33843e6f0] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa33848b99c] 2024-09-12T17:58:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa33978c774] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:58:43.049+0000 7fa221e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:58:43.049+0000 7fa221e0b640 10 monclient: dump: 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:58:43.049+0000 7fa33622f800 5 monclient: authenticate success, global_id 7250 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:58:43.049+0000 7fa33622f800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:58:43.049+0000 7fa33622f800 4 set_mon_vals no callback set 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: shutdown 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 asok(0x55587c26d730) unregister_commands rotate-key 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:58:43.050+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: starting msgr at 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: starting objecter 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests hook 0x55587c4be3f0 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: setting wanted keys 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: calling monclient init 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:58:43.050+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:58:43.051+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:58:43.051+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key hook 0x55587c48fa28 2024-09-12T17:58:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c31a3c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c343fb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c3d7940 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.565291s 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c31a3c0 auth_method 0 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c3d7940 auth_method 0 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c343fb0 auth_method 0 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:58:43.051+0000 7fa333d20640 1 monclient: found mon.noname-c 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.341 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:58:43.342 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:58:43.051+0000 7fa33622f800 5 monclient: authenticate success, global_id 7253 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:58:43.051+0000 7fa221e0b640 4 set_mon_vals no callback set 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:58:43.052+0000 7fa33622f800 1 librados: init done 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:58:43.053+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa21c076470 auth_method 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:58:43.054+0000 7fa334521640 10 monclient: get_auth_request con 0x55587c4cdeb0 auth_method 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:58:43.054+0000 7fa333d20640 10 monclient: get_auth_request con 0x55587c4dacc0 auth_method 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:58:43.056+0000 7fa32b51f640 10 monclient: get_auth_request con 0x55587c4dff60 auth_method 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:58:43.056+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:58:43.056+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:58:43.056+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.344 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests cmddesc objecter_requests hook 0x55587c4e7910 EEXIST 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.346 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.347 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x55587c4e30b0 EEXIST 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c50b600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c50d8d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c509dd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.348 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.571895s 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c50b600 auth_method 0 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c50d8d0 auth_method 0 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.349 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c509dd0 auth_method 0 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:58:43.058+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: dump: 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.350 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: dump: 2024-09-12T17:58:43.351 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:58:43.058+0000 7fa33622f800 5 monclient: authenticate success, global_id 7689 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.352 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:58:43.058+0000 7fa334d22640 4 set_mon_vals no callback set 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:58:43.060+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa20c076380 auth_method 0 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: get_monmap_and_config 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:58:43.060+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.353 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.354 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:58:43.060+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.355 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:58:43.061+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:58:43.061+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x7ffc48a43338 EEXIST 2024-09-12T17:58:43.356 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c55f550 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c52f0b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c52bfe0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.575535s 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c55f550 auth_method 0 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.357 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c52bfe0 auth_method 0 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c52f0b0 auth_method 0 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.358 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7692 payload 274 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:58:43.061+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: dump: 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.359 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: dump: 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.360 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 monclient: authenticate success, global_id 7692 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:58:43.062+0000 7fa33622f800 4 set_mon_vals no callback set 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: shutdown 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.361 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.362 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:58:43.062+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 librados: starting msgr at 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 librados: starting objecter 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests cmddesc objecter_requests hook 0x55587c530cf0 EEXIST 2024-09-12T17:58:43.363 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:58:43.063+0000 7fa33622f800 1 librados: setting wanted keys 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:58:43.063+0000 7fa33622f800 1 librados: calling monclient init 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.364 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:58:43.063+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:58:43.063+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x55587c5234f8 EEXIST 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c52bfe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c52f0b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c55f550 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.365 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.577682s 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c52bfe0 auth_method 0 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c55f550 auth_method 0 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.366 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c52f0b0 auth_method 0 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:58:43.063+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.367 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: dump: 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.368 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: dump: 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.369 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:58:43.064+0000 7fa33622f800 5 monclient: authenticate success, global_id 7695 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:58:43.064+0000 7fa212ffd640 4 set_mon_vals no callback set 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:58:43.064+0000 7fa33622f800 1 librados: init done 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:58:43.064+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cr dump hook 0x55587c56cd58 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:58:43.065+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:58:43.066+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa1fc076470 auth_method 0 2024-09-12T17:58:43.370 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:58:43.066+0000 7fa334521640 10 monclient: get_auth_request con 0x55587c578f30 auth_method 0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 realm 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:58:43.067+0000 7fa33622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:58:43.067+0000 7fa333d20640 10 monclient: get_auth_request con 0x55587c57d190 auth_method 0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 searching for the correct realm 2024-09-12T17:58:43.371 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:58:43.068+0000 7fa32b51f640 10 monclient: get_auth_request con 0x55587c582430 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:58:43.069+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa31c03b070 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:58:43.070+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa32c025040 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:58:43.070+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa32406b020 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:58:43.071+0000 7fa334521640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa31c03b070 msgr2=0x7fa31c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:58:43.071+0000 7fa2117fa640 1 client.7695.objecter ms_handle_reset 0x7fa31c03b070 session 0x7fa31c01d040 osd.7 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:58:43.071+0000 7fa2117fa640 10 monclient: _renew_subs 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:58:43.071+0000 7fa2117fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:58:43.071+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa1fc086b90 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:58:43.072+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa31c02d070 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:58:43.074+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa31c02e910 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:58:43.074+0000 7fa333d20640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa31c02e910 msgr2=0x7fa31c008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:58:43.275+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa31c02e910 auth_method 0 2024-09-12T17:58:43.372 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.373 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 zone default found 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 Realm: () 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:58:43.281+0000 7fa33622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 zonegroup default 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.374 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:58:43.282+0000 7fa33622f800 20 started sync module instance, tier type = 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:58:43.282+0000 7fa33622f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=0 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=1 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=2 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=3 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=4 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=5 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=6 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:58:43.291+0000 7fa33622f800 20 add_watcher() i=7 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:58:43.291+0000 7fa33622f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.375 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:58:43.293+0000 7fa1e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.376 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:58:43.293+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache list hook 0x55587c54d250 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache inspect hook 0x55587c54d250 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache erase hook 0x55587c54d250 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache zap hook 0x55587c54d250 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 note: GC not initialized 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:58:43.294+0000 7fa1e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace show hook 0x7fa3240d6070 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace history hook 0x7fa3240d6070 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace active hook 0x7fa3240d6070 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace active_short hook 0x7fa3240d6070 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:43.377 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 Filter name: none 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:58:43.294+0000 7fa1627fc640 20 reqs_thread_entry: start 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:58:43.294+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : miss 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:43.378 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 93838531648912 notifier 7695 bl.length()=923 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:58:43.379 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:58:43.305+0000 7fa33622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa33622f800 time 2024-09-12T17:58:43.305764+0000 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa33978c71a] 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.380 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:58:43.306+0000 7fa33622f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa33622f800 thread_name:radosgw-admin 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33843e6f0] 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa33848b99c] 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa33978c774] 2024-09-12T17:58:43.381 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:58:43.382 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:58:43.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:58:43.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:43.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:58:43.386 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:43.387 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:58:43.388 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1627fc640 / http_manager 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1e8fe1640 / http_manager 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1e9fe3640 / rgw_dt_lg_renew 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa2117fa640 / ms_dispatch 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa212ffd640 / io_context_pool 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa2197fa640 / ms_dispatch 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa21bfff640 / ms_dispatch 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa221e0b640 / io_context_pool 2024-09-12T17:58:43.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa32b51f640 / msgr-worker-2 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa333d20640 / msgr-worker-1 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa334521640 / msgr-worker-0 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa334d22640 / io_context_pool 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa33622f800 / radosgw-admin 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.133589.log 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:58:43.049+0000 7fa221e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:58:43.049+0000 7fa221e0b640 10 monclient: dump: 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.390 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:58:43.049+0000 7fa33622f800 5 monclient: authenticate success, global_id 7250 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:58:43.049+0000 7fa33622f800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:58:43.049+0000 7fa33622f800 4 set_mon_vals no callback set 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: shutdown 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 asok(0x55587c26d730) unregister_commands rotate-key 2024-09-12T17:58:43.391 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.392 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding auth protocol: cephx 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: crc 2024-09-12T17:58:43.393 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c4929d0) adding con mode: secure 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:58:43.050+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: starting msgr at 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: starting objecter 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests hook 0x55587c4be3f0 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: setting wanted keys 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:58:43.050+0000 7fa33622f800 1 librados: calling monclient init 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:58:43.050+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding auth protocol: cephx 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.394 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: crc 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:58:43.050+0000 7fa33622f800 5 AuthRegistry(0x55587c48f8e0) adding con mode: secure 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:58:43.050+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:58:43.051+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:58:43.051+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key hook 0x55587c48fa28 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:58:43.395 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c31a3c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c343fb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c3d7940 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:58:43.051+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.565291s 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c31a3c0 auth_method 0 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c3d7940 auth_method 0 2024-09-12T17:58:43.396 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:58:43.051+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c343fb0 auth_method 0 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.397 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:58:43.051+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:58:43.051+0000 7fa333d20640 1 monclient: found mon.noname-c 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:58:43.051+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.398 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:58:43.051+0000 7fa21bfff640 10 monclient: dump: 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.399 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:58:43.051+0000 7fa33622f800 5 monclient: authenticate success, global_id 7253 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:58:43.051+0000 7fa221e0b640 4 set_mon_vals no callback set 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:58:43.052+0000 7fa33622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:58:43.052+0000 7fa33622f800 1 librados: init done 2024-09-12T17:58:43.400 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:58:43.053+0000 7fa21bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:58:43.053+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa21c076470 auth_method 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:58:43.054+0000 7fa334521640 10 monclient: get_auth_request con 0x55587c4cdeb0 auth_method 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:58:43.054+0000 7fa333d20640 10 monclient: get_auth_request con 0x55587c4dacc0 auth_method 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:58:43.056+0000 7fa32b51f640 10 monclient: get_auth_request con 0x55587c4dff60 auth_method 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:58:43.056+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:58:43.056+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:58:43.056+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.401 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding auth protocol: cephx 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.402 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: crc 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:58:43.056+0000 7fa33622f800 5 AuthRegistry(0x55587c4e3f20) adding con mode: secure 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests cmddesc objecter_requests hook 0x55587c4e7910 EEXIST 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding auth protocol: cephx 2024-09-12T17:58:43.403 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: crc 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 AuthRegistry(0x55587c4e2f68) adding con mode: secure 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:58:43.057+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.404 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:58:43.057+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x55587c4e30b0 EEXIST 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c50b600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c50d8d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c509dd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:58:43.057+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.571895s 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c50b600 auth_method 0 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.405 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:58:43.057+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c50d8d0 auth_method 0 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:58:43.058+0000 7fa32b51f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c509dd0 auth_method 0 2024-09-12T17:58:43.406 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:58:43.058+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:58:43.058+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:58:43.058+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: dump: 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.407 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:58:43.058+0000 7fa2197fa640 10 monclient: dump: 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.408 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:58:43.058+0000 7fa33622f800 5 monclient: authenticate success, global_id 7689 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:58:43.058+0000 7fa334d22640 4 set_mon_vals no callback set 2024-09-12T17:58:43.409 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:58:43.058+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:58:43.060+0000 7fa2197fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:58:43.060+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa20c076380 auth_method 0 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: get_monmap_and_config 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:58:43.060+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:58:43.060+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.410 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding auth protocol: cephx 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.411 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: crc 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:58:43.060+0000 7fa33622f800 5 AuthRegistry(0x55587c52b030) adding con mode: secure 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:58:43.060+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.412 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding auth protocol: cephx 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: crc 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a431f0) adding con mode: secure 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:58:43.061+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.413 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:58:43.061+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:58:43.061+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x7ffc48a43338 EEXIST 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c55f550 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c52f0b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c52bfe0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:58:43.061+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.575535s 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c55f550 auth_method 0 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.414 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c52bfe0 auth_method 0 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:58:43.061+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c52f0b0 auth_method 0 2024-09-12T17:58:43.415 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:58:43.061+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7692 payload 274 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:58:43.061+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:58:43.061+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: dump: 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.416 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:58:43.062+0000 7fa212ffd640 10 monclient: dump: 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.417 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 monclient: authenticate success, global_id 7692 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: get_monmap_and_config success 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:58:43.062+0000 7fa33622f800 4 set_mon_vals no callback set 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: shutdown 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: build_initial_monmap 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 build_initial for_mkfs: 0 2024-09-12T17:58:43.418 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:58:43.062+0000 7fa33622f800 10 monclient: monmap: 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding auth protocol: cephx 2024-09-12T17:58:43.419 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: crc 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:58:43.062+0000 7fa33622f800 5 AuthRegistry(0x55587c52afe0) adding con mode: secure 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:58:43.062+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.420 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 librados: starting msgr at 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:58:43.062+0000 7fa33622f800 1 librados: starting objecter 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 asok(0x55587c26d730) register_command objecter_requests cmddesc objecter_requests hook 0x55587c530cf0 EEXIST 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:58:43.063+0000 7fa33622f800 1 librados: setting wanted keys 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:58:43.063+0000 7fa33622f800 1 librados: calling monclient init 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: init 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding auth protocol: cephx 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.421 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: crc 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 AuthRegistry(0x55587c5233b0) adding con mode: secure 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:58:43.063+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:58:43.063+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:58:43.063+0000 7fa33622f800 5 asok(0x55587c26d730) register_command rotate-key cmddesc rotate-key hook 0x55587c5234f8 EEXIST 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: _reopen_session rank -1 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-a con 0x55587c52bfe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:58:43.422 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-b con 0x55587c52f0b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): picked mon.noname-c con 0x55587c55f550 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): _renew_subs 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:58:43.063+0000 7fa33622f800 10 monclient(hunting): authenticate will time out at 2196.577682s 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): get_auth_request con 0x55587c52bfe0 auth_method 0 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): get_auth_request con 0x55587c55f550 auth_method 0 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.423 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:58:43.063+0000 7fa334521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): get_auth_request con 0x55587c52f0b0 auth_method 0 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:58:43.063+0000 7fa32b51f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient: _finish_hunting 0 2024-09-12T17:58:43.424 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:58:43.063+0000 7fa333d20640 1 monclient: found mon.noname-a 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:58:43.063+0000 7fa333d20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: dump: 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.425 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: _finish_auth 0 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: _check_auth_tickets 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:58:43.064+0000 7fa2117fa640 10 monclient: dump: 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:58:43.426 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:58:43.064+0000 7fa33622f800 5 monclient: authenticate success, global_id 7695 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:58:43.064+0000 7fa212ffd640 4 set_mon_vals no callback set 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _renew_subs 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:58:43.064+0000 7fa33622f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:58:43.064+0000 7fa33622f800 1 librados: init done 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:58:43.064+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cr dump hook 0x55587c56cd58 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:58:43.065+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.427 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:58:43.066+0000 7fa2117fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:58:43.066+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa1fc076470 auth_method 0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:58:43.066+0000 7fa334521640 10 monclient: get_auth_request con 0x55587c578f30 auth_method 0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 realm 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:58:43.067+0000 7fa33622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:58:43.067+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:58:43.067+0000 7fa333d20640 10 monclient: get_auth_request con 0x55587c57d190 auth_method 0 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.428 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:58:43.068+0000 7fa33622f800 20 searching for the correct realm 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:58:43.068+0000 7fa32b51f640 10 monclient: get_auth_request con 0x55587c582430 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:58:43.069+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa31c03b070 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:58:43.070+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa32c025040 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:58:43.070+0000 7fa32b51f640 10 monclient: get_auth_request con 0x7fa32406b020 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:58:43.071+0000 7fa334521640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fa31c03b070 msgr2=0x7fa31c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:58:43.071+0000 7fa2117fa640 1 client.7695.objecter ms_handle_reset 0x7fa31c03b070 session 0x7fa31c01d040 osd.7 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:58:43.071+0000 7fa2117fa640 10 monclient: _renew_subs 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:58:43.071+0000 7fa2117fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:58:43.071+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa1fc086b90 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:58:43.072+0000 7fa334521640 10 monclient: get_auth_request con 0x7fa31c02d070 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:58:43.074+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa31c02e910 auth_method 0 2024-09-12T17:58:43.429 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:58:43.074+0000 7fa333d20640 0 -- 172.21.15.94:0/722933977 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa31c02e910 msgr2=0x7fa31c008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:58:43.275+0000 7fa333d20640 10 monclient: get_auth_request con 0x7fa31c02e910 auth_method 0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:58:43.280+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.430 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 zone default found 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 Realm: () 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:58:43.281+0000 7fa33622f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:58:43.281+0000 7fa33622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 zonegroup default 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.431 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:58:43.281+0000 7fa33622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:58:43.282+0000 7fa33622f800 20 started sync module instance, tier type = 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:58:43.282+0000 7fa33622f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=0 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=1 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=2 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=3 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=4 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=5 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:58:43.290+0000 7fa33622f800 20 add_watcher() i=6 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:58:43.291+0000 7fa33622f800 20 add_watcher() i=7 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:58:43.291+0000 7fa33622f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.432 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding auth protocol: cephx 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: crc 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 AuthRegistry(0x7ffc48a436c0) adding con mode: secure 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:58:43.293+0000 7fa1e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.433 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:58:43.293+0000 7fa33622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:58:43.293+0000 7fa33622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache list hook 0x55587c54d250 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache inspect hook 0x55587c54d250 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache erase hook 0x55587c54d250 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 asok(0x55587c26d730) register_command cache zap hook 0x55587c54d250 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:58:43.293+0000 7fa33622f800 5 note: GC not initialized 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:58:43.294+0000 7fa1e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace show hook 0x7fa3240d6070 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace history hook 0x7fa3240d6070 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace active hook 0x7fa3240d6070 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:58:43.294+0000 7fa33622f800 5 asok(0x55587c26d730) register_command sync trace active_short hook 0x7fa3240d6070 2024-09-12T17:58:43.434 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 Filter name: none 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:58:43.294+0000 7fa1627fc640 20 reqs_thread_entry: start 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:58:43.294+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:58:43.294+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : miss 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:58:43.295+0000 7fa33622f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:43.435 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:58:43.295+0000 7fa33622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:58:43.299+0000 7fa33622f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 93838531648912 notifier 7695 bl.length()=923 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:58:43.300+0000 7fa212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:58:43.436 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:58:43.302+0000 7fa33622f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:58:43.437 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:58:43.305+0000 7fa33622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa33622f800 time 2024-09-12T17:58:43.305764+0000 2024-09-12T17:58:43.437 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:43.437 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.437 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa33978c71a] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:58:43.441 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:58:43.306+0000 7fa33622f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa33622f800 thread_name:radosgw-admin 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33843e6f0] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa33848b99c] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa33978c774] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa33978c8d8] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555879e5a841] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x55587a36890c] 2024-09-12T17:58:43.442 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555879e6a50d] 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa338429590] 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:43.443 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:43.444 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:58:43.445 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:43.446 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:58:43.447 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:43.448 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:43.449 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1627fc640 / http_manager 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1e8fe1640 / http_manager 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa1e9fe3640 / rgw_dt_lg_renew 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa2117fa640 / ms_dispatch 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa212ffd640 / io_context_pool 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa2197fa640 / ms_dispatch 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa21bfff640 / ms_dispatch 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa221e0b640 / io_context_pool 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa32b51f640 / msgr-worker-2 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa333d20640 / msgr-worker-1 2024-09-12T17:58:43.450 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa334521640 / msgr-worker-0 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa334d22640 / io_context_pool 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa33622f800 / radosgw-admin 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:58:43.307417Z_72c062ba-7204-48b1-b250-8770b7b8d541/log 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:58:43.451 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.381+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 realm 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.383+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.384+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.384+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.384+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.384+0000 7fbdc6bad800 20 searching for the correct realm 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.388+0000 7fbdbbe96640 0 -- 172.21.15.94:0/2081095557 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5632f992f300 msgr2=0x5632f9931730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.391+0000 7fbdc4697640 0 -- 172.21.15.94:0/2081095557 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbdac0878c0 msgr2=0x7fbdac090330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:43.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.395+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 zone default found 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 4 Realm: () 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 zonegroup default 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.396+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.397+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.397+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.397+0000 7fbdc6bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.397+0000 7fbdc6bad800 20 started sync module instance, tier type = 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.397+0000 7fbdc6bad800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=0 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=1 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=2 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=3 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=4 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=5 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.405+0000 7fbdc6bad800 20 add_watcher() i=6 2024-09-12T17:58:43.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.406+0000 7fbdc6bad800 20 add_watcher() i=7 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.406+0000 7fbdc6bad800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbc7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 5 note: GC not initialized 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbc79fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 20 Filter name: none 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbbeb7fe640 20 reqs_thread_entry: start 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.408+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.409+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.409+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.410+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:58:43.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.410+0000 7fbdc6bad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.410+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.411+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.411+0000 7fbdc6bad800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.411+0000 7fbdc6bad800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.411+0000 7fbdc6bad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.413+0000 7fbc7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.414+0000 7fbdc6bad800 20 remove_watcher() i=0 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.414+0000 7fbdc6bad800 2 removed watcher, disabling cache 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.416+0000 7fbdc6bad800 20 remove_watcher() i=1 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.417+0000 7fbdc6bad800 20 remove_watcher() i=2 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.418+0000 7fbdc6bad800 20 remove_watcher() i=3 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.419+0000 7fbdc6bad800 20 remove_watcher() i=4 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.420+0000 7fbdc6bad800 20 remove_watcher() i=5 2024-09-12T17:58:43.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.421+0000 7fbdc6bad800 20 remove_watcher() i=6 2024-09-12T17:58:43.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.421+0000 7fbdc6bad800 20 remove_watcher() i=7 2024-09-12T17:58:43.463 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.463 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:58:43.463 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:43.463 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:58:43.523 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:43.554 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:43.554 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:43.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.589+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 realm 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.591+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.592+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.592+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.592+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:43.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.592+0000 7f890f126800 20 searching for the correct realm 2024-09-12T17:58:43.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.595+0000 7f890b64c640 0 -- 172.21.15.94:0/986086126 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f88f4050040 msgr2=0x7f88f4043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.598+0000 7f890ae4b640 0 -- 172.21.15.94:0/986086126 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f88f4036bc0 msgr2=0x7f88f4041930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:43.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:43.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.803+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:43.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 zone default found 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 4 Realm: () 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 zonegroup default 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.804+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.805+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.805+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.805+0000 7f890f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.805+0000 7f890f126800 20 started sync module instance, tier type = 2024-09-12T17:58:43.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.805+0000 7f890f126800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=0 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=1 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=2 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=3 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=4 2024-09-12T17:58:43.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=5 2024-09-12T17:58:43.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.814+0000 7f890f126800 20 add_watcher() i=6 2024-09-12T17:58:43.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.815+0000 7f890f126800 20 add_watcher() i=7 2024-09-12T17:58:43.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.815+0000 7f890f126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:43.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.816+0000 7f87c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:43.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:43.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 5 note: GC not initialized 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f873bfff640 20 reqs_thread_entry: start 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 20 init_complete bucket index max shards: 11 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 20 Filter name: none 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f8739ffb640 20 reqs_thread_entry: start 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.817+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : miss 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 20 rados->read ofs=0 len=0 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:58:43.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.818+0000 7f890f126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.820+0000 7f890f126800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to be held by another RGW process; skipping for now 2024-09-12T17:58:43.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.820+0000 7f87c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:43.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.822+0000 7f890f126800 20 remove_watcher() i=0 2024-09-12T17:58:43.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.822+0000 7f890f126800 2 removed watcher, disabling cache 2024-09-12T17:58:43.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.823+0000 7f890f126800 20 remove_watcher() i=1 2024-09-12T17:58:43.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.824+0000 7f890f126800 20 remove_watcher() i=2 2024-09-12T17:58:43.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.825+0000 7f890f126800 20 remove_watcher() i=3 2024-09-12T17:58:43.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.826+0000 7f890f126800 20 remove_watcher() i=4 2024-09-12T17:58:43.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.827+0000 7f890f126800 20 remove_watcher() i=5 2024-09-12T17:58:43.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.828+0000 7f890f126800 20 remove_watcher() i=6 2024-09-12T17:58:43.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:58:43.829+0000 7f890f126800 20 remove_watcher() i=7 2024-09-12T17:58:43.840 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:59:13.873 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:13.907 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:13.908 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:13.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.949+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.950+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.950+0000 7fc89fd46800 20 realm 2024-09-12T17:59:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.950+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.951+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.951+0000 7fc89fd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.951+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.951+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.951+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.952+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.952+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:13.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.952+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:13.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.952+0000 7fc89fd46800 20 searching for the correct realm 2024-09-12T17:59:13.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:13.954+0000 7fc89d830640 0 -- 172.21.15.94:0/794854881 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fc89802eb50 msgr2=0x7fc8980293f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:14.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.159+0000 7fc89e031640 0 -- 172.21.15.94:0/794854881 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fc88803c030 msgr2=0x7fc88807ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.165+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 zone default found 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 4 Realm: () 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 zonegroup default 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.166+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 started sync module instance, tier type = 2024-09-12T17:59:14.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.167+0000 7fc89fd46800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=0 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=1 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=2 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=3 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=4 2024-09-12T17:59:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=5 2024-09-12T17:59:14.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.177+0000 7fc89fd46800 20 add_watcher() i=6 2024-09-12T17:59:14.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.178+0000 7fc89fd46800 20 add_watcher() i=7 2024-09-12T17:59:14.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.178+0000 7fc89fd46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:14.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc74f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 5 note: GC not initialized 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc74e7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 20 Filter name: none 2024-09-12T17:59:14.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc6bffff640 20 reqs_thread_entry: start 2024-09-12T17:59:14.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.180+0000 7fc89fd46800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:59:14.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : miss 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.181+0000 7fc89fd46800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:59:14.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:14.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.182+0000 7fc89fd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:59:14.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.183+0000 7fc89fd46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc89fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc89fd46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc89fd46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc89fd46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc7817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94455103800640 notifier 7746 bl.length()=923 2024-09-12T17:59:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc7817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc7817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.190+0000 7fc7817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.192+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:59:14.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.192+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:59:14.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.192+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:59:14.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.192+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:59:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.0 2024-09-12T17:59:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.0 2024-09-12T17:59:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.1 2024-09-12T17:59:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.1 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.2 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.2 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.3 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.3 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.4 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.4 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.5 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.5 2024-09-12T17:59:14.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.6 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.6 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.7 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.7 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.8 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.8 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.9 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.9 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.10 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.10 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.11 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2.11 2024-09-12T17:59:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.198+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.0 2024-09-12T17:59:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.199+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.1 2024-09-12T17:59:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.199+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2 2024-09-12T17:59:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.200+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.3 2024-09-12T17:59:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.200+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.4 2024-09-12T17:59:14.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.201+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.5 2024-09-12T17:59:14.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.201+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.6 2024-09-12T17:59:14.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.202+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.7 2024-09-12T17:59:14.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.202+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.8 2024-09-12T17:59:14.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.203+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.9 2024-09-12T17:59:14.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.204+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.10 2024-09-12T17:59:14.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.207+0000 7fc89fd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:14.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.207+0000 7fc89fd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:59:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc89fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc89fd46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc89fd46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc89fd46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:59:14.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc780ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94455103800640 notifier 7746 bl.length()=923 2024-09-12T17:59:14.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.208+0000 7fc780ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.209+0000 7fc780ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.209+0000 7fc780ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.211+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:59:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.211+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:59:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.211+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:59:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.211+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:59:14.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.213+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.0 2024-09-12T17:59:14.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.214+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.1 2024-09-12T17:59:14.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.214+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.2 2024-09-12T17:59:14.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.214+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.3 2024-09-12T17:59:14.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.215+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.4 2024-09-12T17:59:14.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.215+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.5 2024-09-12T17:59:14.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.215+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.6 2024-09-12T17:59:14.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.216+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.7 2024-09-12T17:59:14.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.216+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.8 2024-09-12T17:59:14.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.216+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.9 2024-09-12T17:59:14.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.217+0000 7fc89fd46800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36.10 2024-09-12T17:59:14.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.217+0000 7fc89fd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:14.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.217+0000 7fc89fd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc89fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc89fd46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc89fd46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc89fd46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36, ofs0, ns] 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc7817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529721 cookie 94455103800640 notifier 7746 bl.length()=891 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc7817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 info.flags=0x17 2024-09-12T17:59:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc7817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 to cache LRU end 2024-09-12T17:59:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.219+0000 7fc7817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.220+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_sources= new_sources= 2024-09-12T17:59:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.220+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential sources added=[] removed=[] 2024-09-12T17:59:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.220+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): orig_dests= new_dests= 2024-09-12T17:59:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.220+0000 7fc89fd46800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36]): potential dests added=[] removed=[] 2024-09-12T17:59:14.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.223+0000 7fc89fd46800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:14.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.225+0000 7fc74f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:14.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.227+0000 7fc89fd46800 20 remove_watcher() i=0 2024-09-12T17:59:14.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.227+0000 7fc89fd46800 2 removed watcher, disabling cache 2024-09-12T17:59:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.228+0000 7fc89fd46800 20 remove_watcher() i=1 2024-09-12T17:59:14.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.229+0000 7fc89fd46800 20 remove_watcher() i=2 2024-09-12T17:59:14.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.230+0000 7fc89fd46800 20 remove_watcher() i=3 2024-09-12T17:59:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.231+0000 7fc89fd46800 20 remove_watcher() i=4 2024-09-12T17:59:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.232+0000 7fc89fd46800 20 remove_watcher() i=5 2024-09-12T17:59:14.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.233+0000 7fc89fd46800 20 remove_watcher() i=6 2024-09-12T17:59:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.234+0000 7fc89fd46800 20 remove_watcher() i=7 2024-09-12T17:59:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:59:14.277 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:14.277 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:14.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.312+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 realm 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.314+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.315+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:14.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.315+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.315+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:14.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.315+0000 7fcf08f28800 20 searching for the correct realm 2024-09-12T17:59:14.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.319+0000 7fcefc46e640 0 -- 172.21.15.94:0/1016150753 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x562fa07cbe20 msgr2=0x562fa07ce270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:14.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.322+0000 7fcf04c6f640 0 -- 172.21.15.94:0/1016150753 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fceec060b30 msgr2=0x7fceec0093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:14.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.326+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 zone default found 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 4 Realm: () 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:14.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 zonegroup default 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 started sync module instance, tier type = 2024-09-12T17:59:14.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.327+0000 7fcf08f28800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:14.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=0 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=1 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=2 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=3 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=4 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=5 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=6 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 20 add_watcher() i=7 2024-09-12T17:59:14.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.336+0000 7fcf08f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:14.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.338+0000 7fcdbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:14.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.338+0000 7fcf08f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:14.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.338+0000 7fcf08f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:14.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 5 note: GC not initialized 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcdba7e4640 20 reqs_thread_entry: start 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 20 Filter name: none 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcdb3fff640 20 reqs_thread_entry: start 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:14.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.339+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.340+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.340+0000 7fcf08f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.340+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.341+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.341+0000 7fcf08f28800 20 rados->read ofs=0 len=0 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.341+0000 7fcf08f28800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:14.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.341+0000 7fcf08f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:14.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.342+0000 7fcdbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:14.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.344+0000 7fcf08f28800 20 remove_watcher() i=0 2024-09-12T17:59:14.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.344+0000 7fcf08f28800 2 removed watcher, disabling cache 2024-09-12T17:59:14.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.345+0000 7fcf08f28800 20 remove_watcher() i=1 2024-09-12T17:59:14.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.346+0000 7fcf08f28800 20 remove_watcher() i=2 2024-09-12T17:59:14.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.347+0000 7fcf08f28800 20 remove_watcher() i=3 2024-09-12T17:59:14.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.348+0000 7fcf08f28800 20 remove_watcher() i=4 2024-09-12T17:59:14.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.349+0000 7fcf08f28800 20 remove_watcher() i=5 2024-09-12T17:59:14.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.350+0000 7fcf08f28800 20 remove_watcher() i=6 2024-09-12T17:59:14.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:14.351+0000 7fcf08f28800 20 remove_watcher() i=7 2024-09-12T17:59:14.362 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:14.362 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:14.362 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:14.363 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:14.723 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:59:14.723 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:15.534 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:59:15.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:15.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:15.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.799+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 realm 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.801+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.802+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.802+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.802+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.802+0000 7f4ac9375800 20 searching for the correct realm 2024-09-12T17:59:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:15.805+0000 7f4abe65e640 0 -- 172.21.15.94:0/1099816072 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f4ab8027040 msgr2=0x7f4ab8083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.010+0000 7f4ac6e5f640 0 -- 172.21.15.94:0/1099816072 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f4ab0054370 msgr2=0x7f4ab00547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.216+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 zone default found 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 4 Realm: () 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 zonegroup default 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.217+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 started sync module instance, tier type = 2024-09-12T17:59:16.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.218+0000 7f4ac9375800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:16.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=0 2024-09-12T17:59:16.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=1 2024-09-12T17:59:16.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=2 2024-09-12T17:59:16.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=3 2024-09-12T17:59:16.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=4 2024-09-12T17:59:16.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=5 2024-09-12T17:59:16.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.227+0000 7f4ac9375800 20 add_watcher() i=6 2024-09-12T17:59:16.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.228+0000 7f4ac9375800 20 add_watcher() i=7 2024-09-12T17:59:16.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.228+0000 7f4ac9375800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:16.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f497d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f4ac9375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f4ac9375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f4ac9375800 5 note: GC not initialized 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f48f7fff640 20 reqs_thread_entry: start 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.230+0000 7f4ac9375800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.231+0000 7f4ac9375800 20 Filter name: none 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.231+0000 7f48f5ffb640 20 reqs_thread_entry: start 2024-09-12T17:59:16.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.231+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.231+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:16.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.231+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.232+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:16.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.232+0000 7f4ac9375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:16.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.232+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.232+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:16.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.232+0000 7f4ac9375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.233+0000 7f4ac9375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:16.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.233+0000 7f4ac9375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:16.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.234+0000 7f497d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.236+0000 7f4ac9375800 20 remove_watcher() i=0 2024-09-12T17:59:16.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.236+0000 7f4ac9375800 2 removed watcher, disabling cache 2024-09-12T17:59:16.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.237+0000 7f4ac9375800 20 remove_watcher() i=1 2024-09-12T17:59:16.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.238+0000 7f4ac9375800 20 remove_watcher() i=2 2024-09-12T17:59:16.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.239+0000 7f4ac9375800 20 remove_watcher() i=3 2024-09-12T17:59:16.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.240+0000 7f4ac9375800 20 remove_watcher() i=4 2024-09-12T17:59:16.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.241+0000 7f4ac9375800 20 remove_watcher() i=5 2024-09-12T17:59:16.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.242+0000 7f4ac9375800 20 remove_watcher() i=6 2024-09-12T17:59:16.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.243+0000 7f4ac9375800 20 remove_watcher() i=7 2024-09-12T17:59:16.254 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:16.254 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:16.254 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:16.254 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:16.256 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:59:16.290 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:16.290 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.326+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 realm 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.328+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.329+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:16.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.329+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.329+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:16.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.329+0000 7f17be014800 20 searching for the correct realm 2024-09-12T17:59:16.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.332+0000 7f17b9ecc640 0 -- 172.21.15.94:0/3959021353 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f17a402b070 msgr2=0x7f17a4074040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.335+0000 7f17b96cb640 0 -- 172.21.15.94:0/3959021353 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f17a40748f0 msgr2=0x7f17a4074040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.540+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 zone default found 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 4 Realm: () 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 zonegroup default 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.541+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 started sync module instance, tier type = 2024-09-12T17:59:16.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.542+0000 7f17be014800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=0 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=1 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=2 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=3 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=4 2024-09-12T17:59:16.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=5 2024-09-12T17:59:16.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.551+0000 7f17be014800 20 add_watcher() i=6 2024-09-12T17:59:16.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.552+0000 7f17be014800 20 add_watcher() i=7 2024-09-12T17:59:16.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.552+0000 7f17be014800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:16.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.553+0000 7f166f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 5 note: GC not initialized 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f166e7e4640 20 reqs_thread_entry: start 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 20 Filter name: none 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f15dffff640 20 reqs_thread_entry: start 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.554+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 : miss 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:16.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:16.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:16.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:16.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.555+0000 7f17be014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 2024-09-12T17:59:16.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f17be014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:16.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f17be014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:16.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f17be014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:16.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f17be014800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37, ofs0, ns] 2024-09-12T17:59:16.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f168bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529734 cookie 94407669825744 notifier 7803 bl.length()=931 2024-09-12T17:59:16.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f168bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:16.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f168bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:16.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.561+0000 7f168bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:16.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.562+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_sources= new_sources= 2024-09-12T17:59:16.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.562+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential sources added=[] removed=[] 2024-09-12T17:59:16.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.562+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_dests= new_dests= 2024-09-12T17:59:16.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.562+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential dests added=[] removed=[] 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.0 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.0 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.1 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.1 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.2 2024-09-12T17:59:16.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.2 2024-09-12T17:59:16.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.3 2024-09-12T17:59:16.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.3 2024-09-12T17:59:16.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.4 2024-09-12T17:59:16.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.4 2024-09-12T17:59:16.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.5 2024-09-12T17:59:16.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.5 2024-09-12T17:59:16.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.6 2024-09-12T17:59:16.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.6 2024-09-12T17:59:16.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.7 2024-09-12T17:59:16.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.7 2024-09-12T17:59:16.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.8 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.8 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.9 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.9 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.10 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.10 2024-09-12T17:59:16.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.11 2024-09-12T17:59:16.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.11 2024-09-12T17:59:16.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.0 2024-09-12T17:59:16.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.567+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1 2024-09-12T17:59:16.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.568+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.2 2024-09-12T17:59:16.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.569+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.3 2024-09-12T17:59:16.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.569+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.4 2024-09-12T17:59:16.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.570+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.5 2024-09-12T17:59:16.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.570+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.6 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.571+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.7 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.571+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.8 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.572+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.9 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.572+0000 7f17be014800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.10 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.575+0000 7f17be014800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:59:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.575+0000 7f17be014800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:59:16.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.583+0000 7f17be014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:16.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.584+0000 7f17be014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 2024-09-12T17:59:16.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f17be014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f17be014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f17be014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f17be014800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37, ofs0, ns] 2024-09-12T17:59:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f168bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529735 cookie 94407669825744 notifier 7803 bl.length()=899 2024-09-12T17:59:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f168bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f168bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.585+0000 7f168bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:16.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.586+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_sources= new_sources= 2024-09-12T17:59:16.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.586+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential sources added=[] removed=[] 2024-09-12T17:59:16.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.586+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_dests= new_dests= 2024-09-12T17:59:16.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.586+0000 7f17be014800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential dests added=[] removed=[] 2024-09-12T17:59:16.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.586+0000 7f17be014800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:59:16.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.588+0000 7f166f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.590+0000 7f17be014800 20 remove_watcher() i=0 2024-09-12T17:59:16.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.590+0000 7f17be014800 2 removed watcher, disabling cache 2024-09-12T17:59:16.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.591+0000 7f17be014800 20 remove_watcher() i=1 2024-09-12T17:59:16.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.592+0000 7f17be014800 20 remove_watcher() i=2 2024-09-12T17:59:16.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.594+0000 7f17be014800 20 remove_watcher() i=3 2024-09-12T17:59:16.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.594+0000 7f17be014800 20 remove_watcher() i=4 2024-09-12T17:59:16.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.596+0000 7f17be014800 20 remove_watcher() i=5 2024-09-12T17:59:16.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.597+0000 7f17be014800 20 remove_watcher() i=6 2024-09-12T17:59:16.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.598+0000 7f17be014800 20 remove_watcher() i=7 2024-09-12T17:59:16.610 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:59:16.639 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:16.639 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:16.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.675+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.676+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 realm 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.677+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.678+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:16.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.678+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.678+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:16.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.678+0000 7f3676087800 20 searching for the correct realm 2024-09-12T17:59:16.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.680+0000 7f3673b71640 0 -- 172.21.15.94:0/636534521 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x561d27934290 msgr2=0x7f366c080dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.884+0000 7f3674372640 0 -- 172.21.15.94:0/636534521 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f365c03b040 msgr2=0x7f365c018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 zone default found 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 4 Realm: () 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 zonegroup default 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.890+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 started sync module instance, tier type = 2024-09-12T17:59:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.891+0000 7f3676087800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=0 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=1 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=2 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=3 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=4 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=5 2024-09-12T17:59:16.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=6 2024-09-12T17:59:16.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.900+0000 7f3676087800 20 add_watcher() i=7 2024-09-12T17:59:16.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.901+0000 7f3676087800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:16.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.902+0000 7f3529fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:16.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:16.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 5 note: GC not initialized 2024-09-12T17:59:16.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3528fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:16.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:16.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 20 Filter name: none 2024-09-12T17:59:16.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f34a27fc640 20 reqs_thread_entry: start 2024-09-12T17:59:16.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.903+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.904+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.904+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.904+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.904+0000 7f3676087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.904+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.905+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:16.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.905+0000 7f3676087800 20 rados->read ofs=0 len=0 2024-09-12T17:59:16.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.905+0000 7f3676087800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:16.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.905+0000 7f3676087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:16.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.907+0000 7f3529fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:16.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.909+0000 7f3676087800 20 remove_watcher() i=0 2024-09-12T17:59:16.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.909+0000 7f3676087800 2 removed watcher, disabling cache 2024-09-12T17:59:16.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.910+0000 7f3676087800 20 remove_watcher() i=1 2024-09-12T17:59:16.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.912+0000 7f3676087800 20 remove_watcher() i=2 2024-09-12T17:59:16.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.913+0000 7f3676087800 20 remove_watcher() i=3 2024-09-12T17:59:16.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.913+0000 7f3676087800 20 remove_watcher() i=4 2024-09-12T17:59:16.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.914+0000 7f3676087800 20 remove_watcher() i=5 2024-09-12T17:59:16.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.915+0000 7f3676087800 20 remove_watcher() i=6 2024-09-12T17:59:16.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:16.916+0000 7f3676087800 20 remove_watcher() i=7 2024-09-12T17:59:16.929 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:16.929 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:16.929 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:16.929 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:17.018 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:17.051 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:17.052 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:17.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.088+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 realm 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.089+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.090+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.090+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.090+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:17.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.090+0000 7f1481220800 20 searching for the correct realm 2024-09-12T17:59:17.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.092+0000 7f147ed11640 0 -- 172.21.15.94:0/2539967981 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x560abc590130 msgr2=0x7f1478054420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.298+0000 7f147f512640 0 -- 172.21.15.94:0/2539967981 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f1474028040 msgr2=0x7f1474068ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:17.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:17.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.303+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 zone default found 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 4 Realm: () 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 zonegroup default 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.304+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.305+0000 7f1481220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.305+0000 7f1481220800 20 started sync module instance, tier type = 2024-09-12T17:59:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.305+0000 7f1481220800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=0 2024-09-12T17:59:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=1 2024-09-12T17:59:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=2 2024-09-12T17:59:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=3 2024-09-12T17:59:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=4 2024-09-12T17:59:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=5 2024-09-12T17:59:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.314+0000 7f1481220800 20 add_watcher() i=6 2024-09-12T17:59:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.315+0000 7f1481220800 20 add_watcher() i=7 2024-09-12T17:59:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.315+0000 7f1481220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f13357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 5 note: GC not initialized 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f12affff640 20 reqs_thread_entry: start 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 20 Filter name: none 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f12adffb640 20 reqs_thread_entry: start 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.317+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 : miss 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.318+0000 7f1481220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 2024-09-12T17:59:17.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1481220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1481220800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1481220800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1481220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37, ofs0, ns] 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1361ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529736 cookie 94604111997024 notifier 7391 bl.length()=931 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1361ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1361ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.323+0000 7f1361ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.325+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_sources= new_sources= 2024-09-12T17:59:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.325+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential sources added=[] removed=[] 2024-09-12T17:59:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.325+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_dests= new_dests= 2024-09-12T17:59:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.325+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential dests added=[] removed=[] 2024-09-12T17:59:17.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.0 2024-09-12T17:59:17.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.0 2024-09-12T17:59:17.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.1 2024-09-12T17:59:17.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.1 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.2 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.2 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.3 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.3 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.4 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.4 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.5 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.5 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.6 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.6 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.7 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.7 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.8 2024-09-12T17:59:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.8 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.9 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.9 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.10 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.10 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.11 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1.11 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.329+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.0 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.330+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.330+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.2 2024-09-12T17:59:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.331+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.3 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.331+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.4 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.332+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.5 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.332+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.6 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.332+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.7 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.333+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.8 2024-09-12T17:59:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.334+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.9 2024-09-12T17:59:17.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.334+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.10 2024-09-12T17:59:17.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.338+0000 7f1481220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:17.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.338+0000 7f1481220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 2024-09-12T17:59:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f1481220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f1481220800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f1481220800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f1481220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37, ofs0, ns] 2024-09-12T17:59:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f13627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94604111997024 notifier 7391 bl.length()=931 2024-09-12T17:59:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f13627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f13627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.339+0000 7f13627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.341+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_sources= new_sources= 2024-09-12T17:59:17.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.341+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential sources added=[] removed=[] 2024-09-12T17:59:17.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.341+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_dests= new_dests= 2024-09-12T17:59:17.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.341+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential dests added=[] removed=[] 2024-09-12T17:59:17.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.344+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.0 2024-09-12T17:59:17.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.344+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.1 2024-09-12T17:59:17.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.344+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.2 2024-09-12T17:59:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.345+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.3 2024-09-12T17:59:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.345+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.4 2024-09-12T17:59:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.345+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.5 2024-09-12T17:59:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.345+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.6 2024-09-12T17:59:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.346+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.7 2024-09-12T17:59:17.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.346+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.8 2024-09-12T17:59:17.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.346+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.9 2024-09-12T17:59:17.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.347+0000 7f1481220800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37.10 2024-09-12T17:59:17.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.347+0000 7f1481220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.347+0000 7f1481220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 2024-09-12T17:59:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f1481220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f1481220800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f1481220800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f1481220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37, ofs0, ns] 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f13627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94604111997024 notifier 7391 bl.length()=899 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f13627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 info.flags=0x17 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f13627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 to cache LRU end 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.348+0000 7f13627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.350+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_sources= new_sources= 2024-09-12T17:59:17.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.350+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential sources added=[] removed=[] 2024-09-12T17:59:17.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.350+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): orig_dests= new_dests= 2024-09-12T17:59:17.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.350+0000 7f1481220800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37]): potential dests added=[] removed=[] 2024-09-12T17:59:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.353+0000 7f1481220800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:17.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.355+0000 7f13357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.357+0000 7f1481220800 20 remove_watcher() i=0 2024-09-12T17:59:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.357+0000 7f1481220800 2 removed watcher, disabling cache 2024-09-12T17:59:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.357+0000 7f1481220800 20 remove_watcher() i=1 2024-09-12T17:59:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.358+0000 7f1481220800 20 remove_watcher() i=2 2024-09-12T17:59:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.359+0000 7f1481220800 20 remove_watcher() i=3 2024-09-12T17:59:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.360+0000 7f1481220800 20 remove_watcher() i=4 2024-09-12T17:59:17.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.361+0000 7f1481220800 20 remove_watcher() i=5 2024-09-12T17:59:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.362+0000 7f1481220800 20 remove_watcher() i=6 2024-09-12T17:59:17.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.363+0000 7f1481220800 20 remove_watcher() i=7 2024-09-12T17:59:17.375 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:59:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.440+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 realm 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.442+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.443+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.443+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.443+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.443+0000 7ff047e30800 20 searching for the correct realm 2024-09-12T17:59:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.447+0000 7ff03a9cb640 0 -- 172.21.15.94:0/2752453874 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7ff0340afc70 msgr2=0x7ff0340cd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:17.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.450+0000 7ff0439cd640 0 -- 172.21.15.94:0/2752453874 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7ff02c06ac20 msgr2=0x7ff02c065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.453+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 zone default found 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 4 Realm: () 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 zonegroup default 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.454+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:17.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 started sync module instance, tier type = 2024-09-12T17:59:17.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.455+0000 7ff047e30800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=0 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=1 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=2 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=3 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=4 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=5 2024-09-12T17:59:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.464+0000 7ff047e30800 20 add_watcher() i=6 2024-09-12T17:59:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.465+0000 7ff047e30800 20 add_watcher() i=7 2024-09-12T17:59:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.465+0000 7ff047e30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:17.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.466+0000 7feef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.466+0000 7ff047e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.466+0000 7ff047e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.466+0000 7ff047e30800 5 note: GC not initialized 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.467+0000 7feef8fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.467+0000 7ff047e30800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.467+0000 7ff047e30800 20 Filter name: none 2024-09-12T17:59:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.467+0000 7fee727fc640 20 reqs_thread_entry: start 2024-09-12T17:59:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.467+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.468+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.468+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.468+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.468+0000 7ff047e30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.468+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.469+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.469+0000 7ff047e30800 20 rados->read ofs=0 len=0 2024-09-12T17:59:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.469+0000 7ff047e30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:17.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.469+0000 7ff047e30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:17.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.470+0000 7feef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:17.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.472+0000 7ff047e30800 20 remove_watcher() i=0 2024-09-12T17:59:17.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.472+0000 7ff047e30800 2 removed watcher, disabling cache 2024-09-12T17:59:17.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.473+0000 7ff047e30800 20 remove_watcher() i=1 2024-09-12T17:59:17.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.474+0000 7ff047e30800 20 remove_watcher() i=2 2024-09-12T17:59:17.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.475+0000 7ff047e30800 20 remove_watcher() i=3 2024-09-12T17:59:17.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.476+0000 7ff047e30800 20 remove_watcher() i=4 2024-09-12T17:59:17.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.477+0000 7ff047e30800 20 remove_watcher() i=5 2024-09-12T17:59:17.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.478+0000 7ff047e30800 20 remove_watcher() i=6 2024-09-12T17:59:17.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:17.479+0000 7ff047e30800 20 remove_watcher() i=7 2024-09-12T17:59:17.491 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:17.491 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:17.491 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:17.491 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:17.852 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:59:17.852 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:18.659 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:59:18.686 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:18.686 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:18.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.721+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 realm 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:18.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.723+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.724+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.724+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.724+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:18.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.724+0000 7f94d8375800 20 searching for the correct realm 2024-09-12T17:59:18.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.727+0000 7f94cd665640 0 -- 172.21.15.94:0/2776644567 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55c29cb88f90 msgr2=0x55c29cb8b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:18.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.731+0000 7f94d5e66640 0 -- 172.21.15.94:0/2776644567 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f94c00638e0 msgr2=0x7f94c006d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.734+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:18.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 zone default found 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 4 Realm: () 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 zonegroup default 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.735+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.736+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.736+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.736+0000 7f94d8375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.736+0000 7f94d8375800 20 started sync module instance, tier type = 2024-09-12T17:59:18.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.736+0000 7f94d8375800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=0 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=1 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=2 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=3 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=4 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=5 2024-09-12T17:59:18.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.744+0000 7f94d8375800 20 add_watcher() i=6 2024-09-12T17:59:18.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.745+0000 7f94d8375800 20 add_watcher() i=7 2024-09-12T17:59:18.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.745+0000 7f94d8375800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:18.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f93877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f94d8375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f94d8375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f94d8375800 5 note: GC not initialized 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f93867fc640 20 reqs_thread_entry: start 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f94d8375800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.747+0000 7f94d8375800 20 Filter name: none 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.748+0000 7f92f7fff640 20 reqs_thread_entry: start 2024-09-12T17:59:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.748+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.748+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.748+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.749+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.749+0000 7f94d8375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.749+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.749+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.749+0000 7f94d8375800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.750+0000 7f94d8375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.750+0000 7f94d8375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:18.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.751+0000 7f93877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.753+0000 7f94d8375800 20 remove_watcher() i=0 2024-09-12T17:59:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.753+0000 7f94d8375800 2 removed watcher, disabling cache 2024-09-12T17:59:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.754+0000 7f94d8375800 20 remove_watcher() i=1 2024-09-12T17:59:18.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.755+0000 7f94d8375800 20 remove_watcher() i=2 2024-09-12T17:59:18.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.756+0000 7f94d8375800 20 remove_watcher() i=3 2024-09-12T17:59:18.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.757+0000 7f94d8375800 20 remove_watcher() i=4 2024-09-12T17:59:18.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.758+0000 7f94d8375800 20 remove_watcher() i=5 2024-09-12T17:59:18.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.759+0000 7f94d8375800 20 remove_watcher() i=6 2024-09-12T17:59:18.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.760+0000 7f94d8375800 20 remove_watcher() i=7 2024-09-12T17:59:18.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:18.771 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:18.771 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:18.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:18.773 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:59:18.809 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:18.809 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.845+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 realm 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.847+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.848+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.848+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.848+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:18.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:18.848+0000 7ffa0080f800 20 searching for the correct realm 2024-09-12T17:59:19.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.053+0000 7ff9feafa640 0 -- 172.21.15.94:0/1723145628 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7ff9e806a9d0 msgr2=0x7ff9e80608a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:19.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.057+0000 7ff9fe2f9640 0 -- 172.21.15.94:0/1723145628 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7ff9e807d0f0 msgr2=0x7ff9e80870c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 zone default found 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 4 Realm: () 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 zonegroup default 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.062+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 started sync module instance, tier type = 2024-09-12T17:59:19.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.063+0000 7ffa0080f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=0 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=1 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=2 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=3 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=4 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=5 2024-09-12T17:59:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.072+0000 7ffa0080f800 20 add_watcher() i=6 2024-09-12T17:59:19.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.073+0000 7ffa0080f800 20 add_watcher() i=7 2024-09-12T17:59:19.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.073+0000 7ffa0080f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:19.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.074+0000 7ff8b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.074+0000 7ffa0080f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.074+0000 7ffa0080f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.074+0000 7ffa0080f800 5 note: GC not initialized 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ff82f7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:19.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 20 Filter name: none 2024-09-12T17:59:19.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ff82d7fa640 20 reqs_thread_entry: start 2024-09-12T17:59:19.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:59:19.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 : miss 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.075+0000 7ffa0080f800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.076+0000 7ffa0080f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 2024-09-12T17:59:19.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ffa0080f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ffa0080f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ffa0080f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ffa0080f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38, ofs0, ns] 2024-09-12T17:59:19.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ff8e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529741 cookie 94686498965888 notifier 7445 bl.length()=931 2024-09-12T17:59:19.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ff8e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ff8e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.082+0000 7ff8e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.084+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_sources= new_sources= 2024-09-12T17:59:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.084+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential sources added=[] removed=[] 2024-09-12T17:59:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.084+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_dests= new_dests= 2024-09-12T17:59:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.084+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential dests added=[] removed=[] 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.0 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.0 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.1 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.1 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.2 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.2 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.3 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.3 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.4 2024-09-12T17:59:19.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.4 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.5 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.5 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.6 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.6 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.7 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.7 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.8 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.8 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.9 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.9 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.10 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.10 2024-09-12T17:59:19.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.11 2024-09-12T17:59:19.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1.11 2024-09-12T17:59:19.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.0 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.089+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.090+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.2 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.090+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.3 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.091+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.4 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.091+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.5 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.092+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.6 2024-09-12T17:59:19.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.092+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.7 2024-09-12T17:59:19.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.093+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.8 2024-09-12T17:59:19.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.094+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.9 2024-09-12T17:59:19.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.094+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.10 2024-09-12T17:59:19.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.097+0000 7ffa0080f800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:59:19.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.097+0000 7ffa0080f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:19.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.098+0000 7ffa0080f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ffa0080f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ffa0080f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ffa0080f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ffa0080f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38, ofs0, ns] 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ff8e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94686498965888 notifier 7445 bl.length()=931 2024-09-12T17:59:19.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ff8e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ff8e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.099+0000 7ff8e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.101+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_sources= new_sources= 2024-09-12T17:59:19.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.101+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential sources added=[] removed=[] 2024-09-12T17:59:19.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.101+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_dests= new_dests= 2024-09-12T17:59:19.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.101+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential dests added=[] removed=[] 2024-09-12T17:59:19.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.103+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.0 2024-09-12T17:59:19.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.103+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.1 2024-09-12T17:59:19.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.103+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.2 2024-09-12T17:59:19.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.104+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.3 2024-09-12T17:59:19.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.104+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.4 2024-09-12T17:59:19.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.104+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.5 2024-09-12T17:59:19.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.105+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.6 2024-09-12T17:59:19.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.105+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.7 2024-09-12T17:59:19.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.105+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.8 2024-09-12T17:59:19.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.105+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.9 2024-09-12T17:59:19.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.106+0000 7ffa0080f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38.10 2024-09-12T17:59:19.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.106+0000 7ffa0080f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:19.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.106+0000 7ffa0080f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 2024-09-12T17:59:19.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.107+0000 7ffa0080f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.107+0000 7ffa0080f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.107+0000 7ffa0080f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.107+0000 7ffa0080f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38, ofs0, ns] 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.108+0000 7ff8e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529743 cookie 94686498965888 notifier 7445 bl.length()=899 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.108+0000 7ff8e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 info.flags=0x17 2024-09-12T17:59:19.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.108+0000 7ff8e17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 to cache LRU end 2024-09-12T17:59:19.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.108+0000 7ff8e17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:19.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.109+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_sources= new_sources= 2024-09-12T17:59:19.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.109+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential sources added=[] removed=[] 2024-09-12T17:59:19.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.109+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): orig_dests= new_dests= 2024-09-12T17:59:19.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.109+0000 7ffa0080f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38]): potential dests added=[] removed=[] 2024-09-12T17:59:19.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.112+0000 7ffa0080f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:19.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.113+0000 7ff8b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:19.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.115+0000 7ffa0080f800 20 remove_watcher() i=0 2024-09-12T17:59:19.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.115+0000 7ffa0080f800 2 removed watcher, disabling cache 2024-09-12T17:59:19.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.117+0000 7ffa0080f800 20 remove_watcher() i=1 2024-09-12T17:59:19.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.118+0000 7ffa0080f800 20 remove_watcher() i=2 2024-09-12T17:59:19.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.118+0000 7ffa0080f800 20 remove_watcher() i=3 2024-09-12T17:59:19.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.119+0000 7ffa0080f800 20 remove_watcher() i=4 2024-09-12T17:59:19.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.120+0000 7ffa0080f800 20 remove_watcher() i=5 2024-09-12T17:59:19.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.121+0000 7ffa0080f800 20 remove_watcher() i=6 2024-09-12T17:59:19.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.122+0000 7ffa0080f800 20 remove_watcher() i=7 2024-09-12T17:59:19.135 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:59:19.164 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:19.164 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:19.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.200+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.201+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.201+0000 7eff31142800 20 realm 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.201+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:19.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.202+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.203+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:19.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.203+0000 7eff31142800 20 searching for the correct realm 2024-09-12T17:59:19.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.206+0000 7eff2d6ee640 0 -- 172.21.15.94:0/2258478209 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7eff20036060 msgr2=0x7eff20066f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:19.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.209+0000 7eff2ceed640 0 -- 172.21.15.94:0/2258478209 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7eff20066600 msgr2=0x7eff2007d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:19.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:19.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:19.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:19.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:19.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.415+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:19.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 zone default found 2024-09-12T17:59:19.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 4 Realm: () 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 zonegroup default 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 started sync module instance, tier type = 2024-09-12T17:59:19.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.416+0000 7eff31142800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=0 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=1 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=2 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=3 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=4 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=5 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.425+0000 7eff31142800 20 add_watcher() i=6 2024-09-12T17:59:19.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.426+0000 7eff31142800 20 add_watcher() i=7 2024-09-12T17:59:19.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.426+0000 7eff31142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:19.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.427+0000 7efde37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 5 note: GC not initialized 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7efde27e4640 20 reqs_thread_entry: start 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 20 Filter name: none 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7efddbfff640 20 reqs_thread_entry: start 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.428+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.429+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.429+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.429+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.429+0000 7eff31142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:19.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.429+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.430+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:19.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.430+0000 7eff31142800 20 rados->read ofs=0 len=0 2024-09-12T17:59:19.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.430+0000 7eff31142800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:19.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.430+0000 7eff31142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:19.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.431+0000 7efde37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:19.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.433+0000 7eff31142800 20 remove_watcher() i=0 2024-09-12T17:59:19.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.433+0000 7eff31142800 2 removed watcher, disabling cache 2024-09-12T17:59:19.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.434+0000 7eff31142800 20 remove_watcher() i=1 2024-09-12T17:59:19.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.435+0000 7eff31142800 20 remove_watcher() i=2 2024-09-12T17:59:19.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.436+0000 7eff31142800 20 remove_watcher() i=3 2024-09-12T17:59:19.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.438+0000 7eff31142800 20 remove_watcher() i=4 2024-09-12T17:59:19.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.438+0000 7eff31142800 20 remove_watcher() i=5 2024-09-12T17:59:19.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.439+0000 7eff31142800 20 remove_watcher() i=6 2024-09-12T17:59:19.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:19.440+0000 7eff31142800 20 remove_watcher() i=7 2024-09-12T17:59:19.451 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:19.452 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:19.452 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:59:19.452 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:19.827 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:59:19.827 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:20.641 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:59:20.669 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:20.669 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:20.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.705+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.706+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.706+0000 7fe6fc820800 20 realm 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.706+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.707+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.707+0000 7fe6fc820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.707+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.707+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.707+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.708+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:20.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.708+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.708+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:20.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.708+0000 7fe6fc820800 20 searching for the correct realm 2024-09-12T17:59:20.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.710+0000 7fe6fa30a640 0 -- 172.21.15.94:0/1665738472 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fe6f4079060 msgr2=0x7fe6f40d8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:20.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.915+0000 7fe6fab0b640 0 -- 172.21.15.94:0/1665738472 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe6e4037040 msgr2=0x7fe6e4038430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:20.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:20.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.920+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 zone default found 2024-09-12T17:59:20.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 4 Realm: () 2024-09-12T17:59:20.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:20.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:20.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:20.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 zonegroup default 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:20.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 started sync module instance, tier type = 2024-09-12T17:59:20.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.921+0000 7fe6fc820800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:20.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=0 2024-09-12T17:59:20.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=1 2024-09-12T17:59:20.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=2 2024-09-12T17:59:20.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=3 2024-09-12T17:59:20.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=4 2024-09-12T17:59:20.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=5 2024-09-12T17:59:20.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.930+0000 7fe6fc820800 20 add_watcher() i=6 2024-09-12T17:59:20.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.931+0000 7fe6fc820800 20 add_watcher() i=7 2024-09-12T17:59:20.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.931+0000 7fe6fc820800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:20.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.932+0000 7fe5b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:20.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:20.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:20.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 5 note: GC not initialized 2024-09-12T17:59:20.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe52b7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:20.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:20.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 Filter name: none 2024-09-12T17:59:20.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe5297fa640 20 reqs_thread_entry: start 2024-09-12T17:59:20.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:20.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.933+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.934+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:20.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.934+0000 7fe6fc820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:20.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.934+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.935+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:20.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.935+0000 7fe6fc820800 20 rados->read ofs=0 len=0 2024-09-12T17:59:20.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.935+0000 7fe6fc820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:20.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.935+0000 7fe6fc820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:20.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.937+0000 7fe5b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:20.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.939+0000 7fe6fc820800 20 remove_watcher() i=0 2024-09-12T17:59:20.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.939+0000 7fe6fc820800 2 removed watcher, disabling cache 2024-09-12T17:59:20.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.940+0000 7fe6fc820800 20 remove_watcher() i=1 2024-09-12T17:59:20.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.941+0000 7fe6fc820800 20 remove_watcher() i=2 2024-09-12T17:59:20.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.942+0000 7fe6fc820800 20 remove_watcher() i=3 2024-09-12T17:59:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.943+0000 7fe6fc820800 20 remove_watcher() i=4 2024-09-12T17:59:20.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.943+0000 7fe6fc820800 20 remove_watcher() i=5 2024-09-12T17:59:20.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.944+0000 7fe6fc820800 20 remove_watcher() i=6 2024-09-12T17:59:20.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:20.945+0000 7fe6fc820800 20 remove_watcher() i=7 2024-09-12T17:59:20.956 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:20.956 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:59:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:21.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.027+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 realm 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.030+0000 7f3f80d39800 20 searching for the correct realm 2024-09-12T17:59:21.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.033+0000 7f3f77fff640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55b144bd9be0 msgr2=0x55b144bdc0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:21.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.036+0000 7f3f7c9c7640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3f6801f3a0 msgr2=0x7f3f68067810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:21.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:21.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:21.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:21.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:21.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:21.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:21.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zone default found 2024-09-12T17:59:21.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Realm: () 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zonegroup default 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.244+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started sync module instance, tier type = 2024-09-12T17:59:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=0 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=1 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=2 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=3 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=4 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=5 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=6 2024-09-12T17:59:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=7 2024-09-12T17:59:21.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.253+0000 7f3f80d39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:21.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3e337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3f80d39800 5 note: GC not initialized 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3e327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.255+0000 7f3f80d39800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 20 Filter name: none 2024-09-12T17:59:21.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3e2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : miss 2024-09-12T17:59:21.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.256+0000 7f3f80d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:21.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.261+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.261+0000 7f3f80d39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.261+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.261+0000 7f3f80d39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94219850872112 notifier 7944 bl.length()=931 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:21.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:21.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:21.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.0 2024-09-12T17:59:21.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1 2024-09-12T17:59:21.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2 2024-09-12T17:59:21.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.3 2024-09-12T17:59:21.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.4 2024-09-12T17:59:21.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.5 2024-09-12T17:59:21.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.6 2024-09-12T17:59:21.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.7 2024-09-12T17:59:21.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.8 2024-09-12T17:59:21.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.9 2024-09-12T17:59:21.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.273+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.10 2024-09-12T17:59:21.278 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f80d39800 time 2024-09-12T17:59:21.278615+0000 2024-09-12T17:59:21.278 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:21.279 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.279 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f8238c71a] 2024-09-12T17:59:21.279 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.279 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3f80d39800 thread_name:radosgw-admin 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.278+0000 7f3f80d39800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f80d39800 time 2024-09-12T17:59:21.278615+0000 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.280 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f8238c71a] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:21.281 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f8103e6f0] 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f8108b99c] 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f8238c774] 2024-09-12T17:59:21.302 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.279+0000 7f3f80d39800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3f80d39800 thread_name:radosgw-admin 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.303 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f8103e6f0] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f8108b99c] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f8238c774] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:21.304 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:59:21.012+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:59:21.012+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:59:21.012+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key hook 0x55b144ae6638 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.305 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b14499ad60 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b14499b1a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144b106f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.526334s 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b14499b1a0 auth_method 0 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.306 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144b106f0 auth_method 0 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b14499ad60 auth_method 0 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.307 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_done global_id 7487 payload 824 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:59:21.012+0000 7f3f77fff640 1 monclient: found mon.noname-c 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: dump: 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: dump: 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.309 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:59:21.012+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7487 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:59:21.012+0000 7f3e6ae05640 4 set_mon_vals no callback set 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:59:21.013+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.310 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:59:21.013+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:59:21.013+0000 7f3f80d39800 1 librados: init done 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:59:21.015+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3e64076470 auth_method 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:59:21.015+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x55b144b0ec80 auth_method 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:59:21.016+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x55b144b31b50 auth_method 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:59:21.017+0000 7f3f77fff640 10 monclient: get_auth_request con 0x55b144b353b0 auth_method 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:59:21.017+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:59:21.017+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:59:21.017+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.311 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.312 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.313 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command objecter_requests cmddesc objecter_requests hook 0x55b144b3e700 EEXIST 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.314 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x55b144b39ec0 EEXIST 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144b623f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144b646c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144b60bc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.532930s 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144b60bc0 auth_method 0 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.316 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144b623f0 auth_method 0 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144b646c0 auth_method 0 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.317 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_done global_id 7938 payload 824 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: dump: 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.318 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.319 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: dump: 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:59:21.019+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7938 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:59:21.019+0000 7f3f7d9c9640 4 set_mon_vals no callback set 2024-09-12T17:59:21.320 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:59:21.021+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3e54076380 auth_method 0 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: get_monmap_and_config 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:59:21.022+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.321 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.322 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.324 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x7ffdeec554e8 EEXIST 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144bb6580 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144bb6960 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144bbc0b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.537028s 2024-09-12T17:59:21.325 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144bb6580 auth_method 0 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144bbc0b0 auth_method 0 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144bb6960 auth_method 0 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.326 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_done global_id 7941 payload 274 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: dump: 2024-09-12T17:59:21.327 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.328 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: dump: 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:59:21.023+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7941 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient: get_monmap_and_config success 2024-09-12T17:59:21.329 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:59:21.023+0000 7f3f80d39800 4 set_mon_vals no callback set 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: shutdown 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.330 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:59:21.024+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: starting msgr at 2024-09-12T17:59:21.332 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: starting objecter 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command objecter_requests cmddesc objecter_requests hook 0x55b144bb6e70 EEXIST 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: setting wanted keys 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: calling monclient init 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.333 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:59:21.024+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:59:21.025+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x55b144b7a2e8 EEXIST 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144bb6580 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144bbc0b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.334 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144bb4670 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.539226s 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144bb6580 auth_method 0 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144bbc0b0 auth_method 0 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.335 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144bb4670 auth_method 0 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.336 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_done global_id 7944 payload 824 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: dump: 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.337 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: dump: 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7944 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:59:21.025+0000 7f3e53fff640 4 set_mon_vals no callback set 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.339 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:59:21.025+0000 7f3f80d39800 1 librados: init done 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cr dump hook 0x55b144bb0a98 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:59:21.027+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:59:21.028+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3e480764a0 auth_method 0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:59:21.028+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x55b144bd0800 auth_method 0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 realm 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.340 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:59:21.029+0000 7f3f80d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:59:21.029+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x55b144bd4910 auth_method 0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 searching for the correct realm 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:59:21.030+0000 7f3f77fff640 10 monclient: get_auth_request con 0x55b144bd9be0 auth_method 0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:59:21.031+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x7f3f6800b040 auth_method 0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:59:21.032+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f78064fb0 auth_method 0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:59:21.032+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3f7009c060 auth_method 0 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:59:21.033+0000 7f3f77fff640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55b144bd9be0 msgr2=0x55b144bdc0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:21.341 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:59:21.033+0000 7f3e527fc640 1 client.7944.objecter ms_handle_reset 0x55b144bd9be0 session 0x55b144bd9560 osd.3 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:59:21.033+0000 7f3e527fc640 10 monclient: _renew_subs 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:59:21.033+0000 7f3e527fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:59:21.033+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3e48086bc0 auth_method 0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:59:21.034+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x7f3f6801fc30 auth_method 0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:59:21.036+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f6801f3a0 auth_method 0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:59:21.036+0000 7f3f7c9c7640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3f6801f3a0 msgr2=0x7f3f68067810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:59:21.238+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f6801f3a0 auth_method 0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:21.342 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zone default found 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Realm: () 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:59:21.243+0000 7f3f80d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zonegroup default 2024-09-12T17:59:21.343 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started sync module instance, tier type = 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=0 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=1 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=2 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=3 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=4 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=5 2024-09-12T17:59:21.344 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=6 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=7 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:59:21.253+0000 7f3f80d39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.345 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:59:21.255+0000 7f3e337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:59:21.255+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache list hook 0x55b144bb4a90 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache inspect hook 0x55b144bb4a90 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache erase hook 0x55b144bb4a90 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache zap hook 0x55b144bb4a90 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 note: GC not initialized 2024-09-12T17:59:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:59:21.255+0000 7f3e327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace show hook 0x7f3f700567a0 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace history hook 0x7f3f700567a0 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace active hook 0x7f3f700567a0 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace active_short hook 0x7f3f700567a0 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 Filter name: none 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:59:21.256+0000 7f3e2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : miss 2024-09-12T17:59:21.347 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94219850872112 notifier 7944 bl.length()=931 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.348 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.349 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.350 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.0 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.3 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.4 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.5 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.6 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.7 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.8 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.9 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:59:21.273+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.10 2024-09-12T17:59:21.351 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:59:21.278+0000 7f3f80d39800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f80d39800 time 2024-09-12T17:59:21.278615+0000 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f8238c71a] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:21.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:59:21.279+0000 7f3f80d39800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3f80d39800 thread_name:radosgw-admin 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f8103e6f0] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f8108b99c] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f8238c774] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.353 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:21.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:59:21.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:21.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:59:21.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:59:21.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:59:21.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e2b7fe640 / http_manager 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e327e4640 / http_manager 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e337e6640 / rgw_dt_lg_renew 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e527fc640 / ms_dispatch 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e537fe640 / io_context_pool 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e53fff640 / io_context_pool 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e627fc640 / ms_dispatch 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e69602640 / ms_dispatch 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e6ae05640 / io_context_pool 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f77fff640 / msgr-worker-2 2024-09-12T17:59:21.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7c9c7640 / msgr-worker-1 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7d1c8640 / msgr-worker-0 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7d9c9640 / io_context_pool 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f80d39800 / radosgw-admin 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.141839.log 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: crc 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:59:21.011+0000 7f3f80d39800 5 AuthRegistry(0x55b144ae64f0) adding con mode: secure 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:59:21.012+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:59:21.012+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:59:21.012+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key hook 0x55b144ae6638 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b14499ad60 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b14499b1a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144b106f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.363 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.526334s 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b14499b1a0 auth_method 0 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144b106f0 auth_method 0 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.364 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:59:21.012+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b14499ad60 auth_method 0 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:59:21.012+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient(hunting): handle_auth_done global_id 7487 payload 824 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:59:21.012+0000 7f3f77fff640 1 monclient: found mon.noname-c 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:59:21.012+0000 7f3f77fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: dump: 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.365 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:21.366 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:59:21.012+0000 7f3e69602640 10 monclient: dump: 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:59:21.012+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7487 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:59:21.012+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.367 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:59:21.012+0000 7f3e6ae05640 4 set_mon_vals no callback set 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:59:21.013+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:59:21.013+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:59:21.013+0000 7f3f80d39800 1 librados: init done 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:59:21.014+0000 7f3e69602640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:59:21.015+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3e64076470 auth_method 0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:59:21.015+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x55b144b0ec80 auth_method 0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:59:21.016+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x55b144b31b50 auth_method 0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:59:21.017+0000 7f3f77fff640 10 monclient: get_auth_request con 0x55b144b353b0 auth_method 0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:59:21.017+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:59:21.017+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.368 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:59:21.017+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding auth protocol: cephx 2024-09-12T17:59:21.369 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: crc 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:59:21.017+0000 7f3f80d39800 5 AuthRegistry(0x55b144b3adc0) adding con mode: secure 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command objecter_requests cmddesc objecter_requests hook 0x55b144b3e700 EEXIST 2024-09-12T17:59:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding auth protocol: cephx 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.371 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: crc 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 AuthRegistry(0x55b144b39d78) adding con mode: secure 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:59:21.018+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:59:21.018+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x55b144b39ec0 EEXIST 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144b623f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144b646c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144b60bc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:59:21.018+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.532930s 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144b60bc0 auth_method 0 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144b623f0 auth_method 0 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.373 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:59:21.019+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144b646c0 auth_method 0 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:59:21.019+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_done global_id 7938 payload 824 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:59:21.019+0000 7f3f7d1c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: dump: 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.375 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:59:21.019+0000 7f3e627fc640 10 monclient: dump: 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.376 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:59:21.019+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7938 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:59:21.019+0000 7f3f7d9c9640 4 set_mon_vals no callback set 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:59:21.019+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:59:21.021+0000 7f3e627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:59:21.021+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3e54076380 auth_method 0 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: get_monmap_and_config 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:59:21.022+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.377 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding auth protocol: cephx 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.378 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: crc 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x55b144b82300) adding con mode: secure 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.379 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding auth protocol: cephx 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: crc 2024-09-12T17:59:21.380 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec553a0) adding con mode: secure 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:59:21.022+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:59:21.022+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x7ffdeec554e8 EEXIST 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:59:21.022+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144bb6580 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144bb6960 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144bbc0b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.537028s 2024-09-12T17:59:21.381 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144bb6580 auth_method 0 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144bbc0b0 auth_method 0 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144bb6960 auth_method 0 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.382 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:59:21.023+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:59:21.023+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_done global_id 7941 payload 274 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:59:21.023+0000 7f3f7c9c7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: dump: 2024-09-12T17:59:21.383 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.384 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:59:21.023+0000 7f3e53fff640 10 monclient: dump: 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:59:21.023+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7941 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:59:21.023+0000 7f3f80d39800 10 monclient: get_monmap_and_config success 2024-09-12T17:59:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:59:21.023+0000 7f3f80d39800 4 set_mon_vals no callback set 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: shutdown 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: build_initial_monmap 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 build_initial for_mkfs: 0 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: monmap: 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.386 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding auth protocol: cephx 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.387 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: crc 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144bb1e60) adding con mode: secure 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:59:21.024+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: starting msgr at 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: starting objecter 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command objecter_requests cmddesc objecter_requests hook 0x55b144bb6e70 EEXIST 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: setting wanted keys 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:59:21.024+0000 7f3f80d39800 1 librados: calling monclient init 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:59:21.024+0000 7f3f80d39800 10 monclient: init 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding auth protocol: cephx 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.388 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: crc 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:59:21.024+0000 7f3f80d39800 5 AuthRegistry(0x55b144b7a1a0) adding con mode: secure 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:59:21.024+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:59:21.025+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command rotate-key cmddesc rotate-key hook 0x55b144b7a2e8 EEXIST 2024-09-12T17:59:21.389 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-a con 0x55b144bb6580 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-c con 0x55b144bbc0b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): picked mon.noname-b con 0x55b144bb4670 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient(hunting): authenticate will time out at 2234.539226s 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request con 0x55b144bb6580 auth_method 0 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.390 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): get_auth_request con 0x55b144bbc0b0 auth_method 0 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request con 0x55b144bb4670 auth_method 0 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:59:21.025+0000 7f3f77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.391 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:59:21.025+0000 7f3f7d1c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient(hunting): handle_auth_done global_id 7944 payload 824 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient: _finish_hunting 0 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 1 monclient: found mon.noname-a 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:59:21.025+0000 7f3f7c9c7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: dump: 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.392 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:59:21.025+0000 7f3e527fc640 10 monclient: dump: 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 monclient: authenticate success, global_id 7944 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:59:21.025+0000 7f3e53fff640 4 set_mon_vals no callback set 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _renew_subs 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:59:21.025+0000 7f3f80d39800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.394 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:59:21.025+0000 7f3f80d39800 1 librados: init done 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:59:21.025+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cr dump hook 0x55b144bb0a98 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:59:21.027+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:59:21.028+0000 7f3e527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:59:21.028+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3e480764a0 auth_method 0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:59:21.028+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x55b144bd0800 auth_method 0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 realm 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:59:21.029+0000 7f3f80d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.395 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:59:21.029+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:59:21.029+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x55b144bd4910 auth_method 0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:59:21.030+0000 7f3f80d39800 20 searching for the correct realm 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:59:21.030+0000 7f3f77fff640 10 monclient: get_auth_request con 0x55b144bd9be0 auth_method 0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:59:21.031+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x7f3f6800b040 auth_method 0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:59:21.032+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f78064fb0 auth_method 0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:59:21.032+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3f7009c060 auth_method 0 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:59:21.033+0000 7f3f77fff640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55b144bd9be0 msgr2=0x55b144bdc0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:59:21.033+0000 7f3e527fc640 1 client.7944.objecter ms_handle_reset 0x55b144bd9be0 session 0x55b144bd9560 osd.3 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:59:21.033+0000 7f3e527fc640 10 monclient: _renew_subs 2024-09-12T17:59:21.396 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:59:21.033+0000 7f3e527fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:59:21.033+0000 7f3f77fff640 10 monclient: get_auth_request con 0x7f3e48086bc0 auth_method 0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:59:21.034+0000 7f3f7d1c8640 10 monclient: get_auth_request con 0x7f3f6801fc30 auth_method 0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:59:21.036+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f6801f3a0 auth_method 0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:59:21.036+0000 7f3f7c9c7640 0 -- 172.21.15.94:0/2695065314 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3f6801f3a0 msgr2=0x7f3f68067810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:59:21.238+0000 7f3f7c9c7640 10 monclient: get_auth_request con 0x7f3f6801f3a0 auth_method 0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.397 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:59:21.242+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zone default found 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Realm: () 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:59:21.243+0000 7f3f80d39800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:59:21.243+0000 7f3f80d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 zonegroup default 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.398 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:59:21.243+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started sync module instance, tier type = 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:59:21.244+0000 7f3f80d39800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=0 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=1 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=2 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=3 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=4 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=5 2024-09-12T17:59:21.399 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=6 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:59:21.253+0000 7f3f80d39800 20 add_watcher() i=7 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:59:21.253+0000 7f3f80d39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding auth protocol: cephx 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.400 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:59:21.255+0000 7f3e337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: crc 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 AuthRegistry(0x7ffdeec55870) adding con mode: secure 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:59:21.255+0000 7f3f80d39800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache list hook 0x55b144bb4a90 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache inspect hook 0x55b144bb4a90 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache erase hook 0x55b144bb4a90 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command cache zap hook 0x55b144bb4a90 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 note: GC not initialized 2024-09-12T17:59:21.401 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:59:21.255+0000 7f3e327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace show hook 0x7f3f700567a0 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace history hook 0x7f3f700567a0 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace active hook 0x7f3f700567a0 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:59:21.255+0000 7f3f80d39800 5 asok(0x55b1448c4730) register_command sync trace active_short hook 0x7f3f700567a0 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:59:21.255+0000 7f3f80d39800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 Filter name: none 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:59:21.256+0000 7f3e2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : miss 2024-09-12T17:59:21.402 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:59:21.256+0000 7f3f80d39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:59:21.256+0000 7f3f80d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:59:21.261+0000 7f3f80d39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94219850872112 notifier 7944 bl.length()=931 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.403 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:59:21.262+0000 7f3e537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:59:21.264+0000 7f3f80d39800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.0 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.1 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.2 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.404 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.3 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.4 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.5 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.6 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.7 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.8 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.9 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.405 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.10 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:59:21.268+0000 7f3f80d39800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1.11 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.0 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:59:21.268+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:59:21.269+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.3 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.4 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:59:21.270+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.5 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.6 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:59:21.271+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.7 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.8 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:59:21.272+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.9 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:59:21.273+0000 7f3f80d39800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.10 2024-09-12T17:59:21.406 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:59:21.278+0000 7f3f80d39800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f80d39800 time 2024-09-12T17:59:21.278615+0000 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f8238c71a] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:21.407 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:59:21.279+0000 7f3f80d39800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3f80d39800 thread_name:radosgw-admin 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f8103e6f0] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f8108b99c] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f8238c774] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3f8238c8d8] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b143daf841] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b143dbe734] 2024-09-12T17:59:21.408 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b143dbf5d4] 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3f81029590] 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:21.409 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:21.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:59:21.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:21.412 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:59:21.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:59:21.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:59:21.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e2b7fe640 / http_manager 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e327e4640 / http_manager 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e337e6640 / rgw_dt_lg_renew 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e527fc640 / ms_dispatch 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e537fe640 / io_context_pool 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e53fff640 / io_context_pool 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e627fc640 / ms_dispatch 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e69602640 / ms_dispatch 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3e6ae05640 / io_context_pool 2024-09-12T17:59:21.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f77fff640 / msgr-worker-2 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7c9c7640 / msgr-worker-1 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7d1c8640 / msgr-worker-0 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f7d9c9640 / io_context_pool 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3f80d39800 / radosgw-admin 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:59:21.280454Z_46fd4cbb-e1f4-42a1-a93b-b98cb120d6f5/log 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:59:21.417 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:59:21.422 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:21.422 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:21.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.353+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 realm 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.355+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.356+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.356+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.357+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.357+0000 7fc2b5a14800 20 searching for the correct realm 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.360+0000 7fc2a88ca640 0 -- 172.21.15.94:0/1836064014 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55c6cb87ae60 msgr2=0x55c6cb87d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.363+0000 7fc2b10cb640 0 -- 172.21.15.94:0/1836064014 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc29c05b350 msgr2=0x7fc29c0868b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.367+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:21.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 zone default found 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 4 Realm: () 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 zonegroup default 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 started sync module instance, tier type = 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.368+0000 7fc2b5a14800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:21.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=0 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=1 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=2 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=3 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=4 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=5 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.377+0000 7fc2b5a14800 20 add_watcher() i=6 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.378+0000 7fc2b5a14800 20 add_watcher() i=7 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.378+0000 7fc2b5a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.379+0000 7fc167fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 5 note: GC not initialized 2024-09-12T17:59:21.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc166fe5640 20 reqs_thread_entry: start 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 20 Filter name: none 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc164fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.380+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.381+0000 7fc2b5a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.382+0000 7fc2b5a14800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.382+0000 7fc2b5a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.384+0000 7fc167fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.386+0000 7fc2b5a14800 20 remove_watcher() i=0 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.386+0000 7fc2b5a14800 2 removed watcher, disabling cache 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.387+0000 7fc2b5a14800 20 remove_watcher() i=1 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.388+0000 7fc2b5a14800 20 remove_watcher() i=2 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.389+0000 7fc2b5a14800 20 remove_watcher() i=3 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.389+0000 7fc2b5a14800 20 remove_watcher() i=4 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.390+0000 7fc2b5a14800 20 remove_watcher() i=5 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.391+0000 7fc2b5a14800 20 remove_watcher() i=6 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.392+0000 7fc2b5a14800 20 remove_watcher() i=7 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:21.428 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:21.494 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:21.525 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:21.525 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:21.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.560+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 realm 2024-09-12T17:59:21.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.562+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.563+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.563+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.563+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:21.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.564+0000 7f5233f3c800 20 searching for the correct realm 2024-09-12T17:59:21.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.567+0000 7f5230482640 0 -- 172.21.15.94:0/2131957186 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f5218058410 msgr2=0x7f5218058890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.772+0000 7f5230482640 0 -- 172.21.15.94:0/2131957186 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f5218058410 msgr2=0x7f5218058890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:21.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:21.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:21.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:21.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:21.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.775+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 zone default found 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 4 Realm: () 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:21.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 zonegroup default 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 started sync module instance, tier type = 2024-09-12T17:59:21.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.776+0000 7f5233f3c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=0 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=1 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=2 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=3 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=4 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=5 2024-09-12T17:59:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.785+0000 7f5233f3c800 20 add_watcher() i=6 2024-09-12T17:59:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.786+0000 7f5233f3c800 20 add_watcher() i=7 2024-09-12T17:59:21.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.786+0000 7f5233f3c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:21.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.787+0000 7f50e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 5 note: GC not initialized 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f50e57e2640 20 reqs_thread_entry: start 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 20 Filter name: none 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f50de7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.788+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:21.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : miss 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 20 rados->read ofs=0 len=0 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:21.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:21.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.789+0000 7f5233f3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:21.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.791+0000 7f5233f3c800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to be held by another RGW process; skipping for now 2024-09-12T17:59:21.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.791+0000 7f50e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.794+0000 7f5233f3c800 20 remove_watcher() i=0 2024-09-12T17:59:21.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.794+0000 7f5233f3c800 2 removed watcher, disabling cache 2024-09-12T17:59:21.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.795+0000 7f5233f3c800 20 remove_watcher() i=1 2024-09-12T17:59:21.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.796+0000 7f5233f3c800 20 remove_watcher() i=2 2024-09-12T17:59:21.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.797+0000 7f5233f3c800 20 remove_watcher() i=3 2024-09-12T17:59:21.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.798+0000 7f5233f3c800 20 remove_watcher() i=4 2024-09-12T17:59:21.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.799+0000 7f5233f3c800 20 remove_watcher() i=5 2024-09-12T17:59:21.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.799+0000 7f5233f3c800 20 remove_watcher() i=6 2024-09-12T17:59:21.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:21.800+0000 7f5233f3c800 20 remove_watcher() i=7 2024-09-12T17:59:21.811 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:59:51.829 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:51.865 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:51.865 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:51.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.906+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 realm 2024-09-12T17:59:51.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.907+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.908+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.908+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.909+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:51.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.909+0000 7fecc6a14800 20 searching for the correct realm 2024-09-12T17:59:51.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.913+0000 7fecc28cc640 0 -- 172.21.15.94:0/1310927385 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55ddc1c3a340 msgr2=0x55ddc1c3c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:51.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.917+0000 7fecb98ca640 0 -- 172.21.15.94:0/1310927385 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fecb404d0b0 msgr2=0x7fecb4062750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:51.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:51.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:51.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.921+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:51.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 zone default found 2024-09-12T17:59:51.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 4 Realm: () 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 zonegroup default 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.922+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.923+0000 7fecc6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:51.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.923+0000 7fecc6a14800 20 started sync module instance, tier type = 2024-09-12T17:59:51.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.923+0000 7fecc6a14800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:51.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=0 2024-09-12T17:59:51.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=1 2024-09-12T17:59:51.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=2 2024-09-12T17:59:51.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=3 2024-09-12T17:59:51.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=4 2024-09-12T17:59:51.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=5 2024-09-12T17:59:51.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.932+0000 7fecc6a14800 20 add_watcher() i=6 2024-09-12T17:59:51.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.933+0000 7fecc6a14800 20 add_watcher() i=7 2024-09-12T17:59:51.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.933+0000 7fecc6a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:51.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7feb78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:51.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7fecc6a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:51.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7fecc6a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7fecc6a14800 5 note: GC not initialized 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7feaf37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.935+0000 7fecc6a14800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 20 Filter name: none 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7feaf17fa640 20 reqs_thread_entry: start 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:59:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : miss 2024-09-12T17:59:51.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.936+0000 7fecc6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:59:51.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:59:51.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.937+0000 7fecc6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.938+0000 7fecc6a14800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:59:51.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.945+0000 7fecc6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.945+0000 7fecc6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.945+0000 7fecc6a14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.945+0000 7fecc6a14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:51.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.946+0000 7feba57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94410927018144 notifier 7998 bl.length()=931 2024-09-12T17:59:51.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.946+0000 7feba57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.946+0000 7feba57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.946+0000 7feba57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.948+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:51.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.948+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:51.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.948+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:51.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.948+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:51.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.0 2024-09-12T17:59:51.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.0 2024-09-12T17:59:51.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.1 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.1 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.2 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.2 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.3 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.3 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.4 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.4 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.5 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.5 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.6 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.6 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.7 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.7 2024-09-12T17:59:51.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.8 2024-09-12T17:59:51.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.8 2024-09-12T17:59:51.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.9 2024-09-12T17:59:51.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.9 2024-09-12T17:59:51.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.10 2024-09-12T17:59:51.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.10 2024-09-12T17:59:51.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.11 2024-09-12T17:59:51.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2.11 2024-09-12T17:59:51.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.0 2024-09-12T17:59:51.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.954+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.955+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.955+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.3 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.956+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.4 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.957+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.5 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.957+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.6 2024-09-12T17:59:51.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.958+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.7 2024-09-12T17:59:51.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.958+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.8 2024-09-12T17:59:51.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.959+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.9 2024-09-12T17:59:51.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.959+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.10 2024-09-12T17:59:51.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.963+0000 7fecc6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:51.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.963+0000 7fecc6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:51.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.964+0000 7fecc6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.964+0000 7fecc6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.964+0000 7fecc6a14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.965+0000 7fecc6a14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.965+0000 7feba5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94410927018144 notifier 7998 bl.length()=931 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.965+0000 7feba5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.965+0000 7feba5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.965+0000 7feba5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.966+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:51.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.966+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:51.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.966+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:51.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.966+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:51.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.970+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.0 2024-09-12T17:59:51.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.970+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.1 2024-09-12T17:59:51.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.971+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.2 2024-09-12T17:59:51.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.971+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.3 2024-09-12T17:59:51.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.971+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.4 2024-09-12T17:59:51.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.972+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.5 2024-09-12T17:59:51.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.972+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.6 2024-09-12T17:59:51.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.973+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.7 2024-09-12T17:59:51.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.973+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.8 2024-09-12T17:59:51.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.973+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.9 2024-09-12T17:59:51.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.974+0000 7fecc6a14800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39.10 2024-09-12T17:59:51.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.974+0000 7fecc6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:51.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.974+0000 7fecc6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 2024-09-12T17:59:51.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7fecc6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7fecc6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7fecc6a14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7fecc6a14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39, ofs0, ns] 2024-09-12T17:59:51.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7feba5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 94410927018144 notifier 7998 bl.length()=899 2024-09-12T17:59:51.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7feba5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 info.flags=0x17 2024-09-12T17:59:51.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7feba5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 to cache LRU end 2024-09-12T17:59:51.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.976+0000 7feba5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:51.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.978+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_sources= new_sources= 2024-09-12T17:59:51.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.978+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential sources added=[] removed=[] 2024-09-12T17:59:51.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.978+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): orig_dests= new_dests= 2024-09-12T17:59:51.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.978+0000 7fecc6a14800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39]): potential dests added=[] removed=[] 2024-09-12T17:59:51.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.980+0000 7fecc6a14800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:51.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.982+0000 7feb78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:51.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.984+0000 7fecc6a14800 20 remove_watcher() i=0 2024-09-12T17:59:51.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.984+0000 7fecc6a14800 2 removed watcher, disabling cache 2024-09-12T17:59:51.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.985+0000 7fecc6a14800 20 remove_watcher() i=1 2024-09-12T17:59:51.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.986+0000 7fecc6a14800 20 remove_watcher() i=2 2024-09-12T17:59:51.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.988+0000 7fecc6a14800 20 remove_watcher() i=3 2024-09-12T17:59:51.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.989+0000 7fecc6a14800 20 remove_watcher() i=4 2024-09-12T17:59:51.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.990+0000 7fecc6a14800 20 remove_watcher() i=5 2024-09-12T17:59:51.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.991+0000 7fecc6a14800 20 remove_watcher() i=6 2024-09-12T17:59:51.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:51.992+0000 7fecc6a14800 20 remove_watcher() i=7 2024-09-12T17:59:52.005 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:59:52.033 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:52.034 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:52.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.069+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 20 realm 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.071+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.072+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.072+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.073+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:52.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.073+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.073+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:52.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.073+0000 7f4f2b12e800 20 searching for the correct realm 2024-09-12T17:59:52.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.077+0000 7f4f1e563640 0 -- 172.21.15.94:0/649949842 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f4f1800f910 msgr2=0x7f4f18061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:52.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.080+0000 7f4f1e563640 0 -- 172.21.15.94:0/649949842 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f4df0086b90 msgr2=0x7f4df0088fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:52.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.084+0000 7f4f2b12e800 20 zone default found 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 4 Realm: () 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 zonegroup default 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 started sync module instance, tier type = 2024-09-12T17:59:52.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.085+0000 7f4f2b12e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=0 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=1 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=2 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=3 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=4 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=5 2024-09-12T17:59:52.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.095+0000 7f4f2b12e800 20 add_watcher() i=6 2024-09-12T17:59:52.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.096+0000 7f4f2b12e800 20 add_watcher() i=7 2024-09-12T17:59:52.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.096+0000 7f4f2b12e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:52.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.097+0000 7f4ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:52.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:52.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 5 note: GC not initialized 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4d57fff640 20 reqs_thread_entry: start 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 20 Filter name: none 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4d55ffb640 20 reqs_thread_entry: start 2024-09-12T17:59:52.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.098+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.099+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.099+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.099+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.099+0000 7f4f2b12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.099+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.100+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:59:52.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.100+0000 7f4f2b12e800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.100+0000 7f4f2b12e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:59:52.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.100+0000 7f4f2b12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:52.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.102+0000 7f4ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:52.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.104+0000 7f4f2b12e800 20 remove_watcher() i=0 2024-09-12T17:59:52.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.104+0000 7f4f2b12e800 2 removed watcher, disabling cache 2024-09-12T17:59:52.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.105+0000 7f4f2b12e800 20 remove_watcher() i=1 2024-09-12T17:59:52.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.106+0000 7f4f2b12e800 20 remove_watcher() i=2 2024-09-12T17:59:52.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.107+0000 7f4f2b12e800 20 remove_watcher() i=3 2024-09-12T17:59:52.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.108+0000 7f4f2b12e800 20 remove_watcher() i=4 2024-09-12T17:59:52.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.109+0000 7f4f2b12e800 20 remove_watcher() i=5 2024-09-12T17:59:52.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.110+0000 7f4f2b12e800 20 remove_watcher() i=6 2024-09-12T17:59:52.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.111+0000 7f4f2b12e800 20 remove_watcher() i=7 2024-09-12T17:59:52.123 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:52.123 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:52.484 INFO:tasks.workunit.client.0.smithi094.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:59:52.486 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:59:52.515 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:52.515 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:52.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.551+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.552+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.552+0000 7fed10b26800 20 realm 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.552+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.553+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.553+0000 7fed10b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.553+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.553+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.553+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.554+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:52.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.554+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.554+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:52.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.554+0000 7fed10b26800 20 searching for the correct realm 2024-09-12T17:59:52.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.557+0000 7fed0cf0a640 0 -- 172.21.15.94:0/1027823089 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x5587809d0710 msgr2=0x5587809d2ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:52.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.561+0000 7fed0c709640 0 -- 172.21.15.94:0/1027823089 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fecf408f3d0 msgr2=0x7fecf40157a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:52.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 zone default found 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 4 Realm: () 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 zonegroup default 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.566+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 started sync module instance, tier type = 2024-09-12T17:59:52.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.567+0000 7fed10b26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:52.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=0 2024-09-12T17:59:52.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=1 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=2 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=3 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=4 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=5 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.575+0000 7fed10b26800 20 add_watcher() i=6 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.576+0000 7fed10b26800 20 add_watcher() i=7 2024-09-12T17:59:52.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.576+0000 7fed10b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:52.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7febc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7fed10b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7fed10b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7fed10b26800 5 note: GC not initialized 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7febc1fdb640 20 reqs_thread_entry: start 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7fed10b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.578+0000 7fed10b26800 20 Filter name: none 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7feb337fe640 20 reqs_thread_entry: start 2024-09-12T17:59:52.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:52.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.579+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.580+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.580+0000 7fed10b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.580+0000 7fed10b26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:52.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.580+0000 7fed10b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:52.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.582+0000 7febc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:52.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.584+0000 7fed10b26800 20 remove_watcher() i=0 2024-09-12T17:59:52.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.584+0000 7fed10b26800 2 removed watcher, disabling cache 2024-09-12T17:59:52.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.585+0000 7fed10b26800 20 remove_watcher() i=1 2024-09-12T17:59:52.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.586+0000 7fed10b26800 20 remove_watcher() i=2 2024-09-12T17:59:52.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.587+0000 7fed10b26800 20 remove_watcher() i=3 2024-09-12T17:59:52.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.588+0000 7fed10b26800 20 remove_watcher() i=4 2024-09-12T17:59:52.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.589+0000 7fed10b26800 20 remove_watcher() i=5 2024-09-12T17:59:52.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.590+0000 7fed10b26800 20 remove_watcher() i=6 2024-09-12T17:59:52.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.591+0000 7fed10b26800 20 remove_watcher() i=7 2024-09-12T17:59:52.602 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:52.602 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T17:59:52.602 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:59:52.602 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:52.604 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:59:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:52.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.866+0000 7fe768b81640 0 --2- 172.21.15.94:0/4251191165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55869398af20 0x55869398bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:59:52.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.871+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 20 realm 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.873+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.874+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:52.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.874+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.875+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:52.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.875+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:52.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.875+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:52.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.875+0000 7fe773898800 20 searching for the correct realm 2024-09-12T17:59:52.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:52.877+0000 7fe771382640 0 -- 172.21.15.94:0/1354729578 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7fe76c02b060 msgr2=0x7fe76c063250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.082+0000 7fe771b83640 0 -- 172.21.15.94:0/1354729578 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fe75c062c30 msgr2=0x7fe75c0616a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.088+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 zone default found 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 4 Realm: () 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 zonegroup default 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.089+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.090+0000 7fe773898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.090+0000 7fe773898800 20 started sync module instance, tier type = 2024-09-12T17:59:53.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.090+0000 7fe773898800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=0 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=1 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=2 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=3 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=4 2024-09-12T17:59:53.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=5 2024-09-12T17:59:53.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.099+0000 7fe773898800 20 add_watcher() i=6 2024-09-12T17:59:53.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.100+0000 7fe773898800 20 add_watcher() i=7 2024-09-12T17:59:53.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.100+0000 7fe773898800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.101+0000 7fe6277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 5 note: GC not initialized 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe6267e4640 20 reqs_thread_entry: start 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 20 Filter name: none 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe597fff640 20 reqs_thread_entry: start 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.102+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.103+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.103+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.103+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.103+0000 7fe773898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.103+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.104+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.104+0000 7fe773898800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.104+0000 7fe773898800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:53.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.104+0000 7fe773898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:53.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.106+0000 7fe6277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.108+0000 7fe773898800 20 remove_watcher() i=0 2024-09-12T17:59:53.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.108+0000 7fe773898800 2 removed watcher, disabling cache 2024-09-12T17:59:53.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.109+0000 7fe773898800 20 remove_watcher() i=1 2024-09-12T17:59:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.110+0000 7fe773898800 20 remove_watcher() i=2 2024-09-12T17:59:53.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.111+0000 7fe773898800 20 remove_watcher() i=3 2024-09-12T17:59:53.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.113+0000 7fe773898800 20 remove_watcher() i=4 2024-09-12T17:59:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.114+0000 7fe773898800 20 remove_watcher() i=5 2024-09-12T17:59:53.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.115+0000 7fe773898800 20 remove_watcher() i=6 2024-09-12T17:59:53.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.116+0000 7fe773898800 20 remove_watcher() i=7 2024-09-12T17:59:53.129 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:59:53.163 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:53.163 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:53.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.199+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 realm 2024-09-12T17:59:53.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.202+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:53.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.202+0000 7f4cb0537800 20 searching for the correct realm 2024-09-12T17:59:53.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.205+0000 7f4caca22640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f4c940c6b30 msgr2=0x7f4c940a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.411+0000 7f4cac221640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55ecb858fe80 msgr2=0x55ecb85922b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zone default found 2024-09-12T17:59:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Realm: () 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zonegroup default 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started sync module instance, tier type = 2024-09-12T17:59:53.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=0 2024-09-12T17:59:53.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=1 2024-09-12T17:59:53.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=2 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=3 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=4 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=5 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=6 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.425+0000 7f4cb0537800 20 add_watcher() i=7 2024-09-12T17:59:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.425+0000 7f4cb0537800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.427+0000 7f4b62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 5 note: GC not initialized 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4b61fdb640 20 reqs_thread_entry: start 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 20 Filter name: none 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4ad37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:59:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:53.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:53.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.429+0000 7f4cb0537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.434+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.434+0000 7f4cb0537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.434+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.434+0000 7f4cb0537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94475193522496 notifier 7619 bl.length()=827 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:59:53.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:59:53.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:59:53.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.451 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4cb0537800 time 2024-09-12T17:59:53.451022+0000 2024-09-12T17:59:53.451 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:53.451 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.451 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4cb1b8c71a] 2024-09-12T17:59:53.451 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.450+0000 7f4cb0537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4cb0537800 time 2024-09-12T17:59:53.451022+0000 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4cb1b8c71a] 2024-09-12T17:59:53.452 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:59:53.453 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f4cb0537800 thread_name:radosgw-admin 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4cb083e6f0] 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4cb088b99c] 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:53.472 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4cb1b8c774] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.451+0000 7f4cb0537800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f4cb0537800 thread_name:radosgw-admin 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4cb083e6f0] 2024-09-12T17:59:53.473 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4cb088b99c] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4cb1b8c774] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:53.474 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:59:53.183+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:59:53.183+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:59:53.183+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key hook 0x55ecb84a1b58 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:59:53.183+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb832c120 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb83e7530 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb84a7ef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.475 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.698043s 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb83e7530 auth_method 0 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb832c120 auth_method 0 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.476 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb84a7ef0 auth_method 0 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 1 monclient: found mon.noname-a 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: dump: 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.477 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.478 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: dump: 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:59:53.184+0000 7f4cb0537800 5 monclient: authenticate success, global_id 8058 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.479 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:59:53.184+0000 7f4b9a60c640 4 set_mon_vals no callback set 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:59:53.184+0000 7f4cb0537800 1 librados: init done 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:59:53.186+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b94076470 auth_method 0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:59:53.187+0000 7f4caca22640 10 monclient: get_auth_request con 0x55ecb84ca2d0 auth_method 0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:59:53.187+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb84ecdf0 auth_method 0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:59:53.189+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x55ecb84f06c0 auth_method 0 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:59:53.189+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.480 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:59:53.189+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:59:53.189+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.481 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.482 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command objecter_requests cmddesc objecter_requests hook 0x55ecb84f9b50 EEXIST 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.483 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x55ecb84f5260 EEXIST 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb851d840 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb851fb10 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb851c010 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.484 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.704904s 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb851d840 auth_method 0 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb851c010 auth_method 0 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.485 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb851fb10 auth_method 0 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_done global_id 8061 payload 824 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:59:53.191+0000 7f4caca22640 1 monclient: found mon.noname-a 2024-09-12T17:59:53.486 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: dump: 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.487 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: dump: 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:59:53.191+0000 7f4cb0537800 5 monclient: authenticate success, global_id 8061 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:59:53.191+0000 7f4cad223640 4 set_mon_vals no callback set 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.489 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:59:53.193+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b84076380 auth_method 0 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: get_monmap_and_config 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:59:53.193+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.490 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.491 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.492 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x7ffe8ec08368 EEXIST 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb8571ac0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb8562410 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.493 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb856cef0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.708745s 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb8562410 auth_method 0 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb856cef0 auth_method 0 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.494 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient(hunting): handle_auth_done global_id 7616 payload 274 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:59:53.195+0000 7f4caca22640 1 monclient: found mon.noname-c 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:59:53.195+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb8571ac0 auth_method 0 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.495 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: dump: 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.496 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: dump: 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.497 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 monclient: authenticate success, global_id 7616 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: get_monmap_and_config success 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:59:53.195+0000 7f4cb0537800 4 set_mon_vals no callback set 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: shutdown 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:59:53.195+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.498 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.499 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: starting msgr at 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: starting objecter 2024-09-12T17:59:53.500 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command objecter_requests cmddesc objecter_requests hook 0x55ecb851e870 EEXIST 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: setting wanted keys 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: calling monclient init 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.501 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x55ecb8535738 EEXIST 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb8562410 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb856cef0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.502 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb8571ac0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.710901s 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb856cef0 auth_method 0 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb8562410 auth_method 0 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.503 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb8571ac0 auth_method 0 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_done global_id 7619 payload 824 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 1 monclient: found mon.noname-c 2024-09-12T17:59:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: dump: 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.505 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: dump: 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:59:53.197+0000 7f4cb0537800 5 monclient: authenticate success, global_id 7619 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:59:53.197+0000 7f4b837fe640 4 set_mon_vals no callback set 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:59:53.197+0000 7f4cb0537800 1 librados: init done 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:59:53.197+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cr dump hook 0x55ecb8566f08 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:59:53.199+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.507 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:59:53.199+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b74076470 auth_method 0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:59:53.200+0000 7f4caca22640 10 monclient: get_auth_request con 0x55ecb858bc70 auth_method 0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 realm 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:59:53.200+0000 7f4cb0537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:59:53.201+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb858fe80 auth_method 0 2024-09-12T17:59:53.508 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:59:53.202+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:59:53.202+0000 7f4cb0537800 20 searching for the correct realm 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:59:53.202+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x55ecb8595160 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:59:53.202+0000 7f4caca22640 10 monclient: get_auth_request con 0x7f4c940b1930 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:59:53.203+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4ca4064110 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:59:53.204+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x7f4c9c02c040 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:59:53.205+0000 7f4caca22640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f4c940c6b30 msgr2=0x7f4c940a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:59:53.406+0000 7f4caca22640 10 monclient: get_auth_request con 0x7f4c940c6b30 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:59:53.409+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4c940b8090 auth_method 0 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:59:53.411+0000 7f4cac221640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55ecb858fe80 msgr2=0x55ecb85922b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 1 client.7619.objecter ms_handle_reset 0x55ecb858fe80 session 0x55ecb858f800 osd.5 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 10 monclient: _renew_subs 2024-09-12T17:59:53.509 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:59:53.411+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b74086bf0 auth_method 0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.510 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zone default found 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Realm: () 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:59:53.414+0000 7f4cb0537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zonegroup default 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.512 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started sync module instance, tier type = 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=0 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=1 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=2 2024-09-12T17:59:53.513 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=3 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=4 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=5 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=6 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:59:53.425+0000 7f4cb0537800 20 add_watcher() i=7 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:59:53.425+0000 7f4cb0537800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.514 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:59:53.427+0000 7f4b62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:59:53.427+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.515 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache list hook 0x55ecb8566c90 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache inspect hook 0x55ecb8566c90 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache erase hook 0x55ecb8566c90 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache zap hook 0x55ecb8566c90 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 note: GC not initialized 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:59:53.428+0000 7f4b61fdb640 20 reqs_thread_entry: start 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace show hook 0x7f4ca402b020 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace history hook 0x7f4ca402b020 2024-09-12T17:59:53.516 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace active hook 0x7f4ca402b020 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace active_short hook 0x7f4ca402b020 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 Filter name: none 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:59:53.428+0000 7f4ad37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:59:53.428+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.517 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94475193522496 notifier 7619 bl.length()=827 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.518 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.519 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.520 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.521 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.522 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:59:53.450+0000 7f4cb0537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4cb0537800 time 2024-09-12T17:59:53.451022+0000 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.523 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4cb1b8c71a] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:59:53.451+0000 7f4cb0537800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f4cb0537800 thread_name:radosgw-admin 2024-09-12T17:59:53.524 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4cb083e6f0] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4cb088b99c] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4cb1b8c774] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.525 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:53.526 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:59:53.527 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:59:53.528 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:59:53.529 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:59:53.530 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:53.531 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:53.532 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4ad37fe640 / http_manager 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b61fdb640 / http_manager 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b62fdd640 / rgw_dt_lg_renew 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b81ffb640 / ms_dispatch 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b82ffd640 / io_context_pool 2024-09-12T17:59:53.533 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b837fe640 / io_context_pool 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b91ffb640 / ms_dispatch 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b98e09640 / ms_dispatch 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b9a60c640 / io_context_pool 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4ca3a20640 / msgr-worker-2 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cac221640 / msgr-worker-1 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4caca22640 / msgr-worker-0 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cad223640 / io_context_pool 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cb0537800 / radosgw-admin 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.145963.log 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T17:59:53.534 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T17:59:53.183+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T17:59:53.183+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T17:59:53.183+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key hook 0x55ecb84a1b58 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T17:59:53.183+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb832c120 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb83e7530 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb84a7ef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.698043s 2024-09-12T17:59:53.535 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb83e7530 auth_method 0 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb832c120 auth_method 0 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.536 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T17:59:53.184+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb84a7ef0 auth_method 0 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T17:59:53.184+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 1 monclient: found mon.noname-a 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T17:59:53.184+0000 7f4ca3a20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.537 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: dump: 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.538 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T17:59:53.184+0000 7f4b98e09640 10 monclient: dump: 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.539 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T17:59:53.184+0000 7f4cb0537800 5 monclient: authenticate success, global_id 8058 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T17:59:53.184+0000 7f4b9a60c640 4 set_mon_vals no callback set 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T17:59:53.184+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T17:59:53.184+0000 7f4cb0537800 1 librados: init done 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T17:59:53.186+0000 7f4b98e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T17:59:53.186+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b94076470 auth_method 0 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T17:59:53.187+0000 7f4caca22640 10 monclient: get_auth_request con 0x55ecb84ca2d0 auth_method 0 2024-09-12T17:59:53.540 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T17:59:53.187+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb84ecdf0 auth_method 0 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T17:59:53.189+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x55ecb84f06c0 auth_method 0 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T17:59:53.189+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T17:59:53.189+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T17:59:53.189+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.541 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding auth protocol: cephx 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.542 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: crc 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T17:59:53.189+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f61d0) adding con mode: secure 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command objecter_requests cmddesc objecter_requests hook 0x55ecb84f9b50 EEXIST 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding auth protocol: cephx 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.543 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: crc 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 AuthRegistry(0x55ecb84f5118) adding con mode: secure 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T17:59:53.190+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T17:59:53.190+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x55ecb84f5260 EEXIST 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb851d840 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb851fb10 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.544 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb851c010 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T17:59:53.190+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.704904s 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb851d840 auth_method 0 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb851c010 auth_method 0 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.545 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T17:59:53.191+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb851fb10 auth_method 0 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T17:59:53.191+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient(hunting): handle_auth_done global_id 8061 payload 824 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T17:59:53.191+0000 7f4caca22640 1 monclient: found mon.noname-a 2024-09-12T17:59:53.546 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T17:59:53.191+0000 7f4caca22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: dump: 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.547 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T17:59:53.191+0000 7f4b91ffb640 10 monclient: dump: 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T17:59:53.191+0000 7f4cb0537800 5 monclient: authenticate success, global_id 8061 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T17:59:53.191+0000 7f4cad223640 4 set_mon_vals no callback set 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T17:59:53.191+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T17:59:53.193+0000 7f4b91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T17:59:53.193+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b84076380 auth_method 0 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: get_monmap_and_config 2024-09-12T17:59:53.549 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T17:59:53.193+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T17:59:53.193+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.550 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding auth protocol: cephx 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: crc 2024-09-12T17:59:53.551 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T17:59:53.193+0000 7f4cb0537800 5 AuthRegistry(0x55ecb853d4e0) adding con mode: secure 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding auth protocol: cephx 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.552 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: crc 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec08220) adding con mode: secure 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T17:59:53.194+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T17:59:53.194+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x7ffe8ec08368 EEXIST 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb8571ac0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb8562410 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb856cef0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T17:59:53.194+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.708745s 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb8562410 auth_method 0 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb856cef0 auth_method 0 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.554 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T17:59:53.194+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T17:59:53.194+0000 7f4caca22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient(hunting): handle_auth_done global_id 7616 payload 274 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T17:59:53.195+0000 7f4caca22640 1 monclient: found mon.noname-c 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T17:59:53.195+0000 7f4caca22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T17:59:53.195+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb8571ac0 auth_method 0 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: dump: 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.555 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:53.556 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T17:59:53.195+0000 7f4b837fe640 10 monclient: dump: 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 monclient: authenticate success, global_id 7616 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: get_monmap_and_config success 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T17:59:53.195+0000 7f4cb0537800 4 set_mon_vals no callback set 2024-09-12T17:59:53.557 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: shutdown 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: build_initial_monmap 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T17:59:53.195+0000 7f4cb0537800 1 build_initial for_mkfs: 0 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T17:59:53.195+0000 7f4cb0537800 10 monclient: monmap: 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.558 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding auth protocol: cephx 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: crc 2024-09-12T17:59:53.559 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T17:59:53.195+0000 7f4cb0537800 5 AuthRegistry(0x55ecb8541020) adding con mode: secure 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: starting msgr at 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: starting objecter 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command objecter_requests cmddesc objecter_requests hook 0x55ecb851e870 EEXIST 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: setting wanted keys 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T17:59:53.196+0000 7f4cb0537800 1 librados: calling monclient init 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: init 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding auth protocol: cephx 2024-09-12T17:59:53.560 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: crc 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 AuthRegistry(0x55ecb85355f0) adding con mode: secure 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T17:59:53.196+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.561 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T17:59:53.196+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command rotate-key cmddesc rotate-key hook 0x55ecb8535738 EEXIST 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: _reopen_session rank -1 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-a con 0x55ecb8562410 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-c con 0x55ecb856cef0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): picked mon.noname-b con 0x55ecb8571ac0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): _renew_subs 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T17:59:53.196+0000 7f4cb0537800 10 monclient(hunting): authenticate will time out at 2266.710901s 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request con 0x55ecb856cef0 auth_method 0 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.562 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): get_auth_request con 0x55ecb8562410 auth_method 0 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T17:59:53.197+0000 7f4cac221640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): get_auth_request con 0x55ecb8571ac0 auth_method 0 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:53.563 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T17:59:53.197+0000 7f4caca22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient(hunting): handle_auth_done global_id 7619 payload 824 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient: _finish_hunting 0 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 1 monclient: found mon.noname-c 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T17:59:53.197+0000 7f4ca3a20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: dump: 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: _finish_auth 0 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T17:59:53.197+0000 7f4b81ffb640 10 monclient: dump: 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T17:59:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T17:59:53.197+0000 7f4cb0537800 5 monclient: authenticate success, global_id 7619 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T17:59:53.197+0000 7f4b837fe640 4 set_mon_vals no callback set 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _renew_subs 2024-09-12T17:59:53.566 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T17:59:53.197+0000 7f4cb0537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T17:59:53.197+0000 7f4cb0537800 1 librados: init done 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T17:59:53.197+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cr dump hook 0x55ecb8566f08 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T17:59:53.199+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T17:59:53.199+0000 7f4b81ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T17:59:53.199+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b74076470 auth_method 0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T17:59:53.200+0000 7f4caca22640 10 monclient: get_auth_request con 0x55ecb858bc70 auth_method 0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 realm 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.567 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T17:59:53.200+0000 7f4cb0537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T17:59:53.200+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T17:59:53.201+0000 7f4cac221640 10 monclient: get_auth_request con 0x55ecb858fe80 auth_method 0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T17:59:53.201+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T17:59:53.202+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T17:59:53.202+0000 7f4cb0537800 20 searching for the correct realm 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T17:59:53.202+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x55ecb8595160 auth_method 0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T17:59:53.202+0000 7f4caca22640 10 monclient: get_auth_request con 0x7f4c940b1930 auth_method 0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T17:59:53.203+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4ca4064110 auth_method 0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T17:59:53.204+0000 7f4ca3a20640 10 monclient: get_auth_request con 0x7f4c9c02c040 auth_method 0 2024-09-12T17:59:53.568 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T17:59:53.205+0000 7f4caca22640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f4c940c6b30 msgr2=0x7f4c940a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T17:59:53.406+0000 7f4caca22640 10 monclient: get_auth_request con 0x7f4c940c6b30 auth_method 0 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T17:59:53.409+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4c940b8090 auth_method 0 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T17:59:53.411+0000 7f4cac221640 0 -- 172.21.15.94:0/2017175694 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55ecb858fe80 msgr2=0x55ecb85922b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 1 client.7619.objecter ms_handle_reset 0x55ecb858fe80 session 0x55ecb858f800 osd.5 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 10 monclient: _renew_subs 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T17:59:53.411+0000 7f4b81ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T17:59:53.411+0000 7f4cac221640 10 monclient: get_auth_request con 0x7f4b74086bf0 auth_method 0 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.569 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T17:59:53.413+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zone default found 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Realm: () 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T17:59:53.414+0000 7f4cb0537800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T17:59:53.414+0000 7f4cb0537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 zonegroup default 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.570 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T17:59:53.414+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started sync module instance, tier type = 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T17:59:53.415+0000 7f4cb0537800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=0 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=1 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=2 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=3 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=4 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=5 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T17:59:53.424+0000 7f4cb0537800 20 add_watcher() i=6 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T17:59:53.425+0000 7f4cb0537800 20 add_watcher() i=7 2024-09-12T17:59:53.571 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T17:59:53.425+0000 7f4cb0537800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding auth protocol: cephx 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T17:59:53.427+0000 7f4b62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.572 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: crc 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T17:59:53.427+0000 7f4cb0537800 5 AuthRegistry(0x7ffe8ec086f0) adding con mode: secure 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T17:59:53.427+0000 7f4cb0537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T17:59:53.427+0000 7f4cb0537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache list hook 0x55ecb8566c90 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache inspect hook 0x55ecb8566c90 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache erase hook 0x55ecb8566c90 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command cache zap hook 0x55ecb8566c90 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 note: GC not initialized 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T17:59:53.428+0000 7f4b61fdb640 20 reqs_thread_entry: start 2024-09-12T17:59:53.573 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace show hook 0x7f4ca402b020 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace history hook 0x7f4ca402b020 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace active hook 0x7f4ca402b020 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T17:59:53.428+0000 7f4cb0537800 5 asok(0x55ecb827f730) register_command sync trace active_short hook 0x7f4ca402b020 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 Filter name: none 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T17:59:53.428+0000 7f4ad37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T17:59:53.428+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T17:59:53.428+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:59:53.574 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T17:59:53.429+0000 7f4cb0537800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T17:59:53.429+0000 7f4cb0537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T17:59:53.434+0000 7f4cb0537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94475193522496 notifier 7619 bl.length()=827 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.575 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T17:59:53.435+0000 7f4b82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T17:59:53.436+0000 7f4cb0537800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.1 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.2 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.576 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.3 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.4 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.5 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.6 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.7 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.8 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.9 2024-09-12T17:59:53.577 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.10 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.11 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.12 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.13 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T17:59:53.442+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T17:59:53.442+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.578 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T17:59:53.443+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T17:59:53.443+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T17:59:53.444+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T17:59:53.444+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T17:59:53.445+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T17:59:53.445+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.579 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T17:59:53.446+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T17:59:53.446+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T17:59:53.447+0000 7f4cb0537800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T17:59:53.447+0000 7f4cb0537800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T17:59:53.450+0000 7f4cb0537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4cb0537800 time 2024-09-12T17:59:53.451022+0000 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4cb1b8c71a] 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.580 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T17:59:53.451+0000 7f4cb0537800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f4cb0537800 thread_name:radosgw-admin 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4cb083e6f0] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4cb088b99c] 2024-09-12T17:59:53.581 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4cb1b8c774] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4cb1b8c8d8] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ecb666d841] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ecb667c734] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ecb667d5d4] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4cb0829590] 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T17:59:53.582 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T17:59:53.583 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T17:59:53.584 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:53.585 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T17:59:53.586 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:53.587 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T17:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4ad37fe640 / http_manager 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b61fdb640 / http_manager 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b62fdd640 / rgw_dt_lg_renew 2024-09-12T17:59:53.589 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b81ffb640 / ms_dispatch 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b82ffd640 / io_context_pool 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b837fe640 / io_context_pool 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b91ffb640 / ms_dispatch 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b98e09640 / ms_dispatch 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4b9a60c640 / io_context_pool 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4ca3a20640 / msgr-worker-2 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cac221640 / msgr-worker-1 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4caca22640 / msgr-worker-0 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cad223640 / io_context_pool 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4cb0537800 / radosgw-admin 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:59:53.452626Z_b8db305a-36ea-432f-828e-1c709999f7fd/log 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T17:59:53.590 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:59:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.525+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 realm 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.527+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.528+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.528+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.528+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.528+0000 7f5392614800 20 searching for the correct realm 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.532+0000 7f538e4cc640 0 -- 172.21.15.94:0/4022857270 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x56114bd654b0 msgr2=0x56114bd678d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.535+0000 7f538dccb640 0 -- 172.21.15.94:0/4022857270 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f53840bcb90 msgr2=0x7f53840569c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.539+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 zone default found 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 4 Realm: () 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 zonegroup default 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.540+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.541+0000 7f5392614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.541+0000 7f5392614800 20 started sync module instance, tier type = 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.541+0000 7f5392614800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=0 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=1 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=2 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=3 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=4 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=5 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.551+0000 7f5392614800 20 add_watcher() i=6 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.552+0000 7f5392614800 20 add_watcher() i=7 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.552+0000 7f5392614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.553+0000 7f523f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 5 note: GC not initialized 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f523e7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 20 Filter name: none 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f51affff640 20 reqs_thread_entry: start 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.554+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.555+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.555+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.555+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.555+0000 7f5392614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.555+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.556+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.556+0000 7f5392614800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.556+0000 7f5392614800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.556+0000 7f5392614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.558+0000 7f523f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.560+0000 7f5392614800 20 remove_watcher() i=0 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.560+0000 7f5392614800 2 removed watcher, disabling cache 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.560+0000 7f5392614800 20 remove_watcher() i=1 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.562+0000 7f5392614800 20 remove_watcher() i=2 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.562+0000 7f5392614800 20 remove_watcher() i=3 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.563+0000 7f5392614800 20 remove_watcher() i=4 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.564+0000 7f5392614800 20 remove_watcher() i=5 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.565+0000 7f5392614800 20 remove_watcher() i=6 2024-09-12T17:59:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.567+0000 7f5392614800 20 remove_watcher() i=7 2024-09-12T17:59:53.617 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:59:53.645 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:53.645 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:53.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.680+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 20 realm 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.681+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.682+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.682+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.683+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.683+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.683+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.683+0000 7f0be0b26800 20 searching for the correct realm 2024-09-12T17:59:53.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.686+0000 7f0bdcf0a640 0 -- 172.21.15.94:0/1507900867 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f0bc403a040 msgr2=0x7f0bc40a50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.689+0000 7f0bdc709640 0 -- 172.21.15.94:0/1507900867 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f0bc4071040 msgr2=0x7f0bc4074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.693+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 zone default found 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 4 Realm: () 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.694+0000 7f0be0b26800 20 zonegroup default 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:53.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 started sync module instance, tier type = 2024-09-12T17:59:53.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.695+0000 7f0be0b26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T17:59:53.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=0 2024-09-12T17:59:53.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=1 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=2 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=3 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=4 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=5 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.703+0000 7f0be0b26800 20 add_watcher() i=6 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.704+0000 7f0be0b26800 20 add_watcher() i=7 2024-09-12T17:59:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.704+0000 7f0be0b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:53.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.706+0000 7f0a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:53.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 5 note: GC not initialized 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0a917e2640 20 reqs_thread_entry: start 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 20 Filter name: none 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0a02ffd640 20 reqs_thread_entry: start 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:59:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.707+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 20 rados->read ofs=0 len=0 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:59:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.708+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T17:59:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.709+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T17:59:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.710+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.711+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T17:59:53.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.712+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.712+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.712+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.712+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.713+0000 7f0be0b26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.713+0000 7f0be0b26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.714+0000 7f0a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.715+0000 7f0be0b26800 20 remove_watcher() i=0 2024-09-12T17:59:53.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.715+0000 7f0be0b26800 2 removed watcher, disabling cache 2024-09-12T17:59:53.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.716+0000 7f0be0b26800 20 remove_watcher() i=1 2024-09-12T17:59:53.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.717+0000 7f0be0b26800 20 remove_watcher() i=2 2024-09-12T17:59:53.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.719+0000 7f0be0b26800 20 remove_watcher() i=3 2024-09-12T17:59:53.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.720+0000 7f0be0b26800 20 remove_watcher() i=4 2024-09-12T17:59:53.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.721+0000 7f0be0b26800 20 remove_watcher() i=5 2024-09-12T17:59:53.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.722+0000 7f0be0b26800 20 remove_watcher() i=6 2024-09-12T17:59:53.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T17:59:53.723+0000 7f0be0b26800 20 remove_watcher() i=7 2024-09-12T18:00:23.766 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:00:23.799 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:23.800 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:23.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.840+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 20 realm 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.842+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.843+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:23.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.843+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.844+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.844+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.844+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.844+0000 7f03d5575800 20 searching for the correct realm 2024-09-12T18:00:23.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.847+0000 7f03d3860640 0 -- 172.21.15.94:0/314578702 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f03bc0b2270 msgr2=0x7f03bc0aa580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:23.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:23.851+0000 7f03d305f640 0 -- 172.21.15.94:0/314578702 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f03bc0a9c80 msgr2=0x7f03bc0da690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.057+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:24.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 zone default found 2024-09-12T18:00:24.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 4 Realm: () 2024-09-12T18:00:24.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:24.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:24.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 zonegroup default 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.058+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 started sync module instance, tier type = 2024-09-12T18:00:24.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.059+0000 7f03d5575800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:24.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=0 2024-09-12T18:00:24.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=1 2024-09-12T18:00:24.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=2 2024-09-12T18:00:24.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=3 2024-09-12T18:00:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=4 2024-09-12T18:00:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=5 2024-09-12T18:00:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.069+0000 7f03d5575800 20 add_watcher() i=6 2024-09-12T18:00:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.070+0000 7f03d5575800 20 add_watcher() i=7 2024-09-12T18:00:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.070+0000 7f03d5575800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.072+0000 7f0289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.072+0000 7f03d5575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.072+0000 7f03d5575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.072+0000 7f03d5575800 5 note: GC not initialized 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f0288fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f03d5575800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f03d5575800 20 Filter name: none 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f02027fc640 20 reqs_thread_entry: start 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.073+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.074+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.074+0000 7f03d5575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.074+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.074+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.074+0000 7f03d5575800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.075+0000 7f03d5575800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:24.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.075+0000 7f03d5575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:24.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.077+0000 7f0289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.079+0000 7f03d5575800 20 remove_watcher() i=0 2024-09-12T18:00:24.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.079+0000 7f03d5575800 2 removed watcher, disabling cache 2024-09-12T18:00:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.079+0000 7f03d5575800 20 remove_watcher() i=1 2024-09-12T18:00:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.080+0000 7f03d5575800 20 remove_watcher() i=2 2024-09-12T18:00:24.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.082+0000 7f03d5575800 20 remove_watcher() i=3 2024-09-12T18:00:24.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.083+0000 7f03d5575800 20 remove_watcher() i=4 2024-09-12T18:00:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.084+0000 7f03d5575800 20 remove_watcher() i=5 2024-09-12T18:00:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.085+0000 7f03d5575800 20 remove_watcher() i=6 2024-09-12T18:00:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.086+0000 7f03d5575800 20 remove_watcher() i=7 2024-09-12T18:00:24.200 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:00:24.228 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:24.229 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:24.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.263+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 20 realm 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.264+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.265+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.265+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.265+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.266+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.266+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:24.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.266+0000 7faf24328800 20 searching for the correct realm 2024-09-12T18:00:24.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.269+0000 7faf2075e640 0 -- 172.21.15.94:0/884729325 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7faf08048920 msgr2=0x7faf0803a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.272+0000 7faf1ff5d640 0 -- 172.21.15.94:0/884729325 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7faf0802d8f0 msgr2=0x7faf0800d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:24.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:24.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:24.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.478+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 zone default found 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 4 Realm: () 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:24.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 zonegroup default 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.479+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.480+0000 7faf24328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.480+0000 7faf24328800 20 started sync module instance, tier type = 2024-09-12T18:00:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.480+0000 7faf24328800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:24.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=0 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=1 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=2 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=3 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=4 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=5 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.488+0000 7faf24328800 20 add_watcher() i=6 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.489+0000 7faf24328800 20 add_watcher() i=7 2024-09-12T18:00:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.489+0000 7faf24328800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:24.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.491+0000 7fadd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.491+0000 7faf24328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:24.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.491+0000 7faf24328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:24.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7faf24328800 5 note: GC not initialized 2024-09-12T18:00:24.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7fadd4fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:24.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7faf24328800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:24.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7faf24328800 20 Filter name: none 2024-09-12T18:00:24.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7fad4e7fc640 20 reqs_thread_entry: start 2024-09-12T18:00:24.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7faf24328800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:24.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.492+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:24.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:24.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:24.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:24.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.493+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:24.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:24.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:24.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.494+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:24.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.495+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.496+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.497+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.497+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.497+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.497+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.498+0000 7faf24328800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:24.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.498+0000 7faf24328800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:24.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.499+0000 7fadd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.501+0000 7faf24328800 20 remove_watcher() i=0 2024-09-12T18:00:24.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.501+0000 7faf24328800 2 removed watcher, disabling cache 2024-09-12T18:00:24.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.502+0000 7faf24328800 20 remove_watcher() i=1 2024-09-12T18:00:24.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.503+0000 7faf24328800 20 remove_watcher() i=2 2024-09-12T18:00:24.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.504+0000 7faf24328800 20 remove_watcher() i=3 2024-09-12T18:00:24.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.505+0000 7faf24328800 20 remove_watcher() i=4 2024-09-12T18:00:24.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.506+0000 7faf24328800 20 remove_watcher() i=5 2024-09-12T18:00:24.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.507+0000 7faf24328800 20 remove_watcher() i=6 2024-09-12T18:00:24.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.508+0000 7faf24328800 20 remove_watcher() i=7 2024-09-12T18:00:24.522 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:00:24.550 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:24.550 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:24.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.584+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 realm 2024-09-12T18:00:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.586+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.587+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.587+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.588+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:24.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.588+0000 7f8cbd440800 20 searching for the correct realm 2024-09-12T18:00:24.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.591+0000 7f8cbb72b640 0 -- 172.21.15.94:0/4055440892 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f8cb0015030 msgr2=0x7f8cb0069040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:24.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.595+0000 7f8cbaf2a640 0 -- 172.21.15.94:0/4055440892 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8cb006b5a0 msgr2=0x7f8cb00158a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.801+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:24.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 zone default found 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 4 Realm: () 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 zonegroup default 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.802+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.803+0000 7f8cbd440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.803+0000 7f8cbd440800 20 started sync module instance, tier type = 2024-09-12T18:00:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.803+0000 7f8cbd440800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=0 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=1 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=2 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=3 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=4 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=5 2024-09-12T18:00:24.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.812+0000 7f8cbd440800 20 add_watcher() i=6 2024-09-12T18:00:24.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.813+0000 7f8cbd440800 20 add_watcher() i=7 2024-09-12T18:00:24.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.813+0000 7f8cbd440800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:24.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.814+0000 7f8b717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 5 note: GC not initialized 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8aebfff640 20 reqs_thread_entry: start 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 20 Filter name: none 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8ae9ffb640 20 reqs_thread_entry: start 2024-09-12T18:00:24.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.815+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.816+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:24.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.816+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.816+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:24.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.816+0000 7f8cbd440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.816+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.817+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.817+0000 7f8cbd440800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.817+0000 7f8cbd440800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.817+0000 7f8cbd440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:24.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.819+0000 7f8b717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:24.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.821+0000 7f8cbd440800 20 remove_watcher() i=0 2024-09-12T18:00:24.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.821+0000 7f8cbd440800 2 removed watcher, disabling cache 2024-09-12T18:00:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.822+0000 7f8cbd440800 20 remove_watcher() i=1 2024-09-12T18:00:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.823+0000 7f8cbd440800 20 remove_watcher() i=2 2024-09-12T18:00:24.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.824+0000 7f8cbd440800 20 remove_watcher() i=3 2024-09-12T18:00:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.825+0000 7f8cbd440800 20 remove_watcher() i=4 2024-09-12T18:00:24.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.826+0000 7f8cbd440800 20 remove_watcher() i=5 2024-09-12T18:00:24.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.827+0000 7f8cbd440800 20 remove_watcher() i=6 2024-09-12T18:00:24.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.827+0000 7f8cbd440800 20 remove_watcher() i=7 2024-09-12T18:00:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries should be purged before reshard 2024-09-12T18:00:24.841 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:00:24.870 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:24.870 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.904+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 realm 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.906+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.907+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:24.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.907+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:24.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.908+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:24.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.908+0000 7feaa7b17800 20 searching for the correct realm 2024-09-12T18:00:24.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.911+0000 7feaa5e02640 0 -- 172.21.15.94:0/438956195 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fea90037060 msgr2=0x7fea90067180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:24.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:24.914+0000 7feaa5601640 0 -- 172.21.15.94:0/438956195 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fea90068710 msgr2=0x7fea90066880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.120+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 zone default found 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 4 Realm: () 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 zonegroup default 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.121+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 started sync module instance, tier type = 2024-09-12T18:00:25.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.122+0000 7feaa7b17800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=0 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=1 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=2 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=3 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=4 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=5 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.131+0000 7feaa7b17800 20 add_watcher() i=6 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.132+0000 7feaa7b17800 20 add_watcher() i=7 2024-09-12T18:00:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.132+0000 7feaa7b17800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.134+0000 7fe95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.134+0000 7feaa7b17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.134+0000 7feaa7b17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.134+0000 7feaa7b17800 5 note: GC not initialized 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7fe95a7e4640 20 reqs_thread_entry: start 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7feaa7b17800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7feaa7b17800 20 Filter name: none 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7fe8cbfff640 20 reqs_thread_entry: start 2024-09-12T18:00:25.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.135+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:25.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.136+0000 7feaa7b17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.138+0000 7fe95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.141+0000 7feaa7b17800 20 remove_watcher() i=0 2024-09-12T18:00:25.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.141+0000 7feaa7b17800 2 removed watcher, disabling cache 2024-09-12T18:00:25.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.142+0000 7feaa7b17800 20 remove_watcher() i=1 2024-09-12T18:00:25.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.143+0000 7feaa7b17800 20 remove_watcher() i=2 2024-09-12T18:00:25.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.144+0000 7feaa7b17800 20 remove_watcher() i=3 2024-09-12T18:00:25.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.145+0000 7feaa7b17800 20 remove_watcher() i=4 2024-09-12T18:00:25.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.146+0000 7feaa7b17800 20 remove_watcher() i=5 2024-09-12T18:00:25.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.147+0000 7feaa7b17800 20 remove_watcher() i=6 2024-09-12T18:00:25.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.148+0000 7feaa7b17800 20 remove_watcher() i=7 2024-09-12T18:00:25.160 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:00:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T18:00:25.160 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.162 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:00:25.195 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:25.195 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:25.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.229+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 realm 2024-09-12T18:00:25.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.232+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.232+0000 7f216b014800 20 searching for the correct realm 2024-09-12T18:00:25.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.236+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x562c92ca4ae0 msgr2=0x562c92ca6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.239+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f215808b040 msgr2=0x7f2158061810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 zone default found 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 4 Realm: () 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 zonegroup default 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.245+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.245+0000 7f216b014800 20 started sync module instance, tier type = 2024-09-12T18:00:25.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.245+0000 7f216b014800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=0 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=1 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=2 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=3 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=4 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=5 2024-09-12T18:00:25.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=6 2024-09-12T18:00:25.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=7 2024-09-12T18:00:25.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.254+0000 7f216b014800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.256+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.256+0000 7f216b014800 5 note: GC not initialized 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f1f977fe640 20 reqs_thread_entry: start 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 20 Filter name: none 2024-09-12T18:00:25.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f1f957fa640 20 reqs_thread_entry: start 2024-09-12T18:00:25.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:25.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:25.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.258+0000 7f216b014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:25.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f216b014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f216b014800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529749 cookie 94749441344400 notifier 8193 bl.length()=827 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:25.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:25.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:25.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:25.271 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f216b014800 time 2024-09-12T18:00:25.271620+0000 2024-09-12T18:00:25.271 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:25.272 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.272 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f216c18c71a] 2024-09-12T18:00:25.272 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.272 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.272 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.273 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:00:25.273 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.273 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:00:25.273 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:00:25.273 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:00:25.274 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f216b014800 thread_name:radosgw-admin 2024-09-12T18:00:25.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.270+0000 7f216b014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f216b014800 time 2024-09-12T18:00:25.271620+0000 2024-09-12T18:00:25.274 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:25.274 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f216c18c71a] 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:00:25.275 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:00:25.276 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.298 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f216ae3e6f0] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f216ae8b99c] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f216c18c774] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:00:25.299 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.271+0000 7f216b014800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f216b014800 thread_name:radosgw-admin 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f216ae3e6f0] 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f216ae8b99c] 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f216c18c774] 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.300 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:00:25.214+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.301 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.302 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.303 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: starting msgr at 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: starting objecter 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:00:25.214+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests hook 0x562c92bc1030 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: setting wanted keys 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: calling monclient init 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.304 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:00:25.215+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key hook 0x562c92bb9548 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:25.305 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92af5790 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92afed40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92aff880 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.730145s 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92afed40 auth_method 0 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.306 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92af5790 auth_method 0 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92aff880 auth_method 0 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.307 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_done global_id 7730 payload 824 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:00:25.215+0000 7f21666cb640 1 monclient: found mon.noname-c 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: dump: 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.308 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: dump: 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.309 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:00:25.215+0000 7f216b014800 5 monclient: authenticate success, global_id 7730 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.310 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:00:25.215+0000 7f2054608640 4 set_mon_vals no callback set 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:00:25.215+0000 7f216b014800 1 librados: init done 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:00:25.217+0000 7f215deca640 10 monclient: get_auth_request con 0x7f204c076470 auth_method 0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:00:25.218+0000 7f2166ecc640 10 monclient: get_auth_request con 0x562c92be2120 auth_method 0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:00:25.218+0000 7f21666cb640 10 monclient: get_auth_request con 0x562c92c044e0 auth_method 0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:00:25.220+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92c09a50 auth_method 0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:00:25.220+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:00:25.220+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:00:25.220+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.311 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.312 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.313 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:00:25.221+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests cmddesc objecter_requests hook 0x562c92c10c80 EEXIST 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.314 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:00:25.221+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x562c92c0c9d0 EEXIST 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c3ae10 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c35890 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c36460 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.315 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.736867s 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c36460 auth_method 0 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c35890 auth_method 0 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.316 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c3ae10 auth_method 0 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.317 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8187 payload 824 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:00:25.222+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: dump: 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.318 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.319 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: dump: 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:00:25.222+0000 7f216b014800 5 monclient: authenticate success, global_id 8187 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.320 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:00:25.222+0000 7f21676cd640 4 set_mon_vals no callback set 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:00:25.224+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f20400763b0 auth_method 0 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: get_monmap_and_config 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:00:25.224+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.321 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.322 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.323 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.324 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:00:25.225+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x7ffcebbdea28 EEXIST 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c8a530 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c84b50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c85f00 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.740717s 2024-09-12T18:00:25.325 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c84b50 auth_method 0 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c85f00 auth_method 0 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.326 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c8a530 auth_method 0 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8190 payload 274 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:00:25.226+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:00:25.226+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:00:25.226+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.327 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: dump: 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.328 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: dump: 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.329 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:00:25.226+0000 7f216b014800 5 monclient: authenticate success, global_id 8190 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:00:25.226+0000 7f216b014800 4 set_mon_vals no callback set 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: shutdown 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:00:25.226+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.331 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: starting msgr at 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: starting objecter 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:00:25.227+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests cmddesc objecter_requests hook 0x562c92c5bcd0 EEXIST 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: setting wanted keys 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: calling monclient init 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.332 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.333 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:00:25.227+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x562c92a43b28 EEXIST 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c85f00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c8a530 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c7a570 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.742884s 2024-09-12T18:00:25.334 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c8a530 auth_method 0 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c7a570 auth_method 0 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c85f00 auth_method 0 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.335 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8193 payload 824 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:00:25.228+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.336 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: dump: 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.337 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: dump: 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:00:25.228+0000 7f216b014800 5 monclient: authenticate success, global_id 8193 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:00:25.228+0000 7f2049ffb640 4 set_mon_vals no callback set 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:00:25.228+0000 7f216b014800 1 librados: init done 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:00:25.228+0000 7f216b014800 5 asok(0x562c92998730) register_command cr dump hook 0x562c92c89b98 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:00:25.229+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.339 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:00:25.230+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f2030076470 auth_method 0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:00:25.230+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92ca4ae0 auth_method 0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:00:25.231+0000 7f216b014800 20 realm 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:00:25.231+0000 7f216b014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:00:25.231+0000 7f21666cb640 10 monclient: get_auth_request con 0x562c92ca8e00 auth_method 0 2024-09-12T18:00:25.340 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:00:25.232+0000 7f216b014800 20 searching for the correct realm 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:00:25.232+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92cadf70 auth_method 0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:00:25.233+0000 7f2166ecc640 10 monclient: get_auth_request con 0x7f2150085040 auth_method 0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:00:25.234+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f2160029060 auth_method 0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:00:25.235+0000 7f215deca640 10 monclient: get_auth_request con 0x7f215808b040 auth_method 0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:00:25.236+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x562c92ca4ae0 msgr2=0x562c92ca6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:00:25.236+0000 7f2037fff640 1 client.8193.objecter ms_handle_reset 0x562c92ca4ae0 session 0x562c92ca4410 osd.1 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:00:25.236+0000 7f2037fff640 10 monclient: _renew_subs 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:00:25.236+0000 7f2037fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:00:25.236+0000 7f215deca640 10 monclient: get_auth_request con 0x7f2030086b90 auth_method 0 2024-09-12T18:00:25.341 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:00:25.237+0000 7f2166ecc640 10 monclient: get_auth_request con 0x7f2150095930 auth_method 0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:00:25.239+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f215006d450 auth_method 0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:00:25.239+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f215808b040 msgr2=0x7f2158061810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:00:25.239+0000 7f2037fff640 1 client.8193.objecter ms_handle_reset 0x7f215808b040 session 0x7f2158096040 osd.4 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:00:25.240+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92ca4ae0 auth_method 0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.342 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:00:25.244+0000 7f216b014800 20 zone default found 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:00:25.244+0000 7f216b014800 4 Realm: () 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:00:25.244+0000 7f216b014800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:00:25.244+0000 7f216b014800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:00:25.244+0000 7f216b014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:00:25.244+0000 7f216b014800 20 zonegroup default 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.343 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:00:25.245+0000 7f216b014800 20 started sync module instance, tier type = 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:00:25.245+0000 7f216b014800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=0 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=1 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=2 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=3 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=4 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=5 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=6 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=7 2024-09-12T18:00:25.344 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:00:25.254+0000 7f216b014800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.345 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:00:25.256+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:00:25.256+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache list hook 0x562c92c80c30 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache inspect hook 0x562c92c80c30 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache erase hook 0x562c92c80c30 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache zap hook 0x562c92c80c30 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:00:25.256+0000 7f216b014800 5 note: GC not initialized 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:00:25.257+0000 7f1f977fe640 20 reqs_thread_entry: start 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace show hook 0x7f2158064040 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace history hook 0x7f2158064040 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace active hook 0x7f2158064040 2024-09-12T18:00:25.346 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace active_short hook 0x7f2158064040 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:00:25.257+0000 7f216b014800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:00:25.257+0000 7f216b014800 20 Filter name: none 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:00:25.257+0000 7f1f957fa640 20 reqs_thread_entry: start 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:00:25.257+0000 7f216b014800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:00:25.258+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:00:25.258+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:00:25.258+0000 7f216b014800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.347 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:00:25.258+0000 7f216b014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:00:25.263+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:00:25.263+0000 7f216b014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:00:25.263+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:00:25.263+0000 7f216b014800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529749 cookie 94749441344400 notifier 8193 bl.length()=827 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:25.348 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:00:25.270+0000 7f216b014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f216b014800 time 2024-09-12T18:00:25.271620+0000 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f216c18c71a] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:00:25.349 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:00:25.271+0000 7f216b014800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f216b014800 thread_name:radosgw-admin 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f216ae3e6f0] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f216ae8b99c] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f216c18c774] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.350 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:00:25.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:25.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:00:25.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:00:25.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:00:25.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:25.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:25.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:25.358 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1f957fa640 / http_manager 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1f977fe640 / http_manager 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f201cfe1640 / rgw_dt_lg_renew 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2037fff640 / ms_dispatch 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2049ffb640 / io_context_pool 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f204bfff640 / ms_dispatch 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2052e05640 / ms_dispatch 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2054608640 / io_context_pool 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f215deca640 / msgr-worker-2 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f21666cb640 / msgr-worker-1 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2166ecc640 / msgr-worker-0 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f21676cd640 / io_context_pool 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f216b014800 / radosgw-admin 2024-09-12T18:00:25.359 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.150087.log 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:00:25.214+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding auth protocol: cephx 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.361 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: crc 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bbea90) adding con mode: secure 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: starting msgr at 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: starting objecter 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:00:25.214+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests hook 0x562c92bc1030 2024-09-12T18:00:25.362 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: setting wanted keys 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:00:25.214+0000 7f216b014800 1 librados: calling monclient init 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:00:25.214+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding auth protocol: cephx 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: crc 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:00:25.214+0000 7f216b014800 5 AuthRegistry(0x562c92bb9400) adding con mode: secure 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:00:25.214+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:00:25.215+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key hook 0x562c92bb9548 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92af5790 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92afed40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.364 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92aff880 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.730145s 2024-09-12T18:00:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92afed40 auth_method 0 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92af5790 auth_method 0 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.366 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:00:25.215+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92aff880 auth_method 0 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:00:25.215+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient(hunting): handle_auth_done global_id 7730 payload 824 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:00:25.215+0000 7f21666cb640 1 monclient: found mon.noname-c 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:00:25.215+0000 7f21666cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:25.367 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: dump: 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.368 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:00:25.215+0000 7f2052e05640 10 monclient: dump: 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.369 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:00:25.215+0000 7f216b014800 5 monclient: authenticate success, global_id 7730 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:00:25.215+0000 7f2054608640 4 set_mon_vals no callback set 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:00:25.215+0000 7f216b014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:00:25.215+0000 7f216b014800 1 librados: init done 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:00:25.217+0000 7f2052e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.370 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:00:25.217+0000 7f215deca640 10 monclient: get_auth_request con 0x7f204c076470 auth_method 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:00:25.218+0000 7f2166ecc640 10 monclient: get_auth_request con 0x562c92be2120 auth_method 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:00:25.218+0000 7f21666cb640 10 monclient: get_auth_request con 0x562c92c044e0 auth_method 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:00:25.220+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92c09a50 auth_method 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:00:25.220+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:00:25.220+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:00:25.220+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.371 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding auth protocol: cephx 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: crc 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:00:25.220+0000 7f216b014800 5 AuthRegistry(0x562c92c0d7a0) adding con mode: secure 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:00:25.221+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests cmddesc objecter_requests hook 0x562c92c10c80 EEXIST 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding auth protocol: cephx 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.373 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.374 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: crc 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:00:25.221+0000 7f216b014800 5 AuthRegistry(0x562c92c0c888) adding con mode: secure 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:00:25.221+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:00:25.221+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x562c92c0c9d0 EEXIST 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c3ae10 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c35890 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c36460 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.375 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:00:25.221+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.736867s 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c36460 auth_method 0 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:00:25.221+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c35890 auth_method 0 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:00:25.221+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.376 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c3ae10 auth_method 0 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:00:25.222+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:00:25.222+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8187 payload 824 2024-09-12T18:00:25.377 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:00:25.222+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:00:25.222+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: dump: 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.378 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:00:25.222+0000 7f204bfff640 10 monclient: dump: 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.379 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:00:25.222+0000 7f216b014800 5 monclient: authenticate success, global_id 8187 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:00:25.222+0000 7f21676cd640 4 set_mon_vals no callback set 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:00:25.222+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.380 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:00:25.224+0000 7f204bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:00:25.224+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f20400763b0 auth_method 0 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: get_monmap_and_config 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:00:25.224+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:00:25.224+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.381 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding auth protocol: cephx 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.382 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: crc 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:00:25.224+0000 7f216b014800 5 AuthRegistry(0x562c92c56070) adding con mode: secure 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.383 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding auth protocol: cephx 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.384 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: crc 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:00:25.225+0000 7f216b014800 5 AuthRegistry(0x7ffcebbde8e0) adding con mode: secure 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:00:25.225+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:00:25.225+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x7ffcebbdea28 EEXIST 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c8a530 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c84b50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c85f00 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.385 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:00:25.225+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.740717s 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c84b50 auth_method 0 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c85f00 auth_method 0 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.386 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:00:25.225+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c8a530 auth_method 0 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:00:25.225+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:00:25.225+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8190 payload 274 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:00:25.226+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:00:25.226+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:00:25.226+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.387 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: dump: 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.388 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:00:25.226+0000 7f2049ffb640 10 monclient: dump: 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.389 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:00:25.226+0000 7f216b014800 5 monclient: authenticate success, global_id 8190 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:00:25.226+0000 7f216b014800 4 set_mon_vals no callback set 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: shutdown 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: build_initial_monmap 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:00:25.226+0000 7f216b014800 1 build_initial for_mkfs: 0 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:00:25.226+0000 7f216b014800 10 monclient: monmap: 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding auth protocol: cephx 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.391 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: crc 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:00:25.226+0000 7f216b014800 5 AuthRegistry(0x562c92c59c60) adding con mode: secure 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: starting msgr at 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: starting objecter 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:00:25.227+0000 7f216b014800 5 asok(0x562c92998730) register_command objecter_requests cmddesc objecter_requests hook 0x562c92c5bcd0 EEXIST 2024-09-12T18:00:25.392 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: setting wanted keys 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:00:25.227+0000 7f216b014800 1 librados: calling monclient init 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: init 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding auth protocol: cephx 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.393 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: crc 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:00:25.227+0000 7f216b014800 5 AuthRegistry(0x562c92a439e0) adding con mode: secure 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:00:25.227+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:00:25.227+0000 7f216b014800 5 asok(0x562c92998730) register_command rotate-key cmddesc rotate-key hook 0x562c92a43b28 EEXIST 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-b con 0x562c92c85f00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:25.394 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-c con 0x562c92c8a530 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): picked mon.noname-a con 0x562c92c7a570 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:00:25.227+0000 7f216b014800 10 monclient(hunting): authenticate will time out at 2298.742884s 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): get_auth_request con 0x562c92c8a530 auth_method 0 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:00:25.227+0000 7f215deca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): get_auth_request con 0x562c92c7a570 auth_method 0 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.395 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): get_auth_request con 0x562c92c85f00 auth_method 0 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:00:25.228+0000 7f215deca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.396 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:00:25.228+0000 7f21666cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient(hunting): handle_auth_done global_id 8193 payload 824 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient: _finish_hunting 0 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:00:25.228+0000 7f2166ecc640 1 monclient: found mon.noname-a 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:00:25.228+0000 7f2166ecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: dump: 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.397 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: _finish_auth 0 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:25.398 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:00:25.228+0000 7f2037fff640 10 monclient: dump: 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.399 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:00:25.228+0000 7f216b014800 5 monclient: authenticate success, global_id 8193 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:00:25.228+0000 7f2049ffb640 4 set_mon_vals no callback set 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _renew_subs 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:00:25.228+0000 7f216b014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:00:25.228+0000 7f216b014800 1 librados: init done 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:00:25.228+0000 7f216b014800 5 asok(0x562c92998730) register_command cr dump hook 0x562c92c89b98 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:00:25.229+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:00:25.230+0000 7f2037fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:00:25.230+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f2030076470 auth_method 0 2024-09-12T18:00:25.400 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:00:25.230+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92ca4ae0 auth_method 0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:00:25.231+0000 7f216b014800 20 realm 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:00:25.231+0000 7f216b014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:00:25.231+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:00:25.231+0000 7f21666cb640 10 monclient: get_auth_request con 0x562c92ca8e00 auth_method 0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.401 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:00:25.232+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:00:25.232+0000 7f216b014800 20 searching for the correct realm 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:00:25.232+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92cadf70 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:00:25.233+0000 7f2166ecc640 10 monclient: get_auth_request con 0x7f2150085040 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:00:25.234+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f2160029060 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:00:25.235+0000 7f215deca640 10 monclient: get_auth_request con 0x7f215808b040 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:00:25.236+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x562c92ca4ae0 msgr2=0x562c92ca6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:00:25.236+0000 7f2037fff640 1 client.8193.objecter ms_handle_reset 0x562c92ca4ae0 session 0x562c92ca4410 osd.1 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:00:25.236+0000 7f2037fff640 10 monclient: _renew_subs 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:00:25.236+0000 7f2037fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:00:25.236+0000 7f215deca640 10 monclient: get_auth_request con 0x7f2030086b90 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:00:25.237+0000 7f2166ecc640 10 monclient: get_auth_request con 0x7f2150095930 auth_method 0 2024-09-12T18:00:25.402 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:00:25.239+0000 7f21666cb640 10 monclient: get_auth_request con 0x7f215006d450 auth_method 0 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:00:25.239+0000 7f215deca640 0 -- 172.21.15.94:0/818749522 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f215808b040 msgr2=0x7f2158061810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:00:25.239+0000 7f2037fff640 1 client.8193.objecter ms_handle_reset 0x7f215808b040 session 0x7f2158096040 osd.4 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:00:25.240+0000 7f215deca640 10 monclient: get_auth_request con 0x562c92ca4ae0 auth_method 0 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:00:25.243+0000 7f216b014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.403 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:00:25.243+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:00:25.244+0000 7f216b014800 20 zone default found 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:00:25.244+0000 7f216b014800 4 Realm: () 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:00:25.244+0000 7f216b014800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:00:25.244+0000 7f216b014800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:00:25.244+0000 7f216b014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:00:25.244+0000 7f216b014800 20 zonegroup default 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.404 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:00:25.244+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:00:25.245+0000 7f216b014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:00:25.245+0000 7f216b014800 20 started sync module instance, tier type = 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:00:25.245+0000 7f216b014800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=0 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=1 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=2 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=3 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=4 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=5 2024-09-12T18:00:25.405 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=6 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:00:25.254+0000 7f216b014800 20 add_watcher() i=7 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:00:25.254+0000 7f216b014800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding auth protocol: cephx 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.406 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: crc 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:00:25.256+0000 7f216b014800 5 AuthRegistry(0x7ffcebbdedb0) adding con mode: secure 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:00:25.256+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:00:25.256+0000 7f216b014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:00:25.256+0000 7f216b014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache list hook 0x562c92c80c30 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache inspect hook 0x562c92c80c30 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache erase hook 0x562c92c80c30 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:00:25.256+0000 7f216b014800 5 asok(0x562c92998730) register_command cache zap hook 0x562c92c80c30 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:00:25.256+0000 7f216b014800 5 note: GC not initialized 2024-09-12T18:00:25.407 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:00:25.257+0000 7f1f977fe640 20 reqs_thread_entry: start 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace show hook 0x7f2158064040 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace history hook 0x7f2158064040 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace active hook 0x7f2158064040 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:00:25.257+0000 7f216b014800 5 asok(0x562c92998730) register_command sync trace active_short hook 0x7f2158064040 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:00:25.257+0000 7f216b014800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:00:25.257+0000 7f216b014800 20 Filter name: none 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:00:25.257+0000 7f1f957fa640 20 reqs_thread_entry: start 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.408 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:00:25.257+0000 7f216b014800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:00:25.257+0000 7f216b014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:00:25.257+0000 7f216b014800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:00:25.258+0000 7f216b014800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:00:25.258+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:00:25.258+0000 7f216b014800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:00:25.258+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:00:25.258+0000 7f216b014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:00:25.263+0000 7f216b014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:00:25.263+0000 7f216b014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:00:25.263+0000 7f216b014800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.409 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:00:25.263+0000 7f216b014800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529749 cookie 94749441344400 notifier 8193 bl.length()=827 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:00:25.263+0000 7f2049ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:00:25.265+0000 7f216b014800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:00:25.270+0000 7f216b014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f216b014800 time 2024-09-12T18:00:25.271620+0000 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.410 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f216c18c71a] 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:00:25.271+0000 7f216b014800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f216b014800 thread_name:radosgw-admin 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.411 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f216ae3e6f0] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f216ae8b99c] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f216c18c774] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f216c18c8d8] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c91e0e841] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562c91e1e57a] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f216ae29590] 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:00:25.412 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:25.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:25.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:00:25.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:00:25.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:00:25.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:25.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:25.419 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1f957fa640 / http_manager 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1f977fe640 / http_manager 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f201cfe1640 / rgw_dt_lg_renew 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2037fff640 / ms_dispatch 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2049ffb640 / io_context_pool 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f204bfff640 / ms_dispatch 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2052e05640 / ms_dispatch 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2054608640 / io_context_pool 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f215deca640 / msgr-worker-2 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f21666cb640 / msgr-worker-1 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2166ecc640 / msgr-worker-0 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f21676cd640 / io_context_pool 2024-09-12T18:00:25.420 INFO:tasks.workunit.client.0.smithi094.stderr: 7f216b014800 / radosgw-admin 2024-09-12T18:00:25.421 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:00:25.421 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:00:25.421 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:00:25.273009Z_a96462bc-2b20-46e0-b98b-0c3f5e7b8b9a/log 2024-09-12T18:00:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:00:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.345+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 realm 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.347+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.348+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.348+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.348+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.348+0000 7fce95946800 20 searching for the correct realm 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.352+0000 7fce92c36640 0 -- 172.21.15.94:0/41792496 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5633a8222b70 msgr2=0x5633a8224f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.355+0000 7fce93437640 0 -- 172.21.15.94:0/41792496 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fce8806e560 msgr2=0x7fce88075630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 zone default found 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 4 Realm: () 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 zonegroup default 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.359+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 started sync module instance, tier type = 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.360+0000 7fce95946800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=0 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=1 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=2 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=3 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=4 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=5 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=6 2024-09-12T18:00:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 20 add_watcher() i=7 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.369+0000 7fce95946800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.371+0000 7fcd49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.371+0000 7fce95946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.371+0000 7fce95946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.371+0000 7fce95946800 5 note: GC not initialized 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fcd48fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fce95946800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fce95946800 20 Filter name: none 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fccc27fc640 20 reqs_thread_entry: start 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.372+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.373+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.373+0000 7fce95946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.373+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.373+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.373+0000 7fce95946800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.374+0000 7fce95946800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.374+0000 7fce95946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.376+0000 7fcd49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.378+0000 7fce95946800 20 remove_watcher() i=0 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.378+0000 7fce95946800 2 removed watcher, disabling cache 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.379+0000 7fce95946800 20 remove_watcher() i=1 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.380+0000 7fce95946800 20 remove_watcher() i=2 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.380+0000 7fce95946800 20 remove_watcher() i=3 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.381+0000 7fce95946800 20 remove_watcher() i=4 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.382+0000 7fce95946800 20 remove_watcher() i=5 2024-09-12T18:00:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.383+0000 7fce95946800 20 remove_watcher() i=6 2024-09-12T18:00:25.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.384+0000 7fce95946800 20 remove_watcher() i=7 2024-09-12T18:00:25.435 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:00:25.464 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:25.464 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:25.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.498+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 20 realm 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.499+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.500+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.500+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.500+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.500+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.501+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.501+0000 7f1eb0cbb800 20 searching for the correct realm 2024-09-12T18:00:25.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.504+0000 7f1eaefa6640 0 -- 172.21.15.94:0/2006582598 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x564deec446d0 msgr2=0x564deec46ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.508+0000 7f1ea5fa4640 0 -- 172.21.15.94:0/2006582598 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f1ea00443f0 msgr2=0x7f1ea0044810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.511+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 zone default found 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 4 Realm: () 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 zonegroup default 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.512+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.513+0000 7f1eb0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.513+0000 7f1eb0cbb800 20 started sync module instance, tier type = 2024-09-12T18:00:25.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.513+0000 7f1eb0cbb800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=0 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=1 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=2 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=3 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=4 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=5 2024-09-12T18:00:25.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.521+0000 7f1eb0cbb800 20 add_watcher() i=6 2024-09-12T18:00:25.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.522+0000 7f1eb0cbb800 20 add_watcher() i=7 2024-09-12T18:00:25.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.522+0000 7f1eb0cbb800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.523+0000 7f1d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 5 note: GC not initialized 2024-09-12T18:00:25.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1cdf7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 20 Filter name: none 2024-09-12T18:00:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1cdd7fa640 20 reqs_thread_entry: start 2024-09-12T18:00:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.524+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:25.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:25.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:25.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.525+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:25.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:25.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:25.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:25.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:25.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.526+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.527+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:25.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.528+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.529+0000 7f1eb0cbb800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.529+0000 7f1eb0cbb800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:25.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.530+0000 7f1d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.532+0000 7f1eb0cbb800 20 remove_watcher() i=0 2024-09-12T18:00:25.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.532+0000 7f1eb0cbb800 2 removed watcher, disabling cache 2024-09-12T18:00:25.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.533+0000 7f1eb0cbb800 20 remove_watcher() i=1 2024-09-12T18:00:25.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.534+0000 7f1eb0cbb800 20 remove_watcher() i=2 2024-09-12T18:00:25.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.535+0000 7f1eb0cbb800 20 remove_watcher() i=3 2024-09-12T18:00:25.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.536+0000 7f1eb0cbb800 20 remove_watcher() i=4 2024-09-12T18:00:25.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.537+0000 7f1eb0cbb800 20 remove_watcher() i=5 2024-09-12T18:00:25.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.538+0000 7f1eb0cbb800 20 remove_watcher() i=6 2024-09-12T18:00:25.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:25.539+0000 7f1eb0cbb800 20 remove_watcher() i=7 2024-09-12T18:00:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:00:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:55.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.660+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 realm 2024-09-12T18:00:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:55.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:55.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:55.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.663+0000 7f2fe2412800 20 searching for the correct realm 2024-09-12T18:00:55.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.666+0000 7f2fd7fff640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f2fd0072030 msgr2=0x7f2fd00a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:55.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:55.873+0000 7f2fddacb640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2fc800e910 msgr2=0x7f2fc800f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zone default found 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Realm: () 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zonegroup default 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started sync module instance, tier type = 2024-09-12T18:00:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=0 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=1 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=2 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=3 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=4 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=5 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=6 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.096+0000 7f2fe2412800 20 add_watcher() i=7 2024-09-12T18:00:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.096+0000 7f2fe2412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:56.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.097+0000 7f2e93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:56.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 5 note: GC not initialized 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2e92fe5640 20 reqs_thread_entry: start 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 20 Filter name: none 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2e90fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:56.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.099+0000 7f2fe2412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.101+0000 7f2fe2412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:00:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.109+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.109+0000 7f2fe2412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.109+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.109+0000 7f2fe2412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94054701438432 notifier 7787 bl.length()=827 2024-09-12T18:00:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:56.116 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2fe2412800 time 2024-09-12T18:00:56.116629+0000 2024-09-12T18:00:56.116 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:56.117 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.117 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2fe358c71a] 2024-09-12T18:00:56.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.117 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.117 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2fe2412800 thread_name:radosgw-admin 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.116+0000 7f2fe2412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2fe2412800 time 2024-09-12T18:00:56.116629+0000 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.118 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2fe358c71a] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T18:00:56.119 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.137 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.137 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2fe223e6f0] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2fe228b99c] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2fe358c774] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T18:00:56.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.117+0000 7f2fe2412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2fe2412800 thread_name:radosgw-admin 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2fe223e6f0] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2fe228b99c] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2fe358c774] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:00:55.641+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:00:55.641+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:00:55.641+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.140 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: dump: 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.141 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: dump: 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.142 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:00:55.642+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7775 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:00:55.642+0000 7f2fe2412800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:00:55.642+0000 7f2fe2412800 4 set_mon_vals no callback set 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: shutdown 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 asok(0x558ad0dfa730) unregister_commands rotate-key 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.144 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:00:55.643+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: starting msgr at 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: starting objecter 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests hook 0x558ad1023500 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: setting wanted keys 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: calling monclient init 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.145 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.146 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:00:55.643+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:00:55.644+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:00:55.644+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key hook 0x558ad101e768 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10248a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10482d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x7f2fcc002340 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.147 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.158301s 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10248a0 auth_method 0 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request con 0x558ad10482d0 auth_method 0 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.148 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:00:55.644+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:00:55.644+0000 7f2eca604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: dump: 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: dump: 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:00:55.645+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7778 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:00:55.645+0000 7f2ecbe07640 4 set_mon_vals no callback set 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.151 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:00:55.645+0000 7f2fe2412800 1 librados: init done 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:00:55.647+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2ec4076470 auth_method 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:00:55.647+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x558ad105e9e0 auth_method 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:00:55.648+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad106a040 auth_method 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:00:55.650+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad106f0d0 auth_method 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:00:55.650+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:00:55.650+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:00:55.650+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.152 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.153 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests cmddesc objecter_requests hook 0x558ad1076a70 EEXIST 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.154 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.155 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x558ad1072210 EEXIST 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad109a760 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad109ca30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad1098f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.165895s 2024-09-12T18:00:56.156 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad109a760 auth_method 0 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request con 0x558ad109ca30 auth_method 0 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad1098f30 auth_method 0 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.157 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:00:55.652+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: dump: 2024-09-12T18:00:56.158 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.159 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: dump: 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:00:55.652+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7781 2024-09-12T18:00:56.160 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:00:55.652+0000 7f2fdeacd640 4 set_mon_vals no callback set 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:00:55.654+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2eb8076380 auth_method 0 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: get_monmap_and_config 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:00:55.654+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.161 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.162 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.163 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.164 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x7ffe5056ceb8 EEXIST 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10ee460 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad10be270 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10e9820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.165 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.169823s 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10ee460 auth_method 0 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad10e9820 auth_method 0 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.166 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:00:55.656+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: dump: 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:00:55.656+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7784 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:00:55.656+0000 7f2fe2412800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:00:55.656+0000 7f2fe2412800 4 set_mon_vals no callback set 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.168 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: dump: 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: shutdown 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.169 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.173 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:00:55.657+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: starting msgr at 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: starting objecter 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests cmddesc objecter_requests hook 0x558ad10bdf70 EEXIST 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: setting wanted keys 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: calling monclient init 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.174 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:00:55.657+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.175 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:00:55.658+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:00:55.658+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x558ad10b2658 EEXIST 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10be270 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad10e9820 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10ee460 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.172232s 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10be270 auth_method 0 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.176 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad10ee460 auth_method 0 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.177 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:00:55.658+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:00:55.658+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad10e9820 auth_method 0 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: dump: 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.178 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: dump: 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:00:55.658+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7787 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:00:55.658+0000 7f2ec17fa640 4 set_mon_vals no callback set 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:00:55.659+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:00:55.659+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:00:55.659+0000 7f2fe2412800 1 librados: init done 2024-09-12T18:00:56.180 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:00:55.659+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cr dump hook 0x558ad10e7188 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:00:55.660+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:00:55.661+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2ea8076470 auth_method 0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:00:55.661+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x558ad1107930 auth_method 0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 realm 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:00:55.662+0000 7f2fe2412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.181 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:00:55.662+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad110bb60 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 searching for the correct realm 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:00:55.664+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad1110e20 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:00:55.664+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x7f2fc801b040 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:00:55.665+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad0ed1c20 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:00:55.666+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2fd0072030 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:00:55.666+0000 7f2fd7fff640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f2fd0072030 msgr2=0x7f2fd00a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:00:55.868+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2fd0072030 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:00:55.870+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x7f2fcc0030f0 auth_method 0 2024-09-12T18:00:56.182 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:00:55.873+0000 7f2fddacb640 10 monclient: get_auth_request con 0x7f2fc800e910 auth_method 0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:00:55.873+0000 7f2fddacb640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2fc800e910 msgr2=0x7f2fc800f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:00:56.075+0000 7f2fddacb640 10 monclient: get_auth_request con 0x7f2fc800e910 auth_method 0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.183 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zone default found 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Realm: () 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:00:56.083+0000 7f2fe2412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zonegroup default 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.184 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started sync module instance, tier type = 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=0 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=1 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=2 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=3 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=4 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=5 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=6 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:00:56.096+0000 7f2fe2412800 20 add_watcher() i=7 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:00:56.096+0000 7f2fe2412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.185 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:00:56.097+0000 7f2e93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:00:56.098+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.186 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache list hook 0x558ad10e4b60 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache inspect hook 0x558ad10e4b60 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache erase hook 0x558ad10e4b60 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache zap hook 0x558ad10e4b60 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 note: GC not initialized 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:00:56.098+0000 7f2e92fe5640 20 reqs_thread_entry: start 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace show hook 0x7f2fd00bf070 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace history hook 0x7f2fd00bf070 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace active hook 0x7f2fd00bf070 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace active_short hook 0x7f2fd00bf070 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 Filter name: none 2024-09-12T18:00:56.187 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:00:56.098+0000 7f2e90fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:00:56.098+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.188 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:00:56.101+0000 7f2fe2412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94054701438432 notifier 7787 bl.length()=827 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:56.189 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:00:56.116+0000 7f2fe2412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2fe2412800 time 2024-09-12T18:00:56.116629+0000 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2fe358c71a] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.190 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:00:56.117+0000 7f2fe2412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2fe2412800 thread_name:radosgw-admin 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2fe223e6f0] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2fe228b99c] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2fe358c774] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T18:00:56.191 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:00:56.192 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:56.193 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:00:56.194 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:56.195 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:00:56.196 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:56.197 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:56.198 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e90fe1640 / http_manager 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e92fe5640 / http_manager 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e93fe7640 / rgw_dt_lg_renew 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2eaf7fe640 / ms_dispatch 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec0ff9640 / io_context_pool 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec17fa640 / io_context_pool 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec37fe640 / ms_dispatch 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2eca604640 / ms_dispatch 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ecbe07640 / io_context_pool 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fd7fff640 / msgr-worker-2 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fddacb640 / msgr-worker-1 2024-09-12T18:00:56.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fde2cc640 / msgr-worker-0 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fdeacd640 / io_context_pool 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fe2412800 / radosgw-admin 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.151856.log 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:00:55.641+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:00:55.641+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:00:55.641+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.200 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:00:55.641+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: dump: 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.201 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:00:55.642+0000 7f2ecbe07640 10 monclient: dump: 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.202 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:00:55.642+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7775 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:00:55.642+0000 7f2fe2412800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:00:55.642+0000 7f2fe2412800 4 set_mon_vals no callback set 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: shutdown 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 asok(0x558ad0dfa730) unregister_commands rotate-key 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding auth protocol: cephx 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.204 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: crc 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad1023c60) adding con mode: secure 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:00:55.643+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: starting msgr at 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: starting objecter 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests hook 0x558ad1023500 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: setting wanted keys 2024-09-12T18:00:56.205 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:00:55.643+0000 7f2fe2412800 1 librados: calling monclient init 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:00:55.643+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding auth protocol: cephx 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.206 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: crc 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:00:55.643+0000 7f2fe2412800 5 AuthRegistry(0x558ad101e620) adding con mode: secure 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:00:55.643+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:00:55.644+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:00:55.644+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key hook 0x558ad101e768 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10248a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10482d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x7f2fcc002340 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.207 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:00:55.644+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.158301s 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10248a0 auth_method 0 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request con 0x558ad10482d0 auth_method 0 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.208 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:00:55.644+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:00:55.644+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:00:55.644+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:00:55.644+0000 7f2eca604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: dump: 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:00:55.645+0000 7f2eca604640 10 monclient: dump: 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.210 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:00:55.645+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7778 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:00:55.645+0000 7f2ecbe07640 4 set_mon_vals no callback set 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:00:55.645+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.211 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:00:55.645+0000 7f2fe2412800 1 librados: init done 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:00:55.646+0000 7f2eca604640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:00:55.647+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2ec4076470 auth_method 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:00:55.647+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x558ad105e9e0 auth_method 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:00:55.648+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad106a040 auth_method 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:00:55.650+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad106f0d0 auth_method 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:00:55.650+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:00:55.650+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:00:55.650+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding auth protocol: cephx 2024-09-12T18:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: crc 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:00:55.650+0000 7f2fe2412800 5 AuthRegistry(0x558ad1073080) adding con mode: secure 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.214 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests cmddesc objecter_requests hook 0x558ad1076a70 EEXIST 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding auth protocol: cephx 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.215 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: crc 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 AuthRegistry(0x558ad10720c8) adding con mode: secure 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:00:55.651+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:00:55.651+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x558ad1072210 EEXIST 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad109a760 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad109ca30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad1098f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.216 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:00:55.651+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.165895s 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad109a760 auth_method 0 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request con 0x558ad109ca30 auth_method 0 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.217 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad1098f30 auth_method 0 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:00:55.652+0000 7f2fd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:00:55.652+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:00:55.652+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.218 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:00:55.652+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: dump: 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.219 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:00:55.652+0000 7f2ec37fe640 10 monclient: dump: 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:00:55.652+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7781 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:00:55.652+0000 7f2fdeacd640 4 set_mon_vals no callback set 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:00:55.652+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:00:55.654+0000 7f2ec37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:00:55.654+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2eb8076380 auth_method 0 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: get_monmap_and_config 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.221 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:00:55.654+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:00:55.654+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.222 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding auth protocol: cephx 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: crc 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:00:55.654+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b9f00) adding con mode: secure 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.223 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding auth protocol: cephx 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.224 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: crc 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056cd70) adding con mode: secure 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:00:55.655+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:00:55.655+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x7ffe5056ceb8 EEXIST 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10ee460 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad10be270 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10e9820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.225 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:00:55.655+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.169823s 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10ee460 auth_method 0 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:00:55.655+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad10e9820 auth_method 0 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.226 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:00:55.656+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:00:55.656+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:00:55.656+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: dump: 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.227 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:00:55.656+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7784 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:00:55.656+0000 7f2fe2412800 10 monclient: get_monmap_and_config success 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:00:55.656+0000 7f2fe2412800 4 set_mon_vals no callback set 2024-09-12T18:00:56.228 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:00:55.656+0000 7f2ec17fa640 10 monclient: dump: 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: shutdown 2024-09-12T18:00:56.229 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: build_initial_monmap 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 build_initial for_mkfs: 0 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: monmap: 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.230 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding auth protocol: cephx 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: crc 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10bf0b0) adding con mode: secure 2024-09-12T18:00:56.231 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:00:55.657+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: starting msgr at 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: starting objecter 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command objecter_requests cmddesc objecter_requests hook 0x558ad10bdf70 EEXIST 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: setting wanted keys 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:00:55.657+0000 7f2fe2412800 1 librados: calling monclient init 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:00:55.657+0000 7f2fe2412800 10 monclient: init 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding auth protocol: cephx 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.232 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: crc 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:00:55.657+0000 7f2fe2412800 5 AuthRegistry(0x558ad10b2510) adding con mode: secure 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:00:55.657+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:00:55.658+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:00:55.658+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command rotate-key cmddesc rotate-key hook 0x558ad10b2658 EEXIST 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _reopen_session rank -1 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:00:56.233 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-c con 0x558ad10be270 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-b con 0x558ad10e9820 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): picked mon.noname-a con 0x558ad10ee460 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): _renew_subs 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient(hunting): authenticate will time out at 2329.172232s 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): get_auth_request con 0x558ad10be270 auth_method 0 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request con 0x558ad10ee460 auth_method 0 2024-09-12T18:00:56.234 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:00:55.658+0000 7f2fde2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient: _finish_hunting 0 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:00:55.658+0000 7f2fddacb640 1 monclient: found mon.noname-c 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:00:55.658+0000 7f2fddacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:00:55.658+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad10e9820 auth_method 0 2024-09-12T18:00:56.235 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: dump: 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: _finish_auth 0 2024-09-12T18:00:56.236 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:00:55.658+0000 7f2eaf7fe640 10 monclient: dump: 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:00:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:00:55.658+0000 7f2fe2412800 5 monclient: authenticate success, global_id 7787 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:00:55.658+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:00:55.658+0000 7f2ec17fa640 4 set_mon_vals no callback set 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:00:55.659+0000 7f2fe2412800 10 monclient: _renew_subs 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:00:55.659+0000 7f2fe2412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:00:55.659+0000 7f2fe2412800 1 librados: init done 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:00:55.659+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cr dump hook 0x558ad10e7188 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:00:55.660+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:00:55.660+0000 7f2eaf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:00:56.238 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:00:55.661+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2ea8076470 auth_method 0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:00:55.661+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x558ad1107930 auth_method 0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 realm 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:00:55.662+0000 7f2fe2412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:00:55.662+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:00:55.662+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad110bb60 auth_method 0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:56.239 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:00:55.663+0000 7f2fe2412800 20 searching for the correct realm 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:00:55.664+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x558ad1110e20 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:00:55.664+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x7f2fc801b040 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:00:55.665+0000 7f2fddacb640 10 monclient: get_auth_request con 0x558ad0ed1c20 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:00:55.666+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2fd0072030 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:00:55.666+0000 7f2fd7fff640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f2fd0072030 msgr2=0x7f2fd00a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:00:55.868+0000 7f2fd7fff640 10 monclient: get_auth_request con 0x7f2fd0072030 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:00:55.870+0000 7f2fde2cc640 10 monclient: get_auth_request con 0x7f2fcc0030f0 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:00:55.873+0000 7f2fddacb640 10 monclient: get_auth_request con 0x7f2fc800e910 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:00:55.873+0000 7f2fddacb640 0 -- 172.21.15.94:0/1775465102 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2fc800e910 msgr2=0x7f2fc800f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:00:56.075+0000 7f2fddacb640 10 monclient: get_auth_request con 0x7f2fc800e910 auth_method 0 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:56.240 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:00:56.082+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zone default found 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Realm: () 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:56.241 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:00:56.083+0000 7f2fe2412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:00:56.083+0000 7f2fe2412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 zonegroup default 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:00:56.083+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started sync module instance, tier type = 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:00:56.084+0000 7f2fe2412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=0 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=1 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=2 2024-09-12T18:00:56.242 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=3 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=4 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=5 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:00:56.094+0000 7f2fe2412800 20 add_watcher() i=6 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:00:56.096+0000 7f2fe2412800 20 add_watcher() i=7 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:00:56.096+0000 7f2fe2412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding auth protocol: cephx 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.243 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:00:56.097+0000 7f2e93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: crc 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:00:56.097+0000 7f2fe2412800 5 AuthRegistry(0x7ffe5056d240) adding con mode: secure 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:00:56.098+0000 7f2fe2412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache list hook 0x558ad10e4b60 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache inspect hook 0x558ad10e4b60 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache erase hook 0x558ad10e4b60 2024-09-12T18:00:56.244 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command cache zap hook 0x558ad10e4b60 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 note: GC not initialized 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:00:56.098+0000 7f2e92fe5640 20 reqs_thread_entry: start 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace show hook 0x7f2fd00bf070 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace history hook 0x7f2fd00bf070 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace active hook 0x7f2fd00bf070 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:00:56.098+0000 7f2fe2412800 5 asok(0x558ad0dfa730) register_command sync trace active_short hook 0x7f2fd00bf070 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 Filter name: none 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:00:56.098+0000 7f2e90fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:00:56.098+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:00:56.098+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:56.245 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:00:56.099+0000 7f2fe2412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:00:56.099+0000 7f2fe2412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:00:56.101+0000 7f2fe2412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.246 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:00:56.109+0000 7f2fe2412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94054701438432 notifier 7787 bl.length()=827 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:00:56.110+0000 7f2ec0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:00:56.112+0000 7f2fe2412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:00:56.116+0000 7f2fe2412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2fe2412800 time 2024-09-12T18:00:56.116629+0000 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2fe358c71a] 2024-09-12T18:00:56.247 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:00:56.117+0000 7f2fe2412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2fe2412800 thread_name:radosgw-admin 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:56.248 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2fe223e6f0] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2fe228b99c] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2fe358c774] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2fe358c8d8] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558acfe39841] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd7490c) [0x558ad034790c] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558acfe4950d] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2fe2229590] 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:56.249 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:56.250 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:00:56.251 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:00:56.252 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:00:56.253 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:56.254 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:00:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e90fe1640 / http_manager 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e92fe5640 / http_manager 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2e93fe7640 / rgw_dt_lg_renew 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2eaf7fe640 / ms_dispatch 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec0ff9640 / io_context_pool 2024-09-12T18:00:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec17fa640 / io_context_pool 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ec37fe640 / ms_dispatch 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2eca604640 / ms_dispatch 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2ecbe07640 / io_context_pool 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fd7fff640 / msgr-worker-2 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fddacb640 / msgr-worker-1 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fde2cc640 / msgr-worker-0 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fdeacd640 / io_context_pool 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2fe2412800 / radosgw-admin 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:00:56.118332Z_381bd8ef-0b42-4025-822e-c436af7d0a97/log 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:00:56.257 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.203+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.203+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.203+0000 7f60a2c0f800 20 realm 2024-09-12T18:00:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.203+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.204+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.204+0000 7f60a2c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.204+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.204+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.204+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.205+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.205+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.205+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.205+0000 7f60a2c0f800 20 searching for the correct realm 2024-09-12T18:00:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.207+0000 7f60a06f9640 0 -- 172.21.15.94:0/2950867687 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f6098073040 msgr2=0x7f6098059440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.414+0000 7f60a0efa640 0 -- 172.21.15.94:0/2950867687 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f608803b070 msgr2=0x7f6088068a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.420+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 zone default found 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 4 Realm: () 2024-09-12T18:00:56.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 zonegroup default 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.421+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.422+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.422+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.422+0000 7f60a2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.422+0000 7f60a2c0f800 20 started sync module instance, tier type = 2024-09-12T18:00:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.422+0000 7f60a2c0f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=0 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=1 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=2 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=3 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=4 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=5 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=6 2024-09-12T18:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 20 add_watcher() i=7 2024-09-12T18:00:56.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.432+0000 7f60a2c0f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f5f56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f60a2c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f60a2c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f60a2c0f800 5 note: GC not initialized 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f5f55fe3640 20 reqs_thread_entry: start 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f60a2c0f800 20 init_complete bucket index max shards: 11 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f60a2c0f800 20 Filter name: none 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.435+0000 7f5f4effd640 20 reqs_thread_entry: start 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:00:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:00:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.436+0000 7f60a2c0f800 20 rados->read ofs=0 len=0 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.437+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.438+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.438+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.438+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.438+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.439+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.439+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.439+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.439+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.440+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.441+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:00:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.442+0000 7f60a2c0f800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.442+0000 7f60a2c0f800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:00:56.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.443+0000 7f5f56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:56.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.445+0000 7f60a2c0f800 20 remove_watcher() i=0 2024-09-12T18:00:56.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.445+0000 7f60a2c0f800 2 removed watcher, disabling cache 2024-09-12T18:00:56.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.447+0000 7f60a2c0f800 20 remove_watcher() i=1 2024-09-12T18:00:56.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.448+0000 7f60a2c0f800 20 remove_watcher() i=2 2024-09-12T18:00:56.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.449+0000 7f60a2c0f800 20 remove_watcher() i=3 2024-09-12T18:00:56.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.450+0000 7f60a2c0f800 20 remove_watcher() i=4 2024-09-12T18:00:56.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.451+0000 7f60a2c0f800 20 remove_watcher() i=5 2024-09-12T18:00:56.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.452+0000 7f60a2c0f800 20 remove_watcher() i=6 2024-09-12T18:00:56.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:00:56.453+0000 7f60a2c0f800 20 remove_watcher() i=7 2024-09-12T18:00:56.464 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries can be purged manually 2024-09-12T18:01:26.493 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:26.526 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:26.526 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:26.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.568+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 realm 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.570+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.571+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:26.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.571+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.571+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:26.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.571+0000 7ffb2cf19800 20 searching for the correct realm 2024-09-12T18:01:26.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.575+0000 7ffb22202640 0 -- 172.21.15.94:0/2698831666 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55b0db747680 msgr2=0x55b0db749a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:26.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.579+0000 7ffb2aa03640 0 -- 172.21.15.94:0/2698831666 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7ffb14049b70 msgr2=0x7ffb14057960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:26.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:26.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:26.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:26.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.584+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:26.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 zone default found 2024-09-12T18:01:26.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 4 Realm: () 2024-09-12T18:01:26.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 zonegroup default 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 started sync module instance, tier type = 2024-09-12T18:01:26.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.585+0000 7ffb2cf19800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:26.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=0 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=1 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=2 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=3 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=4 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=5 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.594+0000 7ffb2cf19800 20 add_watcher() i=6 2024-09-12T18:01:26.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.595+0000 7ffb2cf19800 20 add_watcher() i=7 2024-09-12T18:01:26.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.595+0000 7ffb2cf19800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:26.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.597+0000 7ff9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.597+0000 7ffb2cf19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.597+0000 7ffb2cf19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ffb2cf19800 5 note: GC not initialized 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ff95bfff640 20 reqs_thread_entry: start 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ffb2cf19800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ffb2cf19800 20 Filter name: none 2024-09-12T18:01:26.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ff959ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:26.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.598+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.599+0000 7ffb2cf19800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.600+0000 7ffb2cf19800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.600+0000 7ffb2cf19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:26.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.602+0000 7ff9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.604+0000 7ffb2cf19800 20 remove_watcher() i=0 2024-09-12T18:01:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.604+0000 7ffb2cf19800 2 removed watcher, disabling cache 2024-09-12T18:01:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.605+0000 7ffb2cf19800 20 remove_watcher() i=1 2024-09-12T18:01:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.607+0000 7ffb2cf19800 20 remove_watcher() i=2 2024-09-12T18:01:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.608+0000 7ffb2cf19800 20 remove_watcher() i=3 2024-09-12T18:01:26.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.609+0000 7ffb2cf19800 20 remove_watcher() i=4 2024-09-12T18:01:26.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.609+0000 7ffb2cf19800 20 remove_watcher() i=5 2024-09-12T18:01:26.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.610+0000 7ffb2cf19800 20 remove_watcher() i=6 2024-09-12T18:01:26.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.611+0000 7ffb2cf19800 20 remove_watcher() i=7 2024-09-12T18:01:26.623 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:01:26.623 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T18:01:26.624 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:01:26.659 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:26.659 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:26.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.695+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 realm 2024-09-12T18:01:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:26.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:26.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.698+0000 7f02fc412800 20 searching for the correct realm 2024-09-12T18:01:26.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.701+0000 7f02f82cc640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f02e0082ad0 msgr2=0x7f02e008aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:26.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.706+0000 7f02f7acb640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f02e0021c30 msgr2=0x7f02e00789f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:26.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 zone default found 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 4 Realm: () 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 zonegroup default 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.915+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.915+0000 7f02fc412800 20 started sync module instance, tier type = 2024-09-12T18:01:26.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.915+0000 7f02fc412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:26.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=0 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=1 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=2 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=3 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=4 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=5 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=6 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.924+0000 7f02fc412800 20 add_watcher() i=7 2024-09-12T18:01:26.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.924+0000 7f02fc412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:26.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.926+0000 7f01adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:26.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:26.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:26.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 5 note: GC not initialized 2024-09-12T18:01:26.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f01acfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:26.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:26.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 20 Filter name: none 2024-09-12T18:01:26.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f01267fc640 20 reqs_thread_entry: start 2024-09-12T18:01:26.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:26.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.927+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:26.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.928+0000 7f02fc412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:26.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.930+0000 7f02fc412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:01:26.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:26.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f02fc412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:26.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:26.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f02fc412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:01:26.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94242930057664 notifier 7835 bl.length()=827 2024-09-12T18:01:26.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:26.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:26.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:26.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:01:26.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:01:26.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:01:26.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:01:26.945 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02fc412800 time 2024-09-12T18:01:26.945508+0000 2024-09-12T18:01:26.945 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02fd58c71a] 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:01:26.946 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f02fc412800 thread_name:radosgw-admin 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.945+0000 7f02fc412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02fc412800 time 2024-09-12T18:01:26.945508+0000 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02fd58c71a] 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:01:26.947 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02fc23e6f0] 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02fc28b99c] 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:01:26.966 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02fd58c774] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:26.945+0000 7f02fc412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f02fc412800 thread_name:radosgw-admin 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02fc23e6f0] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02fc28b99c] 2024-09-12T18:01:26.967 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02fd58c774] 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:01:26.678+0000 7f01e5e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:26.968 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:01:26.678+0000 7f01e5e0b640 10 monclient: dump: 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:01:26.678+0000 7f02fc412800 5 monclient: authenticate success, global_id 8283 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:01:26.678+0000 7f02fc412800 10 monclient: get_monmap_and_config success 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:01:26.678+0000 7f02fc412800 4 set_mon_vals no callback set 2024-09-12T18:01:26.969 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: shutdown 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 asok(0x55b6a42c9730) unregister_commands rotate-key 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:01:26.679+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.970 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:26.971 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: starting msgr at 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: starting objecter 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests hook 0x55b6a451cb90 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: setting wanted keys 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: calling monclient init 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.972 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key hook 0x55b6a44eb868 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:26.973 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a43983c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a442e560 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a4431440 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.194761s 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a43983c0 auth_method 0 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a442e560 auth_method 0 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.974 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a4431440 auth_method 0 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.975 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 1 monclient: found mon.noname-a 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: dump: 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.976 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: dump: 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.977 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:01:26.681+0000 7f02fc412800 5 monclient: authenticate success, global_id 8286 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:01:26.681+0000 7f01e5e0b640 4 set_mon_vals no callback set 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:01:26.681+0000 7f02fc412800 1 librados: init done 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:26.978 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:01:26.683+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01e0076470 auth_method 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:01:26.683+0000 7f02f82cc640 10 monclient: get_auth_request con 0x55b6a4513e60 auth_method 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:01:26.684+0000 7f02f7acb640 10 monclient: get_auth_request con 0x55b6a45366b0 auth_method 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:01:26.686+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x55b6a453bc40 auth_method 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:01:26.686+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:01:26.686+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:01:26.686+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.980 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests cmddesc objecter_requests hook 0x55b6a4543020 EEXIST 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.981 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x55b6a453ec50 EEXIST 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:26.982 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a4567340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a4567720 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a4566050 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.201998s 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a4567340 auth_method 0 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a4567720 auth_method 0 2024-09-12T18:01:26.983 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a4566050 auth_method 0 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T18:01:26.984 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 1 monclient: found mon.noname-a 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: dump: 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.985 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: dump: 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.986 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:01:26.688+0000 7f02fc412800 5 monclient: authenticate success, global_id 8289 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:01:26.688+0000 7f02f8acd640 4 set_mon_vals no callback set 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:01:26.690+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01d0076380 auth_method 0 2024-09-12T18:01:26.987 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: get_monmap_and_config 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:01:26.690+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.988 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:26.989 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:01:26.690+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.990 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:01:26.691+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:01:26.691+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x7ffc1052fd88 EEXIST 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a45bb6b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a458b4c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a45b6a70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.991 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.205530s 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a45bb6b0 auth_method 0 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a45b6a70 auth_method 0 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.992 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_done global_id 8292 payload 274 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient: _finish_hunting 0 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:01:26.691+0000 7f02f7acb640 1 monclient: found mon.noname-a 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: dump: 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.993 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: _finish_auth 0 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: dump: 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:26.994 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 monclient: authenticate success, global_id 8292 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: get_monmap_and_config success 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:01:26.692+0000 7f02fc412800 4 set_mon_vals no callback set 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: shutdown 2024-09-12T18:01:26.995 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:01:26.692+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:26.996 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:26.997 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: starting msgr at 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: starting objecter 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests cmddesc objecter_requests hook 0x55b6a45b5760 EEXIST 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: setting wanted keys 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: calling monclient init 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.998 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x55b6a457bd48 EEXIST 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:01:26.999 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a458b4c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a45b6a70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a45bb6b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.207852s 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a45b6a70 auth_method 0 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a45bb6b0 auth_method 0 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.000 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a458b4c0 auth_method 0 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.001 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 1 monclient: found mon.noname-c 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: dump: 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.002 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: dump: 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.003 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:01:26.694+0000 7f02fc412800 5 monclient: authenticate success, global_id 7835 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:01:26.694+0000 7f01d6ffd640 4 set_mon_vals no callback set 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:01:26.694+0000 7f02fc412800 1 librados: init done 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:01:26.694+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cr dump hook 0x55b6a45ad228 2024-09-12T18:01:27.004 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:01:26.695+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:01:26.696+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01c0076470 auth_method 0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:01:26.696+0000 7f02f82cc640 10 monclient: get_auth_request con 0x55b6a45d4fb0 auth_method 0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 realm 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:01:26.697+0000 7f02fc412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:01:26.697+0000 7f02f7acb640 10 monclient: get_auth_request con 0x55b6a45d9220 auth_method 0 2024-09-12T18:01:27.005 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 searching for the correct realm 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:01:26.699+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x55b6a45de590 auth_method 0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:01:26.699+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f02e0082ad0 auth_method 0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:01:26.700+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02f0018040 auth_method 0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:01:26.701+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x7f02e8087050 auth_method 0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:01:26.701+0000 7f02f82cc640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f02e0082ad0 msgr2=0x7f02e008aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:01:26.701+0000 7f01d57fa640 1 client.7835.objecter ms_handle_reset 0x7f02e0082ad0 session 0x7f02e0005040 osd.7 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:01:26.701+0000 7f01d57fa640 10 monclient: _renew_subs 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:01:26.701+0000 7f01d57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:01:26.701+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f01c0086b90 auth_method 0 2024-09-12T18:01:27.006 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:01:26.703+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f02e00697d0 auth_method 0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:01:26.705+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02e0021c30 auth_method 0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:01:26.706+0000 7f02f7acb640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f02e0021c30 msgr2=0x7f02e00789f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:01:26.907+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02e0021c30 auth_method 0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.007 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 zone default found 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 Realm: () 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:01:26.914+0000 7f02fc412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 zonegroup default 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 started sync module instance, tier type = 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:27.008 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=0 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=1 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=2 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=3 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=4 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=5 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=6 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:01:26.924+0000 7f02fc412800 20 add_watcher() i=7 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:01:26.924+0000 7f02fc412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.009 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:01:26.926+0000 7f01adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:01:26.927+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:27.010 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache list hook 0x55b6a4589f60 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache inspect hook 0x55b6a4589f60 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache erase hook 0x55b6a4589f60 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache zap hook 0x55b6a4589f60 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 note: GC not initialized 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:01:26.927+0000 7f01acfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace show hook 0x7f02e8057b10 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace history hook 0x7f02e8057b10 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace active hook 0x7f02e8057b10 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace active_short hook 0x7f02e8057b10 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 Filter name: none 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:01:26.927+0000 7f01267fc640 20 reqs_thread_entry: start 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:01:26.927+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:27.011 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:01:26.930+0000 7f02fc412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.012 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94242930057664 notifier 7835 bl.length()=827 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:01:26.945+0000 7f02fc412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02fc412800 time 2024-09-12T18:01:26.945508+0000 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:27.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02fd58c71a] 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:01:26.945+0000 7f02fc412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f02fc412800 thread_name:radosgw-admin 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.014 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02fc23e6f0] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02fc28b99c] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02fd58c774] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.015 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:01:27.016 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:01:27.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:01:27.018 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:01:27.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:01:27.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:01:27.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01267fc640 / http_manager 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01acfe1640 / http_manager 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01adfe3640 / rgw_dt_lg_renew 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01d57fa640 / ms_dispatch 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01d6ffd640 / io_context_pool 2024-09-12T18:01:27.022 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01dd7fa640 / ms_dispatch 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01dffff640 / ms_dispatch 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01e5e0b640 / io_context_pool 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02ef2ca640 / msgr-worker-2 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f7acb640 / msgr-worker-1 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f82cc640 / msgr-worker-0 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f8acd640 / io_context_pool 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02fc412800 / radosgw-admin 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.153638.log 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-12T18:01:26.678+0000 7f01e5e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:27.023 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-12T18:01:26.678+0000 7f01e5e0b640 10 monclient: dump: 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-12T18:01:26.678+0000 7f02fc412800 5 monclient: authenticate success, global_id 8283 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-12T18:01:26.678+0000 7f02fc412800 10 monclient: get_monmap_and_config success 2024-09-12T18:01:27.024 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-12T18:01:26.678+0000 7f02fc412800 4 set_mon_vals no callback set 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: shutdown 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 asok(0x55b6a42c9730) unregister_commands rotate-key 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-12T18:01:26.679+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-12T18:01:26.679+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:27.025 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding auth protocol: cephx 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.026 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: crc 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-12T18:01:26.679+0000 7f02fc412800 5 AuthRegistry(0x55b6a44f0ea0) adding con mode: secure 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: starting msgr at 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: starting objecter 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests hook 0x55b6a451cb90 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: setting wanted keys 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-12T18:01:26.680+0000 7f02fc412800 1 librados: calling monclient init 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding auth protocol: cephx 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.027 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: crc 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 AuthRegistry(0x55b6a44eb720) adding con mode: secure 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-12T18:01:26.680+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-12T18:01:26.680+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key hook 0x55b6a44eb868 2024-09-12T18:01:27.028 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a43983c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a442e560 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a4431440 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-12T18:01:26.680+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.194761s 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a43983c0 auth_method 0 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.029 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a442e560 auth_method 0 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-12T18:01:26.680+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-12T18:01:26.680+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a4431440 auth_method 0 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.030 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-12T18:01:26.680+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-12T18:01:26.681+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 1 monclient: found mon.noname-a 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-12T18:01:26.681+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: dump: 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.031 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-12T18:01:26.681+0000 7f01dffff640 10 monclient: dump: 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.032 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-12T18:01:26.681+0000 7f02fc412800 5 monclient: authenticate success, global_id 8286 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.033 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-12T18:01:26.681+0000 7f01e5e0b640 4 set_mon_vals no callback set 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-12T18:01:26.681+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-12T18:01:26.681+0000 7f02fc412800 1 librados: init done 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-12T18:01:26.683+0000 7f01dffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-12T18:01:26.683+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01e0076470 auth_method 0 2024-09-12T18:01:27.036 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-12T18:01:26.683+0000 7f02f82cc640 10 monclient: get_auth_request con 0x55b6a4513e60 auth_method 0 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-12T18:01:26.684+0000 7f02f7acb640 10 monclient: get_auth_request con 0x55b6a45366b0 auth_method 0 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-12T18:01:26.686+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x55b6a453bc40 auth_method 0 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-12T18:01:26.686+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-12T18:01:26.686+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-12T18:01:26.686+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:27.037 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding auth protocol: cephx 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.038 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: crc 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-12T18:01:26.686+0000 7f02fc412800 5 AuthRegistry(0x55b6a453fb50) adding con mode: secure 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests cmddesc objecter_requests hook 0x55b6a4543020 EEXIST 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding auth protocol: cephx 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.039 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: crc 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 AuthRegistry(0x55b6a453eb08) adding con mode: secure 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-12T18:01:26.687+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-12T18:01:26.687+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x55b6a453ec50 EEXIST 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a4567340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:27.040 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a4567720 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a4566050 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-12T18:01:26.687+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.201998s 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a4567340 auth_method 0 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a4567720 auth_method 0 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.041 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-12T18:01:26.688+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a4566050 auth_method 0 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-12T18:01:26.688+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 1 monclient: found mon.noname-a 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-12T18:01:26.688+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.042 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: dump: 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:27.043 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-12T18:01:26.688+0000 7f01dd7fa640 10 monclient: dump: 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.044 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-12T18:01:26.688+0000 7f02fc412800 5 monclient: authenticate success, global_id 8289 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-12T18:01:26.688+0000 7f02f8acd640 4 set_mon_vals no callback set 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-12T18:01:26.688+0000 7f02fc412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-12T18:01:26.690+0000 7f01dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-12T18:01:26.690+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01d0076380 auth_method 0 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: get_monmap_and_config 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-12T18:01:26.690+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:27.045 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-12T18:01:26.690+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding auth protocol: cephx 2024-09-12T18:01:27.046 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: crc 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-12T18:01:26.690+0000 7f02fc412800 5 AuthRegistry(0x55b6a4587010) adding con mode: secure 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-12T18:01:26.690+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:27.047 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding auth protocol: cephx 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: crc 2024-09-12T18:01:27.048 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 AuthRegistry(0x7ffc1052fc40) adding con mode: secure 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-12T18:01:26.691+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-12T18:01:26.691+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-12T18:01:26.691+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x7ffc1052fd88 EEXIST 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a45bb6b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a458b4c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a45b6a70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:27.049 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-12T18:01:26.691+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.205530s 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a45bb6b0 auth_method 0 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a45b6a70 auth_method 0 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.050 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-12T18:01:26.691+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient(hunting): handle_auth_done global_id 8292 payload 274 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient: _finish_hunting 0 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-12T18:01:26.691+0000 7f02f7acb640 1 monclient: found mon.noname-a 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-12T18:01:26.691+0000 7f02f7acb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: dump: 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.051 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: _finish_auth 0 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-12T18:01:26.692+0000 7f01d6ffd640 10 monclient: dump: 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.052 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 monclient: authenticate success, global_id 8292 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: get_monmap_and_config success 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-12T18:01:26.692+0000 7f02fc412800 4 set_mon_vals no callback set 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: shutdown 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: build_initial_monmap 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-12T18:01:26.692+0000 7f02fc412800 1 build_initial for_mkfs: 0 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-12T18:01:26.692+0000 7f02fc412800 10 monclient: monmap: 2024-09-12T18:01:27.053 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding auth protocol: cephx 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.054 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: crc 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-12T18:01:26.692+0000 7f02fc412800 5 AuthRegistry(0x55b6a458c300) adding con mode: secure 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: starting msgr at 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: starting objecter 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command objecter_requests cmddesc objecter_requests hook 0x55b6a45b5760 EEXIST 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: setting wanted keys 2024-09-12T18:01:27.055 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-12T18:01:26.693+0000 7f02fc412800 1 librados: calling monclient init 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: init 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding auth protocol: cephx 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.056 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: crc 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 AuthRegistry(0x55b6a457bc00) adding con mode: secure 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-12T18:01:26.693+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-12T18:01:26.693+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command rotate-key cmddesc rotate-key hook 0x55b6a457bd48 EEXIST 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: _reopen_session rank -1 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-b con 0x55b6a458b4c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-c con 0x55b6a45b6a70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): picked mon.noname-a con 0x55b6a45bb6b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:27.057 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): _renew_subs 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-12T18:01:26.693+0000 7f02fc412800 10 monclient(hunting): authenticate will time out at 2360.207852s 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request con 0x55b6a45b6a70 auth_method 0 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-12T18:01:26.693+0000 7f02ef2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): get_auth_request con 0x55b6a45bb6b0 auth_method 0 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-12T18:01:26.693+0000 7f02f82cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): get_auth_request con 0x55b6a458b4c0 auth_method 0 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:27.058 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-12T18:01:26.694+0000 7f02f82cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-12T18:01:26.694+0000 7f02f7acb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient: _finish_hunting 0 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 1 monclient: found mon.noname-c 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-12T18:01:26.694+0000 7f02ef2ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:27.059 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: dump: 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:27.060 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-12T18:01:26.694+0000 7f01d57fa640 10 monclient: dump: 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f8cf509b-ba8a-4799-b42b-c125c378387b 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-12T17:34:34.507049+0000 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-12T18:01:26.694+0000 7f02fc412800 5 monclient: authenticate success, global_id 7835 2024-09-12T18:01:27.061 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-12T18:01:26.694+0000 7f01d6ffd640 4 set_mon_vals no callback set 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _renew_subs 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-12T18:01:26.694+0000 7f02fc412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-12T18:01:26.694+0000 7f02fc412800 1 librados: init done 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-12T18:01:26.694+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cr dump hook 0x55b6a45ad228 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-12T18:01:26.695+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-12T18:01:26.696+0000 7f01d57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.94:6824/1451463540,v1:172.21.15.94:6825/1451463540] 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-12T18:01:26.696+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f01c0076470 auth_method 0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-12T18:01:26.696+0000 7f02f82cc640 10 monclient: get_auth_request con 0x55b6a45d4fb0 auth_method 0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.062 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 realm 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-12T18:01:26.697+0000 7f02fc412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-12T18:01:26.697+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-12T18:01:26.697+0000 7f02f7acb640 10 monclient: get_auth_request con 0x55b6a45d9220 auth_method 0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-12T18:01:26.698+0000 7f02fc412800 20 searching for the correct realm 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-12T18:01:26.699+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x55b6a45de590 auth_method 0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-12T18:01:26.699+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f02e0082ad0 auth_method 0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-12T18:01:26.700+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02f0018040 auth_method 0 2024-09-12T18:01:27.063 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-12T18:01:26.701+0000 7f02ef2ca640 10 monclient: get_auth_request con 0x7f02e8087050 auth_method 0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-12T18:01:26.701+0000 7f02f82cc640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f02e0082ad0 msgr2=0x7f02e008aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-12T18:01:26.701+0000 7f01d57fa640 1 client.7835.objecter ms_handle_reset 0x7f02e0082ad0 session 0x7f02e0005040 osd.7 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-12T18:01:26.701+0000 7f01d57fa640 10 monclient: _renew_subs 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-12T18:01:26.701+0000 7f01d57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-12T18:01:26.701+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f01c0086b90 auth_method 0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-12T18:01:26.703+0000 7f02f82cc640 10 monclient: get_auth_request con 0x7f02e00697d0 auth_method 0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-12T18:01:26.705+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02e0021c30 auth_method 0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-12T18:01:26.706+0000 7f02f7acb640 0 -- 172.21.15.94:0/2230865904 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f02e0021c30 msgr2=0x7f02e00789f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-12T18:01:26.907+0000 7f02f7acb640 10 monclient: get_auth_request con 0x7f02e0021c30 auth_method 0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:27.064 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-12T18:01:26.913+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 zone default found 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 Realm: () 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-12T18:01:26.914+0000 7f02fc412800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-12T18:01:26.914+0000 7f02fc412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:27.065 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 zonegroup default 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-12T18:01:26.914+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 started sync module instance, tier type = 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-12T18:01:26.915+0000 7f02fc412800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=0 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=1 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=2 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=3 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=4 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=5 2024-09-12T18:01:27.066 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-12T18:01:26.923+0000 7f02fc412800 20 add_watcher() i=6 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-12T18:01:26.924+0000 7f02fc412800 20 add_watcher() i=7 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-12T18:01:26.924+0000 7f02fc412800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding auth protocol: cephx 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.067 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: crc 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-12T18:01:26.926+0000 7f02fc412800 5 AuthRegistry(0x7ffc10530110) adding con mode: secure 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-12T18:01:26.926+0000 7f01adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-12T18:01:26.927+0000 7f02fc412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache list hook 0x55b6a4589f60 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache inspect hook 0x55b6a4589f60 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache erase hook 0x55b6a4589f60 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command cache zap hook 0x55b6a4589f60 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 note: GC not initialized 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-12T18:01:26.927+0000 7f01acfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:27.068 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace show hook 0x7f02e8057b10 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace history hook 0x7f02e8057b10 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace active hook 0x7f02e8057b10 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-12T18:01:26.927+0000 7f02fc412800 5 asok(0x55b6a42c9730) register_command sync trace active_short hook 0x7f02e8057b10 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 Filter name: none 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-12T18:01:26.927+0000 7f01267fc640 20 reqs_thread_entry: start 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-12T18:01:26.927+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-12T18:01:26.927+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.069 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-12T18:01:26.928+0000 7f02fc412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-12T18:01:26.928+0000 7f02fc412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-12T18:01:26.930+0000 7f02fc412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-12T18:01:26.937+0000 7f02fc412800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94242930057664 notifier 7835 bl.length()=827 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:27.070 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-12T18:01:26.937+0000 7f01d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-12T18:01:26.939+0000 7f02fc412800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-12T18:01:26.945+0000 7f02fc412800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02fc412800 time 2024-09-12T18:01:26.945508+0000 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f02fd58c71a] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:27.071 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-12T18:01:26.945+0000 7f02fc412800 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f02fc412800 thread_name:radosgw-admin 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f02fc23e6f0] 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f02fc28b99c] 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f02fd58c774] 2024-09-12T18:01:27.072 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f02fd58c8d8] 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6a2ea3841] 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6a2eb357a] 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f02fc229590] 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-12T18:01:27.073 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-12T18:01:27.074 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-12T18:01:27.075 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:27.076 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-12T18:01:27.077 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-12T18:01:27.078 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:27.079 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01267fc640 / http_manager 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01acfe1640 / http_manager 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01adfe3640 / rgw_dt_lg_renew 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01d57fa640 / ms_dispatch 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01d6ffd640 / io_context_pool 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01dd7fa640 / ms_dispatch 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01dffff640 / ms_dispatch 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f01e5e0b640 / io_context_pool 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02ef2ca640 / msgr-worker-2 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f7acb640 / msgr-worker-1 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f82cc640 / msgr-worker-0 2024-09-12T18:01:27.080 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02f8acd640 / io_context_pool 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr: 7f02fc412800 / radosgw-admin 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:01:26.946879Z_1c6153b8-48f0-4ba4-ac90-0ac6dc3a2a54/log 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-12T18:01:27.081 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:27.082 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.020+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 realm 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.022+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.023+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.023+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.024+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:27.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.024+0000 7f455452c800 20 searching for the correct realm 2024-09-12T18:01:27.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.028+0000 7f4550a57640 0 -- 172.21.15.94:0/3141403664 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f4538063040 msgr2=0x7f4538086a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:27.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.235+0000 7f4550256640 0 -- 172.21.15.94:0/3141403664 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x559752d5d7c0 msgr2=0x559752d5fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:27.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:27.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.237+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 zone default found 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 4 Realm: () 2024-09-12T18:01:27.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 zonegroup default 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.238+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.239+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.239+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.239+0000 7f455452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.239+0000 7f455452c800 20 started sync module instance, tier type = 2024-09-12T18:01:27.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.239+0000 7f455452c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=0 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=1 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=2 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=3 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=4 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=5 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.247+0000 7f455452c800 20 add_watcher() i=6 2024-09-12T18:01:27.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.248+0000 7f455452c800 20 add_watcher() i=7 2024-09-12T18:01:27.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.248+0000 7f455452c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f4406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f455452c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f455452c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f455452c800 5 note: GC not initialized 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f4405fdb640 20 reqs_thread_entry: start 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f455452c800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.250+0000 7f455452c800 20 Filter name: none 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.251+0000 7f43777fe640 20 reqs_thread_entry: start 2024-09-12T18:01:27.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.251+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.251+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:27.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.251+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:27.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.252+0000 7f455452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:27.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.254+0000 7f4406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:27.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.256+0000 7f455452c800 20 remove_watcher() i=0 2024-09-12T18:01:27.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.256+0000 7f455452c800 2 removed watcher, disabling cache 2024-09-12T18:01:27.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.257+0000 7f455452c800 20 remove_watcher() i=1 2024-09-12T18:01:27.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.258+0000 7f455452c800 20 remove_watcher() i=2 2024-09-12T18:01:27.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.259+0000 7f455452c800 20 remove_watcher() i=3 2024-09-12T18:01:27.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.261+0000 7f455452c800 20 remove_watcher() i=4 2024-09-12T18:01:27.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.262+0000 7f455452c800 20 remove_watcher() i=5 2024-09-12T18:01:27.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.263+0000 7f455452c800 20 remove_watcher() i=6 2024-09-12T18:01:27.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.263+0000 7f455452c800 20 remove_watcher() i=7 2024-09-12T18:01:27.314 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:01:27.343 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:27.343 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:27.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.581+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.582+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.582+0000 7f9138d25800 20 realm 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.582+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.583+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.583+0000 7f9138d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.583+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.583+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:27.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.583+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.584+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:27.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.584+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:27.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.584+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:27.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.584+0000 7f9138d25800 20 searching for the correct realm 2024-09-12T18:01:27.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.586+0000 7f912c132640 0 -- 172.21.15.94:0/1862998296 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f9124083040 msgr2=0x7f912406b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:27.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:27.793+0000 7f9134933640 0 -- 172.21.15.94:0/1862998296 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f911c087910 msgr2=0x7f911c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:28.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:28.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:28.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.000+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:28.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 zone default found 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 4 Realm: () 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 zonegroup default 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.001+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.002+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.002+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.002+0000 7f9138d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.002+0000 7f9138d25800 20 started sync module instance, tier type = 2024-09-12T18:01:28.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.002+0000 7f9138d25800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:28.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=0 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=1 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=2 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=3 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=4 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=5 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.011+0000 7f9138d25800 20 add_watcher() i=6 2024-09-12T18:01:28.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.013+0000 7f9138d25800 20 add_watcher() i=7 2024-09-12T18:01:28.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.013+0000 7f9138d25800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.014+0000 7f8feafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 5 note: GC not initialized 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f8fe9fe3640 20 reqs_thread_entry: start 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 20 Filter name: none 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f8f5b7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.015+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 20 rados->read ofs=0 len=0 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.016+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.017+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.017+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.017+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.017+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:01:28.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.018+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:01:28.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.019+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.020+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.020+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.020+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.020+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:01:28.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.021+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:01:28.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.021+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:01:28.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.021+0000 7f9138d25800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:01:28.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.021+0000 7f9138d25800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:01:28.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.022+0000 7f8feafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:28.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.025+0000 7f9138d25800 20 remove_watcher() i=0 2024-09-12T18:01:28.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.025+0000 7f9138d25800 2 removed watcher, disabling cache 2024-09-12T18:01:28.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.026+0000 7f9138d25800 20 remove_watcher() i=1 2024-09-12T18:01:28.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.027+0000 7f9138d25800 20 remove_watcher() i=2 2024-09-12T18:01:28.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.028+0000 7f9138d25800 20 remove_watcher() i=3 2024-09-12T18:01:28.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.030+0000 7f9138d25800 20 remove_watcher() i=4 2024-09-12T18:01:28.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.031+0000 7f9138d25800 20 remove_watcher() i=5 2024-09-12T18:01:28.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.032+0000 7f9138d25800 20 remove_watcher() i=6 2024-09-12T18:01:28.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:28.033+0000 7f9138d25800 20 remove_watcher() i=7 2024-09-12T18:01:58.061 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T18:01:58.092 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:58.092 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:58.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.134+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 realm 2024-09-12T18:01:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.136+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.137+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.137+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.137+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.137+0000 7f37e552a800 20 searching for the correct realm 2024-09-12T18:01:58.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.141+0000 7f37e1adb640 0 -- 172.21.15.94:0/1909448477 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f37cc088040 msgr2=0x7f37cc06d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.145+0000 7f37e12da640 0 -- 172.21.15.94:0/1909448477 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f37cc098930 msgr2=0x7f37cc096400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.354+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 zone default found 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 4 Realm: () 2024-09-12T18:01:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 zonegroup default 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.355+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.356+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.356+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.356+0000 7f37e552a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.356+0000 7f37e552a800 20 started sync module instance, tier type = 2024-09-12T18:01:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.356+0000 7f37e552a800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=0 2024-09-12T18:01:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=1 2024-09-12T18:01:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=2 2024-09-12T18:01:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=3 2024-09-12T18:01:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=4 2024-09-12T18:01:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=5 2024-09-12T18:01:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.367+0000 7f37e552a800 20 add_watcher() i=6 2024-09-12T18:01:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.368+0000 7f37e552a800 20 add_watcher() i=7 2024-09-12T18:01:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.368+0000 7f37e552a800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:58.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.370+0000 7f3697fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:58.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 5 note: GC not initialized 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f3696fe5640 20 reqs_thread_entry: start 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 20 Filter name: none 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f3694fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:58.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.371+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.372+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:58.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.372+0000 7f37e552a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.372+0000 7f37e552a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.372+0000 7f37e552a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.372+0000 7f37e552a800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.373+0000 7f37e552a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:58.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.377+0000 7f3697fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.379+0000 7f37e552a800 20 remove_watcher() i=0 2024-09-12T18:01:58.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.379+0000 7f37e552a800 2 removed watcher, disabling cache 2024-09-12T18:01:58.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.381+0000 7f37e552a800 20 remove_watcher() i=1 2024-09-12T18:01:58.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.382+0000 7f37e552a800 20 remove_watcher() i=2 2024-09-12T18:01:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.383+0000 7f37e552a800 20 remove_watcher() i=3 2024-09-12T18:01:58.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.384+0000 7f37e552a800 20 remove_watcher() i=4 2024-09-12T18:01:58.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.385+0000 7f37e552a800 20 remove_watcher() i=5 2024-09-12T18:01:58.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.386+0000 7f37e552a800 20 remove_watcher() i=6 2024-09-12T18:01:58.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.387+0000 7f37e552a800 20 remove_watcher() i=7 2024-09-12T18:01:58.401 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:01:58.431 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:58.432 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:58.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.469+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 20 realm 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.471+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.472+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.472+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.473+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.473+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.473+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:58.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.473+0000 7f33a8940800 20 searching for the correct realm 2024-09-12T18:01:58.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.477+0000 7f33a4e87640 0 -- 172.21.15.94:0/2179729585 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f338c05f710 msgr2=0x7f338c096720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:58.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.683+0000 7f33a4686640 0 -- 172.21.15.94:0/2179729585 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x556fe4b273b0 msgr2=0x556fe4b297e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:58.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.686+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 zone default found 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 4 Realm: () 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 zonegroup default 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.687+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.688+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.688+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.688+0000 7f33a8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.688+0000 7f33a8940800 20 started sync module instance, tier type = 2024-09-12T18:01:58.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.688+0000 7f33a8940800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=0 2024-09-12T18:01:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=1 2024-09-12T18:01:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=2 2024-09-12T18:01:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=3 2024-09-12T18:01:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=4 2024-09-12T18:01:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=5 2024-09-12T18:01:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.697+0000 7f33a8940800 20 add_watcher() i=6 2024-09-12T18:01:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.698+0000 7f33a8940800 20 add_watcher() i=7 2024-09-12T18:01:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.698+0000 7f33a8940800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:58.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f325b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f33a8940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f33a8940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f33a8940800 5 note: GC not initialized 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f325a7dc640 20 reqs_thread_entry: start 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f33a8940800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.700+0000 7f33a8940800 20 Filter name: none 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f32537fe640 20 reqs_thread_entry: start 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:01:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.701+0000 7f33a8940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.702+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:01:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.703+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:01:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.704+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.705+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.705+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.705+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.705+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.706+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.706+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.706+0000 7f33a8940800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:01:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.706+0000 7f33a8940800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:01:58.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.707+0000 7f325b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.710+0000 7f33a8940800 20 remove_watcher() i=0 2024-09-12T18:01:58.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.710+0000 7f33a8940800 2 removed watcher, disabling cache 2024-09-12T18:01:58.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.711+0000 7f33a8940800 20 remove_watcher() i=1 2024-09-12T18:01:58.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.712+0000 7f33a8940800 20 remove_watcher() i=2 2024-09-12T18:01:58.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.713+0000 7f33a8940800 20 remove_watcher() i=3 2024-09-12T18:01:58.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.714+0000 7f33a8940800 20 remove_watcher() i=4 2024-09-12T18:01:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.715+0000 7f33a8940800 20 remove_watcher() i=5 2024-09-12T18:01:58.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.716+0000 7f33a8940800 20 remove_watcher() i=6 2024-09-12T18:01:58.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.717+0000 7f33a8940800 20 remove_watcher() i=7 2024-09-12T18:01:58.728 INFO:tasks.workunit.client.0.smithi094.stderr:check reshard logrecord successfully 2024-09-12T18:01:58.728 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard versioned bucket 2024-09-12T18:01:58.729 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:01:58.758 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:58.758 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.793+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 realm 2024-09-12T18:01:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.795+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.796+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.796+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.796+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.796+0000 7f3d1f32c800 20 searching for the correct realm 2024-09-12T18:01:58.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.800+0000 7f3d13fff640 0 -- 172.21.15.94:0/3787409282 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x563cb49fd110 msgr2=0x563cb49ff560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.803+0000 7f3d1af61640 0 -- 172.21.15.94:0/3787409282 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f3d04037b40 msgr2=0x7f3d0401b8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.807+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 zone default found 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 4 Realm: () 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 zonegroup default 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.808+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.809+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.809+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.809+0000 7f3d1f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.809+0000 7f3d1f32c800 20 started sync module instance, tier type = 2024-09-12T18:01:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.809+0000 7f3d1f32c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:58.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=0 2024-09-12T18:01:58.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=1 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=2 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=3 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=4 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=5 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.817+0000 7f3d1f32c800 20 add_watcher() i=6 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.818+0000 7f3d1f32c800 20 add_watcher() i=7 2024-09-12T18:01:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.818+0000 7f3d1f32c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:58.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3bd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3d1f32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3d1f32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3d1f32c800 5 note: GC not initialized 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3b4bfff640 20 reqs_thread_entry: start 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3d1f32c800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.820+0000 7f3d1f32c800 20 Filter name: none 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3b49ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.821+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.822+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.822+0000 7f3d1f32c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.822+0000 7f3d1f32c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:01:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.822+0000 7f3d1f32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:58.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.824+0000 7f3bd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.826+0000 7f3d1f32c800 20 remove_watcher() i=0 2024-09-12T18:01:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.826+0000 7f3d1f32c800 2 removed watcher, disabling cache 2024-09-12T18:01:58.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.827+0000 7f3d1f32c800 20 remove_watcher() i=1 2024-09-12T18:01:58.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.828+0000 7f3d1f32c800 20 remove_watcher() i=2 2024-09-12T18:01:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.829+0000 7f3d1f32c800 20 remove_watcher() i=3 2024-09-12T18:01:58.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.830+0000 7f3d1f32c800 20 remove_watcher() i=4 2024-09-12T18:01:58.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.831+0000 7f3d1f32c800 20 remove_watcher() i=5 2024-09-12T18:01:58.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.832+0000 7f3d1f32c800 20 remove_watcher() i=6 2024-09-12T18:01:58.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.832+0000 7f3d1f32c800 20 remove_watcher() i=7 2024-09-12T18:01:58.844 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:01:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:01:58.844 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T18:01:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:58.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.912+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 realm 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.914+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.915+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.915+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.916+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.916+0000 7fbcad326800 20 searching for the correct realm 2024-09-12T18:01:58.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.919+0000 7fbca07d8640 0 -- 172.21.15.94:0/2568946993 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56353b15a1d0 msgr2=0x56353b15c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.922+0000 7fbca8fd9640 0 -- 172.21.15.94:0/2568946993 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbc900ba260 msgr2=0x7fbc90059970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.926+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 zone default found 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 4 Realm: () 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 zonegroup default 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.927+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.928+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.928+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.928+0000 7fbcad326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.928+0000 7fbcad326800 20 started sync module instance, tier type = 2024-09-12T18:01:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.928+0000 7fbcad326800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=0 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=1 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=2 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=3 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=4 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=5 2024-09-12T18:01:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.937+0000 7fbcad326800 20 add_watcher() i=6 2024-09-12T18:01:58.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.938+0000 7fbcad326800 20 add_watcher() i=7 2024-09-12T18:01:58.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.938+0000 7fbcad326800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:58.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.939+0000 7fbb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 5 note: GC not initialized 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbb5dfe3640 20 reqs_thread_entry: start 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 20 Filter name: none 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbacf7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.940+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : miss 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 20 rados->read ofs=0 len=0 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 adding default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.941+0000 7fbcad326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:01:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbcad326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbcad326800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbcad326800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbcad326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:01:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbb7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94786624552464 notifier 8406 bl.length()=821 2024-09-12T18:01:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbb7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbb7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.946+0000 7fbb7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.948+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:01:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.948+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:01:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.948+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:01:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.948+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:01:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:01:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:01:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.952+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.0 2024-09-12T18:01:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.953+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.953+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.953+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.954+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.4 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.954+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.5 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.955+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.6 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.955+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.7 2024-09-12T18:01:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.956+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.8 2024-09-12T18:01:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.956+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.9 2024-09-12T18:01:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.956+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.10 2024-09-12T18:01:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.957+0000 7fbcad326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.957+0000 7fbcad326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:01:58.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbcad326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbcad326800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbcad326800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbcad326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbb7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 94786624552464 notifier 8406 bl.length()=821 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbb7f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbb7f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.958+0000 7fbb7f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.960+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:01:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.960+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:01:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.960+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:01:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.960+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:01:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.962+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.0 2024-09-12T18:01:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.962+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1 2024-09-12T18:01:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.963+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2 2024-09-12T18:01:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.963+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3 2024-09-12T18:01:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.963+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.4 2024-09-12T18:01:58.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.964+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.5 2024-09-12T18:01:58.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.964+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.6 2024-09-12T18:01:58.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.964+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.7 2024-09-12T18:01:58.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.965+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.8 2024-09-12T18:01:58.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.965+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.9 2024-09-12T18:01:58.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.965+0000 7fbcad326800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.10 2024-09-12T18:01:58.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.965+0000 7fbcad326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:58.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.966+0000 7fbcad326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbcad326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbcad326800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbcad326800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbcad326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbb7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529754 cookie 94786624552464 notifier 8406 bl.length()=789 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbb7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:01:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbb7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:01:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.967+0000 7fbb7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.968+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:01:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.969+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:01:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.969+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:01:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.969+0000 7fbcad326800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:01:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.971+0000 7fbcad326800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T18:01:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.973+0000 7fbb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.975+0000 7fbcad326800 20 remove_watcher() i=0 2024-09-12T18:01:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.975+0000 7fbcad326800 2 removed watcher, disabling cache 2024-09-12T18:01:58.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.976+0000 7fbcad326800 20 remove_watcher() i=1 2024-09-12T18:01:58.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.977+0000 7fbcad326800 20 remove_watcher() i=2 2024-09-12T18:01:58.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.978+0000 7fbcad326800 20 remove_watcher() i=3 2024-09-12T18:01:58.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.979+0000 7fbcad326800 20 remove_watcher() i=4 2024-09-12T18:01:58.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.980+0000 7fbcad326800 20 remove_watcher() i=5 2024-09-12T18:01:58.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.981+0000 7fbcad326800 20 remove_watcher() i=6 2024-09-12T18:01:58.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:58.982+0000 7fbcad326800 20 remove_watcher() i=7 2024-09-12T18:01:58.995 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:01:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:59.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.059+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.060+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.060+0000 7fbbb282f800 20 realm 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.060+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.061+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.061+0000 7fbbb282f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.061+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.061+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.061+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.062+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:59.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.062+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.062+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:59.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.062+0000 7fbbb282f800 20 searching for the correct realm 2024-09-12T18:01:59.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.065+0000 7fbba7b18640 0 -- 172.21.15.94:0/141488670 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fbba006d060 msgr2=0x7fbba0007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:59.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.068+0000 7fbbb0319640 0 -- 172.21.15.94:0/141488670 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbb98097b00 msgr2=0x7fbb9803a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 zone default found 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 4 Realm: () 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 zonegroup default 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.274+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 started sync module instance, tier type = 2024-09-12T18:01:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.275+0000 7fbbb282f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=0 2024-09-12T18:01:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=1 2024-09-12T18:01:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=2 2024-09-12T18:01:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=3 2024-09-12T18:01:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=4 2024-09-12T18:01:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=5 2024-09-12T18:01:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.284+0000 7fbbb282f800 20 add_watcher() i=6 2024-09-12T18:01:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.285+0000 7fbbb282f800 20 add_watcher() i=7 2024-09-12T18:01:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.285+0000 7fbbb282f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:59.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fbbb282f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fbbb282f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fbbb282f800 5 note: GC not initialized 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fba65fdb640 20 reqs_thread_entry: start 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fbbb282f800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.287+0000 7fbbb282f800 20 Filter name: none 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fb9d77fe640 20 reqs_thread_entry: start 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:01:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.288+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.289+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.289+0000 7fbbb282f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.289+0000 7fbbb282f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:01:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.289+0000 7fbbb282f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.291+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:59.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.293+0000 7fbbb282f800 20 remove_watcher() i=0 2024-09-12T18:01:59.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.293+0000 7fbbb282f800 2 removed watcher, disabling cache 2024-09-12T18:01:59.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.294+0000 7fbbb282f800 20 remove_watcher() i=1 2024-09-12T18:01:59.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.295+0000 7fbbb282f800 20 remove_watcher() i=2 2024-09-12T18:01:59.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.296+0000 7fbbb282f800 20 remove_watcher() i=3 2024-09-12T18:01:59.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.297+0000 7fbbb282f800 20 remove_watcher() i=4 2024-09-12T18:01:59.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.298+0000 7fbbb282f800 20 remove_watcher() i=5 2024-09-12T18:01:59.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.299+0000 7fbbb282f800 20 remove_watcher() i=6 2024-09-12T18:01:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.300+0000 7fbbb282f800 20 remove_watcher() i=7 2024-09-12T18:01:59.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:59.311 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:01:59.311 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:01:59.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:01:59.387 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard removes olh entries with empty name 2024-09-12T18:01:59.687 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:59.716 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:59.716 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:59.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.752+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.753+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.753+0000 7fd405b2c800 20 realm 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.753+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.754+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.754+0000 7fd405b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.754+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.754+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.754+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.755+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.755+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.755+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.755+0000 7fd405b2c800 20 searching for the correct realm 2024-09-12T18:01:59.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.758+0000 7fd401f46640 0 -- 172.21.15.94:0/3345302521 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fd3ec07a040 msgr2=0x7fd3ec0bc950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:59.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.761+0000 7fd401745640 0 -- 172.21.15.94:0/3345302521 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fd3ec059290 msgr2=0x7fd3ec0b3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.966+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:59.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 zone default found 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 4 Realm: () 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 zonegroup default 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.967+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.968+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.968+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.968+0000 7fd405b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.968+0000 7fd405b2c800 20 started sync module instance, tier type = 2024-09-12T18:01:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.968+0000 7fd405b2c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=0 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=1 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=2 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=3 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=4 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=5 2024-09-12T18:01:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.976+0000 7fd405b2c800 20 add_watcher() i=6 2024-09-12T18:01:59.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.977+0000 7fd405b2c800 20 add_watcher() i=7 2024-09-12T18:01:59.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.977+0000 7fd405b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:59.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.978+0000 7fd2b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 5 note: GC not initialized 2024-09-12T18:01:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd2b67e4640 20 reqs_thread_entry: start 2024-09-12T18:01:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 20 Filter name: none 2024-09-12T18:01:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd227fff640 20 reqs_thread_entry: start 2024-09-12T18:01:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.979+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.980+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.980+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 rados->read ofs=0 len=0 2024-09-12T18:01:59.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.981+0000 7fd405b2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:59.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.982+0000 7fd405b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:59.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.983+0000 7fd2b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:59.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.985+0000 7fd405b2c800 20 remove_watcher() i=0 2024-09-12T18:01:59.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.985+0000 7fd405b2c800 2 removed watcher, disabling cache 2024-09-12T18:01:59.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.986+0000 7fd405b2c800 20 remove_watcher() i=1 2024-09-12T18:01:59.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.987+0000 7fd405b2c800 20 remove_watcher() i=2 2024-09-12T18:01:59.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.988+0000 7fd405b2c800 20 remove_watcher() i=3 2024-09-12T18:01:59.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.989+0000 7fd405b2c800 20 remove_watcher() i=4 2024-09-12T18:01:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.990+0000 7fd405b2c800 20 remove_watcher() i=5 2024-09-12T18:01:59.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.991+0000 7fd405b2c800 20 remove_watcher() i=6 2024-09-12T18:01:59.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:01:59.992+0000 7fd405b2c800 20 remove_watcher() i=7 2024-09-12T18:02:00.002 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:02:00.003 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:02:00.003 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T18:02:00.003 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:02:00.004 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T18:02:00.033 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:00.033 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.069+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.070+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.070+0000 7f2923939800 20 realm 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.070+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.071+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.071+0000 7f2923939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.071+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.071+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.071+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.072+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.072+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.072+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.072+0000 7f2923939800 20 searching for the correct realm 2024-09-12T18:02:00.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.074+0000 7f291f5c7640 0 -- 172.21.15.94:0/1199614705 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f2908003bd0 msgr2=0x7f291801c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:00.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.480+0000 7f291f5c7640 0 -- 172.21.15.94:0/1199614705 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f2908003bd0 msgr2=0x7f291801c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.486+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 zone default found 2024-09-12T18:02:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 4 Realm: () 2024-09-12T18:02:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 zonegroup default 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.487+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.488+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.488+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.489+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.489+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.489+0000 7f2923939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.489+0000 7f2923939800 20 started sync module instance, tier type = 2024-09-12T18:02:00.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.489+0000 7f2923939800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=0 2024-09-12T18:02:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=1 2024-09-12T18:02:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=2 2024-09-12T18:02:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=3 2024-09-12T18:02:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=4 2024-09-12T18:02:00.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=5 2024-09-12T18:02:00.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.498+0000 7f2923939800 20 add_watcher() i=6 2024-09-12T18:02:00.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.499+0000 7f2923939800 20 add_watcher() i=7 2024-09-12T18:02:00.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.499+0000 7f2923939800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.500+0000 7f27d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.500+0000 7f2923939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.500+0000 7f2923939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.500+0000 7f2923939800 5 note: GC not initialized 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f27d4fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f2923939800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f2923939800 20 Filter name: none 2024-09-12T18:02:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f274e7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.501+0000 7f2923939800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.502+0000 7f2923939800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.502+0000 7f2923939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.503+0000 7f27d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:00.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.505+0000 7f2923939800 20 remove_watcher() i=0 2024-09-12T18:02:00.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.505+0000 7f2923939800 2 removed watcher, disabling cache 2024-09-12T18:02:00.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.506+0000 7f2923939800 20 remove_watcher() i=1 2024-09-12T18:02:00.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.507+0000 7f2923939800 20 remove_watcher() i=2 2024-09-12T18:02:00.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.508+0000 7f2923939800 20 remove_watcher() i=3 2024-09-12T18:02:00.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.509+0000 7f2923939800 20 remove_watcher() i=4 2024-09-12T18:02:00.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.510+0000 7f2923939800 20 remove_watcher() i=5 2024-09-12T18:02:00.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.511+0000 7f2923939800 20 remove_watcher() i=6 2024-09-12T18:02:00.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.512+0000 7f2923939800 20 remove_watcher() i=7 2024-09-12T18:02:00.525 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.index setomapval .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T18:02:00.552 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:00.552 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:00.568 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:02:00.597 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:00.597 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:00.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.632+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 20 realm 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.633+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.634+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.634+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.634+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.634+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.635+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.635+0000 7f2f2f322800 20 searching for the correct realm 2024-09-12T18:02:00.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.637+0000 7f2f2b869640 0 -- 172.21.15.94:0/2820978468 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f2f14073030 msgr2=0x7f2f140a4150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:00.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.641+0000 7f2f2b068640 0 -- 172.21.15.94:0/2820978468 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f2f140ae1d0 msgr2=0x7f2f140a3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.846+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 zone default found 2024-09-12T18:02:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 4 Realm: () 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 zonegroup default 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.847+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.848+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.848+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.848+0000 7f2f2f322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.848+0000 7f2f2f322800 20 started sync module instance, tier type = 2024-09-12T18:02:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.848+0000 7f2f2f322800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=0 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=1 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=2 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=3 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=4 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=5 2024-09-12T18:02:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.857+0000 7f2f2f322800 20 add_watcher() i=6 2024-09-12T18:02:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.858+0000 7f2f2f322800 20 add_watcher() i=7 2024-09-12T18:02:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.858+0000 7f2f2f322800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2f2f322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2f2f322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2f2f322800 5 note: GC not initialized 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2de0fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2f2f322800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.860+0000 7f2f2f322800 20 Filter name: none 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2d5a7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 INFO: main: starting shard=0 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.861+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.862+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.862+0000 7f2f2f322800 20 INFO: main: starting shard=1 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.862+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.862+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: starting shard=2 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: starting shard=3 2024-09-12T18:02:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 INFO: main: starting shard=4 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.863+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.864+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.864+0000 7f2f2f322800 20 INFO: main: starting shard=5 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.864+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.864+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 INFO: main: starting shard=6 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 INFO: main: starting shard=7 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.865+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 INFO: main: starting shard=8 2024-09-12T18:02:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 INFO: main: starting shard=9 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.866+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 INFO: main: starting shard=10 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 INFO: main: starting shard=11 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.867+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 20 INFO: main: starting shard=12 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.868+0000 7f2f2f322800 20 INFO: main: done 2024-09-12T18:02:00.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.869+0000 7f2de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:00.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.871+0000 7f2f2f322800 20 remove_watcher() i=0 2024-09-12T18:02:00.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.871+0000 7f2f2f322800 2 removed watcher, disabling cache 2024-09-12T18:02:00.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.872+0000 7f2f2f322800 20 remove_watcher() i=1 2024-09-12T18:02:00.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.873+0000 7f2f2f322800 20 remove_watcher() i=2 2024-09-12T18:02:00.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.874+0000 7f2f2f322800 20 remove_watcher() i=3 2024-09-12T18:02:00.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.875+0000 7f2f2f322800 20 remove_watcher() i=4 2024-09-12T18:02:00.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.876+0000 7f2f2f322800 20 remove_watcher() i=5 2024-09-12T18:02:00.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.877+0000 7f2f2f322800 20 remove_watcher() i=6 2024-09-12T18:02:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.878+0000 7f2f2f322800 20 remove_watcher() i=7 2024-09-12T18:02:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T18:02:00.922 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:00.922 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:00.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.959+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 20 realm 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.960+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.961+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.961+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.961+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.961+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.962+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.962+0000 7f122be20800 20 searching for the correct realm 2024-09-12T18:02:00.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.964+0000 7f1229109640 0 -- 172.21.15.94:0/1809743947 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f121c040040 msgr2=0x7f121c04d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:00.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:00.968+0000 7f122990a640 0 -- 172.21.15.94:0/1809743947 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f12200c1130 msgr2=0x7f12200c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.175+0000 7f122be20800 20 zone default found 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 4 Realm: () 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 zonegroup default 2024-09-12T18:02:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 started sync module instance, tier type = 2024-09-12T18:02:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.176+0000 7f122be20800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=0 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=1 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=2 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=3 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=4 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=5 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.185+0000 7f122be20800 20 add_watcher() i=6 2024-09-12T18:02:01.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.186+0000 7f122be20800 20 add_watcher() i=7 2024-09-12T18:02:01.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.186+0000 7f122be20800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.188+0000 7f10db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.188+0000 7f122be20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.188+0000 7f122be20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f122be20800 5 note: GC not initialized 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f10da7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f122be20800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f122be20800 20 Filter name: none 2024-09-12T18:02:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f104bfff640 20 reqs_thread_entry: start 2024-09-12T18:02:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f122be20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.189+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : miss 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.190+0000 7f122be20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f122be20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f122be20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f122be20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f122be20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f110cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529756 cookie 94107352188432 notifier 8018 bl.length()=827 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f110cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f110cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.194+0000 7f110cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.196+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:02:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.196+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:02:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.196+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:02:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.196+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:02:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T18:02:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T18:02:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.201+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.202+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.202+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.202+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.202+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.203+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.203+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.203+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.203+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:01.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.204+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:01.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.205+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:01.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.205+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.206+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.206+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.206+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.206+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:01.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.207+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:01.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.207+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:01.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.208+0000 7f122be20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:01.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.208+0000 7f122be20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:02:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.209+0000 7f122be20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.209+0000 7f122be20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.209+0000 7f122be20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.209+0000 7f122be20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:02:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.210+0000 7f110cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529757 cookie 94107352188432 notifier 8018 bl.length()=827 2024-09-12T18:02:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.210+0000 7f110cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.210+0000 7f110cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.210+0000 7f110cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.211+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:02:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.211+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:02:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.211+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:02:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.211+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:02:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.213+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.213+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.0 2024-09-12T18:02:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.1 2024-09-12T18:02:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.2 2024-09-12T18:02:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.214+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.3 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.4 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.5 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:01.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.215+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.6 2024-09-12T18:02:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.7 2024-09-12T18:02:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.8 2024-09-12T18:02:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.9 2024-09-12T18:02:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.216+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.10 2024-09-12T18:02:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.217+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.217+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.11 2024-09-12T18:02:01.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.217+0000 7f122be20800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:01.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.217+0000 7f122be20800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.2.12 2024-09-12T18:02:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.218+0000 7f122be20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.218+0000 7f122be20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 2024-09-12T18:02:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f122be20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f122be20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f122be20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f122be20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17, ofs0, ns] 2024-09-12T18:02:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f110d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529758 cookie 94107352188432 notifier 8018 bl.length()=795 2024-09-12T18:02:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f110d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 info.flags=0x17 2024-09-12T18:02:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f110d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17 to cache LRU end 2024-09-12T18:02:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.219+0000 7f110d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.221+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_sources= new_sources= 2024-09-12T18:02:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.221+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential sources added=[] removed=[] 2024-09-12T18:02:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.221+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): orig_dests= new_dests= 2024-09-12T18:02:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.221+0000 7f122be20800 20 handle_bi_update(): bucket=:a-bucket[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17]): potential dests added=[] removed=[] 2024-09-12T18:02:01.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.223+0000 7f122be20800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T18:02:01.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.225+0000 7f10db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.227+0000 7f122be20800 20 remove_watcher() i=0 2024-09-12T18:02:01.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.227+0000 7f122be20800 2 removed watcher, disabling cache 2024-09-12T18:02:01.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.228+0000 7f122be20800 20 remove_watcher() i=1 2024-09-12T18:02:01.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.229+0000 7f122be20800 20 remove_watcher() i=2 2024-09-12T18:02:01.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.230+0000 7f122be20800 20 remove_watcher() i=3 2024-09-12T18:02:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.231+0000 7f122be20800 20 remove_watcher() i=4 2024-09-12T18:02:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.232+0000 7f122be20800 20 remove_watcher() i=5 2024-09-12T18:02:01.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.233+0000 7f122be20800 20 remove_watcher() i=6 2024-09-12T18:02:01.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.234+0000 7f122be20800 20 remove_watcher() i=7 2024-09-12T18:02:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:02:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.310+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 realm 2024-09-12T18:02:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.312+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.313+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.313+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.313+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.313+0000 7fbc1c498800 20 searching for the correct realm 2024-09-12T18:02:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.317+0000 7fbc1a78a640 0 -- 172.21.15.94:0/260154518 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7fbc0402d070 msgr2=0x7fbc0404d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:01.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.523+0000 7fbc19f89640 0 -- 172.21.15.94:0/260154518 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x560ba7afe860 msgr2=0x560ba7b00d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.525+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 zone default found 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 4 Realm: () 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 zonegroup default 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.526+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 started sync module instance, tier type = 2024-09-12T18:02:01.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.527+0000 7fbc1c498800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=0 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=1 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=2 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=3 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=4 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=5 2024-09-12T18:02:01.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.537+0000 7fbc1c498800 20 add_watcher() i=6 2024-09-12T18:02:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.538+0000 7fbc1c498800 20 add_watcher() i=7 2024-09-12T18:02:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.538+0000 7fbc1c498800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:01.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.539+0000 7fbacb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 5 note: GC not initialized 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbaca7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 20 Filter name: none 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fba3bfff640 20 reqs_thread_entry: start 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.540+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T18:02:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 INFO: main: starting shard=0 2024-09-12T18:02:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T18:02:01.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.541+0000 7fbc1c498800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17.3.0 2024-09-12T18:02:01.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.542+0000 7fbc1c498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:01.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.542+0000 7fbc1c498800 20 INFO: main: done 2024-09-12T18:02:01.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.543+0000 7fbacb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.545+0000 7fbc1c498800 20 remove_watcher() i=0 2024-09-12T18:02:01.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.545+0000 7fbc1c498800 2 removed watcher, disabling cache 2024-09-12T18:02:01.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.546+0000 7fbc1c498800 20 remove_watcher() i=1 2024-09-12T18:02:01.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.547+0000 7fbc1c498800 20 remove_watcher() i=2 2024-09-12T18:02:01.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.548+0000 7fbc1c498800 20 remove_watcher() i=3 2024-09-12T18:02:01.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.549+0000 7fbc1c498800 20 remove_watcher() i=4 2024-09-12T18:02:01.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.550+0000 7fbc1c498800 20 remove_watcher() i=5 2024-09-12T18:02:01.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.551+0000 7fbc1c498800 20 remove_watcher() i=6 2024-09-12T18:02:01.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.552+0000 7fbc1c498800 20 remove_watcher() i=7 2024-09-12T18:02:01.563 INFO:tasks.workunit.client.0.smithi094.stderr: test: PUT succeeds during reshard 2024-09-12T18:02:01.565 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:02:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:01.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.628+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 realm 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.630+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.631+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.631+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.631+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:01.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.631+0000 7f22c8b40800 20 searching for the correct realm 2024-09-12T18:02:01.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.633+0000 7f22c48ed640 0 -- 172.21.15.94:0/1403718394 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f22bc020040 msgr2=0x7f22bc02e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:01.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.839+0000 7f22c50ee640 0 -- 172.21.15.94:0/1403718394 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f22b80a5c20 msgr2=0x7f22b8068a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.844+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 zone default found 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 4 Realm: () 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 zonegroup default 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.845+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 started sync module instance, tier type = 2024-09-12T18:02:01.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.846+0000 7f22c8b40800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=0 2024-09-12T18:02:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=1 2024-09-12T18:02:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=2 2024-09-12T18:02:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=3 2024-09-12T18:02:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=4 2024-09-12T18:02:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=5 2024-09-12T18:02:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.855+0000 7f22c8b40800 20 add_watcher() i=6 2024-09-12T18:02:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.856+0000 7f22c8b40800 20 add_watcher() i=7 2024-09-12T18:02:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.856+0000 7f22c8b40800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:01.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.858+0000 7f217b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.858+0000 7f22c8b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.858+0000 7f22c8b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.858+0000 7f22c8b40800 5 note: GC not initialized 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f217a7e4640 20 reqs_thread_entry: start 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f22c8b40800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f22c8b40800 20 Filter name: none 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f2173fff640 20 reqs_thread_entry: start 2024-09-12T18:02:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.859+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.860+0000 7f22c8b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.862+0000 7f217b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.864+0000 7f22c8b40800 20 remove_watcher() i=0 2024-09-12T18:02:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.864+0000 7f22c8b40800 2 removed watcher, disabling cache 2024-09-12T18:02:01.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.865+0000 7f22c8b40800 20 remove_watcher() i=1 2024-09-12T18:02:01.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.866+0000 7f22c8b40800 20 remove_watcher() i=2 2024-09-12T18:02:01.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.867+0000 7f22c8b40800 20 remove_watcher() i=3 2024-09-12T18:02:01.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.868+0000 7f22c8b40800 20 remove_watcher() i=4 2024-09-12T18:02:01.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.869+0000 7f22c8b40800 20 remove_watcher() i=5 2024-09-12T18:02:01.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.870+0000 7f22c8b40800 20 remove_watcher() i=6 2024-09-12T18:02:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.871+0000 7f22c8b40800 20 remove_watcher() i=7 2024-09-12T18:02:01.882 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:02:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-12T18:02:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:02:01.882 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:02:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T18:02:01.916 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:01.916 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.952+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 realm 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.953+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.954+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.954+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.954+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.954+0000 7effb5728800 20 searching for the correct realm 2024-09-12T18:02:01.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.957+0000 7effb1c4c640 0 -- 172.21.15.94:0/2432310068 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7eff9c0ac750 msgr2=0x7eff9c0bf960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:01.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:01.962+0000 7effb144b640 0 -- 172.21.15.94:0/2432310068 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7eff9c0c7310 msgr2=0x7eff9c0a41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.168+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 zone default found 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 4 Realm: () 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 zonegroup default 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.169+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.170+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.170+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.170+0000 7effb5728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.170+0000 7effb5728800 20 started sync module instance, tier type = 2024-09-12T18:02:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.170+0000 7effb5728800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=0 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=1 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=2 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=3 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=4 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=5 2024-09-12T18:02:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.180+0000 7effb5728800 20 add_watcher() i=6 2024-09-12T18:02:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.181+0000 7effb5728800 20 add_watcher() i=7 2024-09-12T18:02:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.181+0000 7effb5728800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.182+0000 7efe677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 5 note: GC not initialized 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7efe667e4640 20 reqs_thread_entry: start 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 Filter name: none 2024-09-12T18:02:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7efdd7fff640 20 reqs_thread_entry: start 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : miss 2024-09-12T18:02:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.183+0000 7effb5728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:02.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:02.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:02.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 10 adding default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:02.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:02.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:02.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.184+0000 7effb5728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.189+0000 7effb5728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.189+0000 7effb5728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.189+0000 7effb5728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.189+0000 7effb5728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.190+0000 7efe94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529759 cookie 94208436925136 notifier 8069 bl.length()=821 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.190+0000 7efe94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.190+0000 7efe94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.190+0000 7efe94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.191+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.191+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.191+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:02.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.191+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:02.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:02.196+0000 7effb5728800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T18:02:02.945 INFO:tasks.workunit.client.0.smithi094.stderr:put object successful 2024-09-12T18:02:07.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:07.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:07.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:07.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:02:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.196+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:02:07.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.197+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:02:07.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.197+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:02:07.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.198+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:02:07.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.198+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:02:07.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.198+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.198+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.199+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.199+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.200+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.200+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.201+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:02:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.201+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:02:07.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.202+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:02:07.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.202+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:02:07.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.203+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:02:07.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.203+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:02:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.204+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:02:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.204+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:02:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.204+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:02:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.204+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:02:07.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.205+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:02:07.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.205+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:02:07.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.207+0000 7effb5728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:07.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.208+0000 7effb5728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.209+0000 7effb5728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.209+0000 7effb5728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.209+0000 7effb5728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.209+0000 7effb5728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:07.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.210+0000 7efe94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529760 cookie 94208436925136 notifier 8069 bl.length()=821 2024-09-12T18:02:07.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.210+0000 7efe94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:07.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.210+0000 7efe94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:07.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.210+0000 7efe94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:07.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.211+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:07.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.211+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:07.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.211+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:07.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.211+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:02:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.0 2024-09-12T18:02:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:02:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.1 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.215+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.2 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.216+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.216+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.3 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.216+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:02:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.216+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.4 2024-09-12T18:02:07.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.217+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:02:07.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.217+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.5 2024-09-12T18:02:07.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.217+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:02:07.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.217+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.6 2024-09-12T18:02:07.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:02:07.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.7 2024-09-12T18:02:07.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:02:07.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.8 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.218+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.9 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.219+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.219+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.10 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.219+0000 7effb5728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:02:07.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.219+0000 7effb5728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.1.11 2024-09-12T18:02:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.222+0000 7effb5728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.222+0000 7effb5728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:07.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.223+0000 7effb5728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.223+0000 7effb5728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.223+0000 7effb5728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.223+0000 7effb5728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.224+0000 7efe83fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529761 cookie 94208436925136 notifier 8069 bl.length()=789 2024-09-12T18:02:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.224+0000 7efe83fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.224+0000 7efe83fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.224+0000 7efe83fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.225+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.225+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:07.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.225+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:07.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.225+0000 7effb5728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:07.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.228+0000 7effb5728800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T18:02:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.230+0000 7efe677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:07.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.233+0000 7effb5728800 20 remove_watcher() i=0 2024-09-12T18:02:07.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.233+0000 7effb5728800 2 removed watcher, disabling cache 2024-09-12T18:02:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.235+0000 7effb5728800 20 remove_watcher() i=1 2024-09-12T18:02:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.236+0000 7effb5728800 20 remove_watcher() i=2 2024-09-12T18:02:07.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.237+0000 7effb5728800 20 remove_watcher() i=3 2024-09-12T18:02:07.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.238+0000 7effb5728800 20 remove_watcher() i=4 2024-09-12T18:02:07.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.239+0000 7effb5728800 20 remove_watcher() i=5 2024-09-12T18:02:07.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.240+0000 7effb5728800 20 remove_watcher() i=6 2024-09-12T18:02:07.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:07.241+0000 7effb5728800 20 remove_watcher() i=7 2024-09-12T18:02:07.945 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T18:02:07.946 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:02:08.271 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:02:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:02:10.164 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:02:10.166 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T18:02:10.199 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:10.199 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:10.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.235+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 realm 2024-09-12T18:02:10.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.237+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.238+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.238+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.239+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:10.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.239+0000 7f96ad620800 20 searching for the correct realm 2024-09-12T18:02:10.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.242+0000 7f96aa910640 0 -- 172.21.15.94:0/4221482024 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56176de96480 msgr2=0x56176de98890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.246+0000 7f96ab111640 0 -- 172.21.15.94:0/4221482024 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f96a00773f0 msgr2=0x7f96a0077870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.251+0000 7f96ad620800 20 zone default found 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 4 Realm: () 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 zonegroup default 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 started sync module instance, tier type = 2024-09-12T18:02:10.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.252+0000 7f96ad620800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:10.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=0 2024-09-12T18:02:10.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=1 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=2 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=3 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=4 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=5 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.261+0000 7f96ad620800 20 add_watcher() i=6 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.262+0000 7f96ad620800 20 add_watcher() i=7 2024-09-12T18:02:10.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.262+0000 7f96ad620800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:10.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.264+0000 7f9561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.264+0000 7f96ad620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:10.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.264+0000 7f96ad620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:10.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.264+0000 7f96ad620800 5 note: GC not initialized 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f9560fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f96ad620800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f96ad620800 20 Filter name: none 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f94da7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:10.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.265+0000 7f96ad620800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 20 INFO: main: starting shard=0 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.266+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 INFO: main: starting shard=1 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 INFO: main: starting shard=2 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.267+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 INFO: main: starting shard=3 2024-09-12T18:02:10.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 INFO: main: starting shard=4 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.268+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 INFO: main: starting shard=5 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 INFO: main: starting shard=6 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.269+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 INFO: main: starting shard=7 2024-09-12T18:02:10.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 INFO: main: starting shard=8 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.270+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 INFO: main: starting shard=9 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 INFO: main: starting shard=10 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.271+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: starting shard=11 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: starting shard=12 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.272+0000 7f96ad620800 20 INFO: main: done 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.273+0000 7f9561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.275+0000 7f96ad620800 20 remove_watcher() i=0 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.275+0000 7f96ad620800 2 removed watcher, disabling cache 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.276+0000 7f96ad620800 20 remove_watcher() i=1 2024-09-12T18:02:10.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.277+0000 7f96ad620800 20 remove_watcher() i=2 2024-09-12T18:02:10.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.278+0000 7f96ad620800 20 remove_watcher() i=3 2024-09-12T18:02:10.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.279+0000 7f96ad620800 20 remove_watcher() i=4 2024-09-12T18:02:10.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.280+0000 7f96ad620800 20 remove_watcher() i=5 2024-09-12T18:02:10.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.281+0000 7f96ad620800 20 remove_watcher() i=6 2024-09-12T18:02:10.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.282+0000 7f96ad620800 20 remove_watcher() i=7 2024-09-12T18:02:10.403 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:02:10.405 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T18:02:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:10.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.471+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.472+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.472+0000 7f750752e800 20 realm 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.472+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.473+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.473+0000 7f750752e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.473+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.473+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.473+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.474+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.474+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.474+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:10.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.474+0000 7f750752e800 20 searching for the correct realm 2024-09-12T18:02:10.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.477+0000 7f74fbfff640 0 -- 172.21.15.94:0/3091392559 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f74f4049040 msgr2=0x7f74f401e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.481+0000 7f75032dd640 0 -- 172.21.15.94:0/3091392559 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f74ec0abee0 msgr2=0x7f74ec0cd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.686+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 zone default found 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 4 Realm: () 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 zonegroup default 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.687+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 started sync module instance, tier type = 2024-09-12T18:02:10.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.688+0000 7f750752e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=0 2024-09-12T18:02:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=1 2024-09-12T18:02:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=2 2024-09-12T18:02:10.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=3 2024-09-12T18:02:10.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=4 2024-09-12T18:02:10.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=5 2024-09-12T18:02:10.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.698+0000 7f750752e800 20 add_watcher() i=6 2024-09-12T18:02:10.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.699+0000 7f750752e800 20 add_watcher() i=7 2024-09-12T18:02:10.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.699+0000 7f750752e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:10.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f73b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f750752e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f750752e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f750752e800 5 note: GC not initialized 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f73b8fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.701+0000 7f750752e800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 Filter name: none 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f73327fc640 20 reqs_thread_entry: start 2024-09-12T18:02:10.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:10.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 INFO: main: starting shard=0 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.702+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 INFO: main: starting shard=1 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 INFO: main: starting shard=2 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.703+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 INFO: main: starting shard=3 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 INFO: main: starting shard=4 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.704+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.705+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.705+0000 7f750752e800 20 INFO: main: starting shard=5 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.705+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.705+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 INFO: main: starting shard=6 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 INFO: main: starting shard=7 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.706+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 INFO: main: starting shard=8 2024-09-12T18:02:10.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 INFO: main: starting shard=9 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.707+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 INFO: main: starting shard=10 2024-09-12T18:02:10.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 INFO: main: starting shard=11 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.708+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 20 INFO: main: starting shard=12 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.709+0000 7f750752e800 20 INFO: main: done 2024-09-12T18:02:10.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.710+0000 7f73b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.712+0000 7f750752e800 20 remove_watcher() i=0 2024-09-12T18:02:10.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.712+0000 7f750752e800 2 removed watcher, disabling cache 2024-09-12T18:02:10.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.714+0000 7f750752e800 20 remove_watcher() i=1 2024-09-12T18:02:10.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.715+0000 7f750752e800 20 remove_watcher() i=2 2024-09-12T18:02:10.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.716+0000 7f750752e800 20 remove_watcher() i=3 2024-09-12T18:02:10.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.717+0000 7f750752e800 20 remove_watcher() i=4 2024-09-12T18:02:10.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.718+0000 7f750752e800 20 remove_watcher() i=5 2024-09-12T18:02:10.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.719+0000 7f750752e800 20 remove_watcher() i=6 2024-09-12T18:02:10.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.720+0000 7f750752e800 20 remove_watcher() i=7 2024-09-12T18:02:10.839 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:02:10.841 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T18:02:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:10.872 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:10.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.906+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 20 realm 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.908+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.909+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.909+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.909+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.909+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.910+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:10.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.910+0000 7f7864934800 20 searching for the correct realm 2024-09-12T18:02:10.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.913+0000 7f7857fff640 0 -- 172.21.15.94:0/2886781111 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x560eefb717b0 msgr2=0x560eefb73be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.917+0000 7f7857fff640 0 -- 172.21.15.94:0/2886781111 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f7850018070 msgr2=0x7f7850067610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:10.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:10.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:10.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:10.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:10.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:10.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.922+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 zone default found 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 4 Realm: () 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:10.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 zonegroup default 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.923+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.924+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.924+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.924+0000 7f7864934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.924+0000 7f7864934800 20 started sync module instance, tier type = 2024-09-12T18:02:10.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.924+0000 7f7864934800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:10.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=0 2024-09-12T18:02:10.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=1 2024-09-12T18:02:10.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=2 2024-09-12T18:02:10.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=3 2024-09-12T18:02:10.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=4 2024-09-12T18:02:10.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=5 2024-09-12T18:02:10.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.933+0000 7f7864934800 20 add_watcher() i=6 2024-09-12T18:02:10.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.934+0000 7f7864934800 20 add_watcher() i=7 2024-09-12T18:02:10.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.934+0000 7f7864934800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:10.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 5 note: GC not initialized 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7715fdb640 20 reqs_thread_entry: start 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 20 Filter name: none 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f76877fe640 20 reqs_thread_entry: start 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.936+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:10.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:10.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 INFO: main: starting shard=0 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.937+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 INFO: main: starting shard=1 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 INFO: main: starting shard=2 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.938+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:10.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 INFO: main: starting shard=3 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 INFO: main: starting shard=4 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.939+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 INFO: main: starting shard=5 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 INFO: main: starting shard=6 2024-09-12T18:02:10.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.940+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 INFO: main: starting shard=7 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 INFO: main: starting shard=8 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.941+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 INFO: main: starting shard=9 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 INFO: main: starting shard=10 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.942+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: starting shard=11 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:10.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: starting shard=12 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.943+0000 7f7864934800 20 INFO: main: done 2024-09-12T18:02:10.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.944+0000 7f7716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.946+0000 7f7864934800 20 remove_watcher() i=0 2024-09-12T18:02:10.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.946+0000 7f7864934800 2 removed watcher, disabling cache 2024-09-12T18:02:10.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.947+0000 7f7864934800 20 remove_watcher() i=1 2024-09-12T18:02:10.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.948+0000 7f7864934800 20 remove_watcher() i=2 2024-09-12T18:02:10.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.949+0000 7f7864934800 20 remove_watcher() i=3 2024-09-12T18:02:10.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.950+0000 7f7864934800 20 remove_watcher() i=4 2024-09-12T18:02:10.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.951+0000 7f7864934800 20 remove_watcher() i=5 2024-09-12T18:02:10.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.952+0000 7f7864934800 20 remove_watcher() i=6 2024-09-12T18:02:10.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:10.953+0000 7f7864934800 20 remove_watcher() i=7 2024-09-12T18:02:10.988 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:02:11.376 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:02:11.772 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T18:02:11.803 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:11.804 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:11.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.839+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 20 realm 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.840+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.841+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.841+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.842+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:11.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.842+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.842+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:11.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.842+0000 7f10ea728800 20 searching for the correct realm 2024-09-12T18:02:11.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:11.846+0000 7f10e6c4c640 0 -- 172.21.15.94:0/2582612633 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f10d009d920 msgr2=0x7f10d0089400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.052+0000 7f10e644b640 0 -- 172.21.15.94:0/2582612633 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x55e98af4a520 msgr2=0x55e98af4c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:12.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:12.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.055+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 zone default found 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 4 Realm: () 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:12.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 zonegroup default 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.056+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.057+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.057+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.057+0000 7f10ea728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.057+0000 7f10ea728800 20 started sync module instance, tier type = 2024-09-12T18:02:12.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.057+0000 7f10ea728800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=0 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=1 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=2 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=3 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=4 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=5 2024-09-12T18:02:12.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.066+0000 7f10ea728800 20 add_watcher() i=6 2024-09-12T18:02:12.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.067+0000 7f10ea728800 20 add_watcher() i=7 2024-09-12T18:02:12.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.067+0000 7f10ea728800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:12.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f0f9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f10ea728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:12.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f10ea728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:12.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f10ea728800 5 note: GC not initialized 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f0f177fe640 20 reqs_thread_entry: start 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f10ea728800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.069+0000 7f10ea728800 20 Filter name: none 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f0f157fa640 20 reqs_thread_entry: start 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : miss 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:12.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 adding default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:12.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.070+0000 7f10ea728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:12.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f10ea728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f10ea728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f10ea728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f10ea728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:12.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f0fc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529762 cookie 94461547080848 notifier 8652 bl.length()=821 2024-09-12T18:02:12.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f0fc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f0fc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.077+0000 7f0fc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.079+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:12.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.079+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:12.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.079+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:12.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.079+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:12.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.0 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.0 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.1 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.1 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.2 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.2 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.3 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.3 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.4 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.4 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.5 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.5 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.6 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.6 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.7 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.7 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.8 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.8 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.10 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.10 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.11 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.11 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.12 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.12 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.13 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.13 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.14 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.14 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.15 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.15 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.16 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.16 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.084+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.085+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.085+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:12.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.085+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:12.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.085+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.086+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.086+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.086+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.086+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.087+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.087+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.088+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.088+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.088+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.088+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.089+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.089+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.089+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.089+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.090+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:12.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.090+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:12.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.090+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:12.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.090+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:12.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.091+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:12.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.091+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:12.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.093+0000 7f10ea728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:12.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.093+0000 7f10ea728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:12.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f10ea728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f10ea728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f10ea728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f10ea728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f0fc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529763 cookie 94461547080848 notifier 8652 bl.length()=821 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f0fc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f0fc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.095+0000 7f0fc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.096+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:12.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.096+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:12.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.096+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:12.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.096+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:12.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:12.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.0 2024-09-12T18:02:12.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:12.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.1 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.099+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.2 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.100+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.100+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.3 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.100+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:12.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.100+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.4 2024-09-12T18:02:12.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:12.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.5 2024-09-12T18:02:12.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:12.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.6 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.101+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.7 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.8 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:12.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.9 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.10 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.102+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.11 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.103+0000 7f10ea728800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.103+0000 7f10ea728800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.2.12 2024-09-12T18:02:12.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.103+0000 7f10ea728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:12.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.103+0000 7f10ea728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:12.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.104+0000 7f10ea728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.104+0000 7f10ea728800 10 moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.104+0000 7f10ea728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.104+0000 7f10ea728800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18, ofs0, ns] 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.105+0000 7f0fc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529764 cookie 94461547080848 notifier 8652 bl.length()=789 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.105+0000 7f0fc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.105+0000 7f0fc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.105+0000 7f0fc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.106+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_sources= new_sources= 2024-09-12T18:02:12.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.106+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential sources added=[] removed=[] 2024-09-12T18:02:12.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.106+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): orig_dests= new_dests= 2024-09-12T18:02:12.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.106+0000 7f10ea728800 20 handle_bi_update(): bucket=:myver[42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18]): potential dests added=[] removed=[] 2024-09-12T18:02:12.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.108+0000 7f10ea728800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T18:02:12.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.110+0000 7f0f9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.112+0000 7f10ea728800 20 remove_watcher() i=0 2024-09-12T18:02:12.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.112+0000 7f10ea728800 2 removed watcher, disabling cache 2024-09-12T18:02:12.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.113+0000 7f10ea728800 20 remove_watcher() i=1 2024-09-12T18:02:12.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.114+0000 7f10ea728800 20 remove_watcher() i=2 2024-09-12T18:02:12.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.116+0000 7f10ea728800 20 remove_watcher() i=3 2024-09-12T18:02:12.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.117+0000 7f10ea728800 20 remove_watcher() i=4 2024-09-12T18:02:12.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.117+0000 7f10ea728800 20 remove_watcher() i=5 2024-09-12T18:02:12.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.118+0000 7f10ea728800 20 remove_watcher() i=6 2024-09-12T18:02:12.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.119+0000 7f10ea728800 20 remove_watcher() i=7 2024-09-12T18:02:12.132 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:02:12.167 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:12.167 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:12.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.202+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.203+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.203+0000 7fb29ef26800 20 realm 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.203+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.204+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.204+0000 7fb29ef26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.204+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.204+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.204+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.205+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.205+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.205+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:12.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.205+0000 7fb29ef26800 20 searching for the correct realm 2024-09-12T18:02:12.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.209+0000 7fb29b44c640 0 -- 172.21.15.94:0/3056598005 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55a32242b390 msgr2=0x55a32242d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.212+0000 7fb29ac4b640 0 -- 172.21.15.94:0/3056598005 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fb290068f00 msgr2=0x7fb290070800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:12.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 zone default found 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 4 Realm: () 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:12.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 zonegroup default 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.217+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 started sync module instance, tier type = 2024-09-12T18:02:12.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.218+0000 7fb29ef26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:12.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=0 2024-09-12T18:02:12.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=1 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=2 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=3 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=4 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=5 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.227+0000 7fb29ef26800 20 add_watcher() i=6 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.228+0000 7fb29ef26800 20 add_watcher() i=7 2024-09-12T18:02:12.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.228+0000 7fb29ef26800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:12.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.230+0000 7fb1517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.230+0000 7fb29ef26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.230+0000 7fb29ef26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.230+0000 7fb29ef26800 5 note: GC not initialized 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.230+0000 7fb0cbfff640 20 reqs_thread_entry: start 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 20 Filter name: none 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb0c9ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:02:12.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:12.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 : miss 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.231+0000 7fb29ef26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 info.flags=0x17 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 adding default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 to cache LRU end 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.0 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.0 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:02:12.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.1 2024-09-12T18:02:12.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.1 2024-09-12T18:02:12.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:02:12.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.2 2024-09-12T18:02:12.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.232+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.2 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.233+0000 7fb29ef26800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.233+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.3 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.233+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.3 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.4 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.4 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.5 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.234+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.5 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.6 2024-09-12T18:02:12.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.6 2024-09-12T18:02:12.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:02:12.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.7 2024-09-12T18:02:12.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.235+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.7 2024-09-12T18:02:12.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:02:12.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.8 2024-09-12T18:02:12.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.8 2024-09-12T18:02:12.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T18:02:12.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.236+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.237+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.10 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.237+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.10 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.237+0000 7fb29ef26800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.237+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.11 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.237+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.11 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.12 2024-09-12T18:02:12.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.12 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.13 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.238+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.13 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.14 2024-09-12T18:02:12.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.14 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.15 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.239+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.15 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.240+0000 7fb29ef26800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.240+0000 7fb29ef26800 10 bucket_obj is .dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.16 2024-09-12T18:02:12.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.240+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.16 2024-09-12T18:02:12.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.240+0000 7fb29ef26800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T18:02:12.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.241+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.241+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:x state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.242+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to c4qb6gx9yp1d9c3rowgtuq19bb98n93b 2024-09-12T18:02:12.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.242+0000 7fb29ef26800 20 get_obj_state_impl: setting s->olh_tag to ncjye0cvzyjywgu6kxjspvsa6zbpcco9 2024-09-12T18:02:12.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.242+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ncjye0cvzyjywgu6kxjspvsa6zbpcco9 2024-09-12T18:02:12.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.243+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.245+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=3 key=x[8Yq1pV22HxikKXh9uvMuMB1J-jdQG4B] 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:8Yq1pV22HxikKXh9uvMuMB1J-jdQG4B_x state=0x55a3224a4508 s->prefetch_data=0 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 10 manifest: total_size = 22 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12011695715570310377 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:8Yq1pV22HxikKXh9uvMuMB1J-jdQG4B_x state=0x55a3224a4508 s->prefetch_data=0 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 prepare_atomic_modification: state is not atomic. state=0x55a3224a4508 2024-09-12T18:02:12.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.246+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.249+0000 7fb29ef26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:02:12.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.249+0000 7fb29ef26800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:02:12.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.249+0000 7fb29ef26800 0 deleting objects inline since gc isn't initialized 2024-09-12T18:02:12.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.249+0000 7fb29ef26800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:8Yq1pV22HxikKXh9uvMuMB1J-jdQG4B_.n2sOvIFlp44YIL_zFRQMPfDjy29IefD_0 2024-09-12T18:02:12.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.251+0000 7fb29ef26800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:02:12.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.251+0000 7fb17dffb640 20 handle_completion(): completion ok for obj=x[8Yq1pV22HxikKXh9uvMuMB1J-jdQG4B] 2024-09-12T18:02:12.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.252+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:x state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.252+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ncjye0cvzyjywgu6kxjspvsa6zbpcco9 2024-09-12T18:02:12.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.256+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.257+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.257+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.258+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:y state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.258+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to r02fhwehra9uf96rtc99cwip3nsfycrz 2024-09-12T18:02:12.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.258+0000 7fb29ef26800 20 get_obj_state_impl: setting s->olh_tag to i4owu1yxia901cjyu87nkljflrdmyddr 2024-09-12T18:02:12.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.258+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i4owu1yxia901cjyu87nkljflrdmyddr 2024-09-12T18:02:12.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.260+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.261+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=3 key=y[upbKLKgXbtPcdTb0kmF2xHz5UKXB4YJ] 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:upbKLKgXbtPcdTb0kmF2xHz5UKXB4YJ_y state=0x55a3224a64f8 s->prefetch_data=0 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 10 manifest: total_size = 12 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11307565516668411304 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:upbKLKgXbtPcdTb0kmF2xHz5UKXB4YJ_y state=0x55a3224a64f8 s->prefetch_data=0 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 prepare_atomic_modification: state is not atomic. state=0x55a3224a64f8 2024-09-12T18:02:12.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.262+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.265+0000 7fb29ef26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:02:12.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.265+0000 7fb29ef26800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T18:02:12.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.265+0000 7fb29ef26800 0 deleting objects inline since gc isn't initialized 2024-09-12T18:02:12.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.265+0000 7fb29ef26800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:upbKLKgXbtPcdTb0kmF2xHz5UKXB4YJ_.x_nxavQMpmRKkQgAYPT-Q5FVcUNkwQO_0 2024-09-12T18:02:12.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.266+0000 7fb17e7fc640 20 handle_completion(): completion ok for obj=y[upbKLKgXbtPcdTb0kmF2xHz5UKXB4YJ] 2024-09-12T18:02:12.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.266+0000 7fb29ef26800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:02:12.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.268+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:y state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.268+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i4owu1yxia901cjyu87nkljflrdmyddr 2024-09-12T18:02:12.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.271+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.272+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.273+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.273+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:z state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.273+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to hl17hahynfpfw9vbirqc113tq556u1a7 2024-09-12T18:02:12.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.273+0000 7fb29ef26800 20 get_obj_state_impl: setting s->olh_tag to wcmocqco7vu545cwx0zh6lotydycs765 2024-09-12T18:02:12.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.273+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wcmocqco7vu545cwx0zh6lotydycs765 2024-09-12T18:02:12.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.275+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.276+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.276+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.276+0000 7fb29ef26800 20 olh_log_entry: epoch=2 op=3 key=z[EG9euuU0SMw80-o9XEnD6zRYnCUUNVj] 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.276+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:EG9euuU0SMw80-o9XEnD6zRYnCUUNVj_z state=0x55a3224a64f8 s->prefetch_data=0 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.277+0000 7fb29ef26800 10 manifest: total_size = 12 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.277+0000 7fb29ef26800 20 get_obj_state: setting s->obj_tag to 42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8104353720517375885 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.277+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:_:EG9euuU0SMw80-o9XEnD6zRYnCUUNVj_z state=0x55a3224a64f8 s->prefetch_data=0 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.277+0000 7fb29ef26800 20 prepare_atomic_modification: state is not atomic. state=0x55a3224a64f8 2024-09-12T18:02:12.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.277+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.279+0000 7fb29ef26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:02:12.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.279+0000 7fb29ef26800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T18:02:12.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.279+0000 7fb29ef26800 0 deleting objects inline since gc isn't initialized 2024-09-12T18:02:12.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.279+0000 7fb29ef26800 5 delete_objs_inline: removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:EG9euuU0SMw80-o9XEnD6zRYnCUUNVj_.3hhoqNmp93K0OiJ0bQMh-TCI_sV_jvO_0 2024-09-12T18:02:12.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.280+0000 7fb17e7fc640 20 handle_completion(): completion ok for obj=z[EG9euuU0SMw80-o9XEnD6zRYnCUUNVj] 2024-09-12T18:02:12.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.280+0000 7fb29ef26800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:02:12.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.282+0000 7fb29ef26800 20 get_obj_state: octx=0x55a32219f190 obj=myver:z state=0x55a322466a28 s->prefetch_data=0 2024-09-12T18:02:12.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.282+0000 7fb29ef26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wcmocqco7vu545cwx0zh6lotydycs765 2024-09-12T18:02:12.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.284+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.286+0000 7fb29ef26800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18.3.9 2024-09-12T18:02:12.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.286+0000 7fb29ef26800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T18:02:12.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.286+0000 7fb29ef26800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T18:02:12.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.287+0000 7fb1517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.289+0000 7fb29ef26800 20 remove_watcher() i=0 2024-09-12T18:02:12.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.289+0000 7fb29ef26800 2 removed watcher, disabling cache 2024-09-12T18:02:12.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.290+0000 7fb29ef26800 20 remove_watcher() i=1 2024-09-12T18:02:12.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.291+0000 7fb29ef26800 20 remove_watcher() i=2 2024-09-12T18:02:12.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.292+0000 7fb29ef26800 20 remove_watcher() i=3 2024-09-12T18:02:12.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.293+0000 7fb29ef26800 20 remove_watcher() i=4 2024-09-12T18:02:12.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.294+0000 7fb29ef26800 20 remove_watcher() i=5 2024-09-12T18:02:12.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.295+0000 7fb29ef26800 20 remove_watcher() i=6 2024-09-12T18:02:12.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.295+0000 7fb29ef26800 20 remove_watcher() i=7 2024-09-12T18:02:12.445 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:02:12.473 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:12.474 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:12.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.509+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 realm 2024-09-12T18:02:12.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:12.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.511+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.512+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.512+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.512+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:12.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.512+0000 7fb194d23800 20 searching for the correct realm 2024-09-12T18:02:12.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.515+0000 7fb18bfff640 0 -- 172.21.15.94:0/3025064998 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fb18408d040 msgr2=0x7fb184061080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.519+0000 7fb190a13640 0 -- 172.21.15.94:0/3025064998 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fb17c017070 msgr2=0x7fb17c081eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:12.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.725+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 zone default found 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 4 Realm: () 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:12.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 zonegroup default 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.726+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.727+0000 7fb194d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.727+0000 7fb194d23800 20 started sync module instance, tier type = 2024-09-12T18:02:12.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.727+0000 7fb194d23800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:12.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=0 2024-09-12T18:02:12.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=1 2024-09-12T18:02:12.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=2 2024-09-12T18:02:12.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=3 2024-09-12T18:02:12.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=4 2024-09-12T18:02:12.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=5 2024-09-12T18:02:12.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.736+0000 7fb194d23800 20 add_watcher() i=6 2024-09-12T18:02:12.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.737+0000 7fb194d23800 20 add_watcher() i=7 2024-09-12T18:02:12.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.737+0000 7fb194d23800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb046fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 5 note: GC not initialized 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb045fe3640 20 reqs_thread_entry: start 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:12.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 20 Filter name: none 2024-09-12T18:02:12.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fafb77fe640 20 reqs_thread_entry: start 2024-09-12T18:02:12.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.739+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.740+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:12.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.740+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.740+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.740+0000 7fb194d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.740+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.741+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.741+0000 7fb194d23800 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.741+0000 7fb194d23800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.741+0000 7fb194d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:12.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.743+0000 7fb046fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.745+0000 7fb194d23800 20 remove_watcher() i=0 2024-09-12T18:02:12.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.745+0000 7fb194d23800 2 removed watcher, disabling cache 2024-09-12T18:02:12.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.746+0000 7fb194d23800 20 remove_watcher() i=1 2024-09-12T18:02:12.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.747+0000 7fb194d23800 20 remove_watcher() i=2 2024-09-12T18:02:12.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.748+0000 7fb194d23800 20 remove_watcher() i=3 2024-09-12T18:02:12.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.749+0000 7fb194d23800 20 remove_watcher() i=4 2024-09-12T18:02:12.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.750+0000 7fb194d23800 20 remove_watcher() i=5 2024-09-12T18:02:12.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.751+0000 7fb194d23800 20 remove_watcher() i=6 2024-09-12T18:02:12.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:02:12.752+0000 7fb194d23800 20 remove_watcher() i=7 2024-09-12T18:02:12.764 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:02:12.764 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket a-bucket 2024-09-12T18:02:12.840 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket myver 2024-09-12T18:02:13.080 INFO:tasks.workunit.client.0.smithi094.stderr:Completed resharding tests 2024-09-12T18:02:13.081 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-12T18:02:13.156 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-12T18:02:13.156 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:02:13.157 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-12T18:02:13.158 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-12T18:02:13.159 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-12T18:02:13.159 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:02:13.159 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:02:13.238 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T18:02:13.238 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:02:13.628 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:13.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:02:13.667 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:02:13.667 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:13.737 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:02:13.737 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T18:02:13.751 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T18:02:13.752 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T18:02:13.752 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T18:02:13.752 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:02:13.805 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T18:02:18.158 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T18:02:18.158 DEBUG:teuthology.orchestra.run.smithi094:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T18:02:20.044 INFO:teuthology.orchestra.run.smithi094.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T18:02:20.610 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:30:02 ago on Thu 12 Sep 2024 05:32:18 PM UTC. 2024-09-12T18:02:20.751 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-12T18:02:20.752 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout:Install 5 Packages 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:20.753 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 46 M 2024-09-12T18:02:20.754 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 166 M 2024-09-12T18:02:20.754 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-12T18:02:21.035 INFO:teuthology.orchestra.run.smithi094.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.8 MB/s | 426 kB 00:00 2024-09-12T18:02:21.693 INFO:teuthology.orchestra.run.smithi094.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 3.9 MB/s | 3.5 MB 00:00 2024-09-12T18:02:21.735 INFO:teuthology.orchestra.run.smithi094.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 622 kB/s | 26 kB 00:00 2024-09-12T18:02:23.310 INFO:teuthology.orchestra.run.smithi094.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 3.7 MB/s | 9.3 MB 00:02 2024-09-12T18:02:29.477 INFO:teuthology.orchestra.run.smithi094.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 3.8 MB/s | 32 MB 00:08 2024-09-12T18:02:29.478 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-12T18:02:29.478 INFO:teuthology.orchestra.run.smithi094.stdout:Total 5.2 MB/s | 46 MB 00:08 2024-09-12T18:02:29.898 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-12T18:02:29.919 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-12T18:02:29.919 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-12T18:02:30.400 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-12T18:02:30.401 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-12T18:02:30.924 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-12T18:02:31.252 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T18:02:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T18:02:31.912 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T18:02:32.149 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T18:02:32.180 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T18:02:32.407 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T18:02:32.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T18:02:32.460 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T18:02:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T18:02:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T18:02:35.463 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T18:02:35.463 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T18:02:35.463 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T18:02:35.463 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T18:02:35.463 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T18:02:35.884 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T18:02:35.885 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T18:02:35.885 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T18:02:35.885 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:35.885 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-12T18:02:36.322 INFO:teuthology.orchestra.run.smithi094.stdout: Gradle will be installed under /opt/gradle 2024-09-12T18:02:36.399 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-12 18:02:36-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T18:02:36.757 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-12T18:02:36.771 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T18:02:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T18:02:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T18:02:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-12 18:02:36-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T18:02:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-12T18:02:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-12T18:02:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T18:02:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T180237Z&X-Amz-Expires=300&X-Amz-Signature=1e8681a84789ca1e5f940a0e81124a7b59e7f37393d83b625576a98ae041f874&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T18:02:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-12 18:02:37-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T180237Z&X-Amz-Expires=300&X-Amz-Signature=1e8681a84789ca1e5f940a0e81124a7b59e7f37393d83b625576a98ae041f874&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T18:02:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.108.133, ... 2024-09-12T18:02:37.051 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T18:02:37.126 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T18:02:37.126 INFO:teuthology.orchestra.run.smithi094.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T18:02:37.126 INFO:teuthology.orchestra.run.smithi094.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T18:02:37.126 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:02:37.150 INFO:teuthology.orchestra.run.smithi094.stderr: 0K .......... .......... .......... .......... .......... 0% 2.01M 45s 2024-09-12T18:02:37.153 INFO:teuthology.orchestra.run.smithi094.stderr: 50K .......... .......... .......... .......... .......... 0% 11.4M 26s 2024-09-12T18:02:37.161 INFO:teuthology.orchestra.run.smithi094.stderr: 100K .......... .......... .......... .......... .......... 0% 6.19M 23s 2024-09-12T18:02:37.164 INFO:teuthology.orchestra.run.smithi094.stderr: 150K .......... .......... .......... .......... .......... 0% 15.2M 18s 2024-09-12T18:02:37.166 INFO:teuthology.orchestra.run.smithi094.stderr: 200K .......... .......... .......... .......... .......... 0% 24.8M 15s 2024-09-12T18:02:37.169 INFO:teuthology.orchestra.run.smithi094.stderr: 250K .......... .......... .......... .......... .......... 0% 23.8M 13s 2024-09-12T18:02:37.176 INFO:teuthology.orchestra.run.smithi094.stderr: 300K .......... .......... .......... .......... .......... 0% 7.20M 13s 2024-09-12T18:02:37.176 INFO:teuthology.orchestra.run.smithi094.stderr: 350K .......... .......... .......... .......... .......... 0% 58.2M 12s 2024-09-12T18:02:37.177 INFO:teuthology.orchestra.run.smithi094.stderr: 400K .......... .......... .......... .......... .......... 0% 40.6M 11s 2024-09-12T18:02:37.179 INFO:teuthology.orchestra.run.smithi094.stderr: 450K .......... .......... .......... .......... .......... 0% 30.9M 10s 2024-09-12T18:02:37.179 INFO:teuthology.orchestra.run.smithi094.stderr: 500K .......... .......... .......... .......... .......... 0% 103M 9s 2024-09-12T18:02:37.181 INFO:teuthology.orchestra.run.smithi094.stderr: 550K .......... .......... .......... .......... .......... 0% 33.5M 9s 2024-09-12T18:02:37.186 INFO:teuthology.orchestra.run.smithi094.stderr: 600K .......... .......... .......... .......... .......... 0% 9.95M 9s 2024-09-12T18:02:37.186 INFO:teuthology.orchestra.run.smithi094.stderr: 650K .......... .......... .......... .......... .......... 0% 234M 8s 2024-09-12T18:02:37.187 INFO:teuthology.orchestra.run.smithi094.stderr: 700K .......... .......... .......... .......... .......... 0% 36.2M 8s 2024-09-12T18:02:37.189 INFO:teuthology.orchestra.run.smithi094.stderr: 750K .......... .......... .......... .......... .......... 0% 41.9M 7s 2024-09-12T18:02:37.190 INFO:teuthology.orchestra.run.smithi094.stderr: 800K .......... .......... .......... .......... .......... 0% 59.4M 7s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 850K .......... .......... .......... .......... .......... 0% 64.2M 7s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 900K .......... .......... .......... .......... .......... 1% 329M 6s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 950K .......... .......... .......... .......... .......... 1% 177M 6s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 1000K .......... .......... .......... .......... .......... 1% 43.9M 6s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 1050K .......... .......... .......... .......... .......... 1% 233M 6s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 1100K .......... .......... .......... .......... .......... 1% 323M 5s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 1150K .......... .......... .......... .......... .......... 1% 33.8M 5s 2024-09-12T18:02:37.196 INFO:teuthology.orchestra.run.smithi094.stderr: 1200K .......... .......... .......... .......... .......... 1% 181M 5s 2024-09-12T18:02:38.666 INFO:teuthology.orchestra.run.smithi094.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.4M 5s 2024-09-12T18:02:38.666 INFO:teuthology.orchestra.run.smithi094.stderr: 1300K .......... .......... .......... .......... .......... 1% 334M 5s 2024-09-12T18:02:38.666 INFO:teuthology.orchestra.run.smithi094.stderr: 1350K .......... .......... .......... .......... .......... 1% 396M 5s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1400K .......... .......... .......... .......... .......... 1% 40.2M 5s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1450K .......... .......... .......... .......... .......... 1% 182M 5s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1500K .......... .......... .......... .......... .......... 1% 70.5M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1550K .......... .......... .......... .......... .......... 1% 395M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1600K .......... .......... .......... .......... .......... 1% 232M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1650K .......... .......... .......... .......... .......... 1% 69.0M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1700K .......... .......... .......... .......... .......... 1% 168M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1750K .......... .......... .......... .......... .......... 1% 91.7M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1800K .......... .......... .......... .......... .......... 1% 85.6M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1850K .......... .......... .......... .......... .......... 2% 176M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1900K .......... .......... .......... .......... .......... 2% 137M 4s 2024-09-12T18:02:38.667 INFO:teuthology.orchestra.run.smithi094.stderr: 1950K .......... .......... .......... .......... .......... 2% 351M 4s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2000K .......... .......... .......... .......... .......... 2% 139M 4s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2050K .......... .......... .......... .......... .......... 2% 322M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2100K .......... .......... .......... .......... .......... 2% 419M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2150K .......... .......... .......... .......... .......... 2% 256M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2200K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2250K .......... .......... .......... .......... .......... 2% 425M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2300K .......... .......... .......... .......... .......... 2% 58.1M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2350K .......... .......... .......... .......... .......... 2% 415M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2400K .......... .......... .......... .......... .......... 2% 102M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2450K .......... .......... .......... .......... .......... 2% 431M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2500K .......... .......... .......... .......... .......... 2% 361M 3s 2024-09-12T18:02:38.668 INFO:teuthology.orchestra.run.smithi094.stderr: 2550K .......... .......... .......... .......... .......... 2% 13.8M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2600K .......... .......... .......... .......... .......... 2% 357M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2650K .......... .......... .......... .......... .......... 2% 236M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2700K .......... .......... .......... .......... .......... 2% 325M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2750K .......... .......... .......... .......... .......... 3% 252M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2800K .......... .......... .......... .......... .......... 3% 70.6M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2850K .......... .......... .......... .......... .......... 3% 298M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2900K .......... .......... .......... .......... .......... 3% 169M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 2950K .......... .......... .......... .......... .......... 3% 420M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 3000K .......... .......... .......... .......... .......... 3% 316M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 3050K .......... .......... .......... .......... .......... 3% 130M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 3100K .......... .......... .......... .......... .......... 3% 166M 3s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 3150K .......... .......... .......... .......... .......... 3% 344M 2s 2024-09-12T18:02:38.669 INFO:teuthology.orchestra.run.smithi094.stderr: 3200K .......... .......... .......... .......... .......... 3% 327M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3250K .......... .......... .......... .......... .......... 3% 421M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3300K .......... .......... .......... .......... .......... 3% 140M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3350K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3400K .......... .......... .......... .......... .......... 3% 126M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3450K .......... .......... .......... .......... .......... 3% 299M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3500K .......... .......... .......... .......... .......... 3% 426M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3550K .......... .......... .......... .......... .......... 3% 86.7M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3600K .......... .......... .......... .......... .......... 3% 291M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3650K .......... .......... .......... .......... .......... 3% 74.6M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3700K .......... .......... .......... .......... .......... 4% 363M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3750K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3800K .......... .......... .......... .......... .......... 4% 292M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3850K .......... .......... .......... .......... .......... 4% 309M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3900K .......... .......... .......... .......... .......... 4% 425M 2s 2024-09-12T18:02:38.670 INFO:teuthology.orchestra.run.smithi094.stderr: 3950K .......... .......... .......... .......... .......... 4% 357M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4000K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4050K .......... .......... .......... .......... .......... 4% 301M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4100K .......... .......... .......... .......... .......... 4% 277M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4150K .......... .......... .......... .......... .......... 4% 410M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4200K .......... .......... .......... .......... .......... 4% 313M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4250K .......... .......... .......... .......... .......... 4% 209M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4300K .......... .......... .......... .......... .......... 4% 141M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4350K .......... .......... .......... .......... .......... 4% 424M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4400K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4450K .......... .......... .......... .......... .......... 4% 434M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4500K .......... .......... .......... .......... .......... 4% 424M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4550K .......... .......... .......... .......... .......... 4% 389M 2s 2024-09-12T18:02:38.671 INFO:teuthology.orchestra.run.smithi094.stderr: 4600K .......... .......... .......... .......... .......... 5% 395M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4650K .......... .......... .......... .......... .......... 5% 443M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4700K .......... .......... .......... .......... .......... 5% 428M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4750K .......... .......... .......... .......... .......... 5% 437M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4800K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4850K .......... .......... .......... .......... .......... 5% 428M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4900K .......... .......... .......... .......... .......... 5% 358M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 4950K .......... .......... .......... .......... .......... 5% 409M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5000K .......... .......... .......... .......... .......... 5% 337M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5050K .......... .......... .......... .......... .......... 5% 448M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5100K .......... .......... .......... .......... .......... 5% 23.6M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5150K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5200K .......... .......... .......... .......... .......... 5% 65.0M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5250K .......... .......... .......... .......... .......... 5% 324M 2s 2024-09-12T18:02:38.672 INFO:teuthology.orchestra.run.smithi094.stderr: 5300K .......... .......... .......... .......... .......... 5% 317M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5350K .......... .......... .......... .......... .......... 5% 402M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5400K .......... .......... .......... .......... .......... 5% 395M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5450K .......... .......... .......... .......... .......... 5% 417M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5500K .......... .......... .......... .......... .......... 5% 435M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5550K .......... .......... .......... .......... .......... 6% 400M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5600K .......... .......... .......... .......... .......... 6% 238M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5650K .......... .......... .......... .......... .......... 6% 278M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5700K .......... .......... .......... .......... .......... 6% 296M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5750K .......... .......... .......... .......... .......... 6% 189M 2s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5800K .......... .......... .......... .......... .......... 6% 301M 1s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5850K .......... .......... .......... .......... .......... 6% 226M 1s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5900K .......... .......... .......... .......... .......... 6% 209M 1s 2024-09-12T18:02:38.673 INFO:teuthology.orchestra.run.smithi094.stderr: 5950K .......... .......... .......... .......... .......... 6% 237M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6000K .......... .......... .......... .......... .......... 6% 350M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6050K .......... .......... .......... .......... .......... 6% 425M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6100K .......... .......... .......... .......... .......... 6% 328M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6150K .......... .......... .......... .......... .......... 6% 393M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6200K .......... .......... .......... .......... .......... 6% 375M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6250K .......... .......... .......... .......... .......... 6% 428M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6300K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6350K .......... .......... .......... .......... .......... 6% 431M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6400K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6450K .......... .......... .......... .......... .......... 6% 444M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6500K .......... .......... .......... .......... .......... 7% 440M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6550K .......... .......... .......... .......... .......... 7% 442M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6600K .......... .......... .......... .......... .......... 7% 88.3M 1s 2024-09-12T18:02:38.674 INFO:teuthology.orchestra.run.smithi094.stderr: 6650K .......... .......... .......... .......... .......... 7% 416M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6700K .......... .......... .......... .......... .......... 7% 267M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6750K .......... .......... .......... .......... .......... 7% 429M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6800K .......... .......... .......... .......... .......... 7% 434M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6850K .......... .......... .......... .......... .......... 7% 435M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6900K .......... .......... .......... .......... .......... 7% 232M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 6950K .......... .......... .......... .......... .......... 7% 298M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7000K .......... .......... .......... .......... .......... 7% 435M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7050K .......... .......... .......... .......... .......... 7% 416M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7100K .......... .......... .......... .......... .......... 7% 351M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7150K .......... .......... .......... .......... .......... 7% 416M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7200K .......... .......... .......... .......... .......... 7% 429M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7250K .......... .......... .......... .......... .......... 7% 421M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7300K .......... .......... .......... .......... .......... 7% 350M 1s 2024-09-12T18:02:38.675 INFO:teuthology.orchestra.run.smithi094.stderr: 7350K .......... .......... .......... .......... .......... 7% 291M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7400K .......... .......... .......... .......... .......... 8% 439M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7450K .......... .......... .......... .......... .......... 8% 430M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7500K .......... .......... .......... .......... .......... 8% 389M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7550K .......... .......... .......... .......... .......... 8% 429M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7600K .......... .......... .......... .......... .......... 8% 403M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7650K .......... .......... .......... .......... .......... 8% 433M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7700K .......... .......... .......... .......... .......... 8% 343M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7750K .......... .......... .......... .......... .......... 8% 439M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7800K .......... .......... .......... .......... .......... 8% 431M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7850K .......... .......... .......... .......... .......... 8% 439M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7900K .......... .......... .......... .......... .......... 8% 382M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 7950K .......... .......... .......... .......... .......... 8% 434M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 8000K .......... .......... .......... .......... .......... 8% 420M 1s 2024-09-12T18:02:38.676 INFO:teuthology.orchestra.run.smithi094.stderr: 8050K .......... .......... .......... .......... .......... 8% 421M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8100K .......... .......... .......... .......... .......... 8% 356M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8150K .......... .......... .......... .......... .......... 8% 427M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8200K .......... .......... .......... .......... .......... 8% 438M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8250K .......... .......... .......... .......... .......... 8% 398M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8300K .......... .......... .......... .......... .......... 8% 218M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8350K .......... .......... .......... .......... .......... 9% 442M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8400K .......... .......... .......... .......... .......... 9% 438M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8450K .......... .......... .......... .......... .......... 9% 429M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8500K .......... .......... .......... .......... .......... 9% 349M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8550K .......... .......... .......... .......... .......... 9% 434M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8600K .......... .......... .......... .......... .......... 9% 440M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8650K .......... .......... .......... .......... .......... 9% 433M 1s 2024-09-12T18:02:38.677 INFO:teuthology.orchestra.run.smithi094.stderr: 8700K .......... .......... .......... .......... .......... 9% 387M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 8750K .......... .......... .......... .......... .......... 9% 421M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 8800K .......... .......... .......... .......... .......... 9% 449M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 8850K .......... .......... .......... .......... .......... 9% 414M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 8900K .......... .......... .......... .......... .......... 9% 82.7M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 8950K .......... .......... .......... .......... .......... 9% 40.4M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9000K .......... .......... .......... .......... .......... 9% 271M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9050K .......... .......... .......... .......... .......... 9% 418M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9100K .......... .......... .......... .......... .......... 9% 59.6M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9150K .......... .......... .......... .......... .......... 9% 425M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9200K .......... .......... .......... .......... .......... 9% 391M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9250K .......... .......... .......... .......... .......... 10% 113M 1s 2024-09-12T18:02:38.678 INFO:teuthology.orchestra.run.smithi094.stderr: 9300K .......... .......... .......... .......... .......... 10% 334M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9350K .......... .......... .......... .......... .......... 10% 140M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9400K .......... .......... .......... .......... .......... 10% 297M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9450K .......... .......... .......... .......... .......... 10% 227M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9500K .......... .......... .......... .......... .......... 10% 136M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9550K .......... .......... .......... .......... .......... 10% 421M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9600K .......... .......... .......... .......... .......... 10% 50.7M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9650K .......... .......... .......... .......... .......... 10% 246M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9700K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9750K .......... .......... .......... .......... .......... 10% 429M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9800K .......... .......... .......... .......... .......... 10% 89.5M 1s 2024-09-12T18:02:38.679 INFO:teuthology.orchestra.run.smithi094.stderr: 9850K .......... .......... .......... .......... .......... 10% 163M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 9900K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 9950K .......... .......... .......... .......... .......... 10% 417M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10000K .......... .......... .......... .......... .......... 10% 434M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10050K .......... .......... .......... .......... .......... 10% 397M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10100K .......... .......... .......... .......... .......... 10% 386M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10150K .......... .......... .......... .......... .......... 10% 418M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10200K .......... .......... .......... .......... .......... 11% 374M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10250K .......... .......... .......... .......... .......... 11% 508M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10300K .......... .......... .......... .......... .......... 11% 369M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10350K .......... .......... .......... .......... .......... 11% 442M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10400K .......... .......... .......... .......... .......... 11% 436M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10450K .......... .......... .......... .......... .......... 11% 444M 1s 2024-09-12T18:02:38.680 INFO:teuthology.orchestra.run.smithi094.stderr: 10500K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10550K .......... .......... .......... .......... .......... 11% 291M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10600K .......... .......... .......... .......... .......... 11% 195M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10650K .......... .......... .......... .......... .......... 11% 420M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10700K .......... .......... .......... .......... .......... 11% 334M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10750K .......... .......... .......... .......... .......... 11% 432M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10800K .......... .......... .......... .......... .......... 11% 382M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10850K .......... .......... .......... .......... .......... 11% 146M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10900K .......... .......... .......... .......... .......... 11% 363M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 10950K .......... .......... .......... .......... .......... 11% 283M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 11000K .......... .......... .......... .......... .......... 11% 350M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 11050K .......... .......... .......... .......... .......... 11% 426M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 11100K .......... .......... .......... .......... .......... 12% 416M 1s 2024-09-12T18:02:38.681 INFO:teuthology.orchestra.run.smithi094.stderr: 11150K .......... .......... .......... .......... .......... 12% 435M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11200K .......... .......... .......... .......... .......... 12% 355M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11250K .......... .......... .......... .......... .......... 12% 417M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11300K .......... .......... .......... .......... .......... 12% 426M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11350K .......... .......... .......... .......... .......... 12% 232M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11400K .......... .......... .......... .......... .......... 12% 395M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11450K .......... .......... .......... .......... .......... 12% 429M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11500K .......... .......... .......... .......... .......... 12% 452M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11550K .......... .......... .......... .......... .......... 12% 424M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11600K .......... .......... .......... .......... .......... 12% 354M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11650K .......... .......... .......... .......... .......... 12% 449M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11700K .......... .......... .......... .......... .......... 12% 443M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11750K .......... .......... .......... .......... .......... 12% 425M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11800K .......... .......... .......... .......... .......... 12% 394M 1s 2024-09-12T18:02:38.682 INFO:teuthology.orchestra.run.smithi094.stderr: 11850K .......... .......... .......... .......... .......... 12% 445M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 11900K .......... .......... .......... .......... .......... 12% 427M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 11950K .......... .......... .......... .......... .......... 12% 445M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12000K .......... .......... .......... .......... .......... 12% 332M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12050K .......... .......... .......... .......... .......... 13% 438M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12100K .......... .......... .......... .......... .......... 13% 428M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12150K .......... .......... .......... .......... .......... 13% 434M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12200K .......... .......... .......... .......... .......... 13% 391M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12250K .......... .......... .......... .......... .......... 13% 411M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12300K .......... .......... .......... .......... .......... 13% 443M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12350K .......... .......... .......... .......... .......... 13% 386M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12400K .......... .......... .......... .......... .......... 13% 351M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12450K .......... .......... .......... .......... .......... 13% 457M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12500K .......... .......... .......... .......... .......... 13% 388M 1s 2024-09-12T18:02:38.683 INFO:teuthology.orchestra.run.smithi094.stderr: 12550K .......... .......... .......... .......... .......... 13% 440M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12600K .......... .......... .......... .......... .......... 13% 436M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12650K .......... .......... .......... .......... .......... 13% 437M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12700K .......... .......... .......... .......... .......... 13% 375M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12750K .......... .......... .......... .......... .......... 13% 448M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12800K .......... .......... .......... .......... .......... 13% 319M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12850K .......... .......... .......... .......... .......... 13% 50.2M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12900K .......... .......... .......... .......... .......... 13% 166M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 12950K .......... .......... .......... .......... .......... 13% 294M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 13000K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 13050K .......... .......... .......... .......... .......... 14% 450M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 13100K .......... .......... .......... .......... .......... 14% 151M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 13150K .......... .......... .......... .......... .......... 14% 259M 1s 2024-09-12T18:02:38.684 INFO:teuthology.orchestra.run.smithi094.stderr: 13200K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13250K .......... .......... .......... .......... .......... 14% 294M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13300K .......... .......... .......... .......... .......... 14% 272M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13350K .......... .......... .......... .......... .......... 14% 357M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13400K .......... .......... .......... .......... .......... 14% 81.2M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13450K .......... .......... .......... .......... .......... 14% 356M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13500K .......... .......... .......... .......... .......... 14% 329M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13550K .......... .......... .......... .......... .......... 14% 306M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13600K .......... .......... .......... .......... .......... 14% 152M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13650K .......... .......... .......... .......... .......... 14% 197M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13700K .......... .......... .......... .......... .......... 14% 355M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13750K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13800K .......... .......... .......... .......... .......... 14% 146M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13850K .......... .......... .......... .......... .......... 14% 318M 1s 2024-09-12T18:02:38.685 INFO:teuthology.orchestra.run.smithi094.stderr: 13900K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 13950K .......... .......... .......... .......... .......... 15% 442M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14000K .......... .......... .......... .......... .......... 15% 327M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14050K .......... .......... .......... .......... .......... 15% 92.9M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14100K .......... .......... .......... .......... .......... 15% 389M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14150K .......... .......... .......... .......... .......... 15% 432M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14200K .......... .......... .......... .......... .......... 15% 450M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14250K .......... .......... .......... .......... .......... 15% 425M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14300K .......... .......... .......... .......... .......... 15% 355M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14350K .......... .......... .......... .......... .......... 15% 419M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14400K .......... .......... .......... .......... .......... 15% 441M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14450K .......... .......... .......... .......... .......... 15% 453M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14500K .......... .......... .......... .......... .......... 15% 396M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14550K .......... .......... .......... .......... .......... 15% 440M 1s 2024-09-12T18:02:38.686 INFO:teuthology.orchestra.run.smithi094.stderr: 14600K .......... .......... .......... .......... .......... 15% 442M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14650K .......... .......... .......... .......... .......... 15% 446M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14700K .......... .......... .......... .......... .......... 15% 86.5M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14750K .......... .......... .......... .......... .......... 15% 142M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14800K .......... .......... .......... .......... .......... 15% 77.9M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14850K .......... .......... .......... .......... .......... 16% 390M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14900K .......... .......... .......... .......... .......... 16% 392M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 14950K .......... .......... .......... .......... .......... 16% 432M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15000K .......... .......... .......... .......... .......... 16% 436M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15050K .......... .......... .......... .......... .......... 16% 98.1M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15100K .......... .......... .......... .......... .......... 16% 334M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15150K .......... .......... .......... .......... .......... 16% 423M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15200K .......... .......... .......... .......... .......... 16% 349M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15250K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-12T18:02:38.687 INFO:teuthology.orchestra.run.smithi094.stderr: 15300K .......... .......... .......... .......... .......... 16% 382M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15350K .......... .......... .......... .......... .......... 16% 396M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15400K .......... .......... .......... .......... .......... 16% 166M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15450K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15500K .......... .......... .......... .......... .......... 16% 232M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15550K .......... .......... .......... .......... .......... 16% 114M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15600K .......... .......... .......... .......... .......... 16% 403M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15650K .......... .......... .......... .......... .......... 16% 418M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15700K .......... .......... .......... .......... .......... 16% 374M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15750K .......... .......... .......... .......... .......... 17% 254M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15800K .......... .......... .......... .......... .......... 17% 415M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15850K .......... .......... .......... .......... .......... 17% 357M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15900K .......... .......... .......... .......... .......... 17% 332M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 15950K .......... .......... .......... .......... .......... 17% 431M 1s 2024-09-12T18:02:38.688 INFO:teuthology.orchestra.run.smithi094.stderr: 16000K .......... .......... .......... .......... .......... 17% 426M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16050K .......... .......... .......... .......... .......... 17% 442M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16100K .......... .......... .......... .......... .......... 17% 361M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16150K .......... .......... .......... .......... .......... 17% 435M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16200K .......... .......... .......... .......... .......... 17% 429M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16250K .......... .......... .......... .......... .......... 17% 396M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16300K .......... .......... .......... .......... .......... 17% 351M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16350K .......... .......... .......... .......... .......... 17% 413M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16400K .......... .......... .......... .......... .......... 17% 372M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16450K .......... .......... .......... .......... .......... 17% 413M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16500K .......... .......... .......... .......... .......... 17% 394M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16550K .......... .......... .......... .......... .......... 17% 398M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16600K .......... .......... .......... .......... .......... 17% 449M 1s 2024-09-12T18:02:38.689 INFO:teuthology.orchestra.run.smithi094.stderr: 16650K .......... .......... .......... .......... .......... 17% 443M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16700K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16750K .......... .......... .......... .......... .......... 18% 436M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16800K .......... .......... .......... .......... .......... 18% 441M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16850K .......... .......... .......... .......... .......... 18% 419M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16900K .......... .......... .......... .......... .......... 18% 391M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 16950K .......... .......... .......... .......... .......... 18% 437M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17000K .......... .......... .......... .......... .......... 18% 408M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17050K .......... .......... .......... .......... .......... 18% 441M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17100K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17150K .......... .......... .......... .......... .......... 18% 437M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17200K .......... .......... .......... .......... .......... 18% 449M 1s 2024-09-12T18:02:38.690 INFO:teuthology.orchestra.run.smithi094.stderr: 17250K .......... .......... .......... .......... .......... 18% 427M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17300K .......... .......... .......... .......... .......... 18% 386M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17350K .......... .......... .......... .......... .......... 18% 258M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17400K .......... .......... .......... .......... .......... 18% 434M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17450K .......... .......... .......... .......... .......... 18% 355M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17500K .......... .......... .......... .......... .......... 18% 337M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17550K .......... .......... .......... .......... .......... 18% 205M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17600K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17650K .......... .......... .......... .......... .......... 19% 417M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17700K .......... .......... .......... .......... .......... 19% 286M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17750K .......... .......... .......... .......... .......... 19% 435M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17800K .......... .......... .......... .......... .......... 19% 235M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17850K .......... .......... .......... .......... .......... 19% 351M 1s 2024-09-12T18:02:38.691 INFO:teuthology.orchestra.run.smithi094.stderr: 17900K .......... .......... .......... .......... .......... 19% 89.2M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 17950K .......... .......... .......... .......... .......... 19% 359M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18000K .......... .......... .......... .......... .......... 19% 280M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18050K .......... .......... .......... .......... .......... 19% 422M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18100K .......... .......... .......... .......... .......... 19% 385M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18150K .......... .......... .......... .......... .......... 19% 436M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18200K .......... .......... .......... .......... .......... 19% 437M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18250K .......... .......... .......... .......... .......... 19% 439M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18300K .......... .......... .......... .......... .......... 19% 361M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18350K .......... .......... .......... .......... .......... 19% 440M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18400K .......... .......... .......... .......... .......... 19% 426M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18450K .......... .......... .......... .......... .......... 19% 166M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18500K .......... .......... .......... .......... .......... 19% 392M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18550K .......... .......... .......... .......... .......... 20% 211M 1s 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi094.stderr: 18600K .......... .......... .......... .......... .......... 20% 440M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18650K .......... .......... .......... .......... .......... 20% 69.7M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18700K .......... .......... .......... .......... .......... 20% 151M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18750K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18800K .......... .......... .......... .......... .......... 20% 426M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18850K .......... .......... .......... .......... .......... 20% 441M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18900K .......... .......... .......... .......... .......... 20% 147M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 18950K .......... .......... .......... .......... .......... 20% 156M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19000K .......... .......... .......... .......... .......... 20% 279M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19050K .......... .......... .......... .......... .......... 20% 420M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19100K .......... .......... .......... .......... .......... 20% 81.5M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19150K .......... .......... .......... .......... .......... 20% 391M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19200K .......... .......... .......... .......... .......... 20% 395M 1s 2024-09-12T18:02:38.693 INFO:teuthology.orchestra.run.smithi094.stderr: 19250K .......... .......... .......... .......... .......... 20% 440M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19300K .......... .......... .......... .......... .......... 20% 349M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19350K .......... .......... .......... .......... .......... 20% 284M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19400K .......... .......... .......... .......... .......... 20% 371M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19450K .......... .......... .......... .......... .......... 20% 170M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19500K .......... .......... .......... .......... .......... 21% 325M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19550K .......... .......... .......... .......... .......... 21% 418M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19600K .......... .......... .......... .......... .......... 21% 433M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19650K .......... .......... .......... .......... .......... 21% 232M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19700K .......... .......... .......... .......... .......... 21% 114M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19750K .......... .......... .......... .......... .......... 21% 88.9M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19800K .......... .......... .......... .......... .......... 21% 261M 1s 2024-09-12T18:02:38.694 INFO:teuthology.orchestra.run.smithi094.stderr: 19850K .......... .......... .......... .......... .......... 21% 27.5M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 19900K .......... .......... .......... .......... .......... 21% 350M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 19950K .......... .......... .......... .......... .......... 21% 428M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20000K .......... .......... .......... .......... .......... 21% 423M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20050K .......... .......... .......... .......... .......... 21% 441M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20100K .......... .......... .......... .......... .......... 21% 365M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20150K .......... .......... .......... .......... .......... 21% 427M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20200K .......... .......... .......... .......... .......... 21% 417M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20250K .......... .......... .......... .......... .......... 21% 445M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20300K .......... .......... .......... .......... .......... 21% 353M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20350K .......... .......... .......... .......... .......... 21% 430M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20400K .......... .......... .......... .......... .......... 22% 428M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20450K .......... .......... .......... .......... .......... 22% 406M 1s 2024-09-12T18:02:38.695 INFO:teuthology.orchestra.run.smithi094.stderr: 20500K .......... .......... .......... .......... .......... 22% 358M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20550K .......... .......... .......... .......... .......... 22% 396M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20600K .......... .......... .......... .......... .......... 22% 410M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20650K .......... .......... .......... .......... .......... 22% 427M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20700K .......... .......... .......... .......... .......... 22% 351M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20750K .......... .......... .......... .......... .......... 22% 426M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20800K .......... .......... .......... .......... .......... 22% 436M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20850K .......... .......... .......... .......... .......... 22% 434M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20900K .......... .......... .......... .......... .......... 22% 378M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 20950K .......... .......... .......... .......... .......... 22% 406M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 21000K .......... .......... .......... .......... .......... 22% 423M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 21050K .......... .......... .......... .......... .......... 22% 427M 1s 2024-09-12T18:02:38.696 INFO:teuthology.orchestra.run.smithi094.stderr: 21100K .......... .......... .......... .......... .......... 22% 365M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21150K .......... .......... .......... .......... .......... 22% 442M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21200K .......... .......... .......... .......... .......... 22% 437M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21250K .......... .......... .......... .......... .......... 22% 429M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21300K .......... .......... .......... .......... .......... 22% 397M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21350K .......... .......... .......... .......... .......... 23% 417M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21400K .......... .......... .......... .......... .......... 23% 446M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21450K .......... .......... .......... .......... .......... 23% 429M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21500K .......... .......... .......... .......... .......... 23% 366M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21550K .......... .......... .......... .......... .......... 23% 439M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21600K .......... .......... .......... .......... .......... 23% 438M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21650K .......... .......... .......... .......... .......... 23% 445M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21700K .......... .......... .......... .......... .......... 23% 387M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21750K .......... .......... .......... .......... .......... 23% 449M 1s 2024-09-12T18:02:38.697 INFO:teuthology.orchestra.run.smithi094.stderr: 21800K .......... .......... .......... .......... .......... 23% 415M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 21850K .......... .......... .......... .......... .......... 23% 409M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 21900K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 21950K .......... .......... .......... .......... .......... 23% 436M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22000K .......... .......... .......... .......... .......... 23% 437M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22050K .......... .......... .......... .......... .......... 23% 448M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22100K .......... .......... .......... .......... .......... 23% 398M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22150K .......... .......... .......... .......... .......... 23% 429M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22200K .......... .......... .......... .......... .......... 23% 435M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22250K .......... .......... .......... .......... .......... 24% 422M 1s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22300K .......... .......... .......... .......... .......... 24% 361M 0s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22350K .......... .......... .......... .......... .......... 24% 443M 0s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22400K .......... .......... .......... .......... .......... 24% 451M 0s 2024-09-12T18:02:38.698 INFO:teuthology.orchestra.run.smithi094.stderr: 22450K .......... .......... .......... .......... .......... 24% 440M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22500K .......... .......... .......... .......... .......... 24% 389M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22550K .......... .......... .......... .......... .......... 24% 434M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22600K .......... .......... .......... .......... .......... 24% 455M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22650K .......... .......... .......... .......... .......... 24% 186M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22700K .......... .......... .......... .......... .......... 24% 388M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22750K .......... .......... .......... .......... .......... 24% 438M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22800K .......... .......... .......... .......... .......... 24% 248M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22850K .......... .......... .......... .......... .......... 24% 309M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22900K .......... .......... .......... .......... .......... 24% 140M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 22950K .......... .......... .......... .......... .......... 24% 340M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 23000K .......... .......... .......... .......... .......... 24% 415M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 23050K .......... .......... .......... .......... .......... 24% 436M 0s 2024-09-12T18:02:38.699 INFO:teuthology.orchestra.run.smithi094.stderr: 23100K .......... .......... .......... .......... .......... 24% 237M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23150K .......... .......... .......... .......... .......... 24% 358M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23200K .......... .......... .......... .......... .......... 25% 160M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23250K .......... .......... .......... .......... .......... 25% 255M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23300K .......... .......... .......... .......... .......... 25% 310M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23350K .......... .......... .......... .......... .......... 25% 238M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23400K .......... .......... .......... .......... .......... 25% 443M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23450K .......... .......... .......... .......... .......... 25% 343M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23500K .......... .......... .......... .......... .......... 25% 249M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23550K .......... .......... .......... .......... .......... 25% 422M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23600K .......... .......... .......... .......... .......... 25% 443M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23650K .......... .......... .......... .......... .......... 25% 101M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23700K .......... .......... .......... .......... .......... 25% 26.0M 0s 2024-09-12T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stderr: 23750K .......... .......... .......... .......... .......... 25% 395M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 23800K .......... .......... .......... .......... .......... 25% 142M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 23850K .......... .......... .......... .......... .......... 25% 421M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 23900K .......... .......... .......... .......... .......... 25% 266M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 23950K .......... .......... .......... .......... .......... 25% 415M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24000K .......... .......... .......... .......... .......... 25% 429M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24050K .......... .......... .......... .......... .......... 25% 222M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24100K .......... .......... .......... .......... .......... 25% 301M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24150K .......... .......... .......... .......... .......... 26% 289M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24200K .......... .......... .......... .......... .......... 26% 323M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24250K .......... .......... .......... .......... .......... 26% 429M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24300K .......... .......... .......... .......... .......... 26% 370M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24350K .......... .......... .......... .......... .......... 26% 368M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24400K .......... .......... .......... .......... .......... 26% 203M 0s 2024-09-12T18:02:38.701 INFO:teuthology.orchestra.run.smithi094.stderr: 24450K .......... .......... .......... .......... .......... 26% 418M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24500K .......... .......... .......... .......... .......... 26% 317M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24550K .......... .......... .......... .......... .......... 26% 231M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24600K .......... .......... .......... .......... .......... 26% 378M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24650K .......... .......... .......... .......... .......... 26% 439M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24700K .......... .......... .......... .......... .......... 26% 367M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24750K .......... .......... .......... .......... .......... 26% 426M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24800K .......... .......... .......... .......... .......... 26% 348M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24850K .......... .......... .......... .......... .......... 26% 434M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24900K .......... .......... .......... .......... .......... 26% 387M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 24950K .......... .......... .......... .......... .......... 26% 422M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 25000K .......... .......... .......... .......... .......... 26% 436M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 25050K .......... .......... .......... .......... .......... 27% 437M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 25100K .......... .......... .......... .......... .......... 27% 345M 0s 2024-09-12T18:02:38.702 INFO:teuthology.orchestra.run.smithi094.stderr: 25150K .......... .......... .......... .......... .......... 27% 221M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25200K .......... .......... .......... .......... .......... 27% 406M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25250K .......... .......... .......... .......... .......... 27% 340M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25300K .......... .......... .......... .......... .......... 27% 374M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25350K .......... .......... .......... .......... .......... 27% 438M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25400K .......... .......... .......... .......... .......... 27% 444M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25450K .......... .......... .......... .......... .......... 27% 306M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25500K .......... .......... .......... .......... .......... 27% 249M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25550K .......... .......... .......... .......... .......... 27% 429M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25600K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25650K .......... .......... .......... .......... .......... 27% 417M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25700K .......... .......... .......... .......... .......... 27% 376M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25750K .......... .......... .......... .......... .......... 27% 339M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25800K .......... .......... .......... .......... .......... 27% 254M 0s 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi094.stderr: 25850K .......... .......... .......... .......... .......... 27% 384M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 25900K .......... .......... .......... .......... .......... 27% 305M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 25950K .......... .......... .......... .......... .......... 27% 361M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26000K .......... .......... .......... .......... .......... 28% 429M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26050K .......... .......... .......... .......... .......... 28% 430M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26100K .......... .......... .......... .......... .......... 28% 350M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26150K .......... .......... .......... .......... .......... 28% 418M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26200K .......... .......... .......... .......... .......... 28% 413M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26250K .......... .......... .......... .......... .......... 28% 406M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26300K .......... .......... .......... .......... .......... 28% 346M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26350K .......... .......... .......... .......... .......... 28% 397M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26400K .......... .......... .......... .......... .......... 28% 417M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26450K .......... .......... .......... .......... .......... 28% 431M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26500K .......... .......... .......... .......... .......... 28% 395M 0s 2024-09-12T18:02:38.704 INFO:teuthology.orchestra.run.smithi094.stderr: 26550K .......... .......... .......... .......... .......... 28% 420M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26600K .......... .......... .......... .......... .......... 28% 433M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26650K .......... .......... .......... .......... .......... 28% 421M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26700K .......... .......... .......... .......... .......... 28% 345M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26750K .......... .......... .......... .......... .......... 28% 412M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26800K .......... .......... .......... .......... .......... 28% 410M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26850K .......... .......... .......... .......... .......... 28% 422M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26900K .......... .......... .......... .......... .......... 29% 381M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 26950K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27000K .......... .......... .......... .......... .......... 29% 408M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27050K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27100K .......... .......... .......... .......... .......... 29% 342M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27150K .......... .......... .......... .......... .......... 29% 211M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27200K .......... .......... .......... .......... .......... 29% 403M 0s 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi094.stderr: 27250K .......... .......... .......... .......... .......... 29% 434M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27300K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27350K .......... .......... .......... .......... .......... 29% 418M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27400K .......... .......... .......... .......... .......... 29% 337M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27450K .......... .......... .......... .......... .......... 29% 426M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27500K .......... .......... .......... .......... .......... 29% 162M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27550K .......... .......... .......... .......... .......... 29% 35.1M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27600K .......... .......... .......... .......... .......... 29% 120M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27650K .......... .......... .......... .......... .......... 29% 239M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27700K .......... .......... .......... .......... .......... 29% 236M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27750K .......... .......... .......... .......... .......... 29% 458M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27800K .......... .......... .......... .......... .......... 29% 256M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27850K .......... .......... .......... .......... .......... 30% 343M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27900K .......... .......... .......... .......... .......... 30% 226M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 27950K .......... .......... .......... .......... .......... 30% 147M 0s 2024-09-12T18:02:38.706 INFO:teuthology.orchestra.run.smithi094.stderr: 28000K .......... .......... .......... .......... .......... 30% 329M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28050K .......... .......... .......... .......... .......... 30% 205M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28100K .......... .......... .......... .......... .......... 30% 234M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28150K .......... .......... .......... .......... .......... 30% 417M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28200K .......... .......... .......... .......... .......... 30% 380M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28250K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28300K .......... .......... .......... .......... .......... 30% 364M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28350K .......... .......... .......... .......... .......... 30% 97.2M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28400K .......... .......... .......... .......... .......... 30% 429M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28450K .......... .......... .......... .......... .......... 30% 466M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28500K .......... .......... .......... .......... .......... 30% 287M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28550K .......... .......... .......... .......... .......... 30% 409M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28600K .......... .......... .......... .......... .......... 30% 403M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28650K .......... .......... .......... .......... .......... 30% 404M 0s 2024-09-12T18:02:38.707 INFO:teuthology.orchestra.run.smithi094.stderr: 28700K .......... .......... .......... .......... .......... 30% 353M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 28750K .......... .......... .......... .......... .......... 31% 442M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 28800K .......... .......... .......... .......... .......... 31% 136M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 28850K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 28900K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 28950K .......... .......... .......... .......... .......... 31% 402M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29000K .......... .......... .......... .......... .......... 31% 440M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29050K .......... .......... .......... .......... .......... 31% 102M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29100K .......... .......... .......... .......... .......... 31% 354M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29150K .......... .......... .......... .......... .......... 31% 408M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29200K .......... .......... .......... .......... .......... 31% 424M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29250K .......... .......... .......... .......... .......... 31% 399M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29300K .......... .......... .......... .......... .......... 31% 385M 0s 2024-09-12T18:02:38.708 INFO:teuthology.orchestra.run.smithi094.stderr: 29350K .......... .......... .......... .......... .......... 31% 404M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29400K .......... .......... .......... .......... .......... 31% 447M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29450K .......... .......... .......... .......... .......... 31% 123M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29500K .......... .......... .......... .......... .......... 31% 330M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29550K .......... .......... .......... .......... .......... 31% 273M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29600K .......... .......... .......... .......... .......... 31% 422M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29650K .......... .......... .......... .......... .......... 31% 184M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29700K .......... .......... .......... .......... .......... 32% 97.0M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29750K .......... .......... .......... .......... .......... 32% 200M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29800K .......... .......... .......... .......... .......... 32% 429M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29850K .......... .......... .......... .......... .......... 32% 248M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29900K .......... .......... .......... .......... .......... 32% 285M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 29950K .......... .......... .......... .......... .......... 32% 415M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 30000K .......... .......... .......... .......... .......... 32% 406M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 30050K .......... .......... .......... .......... .......... 32% 430M 0s 2024-09-12T18:02:38.709 INFO:teuthology.orchestra.run.smithi094.stderr: 30100K .......... .......... .......... .......... .......... 32% 391M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30150K .......... .......... .......... .......... .......... 32% 441M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30200K .......... .......... .......... .......... .......... 32% 252M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30250K .......... .......... .......... .......... .......... 32% 435M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30300K .......... .......... .......... .......... .......... 32% 361M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30350K .......... .......... .......... .......... .......... 32% 421M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30400K .......... .......... .......... .......... .......... 32% 436M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30450K .......... .......... .......... .......... .......... 32% 431M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30500K .......... .......... .......... .......... .......... 32% 398M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30550K .......... .......... .......... .......... .......... 32% 384M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30600K .......... .......... .......... .......... .......... 32% 442M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30650K .......... .......... .......... .......... .......... 33% 359M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30700K .......... .......... .......... .......... .......... 33% 404M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30750K .......... .......... .......... .......... .......... 33% 312M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30800K .......... .......... .......... .......... .......... 33% 389M 0s 2024-09-12T18:02:38.710 INFO:teuthology.orchestra.run.smithi094.stderr: 30850K .......... .......... .......... .......... .......... 33% 299M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 30900K .......... .......... .......... .......... .......... 33% 112M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 30950K .......... .......... .......... .......... .......... 33% 459M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31000K .......... .......... .......... .......... .......... 33% 403M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31050K .......... .......... .......... .......... .......... 33% 319M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31100K .......... .......... .......... .......... .......... 33% 493M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31150K .......... .......... .......... .......... .......... 33% 447M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31200K .......... .......... .......... .......... .......... 33% 378M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31250K .......... .......... .......... .......... .......... 33% 460M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31300K .......... .......... .......... .......... .......... 33% 481M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31350K .......... .......... .......... .......... .......... 33% 81.9M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31400K .......... .......... .......... .......... .......... 33% 129M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31450K .......... .......... .......... .......... .......... 33% 433M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31500K .......... .......... .......... .......... .......... 33% 225M 0s 2024-09-12T18:02:38.711 INFO:teuthology.orchestra.run.smithi094.stderr: 31550K .......... .......... .......... .......... .......... 34% 166M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31600K .......... .......... .......... .......... .......... 34% 418M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31650K .......... .......... .......... .......... .......... 34% 454M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31700K .......... .......... .......... .......... .......... 34% 453M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31750K .......... .......... .......... .......... .......... 34% 217M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31800K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31850K .......... .......... .......... .......... .......... 34% 127M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31900K .......... .......... .......... .......... .......... 34% 442M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 31950K .......... .......... .......... .......... .......... 34% 128M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 32000K .......... .......... .......... .......... .......... 34% 306M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 32050K .......... .......... .......... .......... .......... 34% 437M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 32100K .......... .......... .......... .......... .......... 34% 408M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 32150K .......... .......... .......... .......... .......... 34% 351M 0s 2024-09-12T18:02:38.712 INFO:teuthology.orchestra.run.smithi094.stderr: 32200K .......... .......... .......... .......... .......... 34% 262M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32250K .......... .......... .......... .......... .......... 34% 128M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32300K .......... .......... .......... .......... .......... 34% 421M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32350K .......... .......... .......... .......... .......... 34% 265M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32400K .......... .......... .......... .......... .......... 34% 425M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32450K .......... .......... .......... .......... .......... 34% 458M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32500K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32550K .......... .......... .......... .......... .......... 35% 163M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32600K .......... .......... .......... .......... .......... 35% 194M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32650K .......... .......... .......... .......... .......... 35% 208M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32700K .......... .......... .......... .......... .......... 35% 312M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32750K .......... .......... .......... .......... .......... 35% 116M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32800K .......... .......... .......... .......... .......... 35% 446M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32850K .......... .......... .......... .......... .......... 35% 406M 0s 2024-09-12T18:02:38.713 INFO:teuthology.orchestra.run.smithi094.stderr: 32900K .......... .......... .......... .......... .......... 35% 433M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 32950K .......... .......... .......... .......... .......... 35% 400M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33000K .......... .......... .......... .......... .......... 35% 270M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33050K .......... .......... .......... .......... .......... 35% 116M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33100K .......... .......... .......... .......... .......... 35% 265M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33150K .......... .......... .......... .......... .......... 35% 375M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33200K .......... .......... .......... .......... .......... 35% 428M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33250K .......... .......... .......... .......... .......... 35% 439M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33300K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33350K .......... .......... .......... .......... .......... 35% 399M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33400K .......... .......... .......... .......... .......... 36% 427M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33450K .......... .......... .......... .......... .......... 36% 229M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33500K .......... .......... .......... .......... .......... 36% 84.7M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33550K .......... .......... .......... .......... .......... 36% 170M 0s 2024-09-12T18:02:38.714 INFO:teuthology.orchestra.run.smithi094.stderr: 33600K .......... .......... .......... .......... .......... 36% 434M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33650K .......... .......... .......... .......... .......... 36% 132M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33700K .......... .......... .......... .......... .......... 36% 154M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33750K .......... .......... .......... .......... .......... 36% 216M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33800K .......... .......... .......... .......... .......... 36% 437M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33850K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33900K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 33950K .......... .......... .......... .......... .......... 36% 161M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34000K .......... .......... .......... .......... .......... 36% 222M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34050K .......... .......... .......... .......... .......... 36% 381M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34100K .......... .......... .......... .......... .......... 36% 193M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34150K .......... .......... .......... .......... .......... 36% 177M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34200K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34250K .......... .......... .......... .......... .......... 36% 277M 0s 2024-09-12T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stderr: 34300K .......... .......... .......... .......... .......... 36% 444M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34350K .......... .......... .......... .......... .......... 37% 376M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34400K .......... .......... .......... .......... .......... 37% 434M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34450K .......... .......... .......... .......... .......... 37% 245M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34500K .......... .......... .......... .......... .......... 37% 266M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34550K .......... .......... .......... .......... .......... 37% 191M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34600K .......... .......... .......... .......... .......... 37% 431M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34650K .......... .......... .......... .......... .......... 37% 438M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34700K .......... .......... .......... .......... .......... 37% 341M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34750K .......... .......... .......... .......... .......... 37% 371M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34800K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34850K .......... .......... .......... .......... .......... 37% 224M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34900K .......... .......... .......... .......... .......... 37% 80.9M 0s 2024-09-12T18:02:38.716 INFO:teuthology.orchestra.run.smithi094.stderr: 34950K .......... .......... .......... .......... .......... 37% 218M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35000K .......... .......... .......... .......... .......... 37% 416M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35050K .......... .......... .......... .......... .......... 37% 379M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35100K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35150K .......... .......... .......... .......... .......... 37% 376M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35200K .......... .......... .......... .......... .......... 37% 134M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35250K .......... .......... .......... .......... .......... 37% 245M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35300K .......... .......... .......... .......... .......... 38% 11.8M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35350K .......... .......... .......... .......... .......... 38% 386M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35400K .......... .......... .......... .......... .......... 38% 329M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35450K .......... .......... .......... .......... .......... 38% 371M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35500K .......... .......... .......... .......... .......... 38% 411M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35550K .......... .......... .......... .......... .......... 38% 180M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35600K .......... .......... .......... .......... .......... 38% 231M 0s 2024-09-12T18:02:38.717 INFO:teuthology.orchestra.run.smithi094.stderr: 35650K .......... .......... .......... .......... .......... 38% 119M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35700K .......... .......... .......... .......... .......... 38% 423M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35750K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35800K .......... .......... .......... .......... .......... 38% 369M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35850K .......... .......... .......... .......... .......... 38% 447M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35900K .......... .......... .......... .......... .......... 38% 415M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 35950K .......... .......... .......... .......... .......... 38% 283M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36000K .......... .......... .......... .......... .......... 38% 444M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36050K .......... .......... .......... .......... .......... 38% 441M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36100K .......... .......... .......... .......... .......... 38% 374M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36150K .......... .......... .......... .......... .......... 38% 393M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36200K .......... .......... .......... .......... .......... 39% 434M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36250K .......... .......... .......... .......... .......... 39% 443M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36300K .......... .......... .......... .......... .......... 39% 328M 0s 2024-09-12T18:02:38.718 INFO:teuthology.orchestra.run.smithi094.stderr: 36350K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36400K .......... .......... .......... .......... .......... 39% 440M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36450K .......... .......... .......... .......... .......... 39% 441M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36500K .......... .......... .......... .......... .......... 39% 440M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36550K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36600K .......... .......... .......... .......... .......... 39% 427M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36650K .......... .......... .......... .......... .......... 39% 442M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36700K .......... .......... .......... .......... .......... 39% 434M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36750K .......... .......... .......... .......... .......... 39% 147M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36800K .......... .......... .......... .......... .......... 39% 389M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36850K .......... .......... .......... .......... .......... 39% 444M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36900K .......... .......... .......... .......... .......... 39% 434M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 36950K .......... .......... .......... .......... .......... 39% 405M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 37000K .......... .......... .......... .......... .......... 39% 452M 0s 2024-09-12T18:02:38.719 INFO:teuthology.orchestra.run.smithi094.stderr: 37050K .......... .......... .......... .......... .......... 39% 431M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37100K .......... .......... .......... .......... .......... 39% 262M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37150K .......... .......... .......... .......... .......... 40% 361M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37200K .......... .......... .......... .......... .......... 40% 263M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37250K .......... .......... .......... .......... .......... 40% 435M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37300K .......... .......... .......... .......... .......... 40% 433M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37350K .......... .......... .......... .......... .......... 40% 398M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37400K .......... .......... .......... .......... .......... 40% 413M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37450K .......... .......... .......... .......... .......... 40% 433M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37500K .......... .......... .......... .......... .......... 40% 451M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37550K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37600K .......... .......... .......... .......... .......... 40% 446M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37650K .......... .......... .......... .......... .......... 40% 450M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37700K .......... .......... .......... .......... .......... 40% 451M 0s 2024-09-12T18:02:38.720 INFO:teuthology.orchestra.run.smithi094.stderr: 37750K .......... .......... .......... .......... .......... 40% 416M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 37800K .......... .......... .......... .......... .......... 40% 454M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 37850K .......... .......... .......... .......... .......... 40% 442M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 37900K .......... .......... .......... .......... .......... 40% 455M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 37950K .......... .......... .......... .......... .......... 40% 382M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38000K .......... .......... .......... .......... .......... 40% 465M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38050K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38100K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38150K .......... .......... .......... .......... .......... 41% 208M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38200K .......... .......... .......... .......... .......... 41% 215M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38250K .......... .......... .......... .......... .......... 41% 453M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38300K .......... .......... .......... .......... .......... 41% 340M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38350K .......... .......... .......... .......... .......... 41% 174M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38400K .......... .......... .......... .......... .......... 41% 374M 0s 2024-09-12T18:02:38.721 INFO:teuthology.orchestra.run.smithi094.stderr: 38450K .......... .......... .......... .......... .......... 41% 457M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38500K .......... .......... .......... .......... .......... 41% 258M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38550K .......... .......... .......... .......... .......... 41% 405M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38600K .......... .......... .......... .......... .......... 41% 447M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38650K .......... .......... .......... .......... .......... 41% 294M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38700K .......... .......... .......... .......... .......... 41% 459M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38750K .......... .......... .......... .......... .......... 41% 156M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38800K .......... .......... .......... .......... .......... 41% 35.1M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38850K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38900K .......... .......... .......... .......... .......... 41% 427M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 38950K .......... .......... .......... .......... .......... 41% 395M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 39000K .......... .......... .......... .......... .......... 42% 305M 0s 2024-09-12T18:02:38.722 INFO:teuthology.orchestra.run.smithi094.stderr: 39050K .......... .......... .......... .......... .......... 42% 368M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39100K .......... .......... .......... .......... .......... 42% 37.3M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39150K .......... .......... .......... .......... .......... 42% 243M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39200K .......... .......... .......... .......... .......... 42% 429M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39250K .......... .......... .......... .......... .......... 42% 229M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39300K .......... .......... .......... .......... .......... 42% 104M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39350K .......... .......... .......... .......... .......... 42% 355M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39400K .......... .......... .......... .......... .......... 42% 387M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39450K .......... .......... .......... .......... .......... 42% 181M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39500K .......... .......... .......... .......... .......... 42% 157M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39550K .......... .......... .......... .......... .......... 42% 138M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39600K .......... .......... .......... .......... .......... 42% 315M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39650K .......... .......... .......... .......... .......... 42% 452M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39700K .......... .......... .......... .......... .......... 42% 253M 0s 2024-09-12T18:02:38.723 INFO:teuthology.orchestra.run.smithi094.stderr: 39750K .......... .......... .......... .......... .......... 42% 331M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 39800K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 39850K .......... .......... .......... .......... .......... 42% 290M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 39900K .......... .......... .......... .......... .......... 43% 246M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 39950K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40000K .......... .......... .......... .......... .......... 43% 369M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40050K .......... .......... .......... .......... .......... 43% 112M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40100K .......... .......... .......... .......... .......... 43% 410M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40150K .......... .......... .......... .......... .......... 43% 163M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40200K .......... .......... .......... .......... .......... 43% 227M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40250K .......... .......... .......... .......... .......... 43% 176M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40300K .......... .......... .......... .......... .......... 43% 431M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40350K .......... .......... .......... .......... .......... 43% 175M 0s 2024-09-12T18:02:38.724 INFO:teuthology.orchestra.run.smithi094.stderr: 40400K .......... .......... .......... .......... .......... 43% 131M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40450K .......... .......... .......... .......... .......... 43% 44.9M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40500K .......... .......... .......... .......... .......... 43% 405M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40550K .......... .......... .......... .......... .......... 43% 386M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40600K .......... .......... .......... .......... .......... 43% 428M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40650K .......... .......... .......... .......... .......... 43% 312M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40700K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40750K .......... .......... .......... .......... .......... 43% 371M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40800K .......... .......... .......... .......... .......... 43% 390M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40850K .......... .......... .......... .......... .......... 44% 441M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40900K .......... .......... .......... .......... .......... 44% 437M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 40950K .......... .......... .......... .......... .......... 44% 366M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 41000K .......... .......... .......... .......... .......... 44% 430M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 41050K .......... .......... .......... .......... .......... 44% 460M 0s 2024-09-12T18:02:38.725 INFO:teuthology.orchestra.run.smithi094.stderr: 41100K .......... .......... .......... .......... .......... 44% 425M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41150K .......... .......... .......... .......... .......... 44% 352M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41200K .......... .......... .......... .......... .......... 44% 422M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41250K .......... .......... .......... .......... .......... 44% 423M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41300K .......... .......... .......... .......... .......... 44% 413M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41350K .......... .......... .......... .......... .......... 44% 398M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41400K .......... .......... .......... .......... .......... 44% 425M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41450K .......... .......... .......... .......... .......... 44% 434M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41500K .......... .......... .......... .......... .......... 44% 449M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41550K .......... .......... .......... .......... .......... 44% 359M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41600K .......... .......... .......... .......... .......... 44% 440M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41650K .......... .......... .......... .......... .......... 44% 417M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41700K .......... .......... .......... .......... .......... 44% 426M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41750K .......... .......... .......... .......... .......... 44% 397M 0s 2024-09-12T18:02:38.726 INFO:teuthology.orchestra.run.smithi094.stderr: 41800K .......... .......... .......... .......... .......... 45% 362M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 41850K .......... .......... .......... .......... .......... 45% 439M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 41900K .......... .......... .......... .......... .......... 45% 429M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 41950K .......... .......... .......... .......... .......... 45% 193M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42000K .......... .......... .......... .......... .......... 45% 411M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42050K .......... .......... .......... .......... .......... 45% 434M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42100K .......... .......... .......... .......... .......... 45% 455M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42150K .......... .......... .......... .......... .......... 45% 400M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42200K .......... .......... .......... .......... .......... 45% 447M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42250K .......... .......... .......... .......... .......... 45% 185M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42300K .......... .......... .......... .......... .......... 45% 428M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42350K .......... .......... .......... .......... .......... 45% 257M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42400K .......... .......... .......... .......... .......... 45% 225M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42450K .......... .......... .......... .......... .......... 45% 424M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42500K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-12T18:02:38.727 INFO:teuthology.orchestra.run.smithi094.stderr: 42550K .......... .......... .......... .......... .......... 45% 382M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42600K .......... .......... .......... .......... .......... 45% 70.5M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42650K .......... .......... .......... .......... .......... 45% 386M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42700K .......... .......... .......... .......... .......... 46% 99.3M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42750K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42800K .......... .......... .......... .......... .......... 46% 419M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42850K .......... .......... .......... .......... .......... 46% 446M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42900K .......... .......... .......... .......... .......... 46% 454M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 42950K .......... .......... .......... .......... .......... 46% 350M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43000K .......... .......... .......... .......... .......... 46% 373M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43050K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43100K .......... .......... .......... .......... .......... 46% 414M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43150K .......... .......... .......... .......... .......... 46% 232M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43200K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-12T18:02:38.728 INFO:teuthology.orchestra.run.smithi094.stderr: 43250K .......... .......... .......... .......... .......... 46% 404M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43300K .......... .......... .......... .......... .......... 46% 269M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43350K .......... .......... .......... .......... .......... 46% 197M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43400K .......... .......... .......... .......... .......... 46% 405M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43450K .......... .......... .......... .......... .......... 46% 220M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43500K .......... .......... .......... .......... .......... 46% 302M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43550K .......... .......... .......... .......... .......... 46% 192M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43600K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43650K .......... .......... .......... .......... .......... 47% 379M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43700K .......... .......... .......... .......... .......... 47% 116M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43750K .......... .......... .......... .......... .......... 47% 113M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43800K .......... .......... .......... .......... .......... 47% 123M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43850K .......... .......... .......... .......... .......... 47% 431M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43900K .......... .......... .......... .......... .......... 47% 138M 0s 2024-09-12T18:02:38.729 INFO:teuthology.orchestra.run.smithi094.stderr: 43950K .......... .......... .......... .......... .......... 47% 362M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44000K .......... .......... .......... .......... .......... 47% 125M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44050K .......... .......... .......... .......... .......... 47% 384M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44100K .......... .......... .......... .......... .......... 47% 435M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44150K .......... .......... .......... .......... .......... 47% 191M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44200K .......... .......... .......... .......... .......... 47% 197M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44250K .......... .......... .......... .......... .......... 47% 64.4M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44300K .......... .......... .......... .......... .......... 47% 323M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44350K .......... .......... .......... .......... .......... 47% 130M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44400K .......... .......... .......... .......... .......... 47% 239M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44450K .......... .......... .......... .......... .......... 47% 434M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44500K .......... .......... .......... .......... .......... 47% 258M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44550K .......... .......... .......... .......... .......... 48% 382M 0s 2024-09-12T18:02:38.730 INFO:teuthology.orchestra.run.smithi094.stderr: 44600K .......... .......... .......... .......... .......... 48% 234M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44650K .......... .......... .......... .......... .......... 48% 225M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44700K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44750K .......... .......... .......... .......... .......... 48% 359M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44800K .......... .......... .......... .......... .......... 48% 434M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44850K .......... .......... .......... .......... .......... 48% 397M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44900K .......... .......... .......... .......... .......... 48% 435M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 44950K .......... .......... .......... .......... .......... 48% 375M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45000K .......... .......... .......... .......... .......... 48% 431M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45050K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45100K .......... .......... .......... .......... .......... 48% 218M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45150K .......... .......... .......... .......... .......... 48% 269M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45200K .......... .......... .......... .......... .......... 48% 442M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45250K .......... .......... .......... .......... .......... 48% 450M 0s 2024-09-12T18:02:38.731 INFO:teuthology.orchestra.run.smithi094.stderr: 45300K .......... .......... .......... .......... .......... 48% 410M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45350K .......... .......... .......... .......... .......... 48% 403M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45400K .......... .......... .......... .......... .......... 48% 452M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45450K .......... .......... .......... .......... .......... 48% 431M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45500K .......... .......... .......... .......... .......... 49% 261M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45550K .......... .......... .......... .......... .......... 49% 176M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45600K .......... .......... .......... .......... .......... 49% 319M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45650K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45700K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45750K .......... .......... .......... .......... .......... 49% 392M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45800K .......... .......... .......... .......... .......... 49% 436M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45850K .......... .......... .......... .......... .......... 49% 196M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45900K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-12T18:02:38.732 INFO:teuthology.orchestra.run.smithi094.stderr: 45950K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46000K .......... .......... .......... .......... .......... 49% 446M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46050K .......... .......... .......... .......... .......... 49% 394M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46100K .......... .......... .......... .......... .......... 49% 221M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46150K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46200K .......... .......... .......... .......... .......... 49% 433M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46250K .......... .......... .......... .......... .......... 49% 225M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46300K .......... .......... .......... .......... .......... 49% 142M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46350K .......... .......... .......... .......... .......... 49% 222M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46400K .......... .......... .......... .......... .......... 49% 404M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46450K .......... .......... .......... .......... .......... 50% 445M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46500K .......... .......... .......... .......... .......... 50% 210M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46550K .......... .......... .......... .......... .......... 50% 204M 0s 2024-09-12T18:02:38.733 INFO:teuthology.orchestra.run.smithi094.stderr: 46600K .......... .......... .......... .......... .......... 50% 131M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46650K .......... .......... .......... .......... .......... 50% 408M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46700K .......... .......... .......... .......... .......... 50% 262M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46750K .......... .......... .......... .......... .......... 50% 354M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46800K .......... .......... .......... .......... .......... 50% 257M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46850K .......... .......... .......... .......... .......... 50% 204M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46900K .......... .......... .......... .......... .......... 50% 430M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 46950K .......... .......... .......... .......... .......... 50% 240M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47000K .......... .......... .......... .......... .......... 50% 252M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47050K .......... .......... .......... .......... .......... 50% 254M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47100K .......... .......... .......... .......... .......... 50% 437M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47150K .......... .......... .......... .......... .......... 50% 367M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47200K .......... .......... .......... .......... .......... 50% 440M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47250K .......... .......... .......... .......... .......... 50% 450M 0s 2024-09-12T18:02:38.734 INFO:teuthology.orchestra.run.smithi094.stderr: 47300K .......... .......... .......... .......... .......... 50% 301M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47350K .......... .......... .......... .......... .......... 51% 371M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47400K .......... .......... .......... .......... .......... 51% 374M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47450K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47500K .......... .......... .......... .......... .......... 51% 444M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47550K .......... .......... .......... .......... .......... 51% 115M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47600K .......... .......... .......... .......... .......... 51% 423M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47650K .......... .......... .......... .......... .......... 51% 418M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47700K .......... .......... .......... .......... .......... 51% 187M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47750K .......... .......... .......... .......... .......... 51% 219M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47800K .......... .......... .......... .......... .......... 51% 361M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47850K .......... .......... .......... .......... .......... 51% 167M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47900K .......... .......... .......... .......... .......... 51% 155M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 47950K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T18:02:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 48000K .......... .......... .......... .......... .......... 51% 306M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48050K .......... .......... .......... .......... .......... 51% 269M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48100K .......... .......... .......... .......... .......... 51% 88.2M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48150K .......... .......... .......... .......... .......... 51% 210M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48200K .......... .......... .......... .......... .......... 51% 151M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48250K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48300K .......... .......... .......... .......... .......... 52% 119M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48350K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48400K .......... .......... .......... .......... .......... 52% 232M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48450K .......... .......... .......... .......... .......... 52% 196M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48500K .......... .......... .......... .......... .......... 52% 323M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48550K .......... .......... .......... .......... .......... 52% 149M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48600K .......... .......... .......... .......... .......... 52% 410M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48650K .......... .......... .......... .......... .......... 52% 429M 0s 2024-09-12T18:02:38.736 INFO:teuthology.orchestra.run.smithi094.stderr: 48700K .......... .......... .......... .......... .......... 52% 439M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 48750K .......... .......... .......... .......... .......... 52% 356M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 48800K .......... .......... .......... .......... .......... 52% 445M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 48850K .......... .......... .......... .......... .......... 52% 289M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 48900K .......... .......... .......... .......... .......... 52% 246M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 48950K .......... .......... .......... .......... .......... 52% 278M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49000K .......... .......... .......... .......... .......... 52% 430M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49050K .......... .......... .......... .......... .......... 52% 368M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49100K .......... .......... .......... .......... .......... 52% 383M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49150K .......... .......... .......... .......... .......... 52% 314M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49200K .......... .......... .......... .......... .......... 53% 432M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49250K .......... .......... .......... .......... .......... 53% 448M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49300K .......... .......... .......... .......... .......... 53% 446M 0s 2024-09-12T18:02:38.737 INFO:teuthology.orchestra.run.smithi094.stderr: 49350K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49400K .......... .......... .......... .......... .......... 53% 327M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49450K .......... .......... .......... .......... .......... 53% 430M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49500K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49550K .......... .......... .......... .......... .......... 53% 201M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49600K .......... .......... .......... .......... .......... 53% 448M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49650K .......... .......... .......... .......... .......... 53% 326M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49700K .......... .......... .......... .......... .......... 53% 445M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49750K .......... .......... .......... .......... .......... 53% 224M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49800K .......... .......... .......... .......... .......... 53% 175M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49850K .......... .......... .......... .......... .......... 53% 433M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49900K .......... .......... .......... .......... .......... 53% 446M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 49950K .......... .......... .......... .......... .......... 53% 179M 0s 2024-09-12T18:02:38.738 INFO:teuthology.orchestra.run.smithi094.stderr: 50000K .......... .......... .......... .......... .......... 53% 423M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50050K .......... .......... .......... .......... .......... 53% 276M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50100K .......... .......... .......... .......... .......... 53% 411M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50150K .......... .......... .......... .......... .......... 54% 402M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50200K .......... .......... .......... .......... .......... 54% 159M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50250K .......... .......... .......... .......... .......... 54% 429M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50300K .......... .......... .......... .......... .......... 54% 139M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50350K .......... .......... .......... .......... .......... 54% 166M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50400K .......... .......... .......... .......... .......... 54% 430M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50450K .......... .......... .......... .......... .......... 54% 122M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50500K .......... .......... .......... .......... .......... 54% 177M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50550K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-12T18:02:38.739 INFO:teuthology.orchestra.run.smithi094.stderr: 50600K .......... .......... .......... .......... .......... 54% 418M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50650K .......... .......... .......... .......... .......... 54% 425M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50700K .......... .......... .......... .......... .......... 54% 446M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50750K .......... .......... .......... .......... .......... 54% 249M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50800K .......... .......... .......... .......... .......... 54% 424M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50850K .......... .......... .......... .......... .......... 54% 421M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50900K .......... .......... .......... .......... .......... 54% 368M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 50950K .......... .......... .......... .......... .......... 54% 282M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51000K .......... .......... .......... .......... .......... 54% 430M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51050K .......... .......... .......... .......... .......... 55% 443M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51100K .......... .......... .......... .......... .......... 55% 429M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51150K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51200K .......... .......... .......... .......... .......... 55% 173M 0s 2024-09-12T18:02:38.740 INFO:teuthology.orchestra.run.smithi094.stderr: 51250K .......... .......... .......... .......... .......... 55% 268M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51300K .......... .......... .......... .......... .......... 55% 385M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51350K .......... .......... .......... .......... .......... 55% 442M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51400K .......... .......... .......... .......... .......... 55% 425M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51450K .......... .......... .......... .......... .......... 55% 434M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51500K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51550K .......... .......... .......... .......... .......... 55% 405M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51600K .......... .......... .......... .......... .......... 55% 114M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51650K .......... .......... .......... .......... .......... 55% 421M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51700K .......... .......... .......... .......... .......... 55% 398M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51750K .......... .......... .......... .......... .......... 55% 162M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51800K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51850K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51900K .......... .......... .......... .......... .......... 55% 364M 0s 2024-09-12T18:02:38.741 INFO:teuthology.orchestra.run.smithi094.stderr: 51950K .......... .......... .......... .......... .......... 55% 87.2M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52000K .......... .......... .......... .......... .......... 56% 263M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52050K .......... .......... .......... .......... .......... 56% 445M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52100K .......... .......... .......... .......... .......... 56% 59.6M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52150K .......... .......... .......... .......... .......... 56% 157M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52200K .......... .......... .......... .......... .......... 56% 420M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52250K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52300K .......... .......... .......... .......... .......... 56% 353M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52350K .......... .......... .......... .......... .......... 56% 67.0M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52400K .......... .......... .......... .......... .......... 56% 318M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52450K .......... .......... .......... .......... .......... 56% 420M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52500K .......... .......... .......... .......... .......... 56% 369M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52550K .......... .......... .......... .......... .......... 56% 413M 0s 2024-09-12T18:02:38.742 INFO:teuthology.orchestra.run.smithi094.stderr: 52600K .......... .......... .......... .......... .......... 56% 441M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52650K .......... .......... .......... .......... .......... 56% 431M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52700K .......... .......... .......... .......... .......... 56% 246M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52750K .......... .......... .......... .......... .......... 56% 441M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52800K .......... .......... .......... .......... .......... 56% 418M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52850K .......... .......... .......... .......... .......... 56% 217M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52900K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 52950K .......... .......... .......... .......... .......... 57% 413M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53000K .......... .......... .......... .......... .......... 57% 437M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53050K .......... .......... .......... .......... .......... 57% 404M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53100K .......... .......... .......... .......... .......... 57% 346M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53150K .......... .......... .......... .......... .......... 57% 164M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53200K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53250K .......... .......... .......... .......... .......... 57% 421M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53300K .......... .......... .......... .......... .......... 57% 397M 0s 2024-09-12T18:02:38.743 INFO:teuthology.orchestra.run.smithi094.stderr: 53350K .......... .......... .......... .......... .......... 57% 429M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53400K .......... .......... .......... .......... .......... 57% 445M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53450K .......... .......... .......... .......... .......... 57% 354M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53500K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53550K .......... .......... .......... .......... .......... 57% 414M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53600K .......... .......... .......... .......... .......... 57% 350M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53650K .......... .......... .......... .......... .......... 57% 424M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53700K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53750K .......... .......... .......... .......... .......... 57% 424M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53800K .......... .......... .......... .......... .......... 57% 456M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53850K .......... .......... .......... .......... .......... 58% 434M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53900K .......... .......... .......... .......... .......... 58% 356M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 53950K .......... .......... .......... .......... .......... 58% 222M 0s 2024-09-12T18:02:38.744 INFO:teuthology.orchestra.run.smithi094.stderr: 54000K .......... .......... .......... .......... .......... 58% 333M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54050K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54100K .......... .......... .......... .......... .......... 58% 385M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54150K .......... .......... .......... .......... .......... 58% 417M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54200K .......... .......... .......... .......... .......... 58% 434M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54250K .......... .......... .......... .......... .......... 58% 111M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54300K .......... .......... .......... .......... .......... 58% 59.8M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54350K .......... .......... .......... .......... .......... 58% 229M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54400K .......... .......... .......... .......... .......... 58% 440M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54450K .......... .......... .......... .......... .......... 58% 428M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54500K .......... .......... .......... .......... .......... 58% 387M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54550K .......... .......... .......... .......... .......... 58% 392M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54600K .......... .......... .......... .......... .......... 58% 429M 0s 2024-09-12T18:02:38.745 INFO:teuthology.orchestra.run.smithi094.stderr: 54650K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54700K .......... .......... .......... .......... .......... 58% 344M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54750K .......... .......... .......... .......... .......... 58% 204M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54800K .......... .......... .......... .......... .......... 59% 418M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54850K .......... .......... .......... .......... .......... 59% 432M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54900K .......... .......... .......... .......... .......... 59% 394M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 54950K .......... .......... .......... .......... .......... 59% 312M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55000K .......... .......... .......... .......... .......... 59% 425M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55050K .......... .......... .......... .......... .......... 59% 422M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55100K .......... .......... .......... .......... .......... 59% 367M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55150K .......... .......... .......... .......... .......... 59% 178M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55200K .......... .......... .......... .......... .......... 59% 438M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55250K .......... .......... .......... .......... .......... 59% 426M 0s 2024-09-12T18:02:38.746 INFO:teuthology.orchestra.run.smithi094.stderr: 55300K .......... .......... .......... .......... .......... 59% 395M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55350K .......... .......... .......... .......... .......... 59% 451M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55400K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55450K .......... .......... .......... .......... .......... 59% 159M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55500K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55550K .......... .......... .......... .......... .......... 59% 450M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55600K .......... .......... .......... .......... .......... 59% 450M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55650K .......... .......... .......... .......... .......... 59% 272M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55700K .......... .......... .......... .......... .......... 60% 361M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55750K .......... .......... .......... .......... .......... 60% 282M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55800K .......... .......... .......... .......... .......... 60% 157M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55850K .......... .......... .......... .......... .......... 60% 140M 0s 2024-09-12T18:02:38.747 INFO:teuthology.orchestra.run.smithi094.stderr: 55900K .......... .......... .......... .......... .......... 60% 312M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 55950K .......... .......... .......... .......... .......... 60% 92.1M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56000K .......... .......... .......... .......... .......... 60% 275M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56050K .......... .......... .......... .......... .......... 60% 163M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56100K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56150K .......... .......... .......... .......... .......... 60% 437M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56200K .......... .......... .......... .......... .......... 60% 440M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56250K .......... .......... .......... .......... .......... 60% 97.9M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56300K .......... .......... .......... .......... .......... 60% 158M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56350K .......... .......... .......... .......... .......... 60% 197M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56400K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56450K .......... .......... .......... .......... .......... 60% 416M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56500K .......... .......... .......... .......... .......... 60% 392M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56550K .......... .......... .......... .......... .......... 60% 135M 0s 2024-09-12T18:02:38.748 INFO:teuthology.orchestra.run.smithi094.stderr: 56600K .......... .......... .......... .......... .......... 60% 160M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56650K .......... .......... .......... .......... .......... 61% 376M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56700K .......... .......... .......... .......... .......... 61% 125M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56750K .......... .......... .......... .......... .......... 61% 113M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56800K .......... .......... .......... .......... .......... 61% 435M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56850K .......... .......... .......... .......... .......... 61% 418M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56900K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 56950K .......... .......... .......... .......... .......... 61% 419M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57000K .......... .......... .......... .......... .......... 61% 433M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57050K .......... .......... .......... .......... .......... 61% 258M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57100K .......... .......... .......... .......... .......... 61% 338M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57150K .......... .......... .......... .......... .......... 61% 271M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57200K .......... .......... .......... .......... .......... 61% 435M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57250K .......... .......... .......... .......... .......... 61% 365M 0s 2024-09-12T18:02:38.749 INFO:teuthology.orchestra.run.smithi094.stderr: 57300K .......... .......... .......... .......... .......... 61% 341M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57350K .......... .......... .......... .......... .......... 61% 451M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57400K .......... .......... .......... .......... .......... 61% 322M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57450K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57500K .......... .......... .......... .......... .......... 61% 361M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57550K .......... .......... .......... .......... .......... 62% 441M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57600K .......... .......... .......... .......... .......... 62% 431M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57650K .......... .......... .......... .......... .......... 62% 447M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57700K .......... .......... .......... .......... .......... 62% 377M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57750K .......... .......... .......... .......... .......... 62% 370M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57800K .......... .......... .......... .......... .......... 62% 144M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57850K .......... .......... .......... .......... .......... 62% 430M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57900K .......... .......... .......... .......... .......... 62% 186M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 57950K .......... .......... .......... .......... .......... 62% 383M 0s 2024-09-12T18:02:38.750 INFO:teuthology.orchestra.run.smithi094.stderr: 58000K .......... .......... .......... .......... .......... 62% 362M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58050K .......... .......... .......... .......... .......... 62% 73.7M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58100K .......... .......... .......... .......... .......... 62% 234M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58150K .......... .......... .......... .......... .......... 62% 420M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58200K .......... .......... .......... .......... .......... 62% 43.4M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58250K .......... .......... .......... .......... .......... 62% 98.2M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58300K .......... .......... .......... .......... .......... 62% 110M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58350K .......... .......... .......... .......... .......... 62% 432M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58400K .......... .......... .......... .......... .......... 62% 192M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58450K .......... .......... .......... .......... .......... 62% 425M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58500K .......... .......... .......... .......... .......... 63% 263M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58550K .......... .......... .......... .......... .......... 63% 320M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58600K .......... .......... .......... .......... .......... 63% 122M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58650K .......... .......... .......... .......... .......... 63% 275M 0s 2024-09-12T18:02:38.751 INFO:teuthology.orchestra.run.smithi094.stderr: 58700K .......... .......... .......... .......... .......... 63% 291M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 58750K .......... .......... .......... .......... .......... 63% 432M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 58800K .......... .......... .......... .......... .......... 63% 423M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 58850K .......... .......... .......... .......... .......... 63% 163M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 58900K .......... .......... .......... .......... .......... 63% 385M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 58950K .......... .......... .......... .......... .......... 63% 384M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59000K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59050K .......... .......... .......... .......... .......... 63% 98.6M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59100K .......... .......... .......... .......... .......... 63% 238M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59150K .......... .......... .......... .......... .......... 63% 435M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59200K .......... .......... .......... .......... .......... 63% 434M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59250K .......... .......... .......... .......... .......... 63% 428M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59300K .......... .......... .......... .......... .......... 63% 394M 0s 2024-09-12T18:02:38.752 INFO:teuthology.orchestra.run.smithi094.stderr: 59350K .......... .......... .......... .......... .......... 63% 393M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59400K .......... .......... .......... .......... .......... 63% 428M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59450K .......... .......... .......... .......... .......... 64% 437M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59500K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59550K .......... .......... .......... .......... .......... 64% 442M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59600K .......... .......... .......... .......... .......... 64% 429M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59650K .......... .......... .......... .......... .......... 64% 429M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59700K .......... .......... .......... .......... .......... 64% 390M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59750K .......... .......... .......... .......... .......... 64% 428M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59800K .......... .......... .......... .......... .......... 64% 214M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59850K .......... .......... .......... .......... .......... 64% 124M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59900K .......... .......... .......... .......... .......... 64% 183M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 59950K .......... .......... .......... .......... .......... 64% 411M 0s 2024-09-12T18:02:38.753 INFO:teuthology.orchestra.run.smithi094.stderr: 60000K .......... .......... .......... .......... .......... 64% 236M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60050K .......... .......... .......... .......... .......... 64% 440M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60100K .......... .......... .......... .......... .......... 64% 172M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60150K .......... .......... .......... .......... .......... 64% 102M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60200K .......... .......... .......... .......... .......... 64% 386M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60250K .......... .......... .......... .......... .......... 64% 218M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60300K .......... .......... .......... .......... .......... 64% 223M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60350K .......... .......... .......... .......... .......... 65% 450M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60400K .......... .......... .......... .......... .......... 65% 194M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60450K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60500K .......... .......... .......... .......... .......... 65% 77.1M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60550K .......... .......... .......... .......... .......... 65% 132M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60600K .......... .......... .......... .......... .......... 65% 195M 0s 2024-09-12T18:02:38.754 INFO:teuthology.orchestra.run.smithi094.stderr: 60650K .......... .......... .......... .......... .......... 65% 428M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60700K .......... .......... .......... .......... .......... 65% 156M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60750K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60800K .......... .......... .......... .......... .......... 65% 426M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60850K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60900K .......... .......... .......... .......... .......... 65% 381M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 60950K .......... .......... .......... .......... .......... 65% 424M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61000K .......... .......... .......... .......... .......... 65% 438M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61050K .......... .......... .......... .......... .......... 65% 293M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61100K .......... .......... .......... .......... .......... 65% 369M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61150K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61200K .......... .......... .......... .......... .......... 65% 253M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61250K .......... .......... .......... .......... .......... 65% 294M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61300K .......... .......... .......... .......... .......... 66% 334M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61350K .......... .......... .......... .......... .......... 66% 91.0M 0s 2024-09-12T18:02:38.755 INFO:teuthology.orchestra.run.smithi094.stderr: 61400K .......... .......... .......... .......... .......... 66% 412M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61450K .......... .......... .......... .......... .......... 66% 496M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61500K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61550K .......... .......... .......... .......... .......... 66% 435M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61600K .......... .......... .......... .......... .......... 66% 449M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61650K .......... .......... .......... .......... .......... 66% 438M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61700K .......... .......... .......... .......... .......... 66% 187M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61750K .......... .......... .......... .......... .......... 66% 425M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61800K .......... .......... .......... .......... .......... 66% 433M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61850K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61900K .......... .......... .......... .......... .......... 66% 66.8M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 61950K .......... .......... .......... .......... .......... 66% 400M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 62000K .......... .......... .......... .......... .......... 66% 74.4M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 62050K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-12T18:02:38.756 INFO:teuthology.orchestra.run.smithi094.stderr: 62100K .......... .......... .......... .......... .......... 66% 382M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62150K .......... .......... .......... .......... .......... 66% 157M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62200K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62250K .......... .......... .......... .......... .......... 67% 429M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62300K .......... .......... .......... .......... .......... 67% 106M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62350K .......... .......... .......... .......... .......... 67% 424M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62400K .......... .......... .......... .......... .......... 67% 435M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62450K .......... .......... .......... .......... .......... 67% 175M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62500K .......... .......... .......... .......... .......... 67% 385M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62550K .......... .......... .......... .......... .......... 67% 164M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62600K .......... .......... .......... .......... .......... 67% 171M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62650K .......... .......... .......... .......... .......... 67% 432M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62700K .......... .......... .......... .......... .......... 67% 360M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62750K .......... .......... .......... .......... .......... 67% 419M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62800K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-12T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stderr: 62850K .......... .......... .......... .......... .......... 67% 422M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 62900K .......... .......... .......... .......... .......... 67% 418M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 62950K .......... .......... .......... .......... .......... 67% 432M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63000K .......... .......... .......... .......... .......... 67% 160M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63050K .......... .......... .......... .......... .......... 67% 321M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63100K .......... .......... .......... .......... .......... 67% 147M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63150K .......... .......... .......... .......... .......... 68% 432M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63200K .......... .......... .......... .......... .......... 68% 419M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63250K .......... .......... .......... .......... .......... 68% 425M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63300K .......... .......... .......... .......... .......... 68% 91.2M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63350K .......... .......... .......... .......... .......... 68% 376M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63400K .......... .......... .......... .......... .......... 68% 428M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63450K .......... .......... .......... .......... .......... 68% 405M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63500K .......... .......... .......... .......... .......... 68% 364M 0s 2024-09-12T18:02:38.758 INFO:teuthology.orchestra.run.smithi094.stderr: 63550K .......... .......... .......... .......... .......... 68% 423M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63600K .......... .......... .......... .......... .......... 68% 350M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63650K .......... .......... .......... .......... .......... 68% 111M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63700K .......... .......... .......... .......... .......... 68% 353M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63750K .......... .......... .......... .......... .......... 68% 432M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63800K .......... .......... .......... .......... .......... 68% 360M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63850K .......... .......... .......... .......... .......... 68% 172M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63900K .......... .......... .......... .......... .......... 68% 242M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 63950K .......... .......... .......... .......... .......... 68% 317M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64000K .......... .......... .......... .......... .......... 68% 158M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64050K .......... .......... .......... .......... .......... 68% 239M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64100K .......... .......... .......... .......... .......... 69% 212M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64150K .......... .......... .......... .......... .......... 69% 423M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64200K .......... .......... .......... .......... .......... 69% 397M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64250K .......... .......... .......... .......... .......... 69% 248M 0s 2024-09-12T18:02:38.759 INFO:teuthology.orchestra.run.smithi094.stderr: 64300K .......... .......... .......... .......... .......... 69% 122M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64350K .......... .......... .......... .......... .......... 69% 128M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64400K .......... .......... .......... .......... .......... 69% 373M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64450K .......... .......... .......... .......... .......... 69% 142M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64500K .......... .......... .......... .......... .......... 69% 174M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64550K .......... .......... .......... .......... .......... 69% 333M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64600K .......... .......... .......... .......... .......... 69% 351M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64650K .......... .......... .......... .......... .......... 69% 278M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64700K .......... .......... .......... .......... .......... 69% 236M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64750K .......... .......... .......... .......... .......... 69% 193M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64800K .......... .......... .......... .......... .......... 69% 426M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64850K .......... .......... .......... .......... .......... 69% 407M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64900K .......... .......... .......... .......... .......... 69% 383M 0s 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi094.stderr: 64950K .......... .......... .......... .......... .......... 69% 437M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65000K .......... .......... .......... .......... .......... 70% 421M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65050K .......... .......... .......... .......... .......... 70% 435M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65100K .......... .......... .......... .......... .......... 70% 196M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65150K .......... .......... .......... .......... .......... 70% 430M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65200K .......... .......... .......... .......... .......... 70% 427M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65250K .......... .......... .......... .......... .......... 70% 443M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65300K .......... .......... .......... .......... .......... 70% 338M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65350K .......... .......... .......... .......... .......... 70% 446M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65400K .......... .......... .......... .......... .......... 70% 421M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65450K .......... .......... .......... .......... .......... 70% 378M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65500K .......... .......... .......... .......... .......... 70% 369M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65550K .......... .......... .......... .......... .......... 70% 447M 0s 2024-09-12T18:02:38.761 INFO:teuthology.orchestra.run.smithi094.stderr: 65600K .......... .......... .......... .......... .......... 70% 440M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65650K .......... .......... .......... .......... .......... 70% 415M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65700K .......... .......... .......... .......... .......... 70% 401M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65750K .......... .......... .......... .......... .......... 70% 304M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65800K .......... .......... .......... .......... .......... 70% 398M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65850K .......... .......... .......... .......... .......... 70% 440M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65900K .......... .......... .......... .......... .......... 70% 236M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 65950K .......... .......... .......... .......... .......... 71% 378M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66000K .......... .......... .......... .......... .......... 71% 154M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66050K .......... .......... .......... .......... .......... 71% 424M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66100K .......... .......... .......... .......... .......... 71% 388M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66150K .......... .......... .......... .......... .......... 71% 437M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66200K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-12T18:02:38.762 INFO:teuthology.orchestra.run.smithi094.stderr: 66250K .......... .......... .......... .......... .......... 71% 437M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66300K .......... .......... .......... .......... .......... 71% 102M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66350K .......... .......... .......... .......... .......... 71% 191M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66400K .......... .......... .......... .......... .......... 71% 208M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66450K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66500K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66550K .......... .......... .......... .......... .......... 71% 395M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66600K .......... .......... .......... .......... .......... 71% 294M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66650K .......... .......... .......... .......... .......... 71% 208M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66700K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66750K .......... .......... .......... .......... .......... 71% 447M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66800K .......... .......... .......... .......... .......... 71% 234M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66850K .......... .......... .......... .......... .......... 72% 227M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66900K .......... .......... .......... .......... .......... 72% 383M 0s 2024-09-12T18:02:38.763 INFO:teuthology.orchestra.run.smithi094.stderr: 66950K .......... .......... .......... .......... .......... 72% 435M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67000K .......... .......... .......... .......... .......... 72% 76.9M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67050K .......... .......... .......... .......... .......... 72% 331M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67100K .......... .......... .......... .......... .......... 72% 151M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67150K .......... .......... .......... .......... .......... 72% 145M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67200K .......... .......... .......... .......... .......... 72% 380M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67250K .......... .......... .......... .......... .......... 72% 321M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67300K .......... .......... .......... .......... .......... 72% 347M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67350K .......... .......... .......... .......... .......... 72% 442M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67400K .......... .......... .......... .......... .......... 72% 435M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67450K .......... .......... .......... .......... .......... 72% 443M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67500K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67550K .......... .......... .......... .......... .......... 72% 223M 0s 2024-09-12T18:02:38.764 INFO:teuthology.orchestra.run.smithi094.stderr: 67600K .......... .......... .......... .......... .......... 72% 178M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67650K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67700K .......... .......... .......... .......... .......... 72% 395M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67750K .......... .......... .......... .......... .......... 72% 139M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67800K .......... .......... .......... .......... .......... 73% 428M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67850K .......... .......... .......... .......... .......... 73% 392M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67900K .......... .......... .......... .......... .......... 73% 181M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 67950K .......... .......... .......... .......... .......... 73% 269M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68000K .......... .......... .......... .......... .......... 73% 439M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68050K .......... .......... .......... .......... .......... 73% 427M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68100K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68150K .......... .......... .......... .......... .......... 73% 390M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68200K .......... .......... .......... .......... .......... 73% 429M 0s 2024-09-12T18:02:38.765 INFO:teuthology.orchestra.run.smithi094.stderr: 68250K .......... .......... .......... .......... .......... 73% 151M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68300K .......... .......... .......... .......... .......... 73% 355M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68350K .......... .......... .......... .......... .......... 73% 176M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68400K .......... .......... .......... .......... .......... 73% 403M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68450K .......... .......... .......... .......... .......... 73% 119M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68500K .......... .......... .......... .......... .......... 73% 364M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68550K .......... .......... .......... .......... .......... 73% 186M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68600K .......... .......... .......... .......... .......... 73% 412M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68650K .......... .......... .......... .......... .......... 73% 133M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68700K .......... .......... .......... .......... .......... 74% 357M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68750K .......... .......... .......... .......... .......... 74% 145M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68800K .......... .......... .......... .......... .......... 74% 404M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68850K .......... .......... .......... .......... .......... 74% 424M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68900K .......... .......... .......... .......... .......... 74% 363M 0s 2024-09-12T18:02:38.766 INFO:teuthology.orchestra.run.smithi094.stderr: 68950K .......... .......... .......... .......... .......... 74% 423M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69000K .......... .......... .......... .......... .......... 74% 433M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69050K .......... .......... .......... .......... .......... 74% 445M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69100K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69150K .......... .......... .......... .......... .......... 74% 434M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69200K .......... .......... .......... .......... .......... 74% 409M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69250K .......... .......... .......... .......... .......... 74% 440M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69300K .......... .......... .......... .......... .......... 74% 385M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69350K .......... .......... .......... .......... .......... 74% 414M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69400K .......... .......... .......... .......... .......... 74% 443M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69450K .......... .......... .......... .......... .......... 74% 432M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69500K .......... .......... .......... .......... .......... 74% 333M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69550K .......... .......... .......... .......... .......... 74% 347M 0s 2024-09-12T18:02:38.767 INFO:teuthology.orchestra.run.smithi094.stderr: 69600K .......... .......... .......... .......... .......... 74% 422M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69650K .......... .......... .......... .......... .......... 75% 431M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69700K .......... .......... .......... .......... .......... 75% 330M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69750K .......... .......... .......... .......... .......... 75% 444M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69800K .......... .......... .......... .......... .......... 75% 285M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69850K .......... .......... .......... .......... .......... 75% 163M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69900K .......... .......... .......... .......... .......... 75% 117M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 69950K .......... .......... .......... .......... .......... 75% 303M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70000K .......... .......... .......... .......... .......... 75% 444M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70050K .......... .......... .......... .......... .......... 75% 438M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70100K .......... .......... .......... .......... .......... 75% 363M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70150K .......... .......... .......... .......... .......... 75% 266M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70200K .......... .......... .......... .......... .......... 75% 418M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70250K .......... .......... .......... .......... .......... 75% 99.6M 0s 2024-09-12T18:02:38.768 INFO:teuthology.orchestra.run.smithi094.stderr: 70300K .......... .......... .......... .......... .......... 75% 132M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70350K .......... .......... .......... .......... .......... 75% 399M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70400K .......... .......... .......... .......... .......... 75% 120M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70450K .......... .......... .......... .......... .......... 75% 410M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70500K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70550K .......... .......... .......... .......... .......... 75% 423M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70600K .......... .......... .......... .......... .......... 76% 423M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70650K .......... .......... .......... .......... .......... 76% 404M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70700K .......... .......... .......... .......... .......... 76% 231M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70750K .......... .......... .......... .......... .......... 76% 431M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70800K .......... .......... .......... .......... .......... 76% 438M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70850K .......... .......... .......... .......... .......... 76% 428M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70900K .......... .......... .......... .......... .......... 76% 180M 0s 2024-09-12T18:02:38.769 INFO:teuthology.orchestra.run.smithi094.stderr: 70950K .......... .......... .......... .......... .......... 76% 405M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71000K .......... .......... .......... .......... .......... 76% 220M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71050K .......... .......... .......... .......... .......... 76% 431M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71100K .......... .......... .......... .......... .......... 76% 357M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71150K .......... .......... .......... .......... .......... 76% 437M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71200K .......... .......... .......... .......... .......... 76% 448M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71250K .......... .......... .......... .......... .......... 76% 441M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71300K .......... .......... .......... .......... .......... 76% 381M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71350K .......... .......... .......... .......... .......... 76% 412M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71400K .......... .......... .......... .......... .......... 76% 446M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71450K .......... .......... .......... .......... .......... 76% 266M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71500K .......... .......... .......... .......... .......... 77% 357M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71550K .......... .......... .......... .......... .......... 77% 440M 0s 2024-09-12T18:02:38.770 INFO:teuthology.orchestra.run.smithi094.stderr: 71600K .......... .......... .......... .......... .......... 77% 426M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71650K .......... .......... .......... .......... .......... 77% 208M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71700K .......... .......... .......... .......... .......... 77% 462M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71750K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71800K .......... .......... .......... .......... .......... 77% 448M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71850K .......... .......... .......... .......... .......... 77% 489M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71900K .......... .......... .......... .......... .......... 77% 482M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 71950K .......... .......... .......... .......... .......... 77% 482M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72000K .......... .......... .......... .......... .......... 77% 304M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72050K .......... .......... .......... .......... .......... 77% 472M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72100K .......... .......... .......... .......... .......... 77% 464M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72150K .......... .......... .......... .......... .......... 77% 270M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72200K .......... .......... .......... .......... .......... 77% 424M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72250K .......... .......... .......... .......... .......... 77% 207M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72300K .......... .......... .......... .......... .......... 77% 460M 0s 2024-09-12T18:02:38.771 INFO:teuthology.orchestra.run.smithi094.stderr: 72350K .......... .......... .......... .......... .......... 77% 163M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72400K .......... .......... .......... .......... .......... 77% 408M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72450K .......... .......... .......... .......... .......... 78% 104M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72500K .......... .......... .......... .......... .......... 78% 143M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72550K .......... .......... .......... .......... .......... 78% 373M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72600K .......... .......... .......... .......... .......... 78% 307M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72650K .......... .......... .......... .......... .......... 78% 319M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72700K .......... .......... .......... .......... .......... 78% 120M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72750K .......... .......... .......... .......... .......... 78% 276M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72800K .......... .......... .......... .......... .......... 78% 374M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72850K .......... .......... .......... .......... .......... 78% 388M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72900K .......... .......... .......... .......... .......... 78% 212M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 72950K .......... .......... .......... .......... .......... 78% 208M 0s 2024-09-12T18:02:38.772 INFO:teuthology.orchestra.run.smithi094.stderr: 73000K .......... .......... .......... .......... .......... 78% 267M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73050K .......... .......... .......... .......... .......... 78% 373M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73100K .......... .......... .......... .......... .......... 78% 251M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73150K .......... .......... .......... .......... .......... 78% 472M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73200K .......... .......... .......... .......... .......... 78% 281M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73250K .......... .......... .......... .......... .......... 78% 440M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73300K .......... .......... .......... .......... .......... 78% 449M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73350K .......... .......... .......... .......... .......... 79% 341M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73400K .......... .......... .......... .......... .......... 79% 371M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73450K .......... .......... .......... .......... .......... 79% 328M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73500K .......... .......... .......... .......... .......... 79% 431M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73550K .......... .......... .......... .......... .......... 79% 352M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73600K .......... .......... .......... .......... .......... 79% 416M 0s 2024-09-12T18:02:38.773 INFO:teuthology.orchestra.run.smithi094.stderr: 73650K .......... .......... .......... .......... .......... 79% 355M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73700K .......... .......... .......... .......... .......... 79% 197M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73750K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73800K .......... .......... .......... .......... .......... 79% 120M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73850K .......... .......... .......... .......... .......... 79% 195M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73900K .......... .......... .......... .......... .......... 79% 449M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 73950K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74000K .......... .......... .......... .......... .......... 79% 422M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74050K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74100K .......... .......... .......... .......... .......... 79% 222M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74150K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74200K .......... .......... .......... .......... .......... 79% 449M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74250K .......... .......... .......... .......... .......... 79% 125M 0s 2024-09-12T18:02:38.774 INFO:teuthology.orchestra.run.smithi094.stderr: 74300K .......... .......... .......... .......... .......... 80% 48.1M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74350K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74400K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74450K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74500K .......... .......... .......... .......... .......... 80% 277M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74550K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74600K .......... .......... .......... .......... .......... 80% 426M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74650K .......... .......... .......... .......... .......... 80% 380M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74700K .......... .......... .......... .......... .......... 80% 431M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74750K .......... .......... .......... .......... .......... 80% 252M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74800K .......... .......... .......... .......... .......... 80% 431M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74850K .......... .......... .......... .......... .......... 80% 209M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74900K .......... .......... .......... .......... .......... 80% 376M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 74950K .......... .......... .......... .......... .......... 80% 332M 0s 2024-09-12T18:02:38.775 INFO:teuthology.orchestra.run.smithi094.stderr: 75000K .......... .......... .......... .......... .......... 80% 432M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75050K .......... .......... .......... .......... .......... 80% 442M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75100K .......... .......... .......... .......... .......... 80% 435M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75150K .......... .......... .......... .......... .......... 80% 356M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75200K .......... .......... .......... .......... .......... 81% 447M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75250K .......... .......... .......... .......... .......... 81% 422M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75300K .......... .......... .......... .......... .......... 81% 437M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75350K .......... .......... .......... .......... .......... 81% 384M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75400K .......... .......... .......... .......... .......... 81% 281M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75450K .......... .......... .......... .......... .......... 81% 280M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75500K .......... .......... .......... .......... .......... 81% 435M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75550K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75600K .......... .......... .......... .......... .......... 81% 449M 0s 2024-09-12T18:02:38.776 INFO:teuthology.orchestra.run.smithi094.stderr: 75650K .......... .......... .......... .......... .......... 81% 154M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75700K .......... .......... .......... .......... .......... 81% 436M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75750K .......... .......... .......... .......... .......... 81% 390M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75800K .......... .......... .......... .......... .......... 81% 433M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75850K .......... .......... .......... .......... .......... 81% 449M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75900K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 75950K .......... .......... .......... .......... .......... 81% 263M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76000K .......... .......... .......... .......... .......... 81% 445M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76050K .......... .......... .......... .......... .......... 81% 412M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76100K .......... .......... .......... .......... .......... 81% 451M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76150K .......... .......... .......... .......... .......... 82% 394M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76200K .......... .......... .......... .......... .......... 82% 339M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76250K .......... .......... .......... .......... .......... 82% 297M 0s 2024-09-12T18:02:38.777 INFO:teuthology.orchestra.run.smithi094.stderr: 76300K .......... .......... .......... .......... .......... 82% 440M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76350K .......... .......... .......... .......... .......... 82% 214M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76400K .......... .......... .......... .......... .......... 82% 154M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76450K .......... .......... .......... .......... .......... 82% 212M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76500K .......... .......... .......... .......... .......... 82% 58.5M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76550K .......... .......... .......... .......... .......... 82% 317M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76600K .......... .......... .......... .......... .......... 82% 153M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76650K .......... .......... .......... .......... .......... 82% 101M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76700K .......... .......... .......... .......... .......... 82% 257M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76750K .......... .......... .......... .......... .......... 82% 356M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76800K .......... .......... .......... .......... .......... 82% 447M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76850K .......... .......... .......... .......... .......... 82% 173M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76900K .......... .......... .......... .......... .......... 82% 146M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 76950K .......... .......... .......... .......... .......... 82% 295M 0s 2024-09-12T18:02:38.778 INFO:teuthology.orchestra.run.smithi094.stderr: 77000K .......... .......... .......... .......... .......... 82% 258M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77050K .......... .......... .......... .......... .......... 82% 438M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77100K .......... .......... .......... .......... .......... 83% 129M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77150K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77200K .......... .......... .......... .......... .......... 83% 446M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77250K .......... .......... .......... .......... .......... 83% 373M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77300K .......... .......... .......... .......... .......... 83% 421M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77350K .......... .......... .......... .......... .......... 83% 138M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77400K .......... .......... .......... .......... .......... 83% 212M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77450K .......... .......... .......... .......... .......... 83% 128M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77500K .......... .......... .......... .......... .......... 83% 422M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77550K .......... .......... .......... .......... .......... 83% 266M 0s 2024-09-12T18:02:38.779 INFO:teuthology.orchestra.run.smithi094.stderr: 77600K .......... .......... .......... .......... .......... 83% 147M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77650K .......... .......... .......... .......... .......... 83% 436M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77700K .......... .......... .......... .......... .......... 83% 402M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77750K .......... .......... .......... .......... .......... 83% 295M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77800K .......... .......... .......... .......... .......... 83% 215M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77850K .......... .......... .......... .......... .......... 83% 299M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77900K .......... .......... .......... .......... .......... 83% 376M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 77950K .......... .......... .......... .......... .......... 83% 372M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78000K .......... .......... .......... .......... .......... 84% 296M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78050K .......... .......... .......... .......... .......... 84% 132M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78100K .......... .......... .......... .......... .......... 84% 147M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78150K .......... .......... .......... .......... .......... 84% 79.0M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78200K .......... .......... .......... .......... .......... 84% 374M 0s 2024-09-12T18:02:38.780 INFO:teuthology.orchestra.run.smithi094.stderr: 78250K .......... .......... .......... .......... .......... 84% 402M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78300K .......... .......... .......... .......... .......... 84% 271M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78350K .......... .......... .......... .......... .......... 84% 159M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78400K .......... .......... .......... .......... .......... 84% 425M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78450K .......... .......... .......... .......... .......... 84% 122M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78500K .......... .......... .......... .......... .......... 84% 416M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78550K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78600K .......... .......... .......... .......... .......... 84% 447M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78650K .......... .......... .......... .......... .......... 84% 431M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78700K .......... .......... .......... .......... .......... 84% 443M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78750K .......... .......... .......... .......... .......... 84% 85.9M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78800K .......... .......... .......... .......... .......... 84% 395M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78850K .......... .......... .......... .......... .......... 84% 404M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78900K .......... .......... .......... .......... .......... 84% 408M 0s 2024-09-12T18:02:38.781 INFO:teuthology.orchestra.run.smithi094.stderr: 78950K .......... .......... .......... .......... .......... 85% 343M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79000K .......... .......... .......... .......... .......... 85% 416M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79050K .......... .......... .......... .......... .......... 85% 372M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79100K .......... .......... .......... .......... .......... 85% 403M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79150K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79200K .......... .......... .......... .......... .......... 85% 440M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79250K .......... .......... .......... .......... .......... 85% 441M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79300K .......... .......... .......... .......... .......... 85% 444M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79350K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79400K .......... .......... .......... .......... .......... 85% 442M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79450K .......... .......... .......... .......... .......... 85% 422M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79500K .......... .......... .......... .......... .......... 85% 224M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79550K .......... .......... .......... .......... .......... 85% 273M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79600K .......... .......... .......... .......... .......... 85% 371M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79650K .......... .......... .......... .......... .......... 85% 264M 0s 2024-09-12T18:02:38.782 INFO:teuthology.orchestra.run.smithi094.stderr: 79700K .......... .......... .......... .......... .......... 85% 370M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 79750K .......... .......... .......... .......... .......... 85% 214M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 79800K .......... .......... .......... .......... .......... 85% 374M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 79850K .......... .......... .......... .......... .......... 86% 430M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 79900K .......... .......... .......... .......... .......... 86% 441M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 79950K .......... .......... .......... .......... .......... 86% 226M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80000K .......... .......... .......... .......... .......... 86% 423M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80050K .......... .......... .......... .......... .......... 86% 448M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80100K .......... .......... .......... .......... .......... 86% 202M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80150K .......... .......... .......... .......... .......... 86% 164M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80200K .......... .......... .......... .......... .......... 86% 442M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80250K .......... .......... .......... .......... .......... 86% 165M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80300K .......... .......... .......... .......... .......... 86% 418M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80350K .......... .......... .......... .......... .......... 86% 405M 0s 2024-09-12T18:02:38.783 INFO:teuthology.orchestra.run.smithi094.stderr: 80400K .......... .......... .......... .......... .......... 86% 95.4M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80450K .......... .......... .......... .......... .......... 86% 441M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80500K .......... .......... .......... .......... .......... 86% 455M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80550K .......... .......... .......... .......... .......... 86% 122M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80600K .......... .......... .......... .......... .......... 86% 275M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80650K .......... .......... .......... .......... .......... 86% 137M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80700K .......... .......... .......... .......... .......... 86% 179M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80750K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80800K .......... .......... .......... .......... .......... 87% 181M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80850K .......... .......... .......... .......... .......... 87% 188M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80900K .......... .......... .......... .......... .......... 87% 108M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 80950K .......... .......... .......... .......... .......... 87% 145M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 81000K .......... .......... .......... .......... .......... 87% 430M 0s 2024-09-12T18:02:38.784 INFO:teuthology.orchestra.run.smithi094.stderr: 81050K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81100K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81150K .......... .......... .......... .......... .......... 87% 154M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81200K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81250K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81300K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81350K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81400K .......... .......... .......... .......... .......... 87% 275M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81450K .......... .......... .......... .......... .......... 87% 273M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81500K .......... .......... .......... .......... .......... 87% 211M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81550K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81600K .......... .......... .......... .......... .......... 87% 374M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81650K .......... .......... .......... .......... .......... 87% 379M 0s 2024-09-12T18:02:38.785 INFO:teuthology.orchestra.run.smithi094.stderr: 81700K .......... .......... .......... .......... .......... 87% 390M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 81750K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 81800K .......... .......... .......... .......... .......... 88% 429M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 81850K .......... .......... .......... .......... .......... 88% 440M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 81900K .......... .......... .......... .......... .......... 88% 443M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 81950K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82000K .......... .......... .......... .......... .......... 88% 40.0M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82050K .......... .......... .......... .......... .......... 88% 436M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82100K .......... .......... .......... .......... .......... 88% 234M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82150K .......... .......... .......... .......... .......... 88% 437M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82200K .......... .......... .......... .......... .......... 88% 364M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82250K .......... .......... .......... .......... .......... 88% 351M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82300K .......... .......... .......... .......... .......... 88% 180M 0s 2024-09-12T18:02:38.786 INFO:teuthology.orchestra.run.smithi094.stderr: 82350K .......... .......... .......... .......... .......... 88% 381M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82400K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82450K .......... .......... .......... .......... .......... 88% 154M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82500K .......... .......... .......... .......... .......... 88% 143M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82550K .......... .......... .......... .......... .......... 88% 365M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82600K .......... .......... .......... .......... .......... 88% 317M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82650K .......... .......... .......... .......... .......... 89% 61.2M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82700K .......... .......... .......... .......... .......... 89% 293M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82750K .......... .......... .......... .......... .......... 89% 121M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82800K .......... .......... .......... .......... .......... 89% 273M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82850K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82900K .......... .......... .......... .......... .......... 89% 440M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 82950K .......... .......... .......... .......... .......... 89% 252M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 83000K .......... .......... .......... .......... .......... 89% 355M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 83050K .......... .......... .......... .......... .......... 89% 87.8M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 83100K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-12T18:02:38.787 INFO:teuthology.orchestra.run.smithi094.stderr: 83150K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83200K .......... .......... .......... .......... .......... 89% 408M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83250K .......... .......... .......... .......... .......... 89% 410M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83300K .......... .......... .......... .......... .......... 89% 445M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83350K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83400K .......... .......... .......... .......... .......... 89% 340M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83450K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83500K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83550K .......... .......... .......... .......... .......... 89% 239M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83600K .......... .......... .......... .......... .......... 90% 393M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83650K .......... .......... .......... .......... .......... 90% 414M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83700K .......... .......... .......... .......... .......... 90% 412M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83750K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83800K .......... .......... .......... .......... .......... 90% 441M 0s 2024-09-12T18:02:38.788 INFO:teuthology.orchestra.run.smithi094.stderr: 83850K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 83900K .......... .......... .......... .......... .......... 90% 420M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 83950K .......... .......... .......... .......... .......... 90% 231M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84000K .......... .......... .......... .......... .......... 90% 232M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84050K .......... .......... .......... .......... .......... 90% 429M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84100K .......... .......... .......... .......... .......... 90% 419M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84150K .......... .......... .......... .......... .......... 90% 346M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84200K .......... .......... .......... .......... .......... 90% 372M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84250K .......... .......... .......... .......... .......... 90% 448M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84300K .......... .......... .......... .......... .......... 90% 447M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84350K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84400K .......... .......... .......... .......... .......... 90% 255M 0s 2024-09-12T18:02:38.789 INFO:teuthology.orchestra.run.smithi094.stderr: 84450K .......... .......... .......... .......... .......... 90% 191M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84500K .......... .......... .......... .......... .......... 91% 383M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84550K .......... .......... .......... .......... .......... 91% 79.5M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84600K .......... .......... .......... .......... .......... 91% 352M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84650K .......... .......... .......... .......... .......... 91% 264M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84700K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84750K .......... .......... .......... .......... .......... 91% 172M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84800K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84850K .......... .......... .......... .......... .......... 91% 142M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84900K .......... .......... .......... .......... .......... 91% 423M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 84950K .......... .......... .......... .......... .......... 91% 273M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 85000K .......... .......... .......... .......... .......... 91% 293M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 85050K .......... .......... .......... .......... .......... 91% 133M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 85100K .......... .......... .......... .......... .......... 91% 186M 0s 2024-09-12T18:02:38.790 INFO:teuthology.orchestra.run.smithi094.stderr: 85150K .......... .......... .......... .......... .......... 91% 361M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85200K .......... .......... .......... .......... .......... 91% 437M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85250K .......... .......... .......... .......... .......... 91% 439M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85300K .......... .......... .......... .......... .......... 91% 153M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85350K .......... .......... .......... .......... .......... 91% 202M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85400K .......... .......... .......... .......... .......... 91% 403M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85450K .......... .......... .......... .......... .......... 92% 367M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85500K .......... .......... .......... .......... .......... 92% 291M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85550K .......... .......... .......... .......... .......... 92% 369M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85600K .......... .......... .......... .......... .......... 92% 438M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85650K .......... .......... .......... .......... .......... 92% 394M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85700K .......... .......... .......... .......... .......... 92% 401M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85750K .......... .......... .......... .......... .......... 92% 432M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85800K .......... .......... .......... .......... .......... 92% 337M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85850K .......... .......... .......... .......... .......... 92% 46.2M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85900K .......... .......... .......... .......... .......... 92% 468M 0s 2024-09-12T18:02:38.791 INFO:teuthology.orchestra.run.smithi094.stderr: 85950K .......... .......... .......... .......... .......... 92% 304M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86000K .......... .......... .......... .......... .......... 92% 426M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86050K .......... .......... .......... .......... .......... 92% 426M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86100K .......... .......... .......... .......... .......... 92% 415M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86150K .......... .......... .......... .......... .......... 92% 364M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86200K .......... .......... .......... .......... .......... 92% 124M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86250K .......... .......... .......... .......... .......... 92% 374M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86300K .......... .......... .......... .......... .......... 92% 423M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86350K .......... .......... .......... .......... .......... 93% 116M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86400K .......... .......... .......... .......... .......... 93% 433M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86450K .......... .......... .......... .......... .......... 93% 183M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86500K .......... .......... .......... .......... .......... 93% 70.7M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86550K .......... .......... .......... .......... .......... 93% 202M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86600K .......... .......... .......... .......... .......... 93% 354M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86650K .......... .......... .......... .......... .......... 93% 192M 0s 2024-09-12T18:02:38.792 INFO:teuthology.orchestra.run.smithi094.stderr: 86700K .......... .......... .......... .......... .......... 93% 423M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 86750K .......... .......... .......... .......... .......... 93% 357M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 86800K .......... .......... .......... .......... .......... 93% 113M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 86850K .......... .......... .......... .......... .......... 93% 340M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 86900K .......... .......... .......... .......... .......... 93% 75.8M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 86950K .......... .......... .......... .......... .......... 93% 247M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87000K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87050K .......... .......... .......... .......... .......... 93% 428M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87100K .......... .......... .......... .......... .......... 93% 443M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87150K .......... .......... .......... .......... .......... 93% 223M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87200K .......... .......... .......... .......... .......... 93% 160M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87250K .......... .......... .......... .......... .......... 93% 184M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87300K .......... .......... .......... .......... .......... 94% 267M 0s 2024-09-12T18:02:38.793 INFO:teuthology.orchestra.run.smithi094.stderr: 87350K .......... .......... .......... .......... .......... 94% 245M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87400K .......... .......... .......... .......... .......... 94% 176M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87450K .......... .......... .......... .......... .......... 94% 415M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87500K .......... .......... .......... .......... .......... 94% 413M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87550K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87600K .......... .......... .......... .......... .......... 94% 418M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87650K .......... .......... .......... .......... .......... 94% 387M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87700K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87750K .......... .......... .......... .......... .......... 94% 325M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87800K .......... .......... .......... .......... .......... 94% 334M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87850K .......... .......... .......... .......... .......... 94% 105M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87900K .......... .......... .......... .......... .......... 94% 382M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 87950K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-12T18:02:38.794 INFO:teuthology.orchestra.run.smithi094.stderr: 88000K .......... .......... .......... .......... .......... 94% 423M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88050K .......... .......... .......... .......... .......... 94% 416M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88100K .......... .......... .......... .......... .......... 94% 409M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88150K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88200K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88250K .......... .......... .......... .......... .......... 95% 350M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88300K .......... .......... .......... .......... .......... 95% 431M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88350K .......... .......... .......... .......... .......... 95% 198M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88400K .......... .......... .......... .......... .......... 95% 192M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88450K .......... .......... .......... .......... .......... 95% 389M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88500K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88550K .......... .......... .......... .......... .......... 95% 133M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88600K .......... .......... .......... .......... .......... 95% 248M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88650K .......... .......... .......... .......... .......... 95% 220M 0s 2024-09-12T18:02:38.795 INFO:teuthology.orchestra.run.smithi094.stderr: 88700K .......... .......... .......... .......... .......... 95% 342M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 88750K .......... .......... .......... .......... .......... 95% 138M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 88800K .......... .......... .......... .......... .......... 95% 424M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 88850K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 88900K .......... .......... .......... .......... .......... 95% 99.2M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 88950K .......... .......... .......... .......... .......... 95% 406M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89000K .......... .......... .......... .......... .......... 95% 420M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89050K .......... .......... .......... .......... .......... 95% 339M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89100K .......... .......... .......... .......... .......... 95% 433M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89150K .......... .......... .......... .......... .......... 96% 360M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89200K .......... .......... .......... .......... .......... 96% 409M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89250K .......... .......... .......... .......... .......... 96% 413M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89300K .......... .......... .......... .......... .......... 96% 409M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89350K .......... .......... .......... .......... .......... 96% 372M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89400K .......... .......... .......... .......... .......... 96% 434M 0s 2024-09-12T18:02:38.796 INFO:teuthology.orchestra.run.smithi094.stderr: 89450K .......... .......... .......... .......... .......... 96% 430M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89500K .......... .......... .......... .......... .......... 96% 345M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89550K .......... .......... .......... .......... .......... 96% 194M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89600K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89650K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89700K .......... .......... .......... .......... .......... 96% 57.3M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89750K .......... .......... .......... .......... .......... 96% 92.2M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89800K .......... .......... .......... .......... .......... 96% 353M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89850K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89900K .......... .......... .......... .......... .......... 96% 170M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 89950K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 90000K .......... .......... .......... .......... .......... 96% 340M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 90050K .......... .......... .......... .......... .......... 96% 363M 0s 2024-09-12T18:02:38.797 INFO:teuthology.orchestra.run.smithi094.stderr: 90100K .......... .......... .......... .......... .......... 97% 20.3M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90150K .......... .......... .......... .......... .......... 97% 252M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90200K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90250K .......... .......... .......... .......... .......... 97% 257M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90300K .......... .......... .......... .......... .......... 97% 369M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90350K .......... .......... .......... .......... .......... 97% 295M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90400K .......... .......... .......... .......... .......... 97% 101M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90450K .......... .......... .......... .......... .......... 97% 114M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90500K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90550K .......... .......... .......... .......... .......... 97% 336M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90600K .......... .......... .......... .......... .......... 97% 386M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90650K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90700K .......... .......... .......... .......... .......... 97% 144M 0s 2024-09-12T18:02:38.798 INFO:teuthology.orchestra.run.smithi094.stderr: 90750K .......... .......... .......... .......... .......... 97% 155M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 90800K .......... .......... .......... .......... .......... 97% 373M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 90850K .......... .......... .......... .......... .......... 97% 182M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 90900K .......... .......... .......... .......... .......... 97% 363M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 90950K .......... .......... .......... .......... .......... 97% 308M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91000K .......... .......... .......... .......... .......... 98% 340M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91050K .......... .......... .......... .......... .......... 98% 379M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91100K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91150K .......... .......... .......... .......... .......... 98% 248M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91200K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91250K .......... .......... .......... .......... .......... 98% 191M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91300K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91350K .......... .......... .......... .......... .......... 98% 351M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91400K .......... .......... .......... .......... .......... 98% 260M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91450K .......... .......... .......... .......... .......... 98% 344M 0s 2024-09-12T18:02:38.799 INFO:teuthology.orchestra.run.smithi094.stderr: 91500K .......... .......... .......... .......... .......... 98% 329M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91550K .......... .......... .......... .......... .......... 98% 369M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91600K .......... .......... .......... .......... .......... 98% 354M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91650K .......... .......... .......... .......... .......... 98% 318M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91700K .......... .......... .......... .......... .......... 98% 252M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91750K .......... .......... .......... .......... .......... 98% 291M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91800K .......... .......... .......... .......... .......... 98% 272M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91850K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91900K .......... .......... .......... .......... .......... 98% 340M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 91950K .......... .......... .......... .......... .......... 99% 373M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 92000K .......... .......... .......... .......... .......... 99% 285M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 92050K .......... .......... .......... .......... .......... 99% 213M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 92100K .......... .......... .......... .......... .......... 99% 232M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 92150K .......... .......... .......... .......... .......... 99% 329M 0s 2024-09-12T18:02:38.800 INFO:teuthology.orchestra.run.smithi094.stderr: 92200K .......... .......... .......... .......... .......... 99% 304M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92250K .......... .......... .......... .......... .......... 99% 381M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92300K .......... .......... .......... .......... .......... 99% 293M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92350K .......... .......... .......... .......... .......... 99% 283M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92400K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92450K .......... .......... .......... .......... .......... 99% 395M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92500K .......... .......... .......... .......... .......... 99% 369M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92550K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92600K .......... .......... .......... .......... .......... 99% 244M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92650K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92700K .......... .......... .......... .......... .......... 99% 265M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92750K .......... .......... .......... .......... .......... 99% 133M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92800K .......... .......... .......... .......... .......... 99% 243M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92850K .......... .......... .......... .......... .......... 99% 358M 0s 2024-09-12T18:02:38.801 INFO:teuthology.orchestra.run.smithi094.stderr: 92900K 100% 134G=0.4s 2024-09-12T18:02:38.802 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:02:38.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12 18:02:37 (211 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T18:02:38.802 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T18:02:38.836 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T18:02:38.837 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T18:02:38.838 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T18:02:38.839 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T18:02:38.840 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T18:02:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T18:02:38.842 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T18:02:38.843 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T18:02:38.844 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T18:02:38.845 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T18:02:38.846 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T18:02:38.847 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T18:02:38.848 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T18:02:38.849 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T18:02:38.850 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T18:02:38.851 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T18:02:38.852 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T18:02:38.853 INFO:teuthology.orchestra.run.smithi094.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout:Welcome to Gradle 6.0.1! 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout:Here are the highlights of this release: 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Substantial improvements in dependency management, including 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Advanced control of transitive versions 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for optional features and dependencies 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Rules to tweak published metadata 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Java 13 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - New Zinc compiler for Scala 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - VS2019 support 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.854 INFO:teuthology.orchestra.run.smithi094.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Gradle 6.0.1 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Kotlin: 1.3.50 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Groovy: 2.5.8 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T18:02:38.855 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:38.856 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T18:02:38.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:02:38.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:02:38.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:02:38.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:02:38.856 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T18:02:39.099 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T18:02:39.100 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T18:02:39.100 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'RJNMIZGWATACSRBIFIJA', 'access_secret': 'AmSQ34sPL09AoGPCTOKLlj/nYgYcxxc3dUFofGCcuJByxoV3uEIT7w==', 'region': 'mexico', 'endpoint': 'smithi094.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi094.front.sepia.ceph.com'} 2024-09-12T18:02:39.100 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T18:02:39.100 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'RJNMIZGWATACSRBIFIJA', '--secret', 'AmSQ34sPL09AoGPCTOKLlj/nYgYcxxc3dUFofGCcuJByxoV3uEIT7w==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T18:02:39.100 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key RJNMIZGWATACSRBIFIJA --secret AmSQ34sPL09AoGPCTOKLlj/nYgYcxxc3dUFofGCcuJByxoV3uEIT7w== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T18:02:39.165 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:39.165 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:39.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.197+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 20 realm 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.199+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.200+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.200+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.201+0000 7fa11db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:39.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.201+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.201+0000 7fa11db26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:39.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.201+0000 7fa11db26800 20 searching for the correct realm 2024-09-12T18:02:39.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.205+0000 7fa118fd8640 0 -- 172.21.15.94:0/211360170 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55c9a82e3ac0 msgr2=0x55c9a82e5f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.209+0000 7fa1197d9640 0 -- 172.21.15.94:0/211360170 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa110055400 msgr2=0x7fa110055860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.214+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 zone default found 2024-09-12T18:02:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 4 Realm: () 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 zonegroup default 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.215+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.216+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.216+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.216+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.216+0000 7fa11db26800 20 started sync module instance, tier type = 2024-09-12T18:02:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.216+0000 7fa11db26800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:39.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=0 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=1 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=2 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=3 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=4 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=5 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.227+0000 7fa11db26800 20 add_watcher() i=6 2024-09-12T18:02:39.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.228+0000 7fa11db26800 20 add_watcher() i=7 2024-09-12T18:02:39.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.228+0000 7fa11db26800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:39.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.230+0000 7f9fcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.230+0000 7fa11db26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.230+0000 7fa11db26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.230+0000 7fa11db26800 5 note: GC not initialized 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7f9fce7e4640 20 reqs_thread_entry: start 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 20 Filter name: none 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7f9f3ffff640 20 reqs_thread_entry: start 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:02:39.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.231+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 cache get: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA : miss 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA info.flags=0x0 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 adding default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA to cache LRU end 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 cache get: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA : hit (negative entry) 2024-09-12T18:02:39.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.232+0000 7fa11db26800 10 cache get: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA : hit (negative entry) 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.233+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.233+0000 7fa11db26800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.233+0000 7fa11db26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.234+0000 7f9febfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529767 cookie 94324598420464 notifier 8207 bl.length()=670 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.234+0000 7f9febfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:02:39.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.234+0000 7f9febfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:02:39.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:02:39.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7fa11db26800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:02:39.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7fa11db26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:02:39.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7f9febfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529714 cookie 94324598407824 notifier 8207 bl.length()=200 2024-09-12T18:02:39.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7f9febfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:02:39.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.236+0000 7f9febfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:02:39.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7fa11db26800 10 cache put: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA info.flags=0x7 2024-09-12T18:02:39.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7fa11db26800 10 moving default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA to cache LRU end 2024-09-12T18:02:39.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7fa11db26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:RJNMIZGWATACSRBIFIJA, ofs0, ns] 2024-09-12T18:02:39.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7f9febfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94324598407824 notifier 8207 bl.length()=189 2024-09-12T18:02:39.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7f9febfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA info.flags=0x7 2024-09-12T18:02:39.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.239+0000 7f9febfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RJNMIZGWATACSRBIFIJA to cache LRU end 2024-09-12T18:02:39.241 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "tester.client.0", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "tester.client.0", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "RJNMIZGWATACSRBIFIJA", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "AmSQ34sPL09AoGPCTOKLlj/nYgYcxxc3dUFofGCcuJByxoV3uEIT7w==", 2024-09-12T18:02:39.242 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:02:39.233228Z" 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:02:39.243 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:02:39.244 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:02:39.233217Z", 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.241+0000 7f9fcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:39.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.244+0000 7fa11db26800 20 remove_watcher() i=0 2024-09-12T18:02:39.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.244+0000 7fa11db26800 2 removed watcher, disabling cache 2024-09-12T18:02:39.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.245+0000 7fa11db26800 20 remove_watcher() i=1 2024-09-12T18:02:39.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.246+0000 7fa11db26800 20 remove_watcher() i=2 2024-09-12T18:02:39.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.247+0000 7fa11db26800 20 remove_watcher() i=3 2024-09-12T18:02:39.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.248+0000 7fa11db26800 20 remove_watcher() i=4 2024-09-12T18:02:39.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.249+0000 7fa11db26800 20 remove_watcher() i=5 2024-09-12T18:02:39.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.250+0000 7fa11db26800 20 remove_watcher() i=6 2024-09-12T18:02:39.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.251+0000 7fa11db26800 20 remove_watcher() i=7 2024-09-12T18:02:39.264 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T18:02:39.265 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T18:02:39.295 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T18:02:39.295 DEBUG:teuthology.orchestra.run.smithi094:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T18:02:39.361 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.489+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.490+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 realm 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.491+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.492+0000 7f851d533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.492+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.492+0000 7f851d533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.492+0000 7f851d533800 20 searching for the correct realm 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.497+0000 7f8519a77640 0 -- 172.21.15.94:0/657018021 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f850401e060 msgr2=0x7f85040961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:39.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.703+0000 7f8519276640 0 -- 172.21.15.94:0/657018021 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x561a68772500 msgr2=0x561a68774950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:39.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:39.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:39.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:39.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:39.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:39.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:39.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.706+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 zone default found 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 4 Realm: () 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:39.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 zonegroup default 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.707+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.708+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.708+0000 7f851d533800 20 rados->read ofs=0 len=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.708+0000 7f851d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.708+0000 7f851d533800 20 started sync module instance, tier type = 2024-09-12T18:02:39.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.708+0000 7f851d533800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=0 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=1 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=2 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=3 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=4 2024-09-12T18:02:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=5 2024-09-12T18:02:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.717+0000 7f851d533800 20 add_watcher() i=6 2024-09-12T18:02:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.718+0000 7f851d533800 20 add_watcher() i=7 2024-09-12T18:02:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.718+0000 7f851d533800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:39.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.720+0000 7f83cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:39.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.720+0000 7f851d533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:39.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.720+0000 7f851d533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:39.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.758+0000 7f83cefe5640 20 reqs_thread_entry: start 2024-09-12T18:02:39.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.758+0000 7f851d533800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:39.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.758+0000 7f851d533800 20 Filter name: none 2024-09-12T18:02:39.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.758+0000 7f83ccfe1640 20 reqs_thread_entry: start 2024-09-12T18:02:39.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.759+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:02:39.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.760+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:02:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_oW8jT7EHhwjc_-7PkPe_nZ8S_cGbEFM', time=2024-09-12T19:53:38.689982+0000, chain.objs.size()=2 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.g0mpe8D7550fUw2nMaGMeLFOFLpPNzY_0 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.g0mpe8D7550fUw2nMaGMeLFOFLpPNzY_1 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13581157047320684942', time=2024-09-12T19:53:38.713821+0000, chain.objs.size()=2 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_0 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_1 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8951281566910182532', time=2024-09-12T19:54:59.320524+0000, chain.objs.size()=1 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.UDmte-Qq_DpDQndu2kQ5zL4cxUet5a2_0 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3383684014761412364', time=2024-09-12T19:55:35.003000+0000, chain.objs.size()=1 2024-09-12T18:02:39.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.8AFGNZZWIG-W34ghr-_ag6lbCQJ8SM1_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9660579315479975703', time=2024-09-12T19:56:11.260445+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.5I5XnnB70pvFtJ2gErXKna7j3b4Kg7F_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8317775618405287667', time=2024-09-12T19:56:46.758627+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.ZXc5mRlhE2kc_WZfO9oaw53s9sW8nPd_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5355344905980087779', time=2024-09-12T19:56:46.783325+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.RrHf0mFbNCXcLz2pQ78eCWW1Su-a36j_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11049461324182363594', time=2024-09-12T19:56:46.783929+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.eTaTbH95W67h6i-8WgXx29Dm36WUABx_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12843921325033376823', time=2024-09-12T19:56:46.784608+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.OrPxbAj_y__wmpbAual6E6ngnJ_wbGM_0 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6578839465110031362', time=2024-09-12T19:56:49.513370+0000, chain.objs.size()=1 2024-09-12T18:02:39.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.761+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.X5KLUJVuJRa32XbaoR21RYsf5JIJmnx_0 2024-09-12T18:02:39.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3413526054723211040', time=2024-09-12T19:57:24.880585+0000, chain.objs.size()=1 2024-09-12T18:02:39.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.J0LlGxybYDWXXm6ipwKrErIGT1mFuB0_0 2024-09-12T18:02:39.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8939003976104555500', time=2024-09-12T19:57:26.875689+0000, chain.objs.size()=1 2024-09-12T18:02:39.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.YhHe9qcxWIrUbEwbr9VdHK3HKG2fTfM_0 2024-09-12T18:02:39.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11346538664131906988', time=2024-09-12T19:58:03.384330+0000, chain.objs.size()=1 2024-09-12T18:02:39.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.5aUF3fFHUmdgGzFCCBJzETNGT9vE0Xo_0 2024-09-12T18:02:39.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12365909933615985697', time=2024-09-12T19:58:03.424853+0000, chain.objs.size()=1 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.765+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.LQiR-5K6w_We40K0Jhfp2XSU4gRpYd3_0 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2448422589844868673', time=2024-09-12T19:59:14.516567+0000, chain.objs.size()=1 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.0WwNVLIG-jmYQDuSkr44UZMKvPFg1K6_0 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6458087578378382055', time=2024-09-12T19:59:17.663607+0000, chain.objs.size()=1 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.vJTBk02AmvXbAfG9MlWha86QjM5_VUc_0 2024-09-12T18:02:39.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14139203152085755755', time=2024-09-12T19:59:17.712015+0000, chain.objs.size()=1 2024-09-12T18:02:39.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.tsNPFnogXhQ_I_C9WsnTIgZjWwhoDFV_0 2024-09-12T18:02:39.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11950901629170014608', time=2024-09-12T19:59:52.322706+0000, chain.objs.size()=1 2024-09-12T18:02:39.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.766+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.MowSX4wE3c5gjYLyLMfDjciJVgyzOuf_0 2024-09-12T18:02:39.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.768+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8863804815297220664', time=2024-09-12T20:01:59.670442+0000, chain.objs.size()=1 2024-09-12T18:02:39.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.768+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.UUFrPjfhfOvupI-gTYEYn67Vlocm47U_0 2024-09-12T18:02:39.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.772+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.775+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:02:39.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.776+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16470466752307072973', time=2024-09-12T19:54:57.788274+0000, chain.objs.size()=1 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.QHKeo5jANjK2V4IjaI3deXcmawWQp4M_0 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6693459080545234964', time=2024-09-12T19:54:59.406430+0000, chain.objs.size()=1 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.Rt6PJkaWKqwvMa9JfN5d7YK_yaYh4Bx_0 2024-09-12T18:02:39.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18317984750498555052', time=2024-09-12T19:55:34.950576+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.VxwjpSEn_i_ZQtdwBzlTDfKQJkXx2JQ_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12240671192582597380', time=2024-09-12T19:56:08.906232+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.jy_c9xKbNzytyyXk7EaMGwTS7fhb-I1_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.433147182055864762', time=2024-09-12T19:56:08.936137+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.XcMfF8lNwHtzadIhSHUC2nw5KVeBAlT_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10202147047968025509', time=2024-09-12T19:56:11.255735+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.be-fFGOuvK45pkR8WTaMZNnhCcru5wk_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8501068168688278456', time=2024-09-12T19:56:13.653618+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.7tiyW_CBejOzWO4SL_aloAVsaIRGT_L_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10232186484023963492', time=2024-09-12T19:56:49.511588+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.A3m94QS_90uGBdzz8D717Ft0ssgbyAS_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8866068025222263205', time=2024-09-12T19:59:19.639303+0000, chain.objs.size()=1 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.oNLO7qgcwgY5pRwgymubrzmkVj0i4V-_0 2024-09-12T18:02:39.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12336866284930152420', time=2024-09-12T19:59:52.290371+0000, chain.objs.size()=1 2024-09-12T18:02:39.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.vcU04noIj_u7G7yJpvYUqjdAw_6LrfF_0 2024-09-12T18:02:39.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1436158129510341134', time=2024-09-12T19:59:52.346285+0000, chain.objs.size()=1 2024-09-12T18:02:39.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.777+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.vjIf9aSFy5xg92Ji7pZVizy6IWMA2tb_0 2024-09-12T18:02:39.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.778+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17240816849976657404', time=2024-09-12T20:01:59.640844+0000, chain.objs.size()=1 2024-09-12T18:02:39.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.778+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.pkRaMBnECXik6U9DwesgR3ClcAar7IY_0 2024-09-12T18:02:39.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.783+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.785+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:02:39.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10966527156655396539', time=2024-09-12T19:53:38.822632+0000, chain.objs.size()=3 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.1 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.2 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-STANDARD.2~HDdIAkncpFbUfdaN8CCVGiVLQA7122S.3 2024-09-12T18:02:39.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7434195769741265717', time=2024-09-12T19:54:57.790372+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.787+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.EfaM3FtWL3M8uxL8vsVtW6H_hKvQx7b_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5730081591846075875', time=2024-09-12T19:54:59.315742+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.WSiFiaiVHlQVmrID5P7jgnrcqlzX-4L_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2862408136462529023', time=2024-09-12T19:54:59.350223+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.Ef0-2CPjlIG-4W6EiHunYg98-0HJZVr_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18163705403787475359', time=2024-09-12T19:54:59.375711+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.clLkbYhpQL9Kr8mjc4sNtWWz5mkkoT0_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6833064195879998835', time=2024-09-12T19:55:32.013255+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.xb2yYhGP78j6ISnYJQ7Iab4nwxiGicW_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14876876932252985885', time=2024-09-12T19:55:32.027706+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.FQ0qJIDFa5sED3Rtjgr0KNPV19Zwcqj_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10559929610749136338', time=2024-09-12T19:55:34.961922+0000, chain.objs.size()=1 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.dUZMwIYZ2H725JR3Tv3sUnCmCn-kDXn_0 2024-09-12T18:02:39.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17464255780908196326', time=2024-09-12T19:55:34.962704+0000, chain.objs.size()=1 2024-09-12T18:02:39.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.f0qA6ZsbiSPdgBF-zLdTgZBsYh_nktc_0 2024-09-12T18:02:39.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7739890524346629448', time=2024-09-12T19:55:36.518767+0000, chain.objs.size()=1 2024-09-12T18:02:39.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.788+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.LxCiM92ZZV-pCgP6otEBJHq21MTw8gp_0 2024-09-12T18:02:39.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.791+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16383729827485222741', time=2024-09-12T19:56:08.924015+0000, chain.objs.size()=1 2024-09-12T18:02:39.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.791+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.6tqglA_GYyoJ3UJfiXs5wDV7rQYYk1J_0 2024-09-12T18:02:39.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.791+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6902221847350050364', time=2024-09-12T19:56:08.967879+0000, chain.objs.size()=1 2024-09-12T18:02:39.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.791+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.dM4ec-ddnX9vBsiCbqanQGgYQrtNJIS_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12086290874695201727', time=2024-09-12T19:56:11.251126+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.yS8MxHnN0BhdLYdUBNEod9Rw9PxZdUz_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7660837311048574271', time=2024-09-12T19:56:46.740984+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.b4cX9AKWJAOcn4o8rAv5RMDYCmtJKwe_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6350371966444932403', time=2024-09-12T19:57:22.185879+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.kU6CH6w7EdgOM4zazXOy2QU5cuSUcyl_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3800972258160971670', time=2024-09-12T19:57:26.810138+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.PbTIjCNbvC6wxOGVg1lAJwc1hHiseT3_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12180952834256769242', time=2024-09-12T19:58:39.542854+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.43Uh3Rr_mnDVSDkZHlI6q_3hMfLpzsf_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13295274399598254770', time=2024-09-12T19:59:52.288111+0000, chain.objs.size()=1 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.9gcZ3y_zSewzVZo_rqkGdCceUZP4ke8_0 2024-09-12T18:02:39.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12326475745722719996', time=2024-09-12T19:59:52.289266+0000, chain.objs.size()=1 2024-09-12T18:02:39.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.XuFsiTVaGmaBN9xaC7a-dqVJxr34AST_0 2024-09-12T18:02:39.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18117000402135029266', time=2024-09-12T19:59:52.345952+0000, chain.objs.size()=1 2024-09-12T18:02:39.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.793+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.CgD0YAx-kSF7DwzQtXzwmF9kY8bs2yo_0 2024-09-12T18:02:39.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.797+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.800+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:02:39.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.801+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.801+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13659205634136770865', time=2024-09-12T19:53:38.959561+0000, chain.objs.size()=1 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.iVx8fLzEH_hY8ym-eLx9pLZ7q3vd1Y-_0 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8038181726042312404', time=2024-09-12T19:54:57.754577+0000, chain.objs.size()=1 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.mVXOV00yvjn13NX8sdrxzxs5H6JbiAH_0 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5833866103267552452', time=2024-09-12T19:54:57.794731+0000, chain.objs.size()=1 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.7AC6yeBvg3VFD6rjKbKPZ66cqUORgph_0 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5084379333280216381', time=2024-09-12T19:55:32.014011+0000, chain.objs.size()=1 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.GCWr_GEVfvDFniOHsiyBQVJi9iWggsi_0 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6755825588252339505', time=2024-09-12T19:56:11.200454+0000, chain.objs.size()=1 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.R7QusHLIOa_7vpIg1gpYteWaxb-AmUi_0 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1621221255261939911', time=2024-09-12T19:56:11.224800+0000, chain.objs.size()=1 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.4dSPtDux4Jks-Xdja7nUEvZsf1D9lGV_0 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10434612241134145073', time=2024-09-12T19:56:46.743442+0000, chain.objs.size()=1 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.AAZwdXuSZqta35rroQbLRQo5-9W-I08_0 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17024788962436362515', time=2024-09-12T19:56:46.781568+0000, chain.objs.size()=1 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.EDmhWqG_iEBGAgvKiSICFwrsK_MCtB9_0 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2135087260557309298', time=2024-09-12T19:58:39.543976+0000, chain.objs.size()=1 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.zqFAuPgTOyhRIoKq3xEulPGb5hNLzwu_0 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7973475913879113720', time=2024-09-12T19:58:41.621743+0000, chain.objs.size()=1 2024-09-12T18:02:39.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.802+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.RXfyHEsHeQLOt1M0WXzPL251rDG36jl_0 2024-09-12T18:02:39.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.806+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.808+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:02:39.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.810+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.810+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:02:39.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8866274582553351816', time=2024-09-12T19:53:38.549537+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.CiARhY57FodjuOrLUcpV5GETz9cgYLE_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14144845359483792342', time=2024-09-12T19:54:57.822981+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.wMqg0D_vm-TKgIPy6i6--Gstb9TY0K6_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4731070026827992972', time=2024-09-12T19:56:10.330561+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.ynMh6Z9uSZCxsLnGnGR4gsmDv_LiCaW_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9773543231688337258', time=2024-09-12T19:56:13.603698+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.NBgvnrMVIba7RcaAeFFeVh1SsZlhPId_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16872229731375729863', time=2024-09-12T19:56:13.689094+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.oTTXOWhR2TYfOMyW9PZ0wVThuNIDrss_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4048767061186704920', time=2024-09-12T19:57:24.907053+0000, chain.objs.size()=1 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.45lVHtwU-vFmQXzLOImkDVw46Wn7rvj_0 2024-09-12T18:02:39.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10643528268603789724', time=2024-09-12T19:57:26.803427+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.IStUnmfRRn8tU_zyXFIgekPJr4zwyel_0 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6881911511771985381', time=2024-09-12T19:57:26.835929+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.YwstpkqmdJ-5uL7yaK2-F3nvBC6D0Qf_0 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2871142003625414191', time=2024-09-12T19:59:14.545474+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.0ScqaymyxpsNuPx7Bm4xN8nXQ8z1FrP_0 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2206162690062020153', time=2024-09-12T19:59:17.620184+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.-Ixpx6EaSEmsfbyQ6qVk4khwkQLKuoP_0 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6396110236408402880', time=2024-09-12T19:59:17.620981+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.V4QS3s-tYEIp55Pq586mwwlrpVVceCb_0 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4652018437040263457', time=2024-09-12T20:02:08.031705+0000, chain.objs.size()=1 2024-09-12T18:02:39.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.811+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:OV.EY5U1YPW60E15qxCo.TOcFhHujiN_.3_AQ0uNoHITDdR0qkDrJ-DWt7tvEF4z_0 2024-09-12T18:02:39.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.817+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.820+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:02:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.821+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.821+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:02:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4266767193815631768', time=2024-09-12T19:53:38.589471+0000, chain.objs.size()=7 2024-09-12T18:02:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.1 2024-09-12T18:02:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.1_1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.2 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.2_1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.3 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__shadow_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.3_1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11__multipart_foo.2~1ikNnV7xI51wvJOIyDxqV6IAaVyjBaA.4 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686192241065215657', time=2024-09-12T19:53:38.789327+0000, chain.objs.size()=5 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1_1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2_1 2024-09-12T18:02:39.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.822+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.3 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.800623712207437511', time=2024-09-12T19:54:57.790371+0000, chain.objs.size()=1 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.zgKRRd92X3Tt07p2REqe5A3LSD38OTo_0 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5621680235772939745', time=2024-09-12T19:55:35.004246+0000, chain.objs.size()=1 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.3muzaecKb6ZtEvMFlt3V1RqzImsVztX_0 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8618762873774852097', time=2024-09-12T19:55:36.538013+0000, chain.objs.size()=1 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.T79SMVNhiPZCmViqL_pY6CgaCqLadk4_0 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12444482967960233721', time=2024-09-12T19:56:08.924005+0000, chain.objs.size()=1 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.iSgNdegpE-wZHBm1CAPC_CyE_pLmRVp_0 2024-09-12T18:02:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3536487566948599632', time=2024-09-12T19:56:08.967158+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.pPf46kQZobq2bwJR8zBFmmkdR154uk__0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17450339050251703524', time=2024-09-12T19:56:08.968176+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.BPVOKcyX0z8MgYrDm9k8c9WKg2Qlupx_0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6334068512374842765', time=2024-09-12T19:56:13.652919+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.McUxYKK7fHcL0mlUJYsX2dTF89YI7Xb_0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8252004117732222321', time=2024-09-12T19:56:49.461473+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.gh0xUi6jFsyhiHSNlCk_v0pO88Ql_Z2_0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14846501128906076800', time=2024-09-12T19:57:22.095880+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.VUFuMxsH9-6CTEDiIy7_7u7lIKcZYbP_0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1399224514767204870', time=2024-09-12T19:57:22.131900+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.AeReondPju-q4JJ2-J7xDz_FLI3wHHX_0 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7764295623593707895', time=2024-09-12T19:57:22.139698+0000, chain.objs.size()=1 2024-09-12T18:02:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.826+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.c8H6O008otOkkVtpa2Hv5p3L0aJtgmt_0 2024-09-12T18:02:39.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.830+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14533903951359258915', time=2024-09-12T19:57:22.185887+0000, chain.objs.size()=1 2024-09-12T18:02:39.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.830+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.ZSjg1W7aCu3ihC8mdoZMMrIGBN3nLlx_0 2024-09-12T18:02:39.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14108709204001408069', time=2024-09-12T19:57:24.849385+0000, chain.objs.size()=1 2024-09-12T18:02:39.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.pCV7xnwavK-2cN3pJmDmXxJ4cEIBiJX_0 2024-09-12T18:02:39.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8938005764206439357', time=2024-09-12T19:58:39.542894+0000, chain.objs.size()=1 2024-09-12T18:02:39.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.C_hki0dBau-AENFMoJrW_kd4LOs7Fvp_0 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3634868449682382916', time=2024-09-12T19:59:14.536669+0000, chain.objs.size()=1 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_._aefmzSNHHRvIz_-seg1zvviraqGx6M_0 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15725534751323318843', time=2024-09-12T19:59:17.660169+0000, chain.objs.size()=1 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.2GxsC5u7p4QdKQko8gq6II41f_UB58x_0 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6177761165020836262', time=2024-09-12T19:59:19.640649+0000, chain.objs.size()=1 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.5ksWO2BlbA_ZtkDBcvagogIKklRprPr_0 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7281914148211709634', time=2024-09-12T19:59:52.288144+0000, chain.objs.size()=1 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.I3z6zVuZRl-V87BrpTZ8gtouAkQctdX_0 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17413123949739173026', time=2024-09-12T20:01:59.669935+0000, chain.objs.size()=1 2024-09-12T18:02:39.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.831+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.8DSuEP0Uplyoox2nrfbZSkC1MI8Nej1_0 2024-09-12T18:02:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.835+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.838+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:02:39.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.839+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17461671826757961452', time=2024-09-12T19:53:38.562311+0000, chain.objs.size()=1 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.2hHznfNwB-GiJGDNnfX8TDXoi2ns9dn_0 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12173414764066213000', time=2024-09-12T19:53:38.919688+0000, chain.objs.size()=1 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.cWQNz1eBrdk4Fhus7_go-mELqv6vl42_0 2024-09-12T18:02:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4825264314478374800', time=2024-09-12T19:54:57.797114+0000, chain.objs.size()=1 2024-09-12T18:02:39.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.ELQpriG9gup6iWHNsKIYUiAhc-DJgsh_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10708026606453206366', time=2024-09-12T19:54:57.849906+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.v6Dnex-LGQdWCw4Dmktj8os_AF-gNH__0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16268622125999510428', time=2024-09-12T19:54:59.422086+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.F0cGXDa2xmKX52Q93kj2F1n-VwTEuHX_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5188607288512751093', time=2024-09-12T19:55:32.015828+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.C1fDdHfy4SwoMgYv9nnDQS5UraYqBv8_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3245309561068831874', time=2024-09-12T19:56:13.632903+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.5QxI5xFOWuxtqXnbrW0hC3czfEPGpE1_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4975732371875254741', time=2024-09-12T19:56:46.781388+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.3gCUt1ctPZfTgvIRLn9_PJL_jwJbzBL_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8388954220274278807', time=2024-09-12T19:56:46.782138+0000, chain.objs.size()=1 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.5uV0zBcZQ3taJBM5pBEwAPnjDcdxH1d_0 2024-09-12T18:02:39.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8945329777994325112', time=2024-09-12T19:56:46.811547+0000, chain.objs.size()=1 2024-09-12T18:02:39.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.JLhUMUI6CyRh77esCl873ynVi8hh6ku_0 2024-09-12T18:02:39.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6935910745676051831', time=2024-09-12T19:57:22.120311+0000, chain.objs.size()=1 2024-09-12T18:02:39.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.lT-ycPA54Mf2xnC1aL_xGBA-CtYd_p7_0 2024-09-12T18:02:39.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8870600956293738589', time=2024-09-12T19:57:24.889242+0000, chain.objs.size()=1 2024-09-12T18:02:39.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.840+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.ns8N6rZpsXc4xWsqO1PT8bI_nNgkfns_0 2024-09-12T18:02:39.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.844+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11981252858669240014', time=2024-09-12T19:57:26.782407+0000, chain.objs.size()=1 2024-09-12T18:02:39.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.kJHQ-IVAeEues1LdOvOw0KEJBfRKp8g_0 2024-09-12T18:02:39.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5661337012088192508', time=2024-09-12T19:57:26.831156+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.gRocPqXBb0fo7UsCY8G4M_YLd3ZGQe2_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2386927082551562720', time=2024-09-12T19:58:00.039284+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.YZZ94o5Rdww6QOnPg2nYLssfsBhjFz2_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11740310250696848895', time=2024-09-12T19:58:39.473398+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.luD7hjeUmKtFAyFxkGZadU0dk-FwhnV_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16656673789272538937', time=2024-09-12T19:58:39.534228+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.jsZCbZez2MQ3mwggdXXDePEg0aFTlPy_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11890931480711056320', time=2024-09-12T19:58:39.592437+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.VgX-fjjywrBH5WY75AQsIqEEPDV5h0l_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13598896998803894364', time=2024-09-12T19:58:41.635663+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.WxftjT1_6IgOv56R5ILap-w8H_YK-oz_0 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17315769602286997308', time=2024-09-12T19:59:14.512498+0000, chain.objs.size()=1 2024-09-12T18:02:39.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.oXdX4Wp8BRgSw-rzRlMFAnPMqjEW2dr_0 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12351794965045176012', time=2024-09-12T19:59:14.533755+0000, chain.objs.size()=1 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.JEHonhsHXcTgCZcBg8wmKgUCFvrKFJ4_0 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1482932839027508413', time=2024-09-12T19:59:14.534393+0000, chain.objs.size()=1 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.eupViw69vEvwrG8fl6UMJbuObdNxZes_0 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5090900770313770646', time=2024-09-12T19:59:17.667524+0000, chain.objs.size()=1 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.845+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.u-cucf3YAARdvnw2cBsb9ySRHF4zDIA_0 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.848+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14153765028385871070', time=2024-09-12T20:02:12.421520+0000, chain.objs.size()=1 2024-09-12T18:02:39.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.848+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:PAdg0P23a0EN80f6QpWVKv1FCPiT.1T_.SY87KxoGHJemBgRzzQu6eGr52NRAiv8_0 2024-09-12T18:02:39.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.852+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.854+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:02:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.855+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.855+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11460283205344986273', time=2024-09-12T19:53:38.637097+0000, chain.objs.size()=4 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.1 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.2 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.3 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10__multipart_foo.2~KTJ24Mbh6vvYr581wI8WqQpys9ye4_7.4 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_vRGKH9NN8neC_EPpI2tZ0oZaAaB15K2', time=2024-09-12T19:53:38.726312+0000, chain.objs.size()=2 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.IVjI1IXAM6Av7fLtksqp2RkDTku_cYZ_0 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.IVjI1IXAM6Av7fLtksqp2RkDTku_cYZ_1 2024-09-12T18:02:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17890551487323353906', time=2024-09-12T19:55:32.001802+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.ocQZRBS_wSu1YWO34HuDB7v_16dX-YO_0 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.924516932536930548', time=2024-09-12T19:55:32.002550+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.6oW22MeM5oLXmKOWWspSvzPNy1x7Xa9_0 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7622051702652155430', time=2024-09-12T19:55:32.032171+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.ujab_ovFuZao_BWD7KNpB7_4y8lWBnJ_0 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12390520174991354228', time=2024-09-12T19:55:34.932797+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.DO1qTUVQKWEQ5DBkyQwstV-YHStJxjN_0 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16263408561839426706', time=2024-09-12T19:55:34.963998+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.TuPCSWgOl-UZNyUOrHABd3W_QxpZN96_0 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13203534668458295495', time=2024-09-12T19:55:36.570734+0000, chain.objs.size()=1 2024-09-12T18:02:39.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.856+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.msJ99kVZMiAFg2DK5gCvJLMNrG0Xssq_0 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14239547064983743981', time=2024-09-12T19:56:08.951907+0000, chain.objs.size()=1 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.C1X0txf5oJLMX1oOvjRP0R-Psa_fHU-_0 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2073362604228149174', time=2024-09-12T19:56:11.242400+0000, chain.objs.size()=1 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_._gNCdxiX6d_HEQV-ruCQz5P0x80M4v__0 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8335652698529923404', time=2024-09-12T19:56:13.612537+0000, chain.objs.size()=1 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.UDTB9nRNsYxHEcIAr1EhJZiOGx3Eu8J_0 2024-09-12T18:02:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6361301607723635006', time=2024-09-12T19:57:24.829822+0000, chain.objs.size()=1 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.OZQ7GqMLNX_rmNH69bcgLBt8we5F1QO_0 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6951149020193898974', time=2024-09-12T19:57:24.881407+0000, chain.objs.size()=1 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.J-v9gQqjR3bPt43PNizagQ6lMHiIe6p_0 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2058083711886733989', time=2024-09-12T19:57:26.879876+0000, chain.objs.size()=1 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.dXupukGaM9wpcgGqJff-wdH3gnR0MSJ_0 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7335252050761222504', time=2024-09-12T19:58:43.463057+0000, chain.objs.size()=1 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_._OZe8MN0xXNXjdehl9NBflu8bcGBUvW_0 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.855640144061141883', time=2024-09-12T19:59:19.612206+0000, chain.objs.size()=1 2024-09-12T18:02:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.861+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.DsUtVIl3xQV5iGAPwvLd7zPO5_YziaY_0 2024-09-12T18:02:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.863+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12258469410048097598', time=2024-09-12T19:59:19.671394+0000, chain.objs.size()=1 2024-09-12T18:02:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.863+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.dXovxHARmq_oL3UPcLL9t13yMXDqI1F_0 2024-09-12T18:02:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.866+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.868+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:02:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.869+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7870822656303851154', time=2024-09-12T19:53:38.761038+0000, chain.objs.size()=5 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1_1 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2_1 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.3 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15273049909659635424', time=2024-09-12T19:54:56.885931+0000, chain.objs.size()=1 2024-09-12T18:02:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.Y73URZHOVBWh1JS-_W6G3a5kelxLAEF_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14136988870811034366', time=2024-09-12T19:55:34.963013+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.ZHtp4iWDL1Nljlr81qDs24UKCwlRNYw_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5187090867575288814', time=2024-09-12T19:56:11.276883+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.b8uFLVdzxL6e58clyJmcUJSB1O0KCwb_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5611732554108941787', time=2024-09-12T19:56:49.439104+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.aZVHZLLc6AfHK9F9jKmclvFfQWqFnAe_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5086740608813461973', time=2024-09-12T19:56:49.462377+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.LtcInHvSATxwqK_B-hMXpjU-6pRWVXy_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2016329403158903988', time=2024-09-12T19:56:49.502501+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.2rTQETesf9Hz2_J8XOhBwfo3CJktoVf_0 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4806351565752704888', time=2024-09-12T19:57:22.127922+0000, chain.objs.size()=1 2024-09-12T18:02:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.870+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.LATYmBVBJCBjiU8HSBmMTF1XXwuaqWC_0 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.872+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4783718976872125776', time=2024-09-12T19:58:39.477207+0000, chain.objs.size()=1 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.872+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.8b0X3EBqhqzUtmDJYG8TVEmj3WjLdhV_0 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4468300673077543243', time=2024-09-12T19:58:41.621460+0000, chain.objs.size()=1 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.XKZqTQdmrWHd800DPs8QzEitlO36xhs_0 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2988274340620826657', time=2024-09-12T19:59:17.659559+0000, chain.objs.size()=1 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.hzjdirBhOfXvgRI3nEklgXJYcc244RG_0 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15076022805478597535', time=2024-09-12T19:59:52.325200+0000, chain.objs.size()=1 2024-09-12T18:02:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.-mS2CBCZ09w6iNyQV8t4BXtyupHFJ28_0 2024-09-12T18:02:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7026422810936976466', time=2024-09-12T20:01:59.642520+0000, chain.objs.size()=1 2024-09-12T18:02:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.KTA7JhREFEy003jRJoim77mAdAtL2Ta_0 2024-09-12T18:02:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17589324242335665367', time=2024-09-12T20:01:59.652298+0000, chain.objs.size()=1 2024-09-12T18:02:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.873+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.qGhJBQArY_2ANodQgfCVVdRvC9rH8Gk_0 2024-09-12T18:02:39.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.877+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.880+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:02:39.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.881+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.881+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:02:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10573304067476189880', time=2024-09-12T19:53:38.730445+0000, chain.objs.size()=2 2024-09-12T18:02:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_0 2024-09-12T18:02:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17139640703343064952', time=2024-09-12T19:55:32.049304+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.bBr8QBMcgntOGjE_KgJFcn_kzQNN_ta_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12277252207078838315', time=2024-09-12T19:55:36.487875+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.EYhOkvHUlvJcv9rTF9d4RyC2yG69gqb_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14957664061039415887', time=2024-09-12T19:56:46.816271+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.3P87fxgXsVWuUXUbBtken_FnbTJaqz8_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4791191191813807126', time=2024-09-12T19:57:22.131494+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.Q8w_2gsaxKGoR49VALWe3fpRZXowBzY_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10412761836343612569', time=2024-09-12T19:58:00.031400+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.OSTANb7XqNW6wQmnpZosmJQ_8ky8GeY_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8381851364673044804', time=2024-09-12T19:58:00.072027+0000, chain.objs.size()=1 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.gASEaiW4cTY8rWOgzCMOi6hvE4nGFbF_0 2024-09-12T18:02:39.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9578519290159969975', time=2024-09-12T19:58:03.371791+0000, chain.objs.size()=1 2024-09-12T18:02:39.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.toJA4RBtzlLwEzPJaykSSR4Mzw63KKu_0 2024-09-12T18:02:39.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1262578624991853523', time=2024-09-12T19:59:19.640598+0000, chain.objs.size()=1 2024-09-12T18:02:39.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.OnXOC5JkrzE5cZsfMPaPgKTl-uNZtAv_0 2024-09-12T18:02:39.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9222580283502845079', time=2024-09-12T20:01:59.669867+0000, chain.objs.size()=1 2024-09-12T18:02:39.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.882+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.vyj3hAOU_8hdbcF5mtJM0pwBp-6yalV_0 2024-09-12T18:02:39.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.886+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.889+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:02:39.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.890+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.890+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12357966254277335468', time=2024-09-12T19:53:38.541269+0000, chain.objs.size()=1 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.GOCviLTHM1t6qkzATb6ZzKRkZWgoovU_0 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2709317650297298260', time=2024-09-12T19:53:38.545210+0000, chain.objs.size()=1 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.mqZfA-jFo5oN34D-mqM---0oNM8dCyt_0 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_ZRJQft7bj8erG9BKIQXlBKDW0IujHTh', time=2024-09-12T19:53:38.765082+0000, chain.objs.size()=3 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_0 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_1 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.JnFpFnJ5zWMGl8IbTTUBM6VH6vpLU6N_2 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14856109713806027893', time=2024-09-12T19:53:38.818511+0000, chain.objs.size()=5 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.1 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.1_1 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.2 2024-09-12T18:02:39.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.2_1 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-FROZEN.2~-wYkkug9AkAXHtI0gevK-nnvKS6UTem.3 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13076426429495432198', time=2024-09-12T19:55:32.028811+0000, chain.objs.size()=1 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.91PGQP8-6lu5Wd_6RWggjMAg7VLOijT_0 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5275243800508419951', time=2024-09-12T19:56:46.740256+0000, chain.objs.size()=1 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.891+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.vKfiXPgy_j8KpY9H5gPiZFY-4-W1w91_0 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.893+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7501226822380091847', time=2024-09-12T19:56:49.540299+0000, chain.objs.size()=1 2024-09-12T18:02:39.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.893+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.m7yVuZXT22qHfKfpNvUVbdIPERgVk70_0 2024-09-12T18:02:39.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.893+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11509236262011778086', time=2024-09-12T19:57:22.122601+0000, chain.objs.size()=1 2024-09-12T18:02:39.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.893+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.-jE1VcEftaaM7x0rb8WfMjorfrPpsjn_0 2024-09-12T18:02:39.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.894+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7806011309525890691', time=2024-09-12T19:57:24.852563+0000, chain.objs.size()=1 2024-09-12T18:02:39.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.894+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.50zXJykuXVD_EnDioKQhyPPt67gCfSt_0 2024-09-12T18:02:39.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.894+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16310441089523495706', time=2024-09-12T19:58:39.494956+0000, chain.objs.size()=1 2024-09-12T18:02:39.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.894+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.Fmqs3wnkUwy0v42eQoCLNJjRpvl6TfJ_0 2024-09-12T18:02:39.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16837100182370749316', time=2024-09-12T19:58:39.496247+0000, chain.objs.size()=1 2024-09-12T18:02:39.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.ztx7tC3G-3wBQexOXwTSoy_DFGbWMJt_0 2024-09-12T18:02:39.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9498290195808786994', time=2024-09-12T19:59:52.324807+0000, chain.objs.size()=1 2024-09-12T18:02:39.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.nRzXMzPQivDQBfmvAd6JSVzpGqNjLHe_0 2024-09-12T18:02:39.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7833036610583350199', time=2024-09-12T19:59:52.326779+0000, chain.objs.size()=1 2024-09-12T18:02:39.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.895+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.5qh3snMKL_k_0JrTa7biRvR7kZJzOEr_0 2024-09-12T18:02:39.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.898+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.901+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:02:39.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:02:39.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_XrrVkp9javolEthPtoOa0BG8xtsNYA8', time=2024-09-12T19:53:38.698078+0000, chain.objs.size()=2 2024-09-12T18:02:39.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.G2jrMgtVYZ-oHX3eRrNd3HoYlLi8OqJ_0 2024-09-12T18:02:39.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.902+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.G2jrMgtVYZ-oHX3eRrNd3HoYlLi8OqJ_1 2024-09-12T18:02:39.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13365310486128673173', time=2024-09-12T19:54:57.784039+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.nMipbBODxtGU2T2ZsTqkR-M3rzm6YSn_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12563313653541501620', time=2024-09-12T19:54:59.337007+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.lb64vsECRwiPEGo0uiWDb3Je4nJVewl_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4872669469998563807', time=2024-09-12T19:55:34.928170+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.lxEwGjAzalO8g9138WhcLcYc-3Xl9s9_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3880303510490194016', time=2024-09-12T19:55:34.964012+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.O3W_v3YwTIhdj5BnGz8BvcEKQ7nQ37n_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13540311902237186986', time=2024-09-12T19:55:36.483666+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.JZclyNfThJhwRtYbndNUtMgPUAQMTt1_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3272298036788506532', time=2024-09-12T19:56:08.924912+0000, chain.objs.size()=1 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.sClJWy5nwWidGQHZ5PFcKIRWxRTmzSj_0 2024-09-12T18:02:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.95544116240219438', time=2024-09-12T19:56:13.612473+0000, chain.objs.size()=1 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.J9IW5N5w7bu0Hly6BeRGr9QycXE0m9-_0 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7061886893267541253', time=2024-09-12T19:56:13.613664+0000, chain.objs.size()=1 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.kKE19Xe9RaDZ-ltxBcdaIZ29pjNNPMI_0 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17062273795448324784', time=2024-09-12T19:56:13.614307+0000, chain.objs.size()=1 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.tQ-Eb90t5YTI0MGbxrGOl1GzCIntfR3_0 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1146229343971671583', time=2024-09-12T19:56:13.635075+0000, chain.objs.size()=1 2024-09-12T18:02:39.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.903+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.wVn6iTRU66CYqs-qq5C_mxA1VoFwSDw_0 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12592063487657823184', time=2024-09-12T19:57:24.829812+0000, chain.objs.size()=1 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.Q84S-thQrnfdclaqcw7qgFWmppaZoIw_0 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6060572829803611368', time=2024-09-12T19:57:26.800181+0000, chain.objs.size()=1 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.2AKxVrMbl4_VnruGX00ZL3YWJC0FSZG_0 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13177240047987518296', time=2024-09-12T19:58:03.385110+0000, chain.objs.size()=1 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.906+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_._AZqd5uYfSaU6iVMwxsenXltJIl88cP_0 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.907+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4806653766311468760', time=2024-09-12T19:58:08.449753+0000, chain.objs.size()=1 2024-09-12T18:02:39.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.907+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.TIlQCrdaac76RSeqv5qv4josQ6sKy5__0 2024-09-12T18:02:39.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.908+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3902406882244104914', time=2024-09-12T19:59:52.323400+0000, chain.objs.size()=1 2024-09-12T18:02:39.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.908+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.3gE_fX28xIfrtFXectohxkJfqjujvnQ_0 2024-09-12T18:02:39.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.911+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.913+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:02:39.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.914+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17317998501597302268', time=2024-09-12T19:53:38.537203+0000, chain.objs.size()=1 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.vTCKRVjs2iIPlJkZF_fuCJwgxd9Ao-3_0 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8255832112452445960', time=2024-09-12T19:53:38.772903+0000, chain.objs.size()=3 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.1 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.2 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.3 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6638308331128197254', time=2024-09-12T19:53:38.797378+0000, chain.objs.size()=5 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.1_1 2024-09-12T18:02:39.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.2_1 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-FROZEN.2~v5AStdaKv8zKAbpaH3Fom3LbQWjWV9w.3 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.438014828990462891', time=2024-09-12T19:55:32.043173+0000, chain.objs.size()=1 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.ddBsPoiiytPyI114j-obL6G7CqZac6C_0 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10616712398233024941', time=2024-09-12T19:55:36.460460+0000, chain.objs.size()=1 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.5KVYo8V3xMOx5iCqPx8zawzqyMrJ_iO_0 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3457346950382107355', time=2024-09-12T19:55:36.485928+0000, chain.objs.size()=1 2024-09-12T18:02:39.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.915+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_._fm6QjRIGLEnWpc6V70WV1T2HYQKRUX_0 2024-09-12T18:02:39.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.918+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14234371288241631247', time=2024-09-12T19:55:36.488037+0000, chain.objs.size()=1 2024-09-12T18:02:39.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.918+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.QWrpZoTvPTOnvLX_5XvI34pUuXzfx0b_0 2024-09-12T18:02:39.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.918+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9485853410794579072', time=2024-09-12T19:56:08.933368+0000, chain.objs.size()=1 2024-09-12T18:02:39.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.918+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.7J2UbVBEg-v15bRqULOs6OAZq7Ta7U6_0 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13389318922714544831', time=2024-09-12T19:56:11.186463+0000, chain.objs.size()=1 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.Wp-ATVI4CFx6tAKjID5_ozlEKYBw2dS_0 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4452781816887992579', time=2024-09-12T19:56:11.187038+0000, chain.objs.size()=1 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.SXnYZElbZMvMCh0MDLLWstrUg6FzGVM_0 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2927170524525161992', time=2024-09-12T19:56:46.740276+0000, chain.objs.size()=1 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.KDc5V8LPbdeE1YD_GE1yQDvIMjky2GN_0 2024-09-12T18:02:39.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12303638044778857142', time=2024-09-12T19:56:46.740871+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.NNnUI6Lw7X0thwo3NJ67KAMgkaENj89_0 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10946883302137971430', time=2024-09-12T19:57:22.159924+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.05-BqSoQrKZazIm9keZkLAtDA8-eKHt_0 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.305085023391711641', time=2024-09-12T19:57:26.773482+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.Zj4KnDoSBB1loJE7R1OqCfoG79J6QyT_0 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10535080945283457129', time=2024-09-12T19:57:26.801202+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.919+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.XSvdbuNKVh6sflGJAlRL8TJuhT8JZ6I_0 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.920+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13475355964253726033', time=2024-09-12T19:57:26.827243+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.920+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.XO_iihxHSJdDCp1evtZFgIWZnISaz0o_0 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.920+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5322806481629337867', time=2024-09-12T19:58:03.349604+0000, chain.objs.size()=1 2024-09-12T18:02:39.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.920+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_._TkOwXyUac1x1Bhu8X6f0wCDMX5FCev_0 2024-09-12T18:02:39.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.922+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12827942860796858293', time=2024-09-12T19:58:03.417260+0000, chain.objs.size()=1 2024-09-12T18:02:39.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.922+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.nzI90mg5sWNo9BRyVwTwKrXacIYSlW7_0 2024-09-12T18:02:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16655026974255054145', time=2024-09-12T19:58:41.622840+0000, chain.objs.size()=1 2024-09-12T18:02:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.gA3OcBi0Yf6wp4df-r8VPvpWzL9uZeN_0 2024-09-12T18:02:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17860503343153079008', time=2024-09-12T19:59:14.519402+0000, chain.objs.size()=1 2024-09-12T18:02:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.gyDIA1vOMORjv7LjUMxEg_JUM2tUvVb_0 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4324519064501525634', time=2024-09-12T19:59:14.520349+0000, chain.objs.size()=1 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.teBz7aBhvqKOJWqxOmye5PFw3xhZIyW_0 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15508242922326337238', time=2024-09-12T19:59:17.660001+0000, chain.objs.size()=1 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.gxextZGNiPWwUX2IX_4m0Gi3fl6d_Qs_0 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8747380537118718605', time=2024-09-12T19:59:52.325161+0000, chain.objs.size()=1 2024-09-12T18:02:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.924+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.IipNU4sVqrPrls_LyYOfXWmpvdj63RM_0 2024-09-12T18:02:39.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.928+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.930+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:02:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.932+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.932+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:02:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5230214712504596800', time=2024-09-12T19:53:38.928156+0000, chain.objs.size()=1 2024-09-12T18:02:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.KFxGLDn6f9yOH0Pd66Itnyq9InYGdnl_0 2024-09-12T18:02:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10252930992653647815', time=2024-09-12T19:55:31.988922+0000, chain.objs.size()=1 2024-09-12T18:02:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.k8Kz9RHeg4K8TfoX9zpmv2qOMZrgnZh_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13882347658098179367', time=2024-09-12T19:55:34.026513+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.5ZAe7QejpFEIW5aTs-lMKURJKknYs0L_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10814031918960779640', time=2024-09-12T19:55:36.487100+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.rGJbGqkrhf-9gXkBu0IGDVjc9nNpGd__0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3264652033225165704', time=2024-09-12T19:56:08.995289+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.J5yV5kN9haNFVjxymdaH2WleVV0AG_G_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10632581958426570935', time=2024-09-12T19:56:13.634269+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.71PN6j94pUr_jsgGFCAvHD1iRMYfc6-_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13607418100211881298', time=2024-09-12T19:56:13.634828+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.wBeVbV1rFf9Z28Vbabelf5EBGUJAqhd_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12478927303258122875', time=2024-09-12T19:56:13.680327+0000, chain.objs.size()=1 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.7Hi5zr5UpefzBpPYk0kt3Ju8WHFSD88_0 2024-09-12T18:02:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4659478733354430657', time=2024-09-12T19:56:46.786406+0000, chain.objs.size()=1 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.2ab-nj1bvvMseaayahZsa-nxh8yyXGC_0 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1144140715095955677', time=2024-09-12T19:56:49.509955+0000, chain.objs.size()=1 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.Dmdi0zZ1pf86_F6M-47ipIvedse2hhn_0 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10219324964222627165', time=2024-09-12T19:56:51.281010+0000, chain.objs.size()=1 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.TKrCM_0tPfAxwJ6tIh8Z_yEHj84RI8y_0 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7740915857027983334', time=2024-09-12T19:58:02.469855+0000, chain.objs.size()=1 2024-09-12T18:02:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.933+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.Q5vPwMO2Hd0T1MlYVF2VmDQjjzdPbJU_0 2024-09-12T18:02:39.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.936+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4566535373307973558', time=2024-09-12T19:58:41.624042+0000, chain.objs.size()=1 2024-09-12T18:02:39.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.936+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.s4ULZZGIGF5nQeRr6I4lSkEh6avjrJ2_0 2024-09-12T18:02:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4434969692209558733', time=2024-09-12T19:58:41.625170+0000, chain.objs.size()=1 2024-09-12T18:02:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.6W1hubebv4glnqLC0tC_IoeSQUP3STy_0 2024-09-12T18:02:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13866058444103576766', time=2024-09-12T19:58:41.625765+0000, chain.objs.size()=1 2024-09-12T18:02:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.uCFEo_JypE2OUxOgPe4yYrMzgIkRvab_0 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12273634334540455267', time=2024-09-12T19:59:14.520379+0000, chain.objs.size()=1 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.A415DZNBAz_hOiNeRTJNFh_h8nXaW-d_0 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15757669224396324484', time=2024-09-12T20:01:59.651106+0000, chain.objs.size()=1 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.vFK6fMkbVy1KiC-8puqOpvPRFQyadjA_0 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15208635152527849542', time=2024-09-12T20:01:59.653292+0000, chain.objs.size()=1 2024-09-12T18:02:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.938+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.bA3S3rIuQHdPUuXWLFDz8YhMJdIiOOg_0 2024-09-12T18:02:39.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.941+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.944+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.945+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.945+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17664381139827973959', time=2024-09-12T19:53:38.532556+0000, chain.objs.size()=1 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.Jkf6bFQHtdocgbkTZsVYmVE-m5Nv8Pe_0 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14801797032883325210', time=2024-09-12T19:53:38.662084+0000, chain.objs.size()=4 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.1 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.2 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.3 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9__multipart_foo.2~dDP303HzHPfnAtkEzDcEiiyVOStkZkM.4 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13948287868554332846', time=2024-09-12T19:53:38.826584+0000, chain.objs.size()=5 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.1 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.1_1 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.2 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__shadow_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.2_1 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14__multipart_foo-LUKEWARM.2~2gEZNX2rOw6Gz_ZA9B1DaRSMBUEIx0I.3 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12868587725693091757', time=2024-09-12T19:53:38.911312+0000, chain.objs.size()=1 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.OOSTGtEwLcv9S7UfApsTMtsVIQTrdpv_0 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10802009384636471771', time=2024-09-12T19:54:59.351101+0000, chain.objs.size()=1 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.946+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.25Mh_Kx1jDcHDns0rMmhLINu-nKpjHB_0 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.949+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10372662058602394989', time=2024-09-12T19:55:34.962197+0000, chain.objs.size()=1 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.949+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.vs8X1logMMK4FIK59ZzuSgU1ow_TlOO_0 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16884381437852302488', time=2024-09-12T19:55:36.487996+0000, chain.objs.size()=1 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.dN7AA9Z8ewQSFPN2vT0k_lTVyaO5rlQ_0 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3154713623030214871', time=2024-09-12T19:56:11.232946+0000, chain.objs.size()=1 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.V8cx-g0taYgSEGYxhxEdvnWUnCDpPWq_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3891376020679033803', time=2024-09-12T19:57:22.128680+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.bWrzFsN95IPCH_CdAdGV107vqMBu5gf_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16216622852824955967', time=2024-09-12T19:57:24.871813+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.GgNGASNsf0D8NHh4p0lM60Q1sN9kDOf_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5520326117186805371', time=2024-09-12T19:57:24.872305+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.DQAarlA8qLSF5rHUB5gqBPe1BD7564R_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5343558046945510748', time=2024-09-12T19:58:00.058965+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.LKMsa19IAsPhW6_fHhPwvNb8tlkTWbq_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2348751437298828087', time=2024-09-12T19:59:14.545705+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.F-cUT2kV2tGPAg-yoN-KvBjOeeGNOtf_0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1944307209424412705', time=2024-09-12T20:01:59.643520+0000, chain.objs.size()=1 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.950+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.OX8aV_Nt5BblZDujVSZDysuD7iMRW1D_0 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.955+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.957+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.958+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_ASutp0-dejsqR2ph_k5kVpxc1dCUyWZ', time=2024-09-12T19:53:38.709922+0000, chain.objs.size()=2 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.4LX86ymCSphzOMlR62jUejvxlf0rdlK_0 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.4LX86ymCSphzOMlR62jUejvxlf0rdlK_1 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.778246774665819849', time=2024-09-12T19:54:59.338022+0000, chain.objs.size()=1 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.193f9xxiuMnSWUvcFRGuNcJ_aWGGXQY_0 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11376901580328614426', time=2024-09-12T19:55:31.998617+0000, chain.objs.size()=1 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.ZlewfMxOiqcJRqbYD_ZfKegPKftR8TQ_0 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11224473973865747050', time=2024-09-12T19:55:34.966284+0000, chain.objs.size()=1 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.mhKIX-3Cq09Pxyz_7P0FrMdxC9-pluF_0 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12492182522170024045', time=2024-09-12T19:55:36.563132+0000, chain.objs.size()=1 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.jffrodWAwHYALo0eRZ0pOgeSjKeKRob_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18329628734180493540', time=2024-09-12T19:56:08.989451+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.6OfDYMkkt09l6CzaT0xzbLeKNS_9_Q8_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14074009434262103218', time=2024-09-12T19:56:46.740253+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.jEYyUjkfxX_FB61oVxSqTdi7Q2FL5Ib_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4144361117549942067', time=2024-09-12T19:57:22.120357+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.ijXqmljYU1OuyWHFgT2PSR4mXpXe1nh_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16898651666410879973', time=2024-09-12T19:57:24.828344+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.nk199O0g9foJ80tSE7DZAF-vZuej_IE_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4636822655113896631', time=2024-09-12T19:58:00.040202+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.q2wjqDS7aBU3zUPPkM-LZxCzz1nWmTg_0 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13115404582782483825', time=2024-09-12T19:58:39.534250+0000, chain.objs.size()=1 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.959+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.HlGgvt_w797rOA73iqUdF0GuylGmbEY_0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9382983279296051683', time=2024-09-12T19:58:39.562540+0000, chain.objs.size()=1 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.SaDuJcSVbI7qycAUlVBlvh2fvMBhABq_0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5482648543861685899', time=2024-09-12T19:58:41.605897+0000, chain.objs.size()=1 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.yHce1zO5HsqqnbyfZ8ly7jmq3MQmhes_0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16737051138464995226', time=2024-09-12T19:59:19.575099+0000, chain.objs.size()=1 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.CNU0EAXTNjRwH0T5l6BQgq5UZlTvVGr_0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5485493165911906819', time=2024-09-12T19:59:52.282034+0000, chain.objs.size()=1 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.964+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.vK9DEXzSYNxN3HOfaMRVeJmEp_pZY1Z_0 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.968+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.970+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.972+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.972+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6590346764683120500', time=2024-09-12T19:53:38.553879+0000, chain.objs.size()=1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.lJbFM63hyZmvXly6MUN6MbHnOttDIhV_0 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6275589319792975082', time=2024-09-12T19:53:38.780916+0000, chain.objs.size()=5 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.1_1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.2_1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-LUKEWARM.2~vSqWAsSHflq5D3FfZJS0J1nbsd4t2Gl.3 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10177736985847400179', time=2024-09-12T19:53:38.854211+0000, chain.objs.size()=1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ce1P84EDrEdQ8aXfi5XtlY7MFg0aMgT_0 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14917175050988558898', time=2024-09-12T19:54:57.782782+0000, chain.objs.size()=1 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.AXziLvhXyIl09leYApnghAwGt1rcpwR_0 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2144115773372364684', time=2024-09-12T19:55:32.009106+0000, chain.objs.size()=1 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.xdW63mP3FfI5lPBg4ff1JZRkeTceBMs_0 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2389353109518450362', time=2024-09-12T19:55:32.080767+0000, chain.objs.size()=1 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.3qpYZ5mTJuFqLsEpOkoqxcN1hkx3ixw_0 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17528388240515416740', time=2024-09-12T19:56:15.864952+0000, chain.objs.size()=1 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.cFuytpi9JMONHJPtkUjBXEzef6Q7At__0 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.796271267811551318', time=2024-09-12T19:57:22.160482+0000, chain.objs.size()=1 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.973+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.sB0Xr-fRR8X5-KL-v0LX0lBQdcTg0Cg_0 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.976+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13470897401122938039', time=2024-09-12T19:58:41.658016+0000, chain.objs.size()=1 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.976+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.st4xUhxJeRASyil3EislwFuZJvUvZ01_0 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.878069143456258430', time=2024-09-12T19:59:17.660033+0000, chain.objs.size()=1 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.oLjRqkNeJ8YiXoT3n6com9FErOJLnRq_0 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4661977219134119778', time=2024-09-12T19:59:19.644595+0000, chain.objs.size()=1 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.zHpIkKbZ7Rphey9QacF_d9JJOZS8TIx_0 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.586108612033872037', time=2024-09-12T19:59:52.269491+0000, chain.objs.size()=1 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.HOtQ9byYOgWjIpLjGk91vAB9ZZ-5v8L_0 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14820820072937260296', time=2024-09-12T20:01:59.678443+0000, chain.objs.size()=1 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.mjgRid6n5-Tgq4rylHG3eLARH13yWZu_0 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13277675253277264005', time=2024-09-12T20:02:12.412778+0000, chain.objs.size()=1 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.978+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:SXPJ3GgNa7wlNw.JY.MvLVm6DqcABFR_.25NUaHb-ModJPVZqxKEA5_MSgbf3gBB_0 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.982+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.984+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.985+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4283397495307201165', time=2024-09-12T19:54:57.821689+0000, chain.objs.size()=1 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.05fGJu7b6fiRP9g5cNnpL3fsyx7gHeD_0 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9957527206249712710', time=2024-09-12T19:55:36.487809+0000, chain.objs.size()=1 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.Wv3fBdNXsIgdQkTOzc12koIuVENNNhl_0 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17659930316288835383', time=2024-09-12T19:55:36.552010+0000, chain.objs.size()=1 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.5Dt3-rsgnu8QpAmm97Ekl5uRD26s4kz_0 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11045667165479277423', time=2024-09-12T19:56:48.991236+0000, chain.objs.size()=1 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.IRr0sHFgpcPMXbXar33__4qbTEUKCl2_0 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17681322569037690349', time=2024-09-12T19:56:49.461402+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.0Xa7QTcPXFDeLAF_jKe3OTsefDxp5i6_0 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10051329259384838641', time=2024-09-12T19:57:24.849364+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.nEl9J6xxZ5OrGrh86AgCjwwHCjifQpY_0 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5674459247034541653', time=2024-09-12T19:58:00.072057+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.x5tzr6jDDLPg3NegZfikZ-FuMBZTPLm_0 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2256630020165838051', time=2024-09-12T19:58:00.072799+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.g-tcgfYJdo3jUis1Nb3f031psyT6lQv_0 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16915017539729136509', time=2024-09-12T19:58:03.371778+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.31aMsHEM4w7HBa-xP3-Do0qJYJpgUTf_0 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8454157981957533219', time=2024-09-12T19:58:03.372451+0000, chain.objs.size()=1 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.986+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.lEP4CsNR0DnJ4Dl_V2Zb_rhawCnvRfJ_0 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.991+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.993+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.995+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.995+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.995+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.995+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7137073519114731928', time=2024-09-12T19:54:57.824811+0000, chain.objs.size()=1 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.FlNxaAFmj1FOD-4tLcglPyHEx3n7fzO_0 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14229827834417936163', time=2024-09-12T19:55:36.483663+0000, chain.objs.size()=1 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.hoSyBvZUa0KrmnBvdm_BsZD-G8PiTNk_0 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5960786255550723391', time=2024-09-12T19:56:08.904892+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_._NlIYdE0jkf9A7zNT_Wx_dUIaFpDcik_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6823705238580221721', time=2024-09-12T19:56:13.586714+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.Ik83UrGzN79869jaImilmonK_leb8fV_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9179440993750262311', time=2024-09-12T19:56:13.613902+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.iK9Fr84k-pAOwzetLe_w11NNk4wFC9o_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11696049357965121510', time=2024-09-12T19:56:13.689236+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.S15bK548IRfnunceDUK51dDac0Gyfit_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8330507390524254640', time=2024-09-12T19:56:49.513356+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.FbIea15T7IjVCpJwVysSFmnl40hXVBm_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13152689105542175260', time=2024-09-12T19:57:22.130995+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.pAq6g7h_D0awNtfFu8K3igyc5nx4auO_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6688418461039149497', time=2024-09-12T19:57:24.880585+0000, chain.objs.size()=1 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.JDgWZOYXwt1tImHtZO8UXYD2R0oSJlb_0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4750754439038973439', time=2024-09-12T19:57:24.901057+0000, chain.objs.size()=1 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.w59RRHJtqnzTFE1d9C1cjIrQ1lje_5o_0 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8404253243284923608', time=2024-09-12T19:58:39.551606+0000, chain.objs.size()=1 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.euwid-mTq2427Rfu2f1fVFEn0g6d9Nj_0 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16529651705880349547', time=2024-09-12T19:58:39.587555+0000, chain.objs.size()=1 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.996+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.WzD0Ro9lMaHXluBZbTPu7dH7l1eL7se_0 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10040837935833629668', time=2024-09-12T19:59:14.517687+0000, chain.objs.size()=1 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.t66K2-47PQPrW9AfjBHmYvFFJdDrU3T_0 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16746738540926572325', time=2024-09-12T19:59:14.518404+0000, chain.objs.size()=1 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.Zu9eGA8z405wQCUIdclvYPfABPzbS0s_0 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18033432086314259511', time=2024-09-12T19:59:14.560896+0000, chain.objs.size()=1 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:39.999+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.MR44Iu9-1YTwUv4iJ8-wMugSzb_4Uix_0 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2629880743093288767', time=2024-09-12T19:59:14.581024+0000, chain.objs.size()=1 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.xL7QOknrWXikF2lM-N2bGSGvEuJXECh_0 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2972447099071207481', time=2024-09-12T19:59:19.649732+0000, chain.objs.size()=1 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.XBNfn7fbJzEINmAXO1gWx1YOsTSS0uV_0 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12645311605360913383', time=2024-09-12T19:59:19.689469+0000, chain.objs.size()=1 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.Tu5Q7xvtBVOQSSTUPlaAR6CUkxXxluw_0 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9762770686510272964', time=2024-09-12T19:59:52.246081+0000, chain.objs.size()=1 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.001+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.yY2AkpjY7av4wz4C0muPbHsFshWSY7C_0 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.005+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.007+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13197556418041856209', time=2024-09-12T19:54:59.374822+0000, chain.objs.size()=1 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.VbpovJ1MM09H21xDT2xpFvTQqXML_KB_0 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17852184242080219419', time=2024-09-12T19:55:36.489241+0000, chain.objs.size()=1 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.LBVvnECytFoUnseqEOksOJbcBYtH3JC_0 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16095130349022028320', time=2024-09-12T19:55:36.554170+0000, chain.objs.size()=1 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.u_J6VsTHAUQkMA3aOiAwy3wmsX-y4aq_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15363163207708926136', time=2024-09-12T19:56:08.907069+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.nHZcDf7piPL0O7Ctfr-Zk6h82OsdWzF_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2232725088806800087', time=2024-09-12T19:56:08.934860+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.qkWpYVshrhOdI0NM9xIzpFMQFFyy-DZ_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11537639266214938338', time=2024-09-12T19:56:11.239430+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.vdGb-9iGDO4q_bZhKoxa8IKUxyk52m-_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16362479127228744076', time=2024-09-12T19:56:49.465482+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.xaJ5WFln5-wFmnfRwZTSEohcopVktoy_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2978285472045640612', time=2024-09-12T19:57:24.839921+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.GIy0UDpl79bhe-iCIEkRzcWjKQQf5aR_0 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12694869898522909157', time=2024-09-12T19:58:00.054973+0000, chain.objs.size()=1 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.IHo4_Z600RbJDnfX_rVETkh0NNvHTGR_0 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4336853624199169850', time=2024-09-12T19:58:41.140280+0000, chain.objs.size()=1 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.009+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.N_bVXDzLSru9uA-n3Gh4CCoUg9mSB8X_0 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.010+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7857448139446768122', time=2024-09-12T19:59:14.515897+0000, chain.objs.size()=1 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.010+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.OfcTc3RYYxjdn6j_Puwj1UHZmQAkKFb_0 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.010+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9244835580176320269', time=2024-09-12T19:59:14.578854+0000, chain.objs.size()=1 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.010+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.to6vlf5IG2lLcSAfN2nvO5xWzT2uiCX_0 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5401859838809923395', time=2024-09-12T19:59:17.664550+0000, chain.objs.size()=1 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.cleXSh6GhRBq2upznoPV4VTyceOT8SZ_0 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12827569827083152669', time=2024-09-12T19:59:19.604044+0000, chain.objs.size()=1 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.g6jqXfhJSA90akaONLTS5d1BzVvAt7l_0 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5462820425215357966', time=2024-09-12T19:59:19.608622+0000, chain.objs.size()=1 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.014+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.2D7kBZnIIK2WBwsVZcU20KwYRuq6mMp_0 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.017+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.019+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.020+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13277338424273695508', time=2024-09-12T19:53:38.693960+0000, chain.objs.size()=2 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_0 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.VDOo-MT0NbLU6vfsK72oAsqEu31Ek22_1 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10023143184939954990', time=2024-09-12T19:55:36.524490+0000, chain.objs.size()=1 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.n1NZORrpg4gdO3WhCJmnJA3ZuzVsb-U_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17778713232870026750', time=2024-09-12T19:56:11.277437+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.QQPUpIiMHj25i0FNPW-KkSgPUCdngit_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3069950517414845453', time=2024-09-12T19:56:49.463049+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.UFGaOFgXFn1EqDUn1SrqbSdmCQXgHl4_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15834760262235355013', time=2024-09-12T19:56:49.503047+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.jNj6QOK_-7OBnrilHxSKHMBVCRN9teO_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1234413976158989453', time=2024-09-12T19:57:22.159601+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.EnfUWzAm7HnnxwoOlftcfeecTZhCjVP_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14162778611777777200', time=2024-09-12T19:57:24.816095+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.hCTEevB0XW7b1ONdn-mi2m_B34FEV4y_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3175967458637354916', time=2024-09-12T19:58:03.349604+0000, chain.objs.size()=1 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.ej65jc-FDkifyLMdWhrk0HFIERKJPsQ_0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5507292007069045534', time=2024-09-12T19:58:03.371092+0000, chain.objs.size()=1 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.I747loUnWBHidPvuBlFqWa2CLraa4zX_0 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4614153019703002816', time=2024-09-12T19:58:39.487476+0000, chain.objs.size()=1 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.PnayRcbczwpXQknkbVF0WoCdMYyChJf_0 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6214627678964818088', time=2024-09-12T19:58:39.562098+0000, chain.objs.size()=1 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.021+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.dA9QXPYuRSXdE7UpGHxIAl2IeC9iodT_0 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.025+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15573867729390941801', time=2024-09-12T19:59:19.646595+0000, chain.objs.size()=1 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.025+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.PeleIU8mTG8Kedw0jiWecSrfZnRM0za_0 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.025+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6501277138969052294', time=2024-09-12T20:02:12.425427+0000, chain.objs.size()=1 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.025+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18__shadow:egulblOLgzeikZ-BuX5mME2jxWRW2Fq_.YWI7RE4VYMk07cSckkPK0odEyxezOEq_0 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.027+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.029+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.030+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1374338983161249010', time=2024-09-12T19:53:38.705832+0000, chain.objs.size()=2 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_0 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_1 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9085106448550294147', time=2024-09-12T19:53:38.963780+0000, chain.objs.size()=1 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.FuZg0_GqOddKfFZfOD4jf7AI50Xg3wa_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13431990628603460485', time=2024-09-12T19:54:57.821752+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.dKaXBEYbxXWKqwjScxtef7vgOPtAyRY_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3435370259679918927', time=2024-09-12T19:55:32.049305+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.1kGNOeBGOlgGkkRt9-_krD_yo0w95va_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6937292861935183490', time=2024-09-12T19:56:13.683422+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.RFm4m1f1eySeA_BdbjA_tBFtyQNYmev_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5407511314819915130', time=2024-09-12T19:57:26.836796+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.aFgxyH8vsbue7NthBB4nZGHz7BZIhj2_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10604284220400632643', time=2024-09-12T19:58:03.371797+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.DOq4-bOSjssrjBCj_pZHAE812yEqxOU_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6063112332841952789', time=2024-09-12T19:58:41.588877+0000, chain.objs.size()=1 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.bjfw-K2LoYDnx7w2OlNbymrHA1Azine_0 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12173333154753981288', time=2024-09-12T19:58:41.687049+0000, chain.objs.size()=1 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.U6lYEw_JPfxztb03f-YB2j9PLv453e__0 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12929628931413049207', time=2024-09-12T19:59:52.290568+0000, chain.objs.size()=1 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.031+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.VyT0WOhEx4hp4NZJhsJ8hx5ZYN9QJoU_0 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.035+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.038+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.039+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.039+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457614986168670356', time=2024-09-12T19:53:38.722536+0000, chain.objs.size()=2 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_0 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.PHGUbGpLCmPa-eG-QlD7nhOALBoFm5p_1 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1338386114695044640', time=2024-09-12T19:54:57.778538+0000, chain.objs.size()=1 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_._wg-V2cs2611YTZ5z-cQB94ct3OMCXP_0 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3045801956424398739', time=2024-09-12T19:54:57.853930+0000, chain.objs.size()=1 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.9T98ioGXw9BweWQT5ywhpWpRNHXRY5D_0 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16808483574887530966', time=2024-09-12T19:54:59.339206+0000, chain.objs.size()=1 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.sjm1awjatFDz4L783PRIhGUBNMge05g_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14633474817781628048', time=2024-09-12T19:55:36.524514+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.6TPfXsr_8fXJaq5pBdb3XttuK2hEJaw_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2960362272201259441', time=2024-09-12T19:56:46.744451+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.mYhZmeMn6R8asE7chcJt76j2-JhLL6Z_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9339408212309027990', time=2024-09-12T19:57:22.116080+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.jNItxXOfzyDVVo_dR968dJuu-Z30cA5_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3935228284877047089', time=2024-09-12T19:57:22.159602+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.hTZ2of_FkCzjGpUn_YY8-ODfo1clZfn_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8728929202487914338', time=2024-09-12T19:57:24.901974+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.bNgiSLhFGYQkAAaXMR_v93E-zavAbqa_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3884953972113961637', time=2024-09-12T19:57:26.809916+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.L3n1Tn4QWLF9ygkjLbLnCtSE8TGm4yo_0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9758212107840904207', time=2024-09-12T19:58:03.374800+0000, chain.objs.size()=1 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.040+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.OwBoGdoAI4Efhm1wcf86f10GWtNziMh_0 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.043+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11960894511423547310', time=2024-09-12T19:58:03.427765+0000, chain.objs.size()=1 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.043+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.9vVvkF68n02_DP_XoT6qC7GZIB2OOtb_0 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.043+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17264347714674255045', time=2024-09-12T19:59:17.666540+0000, chain.objs.size()=1 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.043+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.F8cD1gYg2DVltCRAEKXZCW2lN2yF95m_0 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.046+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.048+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.050+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.050+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16834339248413181806', time=2024-09-12T19:54:59.359770+0000, chain.objs.size()=1 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.Ne9tgdWn2xeLAoxOsbULNlyIXhq8i-h_0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3149973922025106029', time=2024-09-12T19:54:59.428621+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.yS6DQzwcNdU8piW5KzR3hJ_TOto2cBW_0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.369523280620954702', time=2024-09-12T19:54:59.437295+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.0EhAhzwyzyRNI52RebKOs2_fstAdWs__0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14168024416362161811', time=2024-09-12T19:55:32.076571+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.Ic-HshRT7EDScJXhBye7FseK5oDGpvL_0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10424846875816105456', time=2024-09-12T19:55:36.484272+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.eMEHCtg2dksc3D7YGPtBlwOrZL_PwGs_0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7860272051002637116', time=2024-09-12T19:56:08.925752+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.jXGIp7E02Hox569FlMUZ9BNxqAkQtNz_0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13514116051754761422', time=2024-09-12T19:56:08.985462+0000, chain.objs.size()=1 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.JAZkATdAH6_-qfrwrnfsaLeOA43a0j6_0 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10664359188356701861', time=2024-09-12T19:56:11.200161+0000, chain.objs.size()=1 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.1rQX7bND58IEAuwAYU_9kIh3emEsmtj_0 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7226426544021097991', time=2024-09-12T19:56:11.293622+0000, chain.objs.size()=1 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.Nj-lIRR3A3wyLGrwvzDLkOwcqlrxigJ_0 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15140743534179942757', time=2024-09-12T19:57:26.828299+0000, chain.objs.size()=1 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.e8zycSBOuWaPxEyqoHo4VVMhzHOmku1_0 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18431323633171029931', time=2024-09-12T19:58:00.041061+0000, chain.objs.size()=1 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.K_DBenp3W3eOluAYsR94Hck7jd1kFgP_0 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6469720100850386076', time=2024-09-12T19:58:00.041859+0000, chain.objs.size()=1 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.051+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.2Uz9VpUKu0zujPPUulRl3RrRPmiJwVP_0 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.054+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16413018669182794552', time=2024-09-12T19:58:39.552340+0000, chain.objs.size()=1 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.054+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.l0SC6mZDaQ97Z8FqneJDOrN7BMyGtBT_0 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.054+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9496758134625525516', time=2024-09-12T19:59:14.516477+0000, chain.objs.size()=1 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.054+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.IkzLpl0HwbnZg0hhMreC637wp_bF47T_0 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1224643353759857698', time=2024-09-12T19:59:16.957873+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.tGFllN7GkXGAKlfr8C7SHDlCZaU6SQf_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8120432750052624758', time=2024-09-12T19:59:17.663511+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.SluVordw7b_xryz-yL7KwTAUSad_UZF_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11732567281045553758', time=2024-09-12T19:59:17.663979+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.hN_6xsgOPFT9TBXtsJPGotMMx8JPPNh_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5755566806511064238', time=2024-09-12T19:59:19.610733+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.1ATBHj3DsbNOip0jgLaPCd0R_0Ddj4m_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11973798519521346242', time=2024-09-12T19:59:19.611484+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.5lVKD7si3RyGf5bsNwZ9pBjh6svkYw2_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8175028774332613520', time=2024-09-12T19:59:19.650280+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.3kO56OcpoVfPEe7h8R_0LdK0gU4zxWp_0 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11828035081562158129', time=2024-09-12T19:59:19.683458+0000, chain.objs.size()=1 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.AAyoJo9LYZmy-_yu9HU2Fp387WHwpK7_0 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13520427615716527644', time=2024-09-12T20:01:59.653747+0000, chain.objs.size()=1 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.056+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.z9Cuqh_j-DKOn_--yyh5alZ5TjXBMcJ_0 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.061+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.063+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.064+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_y6C7fuEbZiZ3zy4XyVOpBGo2skQl6Kt', time=2024-09-12T19:53:38.752415+0000, chain.objs.size()=1 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CqpHf_jousg-OgMJyoHJawGUlsGvkAW_0 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18252583974976225161', time=2024-09-12T19:53:38.951093+0000, chain.objs.size()=1 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.FBo5Kp92jehdaHk0ZN-QJEKvU6Ck6sV_0 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7970650161915373311', time=2024-09-12T19:54:57.786689+0000, chain.objs.size()=1 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.YCmsiJAqIj3kFlZMhu9ra1Pjlw_dBTo_0 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12056867970986850485', time=2024-09-12T19:54:57.822945+0000, chain.objs.size()=1 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.fJZ6d9fxQTYXpRHTwYc-EgBFpG_PgYW_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12364519987570202400', time=2024-09-12T19:54:59.375357+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.LA9PksEXe-Ez1HgFhh4NERszfOCYyDX_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1765158841090876622', time=2024-09-12T19:54:59.416543+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.P-Z-Y-Yicp2C9V4dDHft1ilsijWrCjT_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.804819316055239302', time=2024-09-12T19:56:13.603237+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.ixfLFh2gQ7BoMUEU4Kmy3o_hORxaWAR_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3237708433822457387', time=2024-09-12T19:58:03.380029+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.WY1uotKs5VVh77DZUETxi_9m_YzVW8T_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17695285440888916309', time=2024-09-12T19:58:03.380471+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.OxliQw2LiQk2QFuL1A2QeQsx4G-VvT1_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15487492284730376859', time=2024-09-12T19:58:41.626841+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.Dx-mhNv-FXoZ2nsZ9g2UAfEe_uobEZb_0 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3194635909858975195', time=2024-09-12T19:58:41.627491+0000, chain.objs.size()=1 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.0wVSyoAAeMicXWpDMUdLoprlKuRmn6K_0 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6088037380603744302', time=2024-09-12T19:59:52.259365+0000, chain.objs.size()=1 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.065+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.M-Dv0JbUfMBXvtjQAbc9sTOE8ER1QZ0_0 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.068+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11073576699848293293', time=2024-09-12T20:01:59.682260+0000, chain.objs.size()=1 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.068+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17__shadow_.hwQi03m7aFOiPAJNjnrGk7rmw8dEsgI_0 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.071+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.074+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.075+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_HckPd2cssfOD9tKyrlQiErq0jeB-0Q_', time=2024-09-12T19:53:38.777006+0000, chain.objs.size()=3 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_0 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_1 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.ZW692AlxIuncNlWSMjAG6UY5XSc9iGc_2 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_Wz8o3McOKgI-r3gSf5nKRmV4_JNMpst', time=2024-09-12T19:53:38.793356+0000, chain.objs.size()=1 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.3ZanmFScomin0lHdePvhN8KT-QII7vx_0 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7344149718521177053', time=2024-09-12T19:54:59.338232+0000, chain.objs.size()=1 2024-09-12T18:02:40.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.T0izmewQa-g-WXzrvyqkzIy4V0omCVQ_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17898134169688337576', time=2024-09-12T19:55:01.155332+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.R7EbzP9jS0H2KstAGNS56Y0tlUBRilN_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.658017235206889609', time=2024-09-12T19:55:32.010166+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.q3j9DgYAx85x8OWYor0Lv8KWyBeXuRE_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3357293607180429553', time=2024-09-12T19:56:08.960693+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.g49foJQIfwI-4RG-iR47pqwY8oU5P5N_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10512318969500584767', time=2024-09-12T19:56:13.603818+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.hvcGhGYMTafpM0dZE3lSYcpyhY42cOs_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3777532599955096586', time=2024-09-12T19:56:13.622359+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26__shadow_.O617Nn610915uXOnU4R_6dpC0z4KUAG_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13363793113848493409', time=2024-09-12T19:56:46.745723+0000, chain.objs.size()=1 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.t5FqY2V6_k-Sj6Q61QxBfxGvtMDe_r9_0 2024-09-12T18:02:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8170018868378006859', time=2024-09-12T19:57:22.117593+0000, chain.objs.size()=1 2024-09-12T18:02:40.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.076+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.WXbQo3Qz3h82OOnW0GXYX4MtsmgKaIo_0 2024-09-12T18:02:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.080+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10358262773856594016', time=2024-09-12T19:57:24.151425+0000, chain.objs.size()=1 2024-09-12T18:02:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.080+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.q_0LR88vuWLQNSIbdeDd9KU_gfoZtZL_0 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17153542468068900797', time=2024-09-12T19:57:24.839883+0000, chain.objs.size()=1 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.70HtOju_PlM6me2m1SyZpfoyxqkeEmQ_0 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11144110785291294649', time=2024-09-12T19:57:58.744361+0000, chain.objs.size()=1 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.dru6KAtztjZPGP_fLKaEcMdwNjSaWLF_0 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14453155655823537318', time=2024-09-12T19:58:03.374837+0000, chain.objs.size()=1 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.4icUIcRlUsP52f6i1Ss01Q_K5NQ9MGu_0 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.081+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16364615084866926843', time=2024-09-12T19:58:41.659996+0000, chain.objs.size()=1 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.082+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.Tv_tpMAXVI-NG1blQXHcMzzkNkdc0Ic_0 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.082+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.132165374894949593', time=2024-09-12T19:59:14.515452+0000, chain.objs.size()=1 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.082+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.Pm_-SmQoYFHA8PSqErvy4GECwS2YZBF_0 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.082+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9203155716699177159', time=2024-09-12T19:59:14.586223+0000, chain.objs.size()=1 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.082+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.36__shadow_.dVfA0GMf-KRi8aOqzu9Umxs10ifn-iu_0 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7215474411970151119', time=2024-09-12T19:59:17.638216+0000, chain.objs.size()=1 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.mnkkeJXhyOman2qeIsDz7Uo15PHDAs7_0 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10004430617616528732', time=2024-09-12T19:59:19.639360+0000, chain.objs.size()=1 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.KS05EzJIcaDzmxoMcvHsiJsOFVXBlx6_0 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7677213859591599476', time=2024-09-12T19:59:52.322285+0000, chain.objs.size()=1 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.tB4MeZo9Svdd9TW-5q89ZYApXCaH2fA_0 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13279039059947533386', time=2024-09-12T19:59:52.342045+0000, chain.objs.size()=1 2024-09-12T18:02:40.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.083+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.9-YT_VMIJijw47LLdINYEuJRpCYcubw_0 2024-09-12T18:02:40.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.087+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.089+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:02:40.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.090+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16741558557231072164', time=2024-09-12T19:53:38.915277+0000, chain.objs.size()=1 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7__shadow_.b3Ohu8joR-W4XZbowuGuo9vF2juNiVd_0 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3321891417960420679', time=2024-09-12T19:54:59.405890+0000, chain.objs.size()=1 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.SQzvTbWYbB0bqp80N8i9VISOMAW-byz_0 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4344555363989267840', time=2024-09-12T19:55:34.917825+0000, chain.objs.size()=1 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.8mTteVrV7smTx2JB4fCNzBeoPYV6up2_0 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16680132530167422573', time=2024-09-12T19:55:36.522109+0000, chain.objs.size()=1 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.23__shadow_.bG27b71wEo4i6ts3s8u4H6XfQtXlImI_0 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4717964641170198065', time=2024-09-12T19:56:49.469119+0000, chain.objs.size()=1 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.YMRenHeKdjsPMkGOFkdfXrfY4a_fmGl_0 2024-09-12T18:02:40.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3756151679566148907', time=2024-09-12T19:57:24.833539+0000, chain.objs.size()=1 2024-09-12T18:02:40.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.30__shadow_.SCnF0LK5xP94zn4zI7fnj0142PGoKAZ_0 2024-09-12T18:02:40.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14002689853283373534', time=2024-09-12T19:58:00.080047+0000, chain.objs.size()=1 2024-09-12T18:02:40.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.L6y2-_7CHsSRbyMSyXXZUwF9wTyKpgt_0 2024-09-12T18:02:40.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3500442819823014110', time=2024-09-12T19:58:00.117075+0000, chain.objs.size()=1 2024-09-12T18:02:40.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.091+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.qMXX5gQwNmtvOuv1KsUBsrGBRObQJc__0 2024-09-12T18:02:40.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.095+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.098+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:02:40.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.099+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13467115751610007399', time=2024-09-12T19:53:38.558195+0000, chain.objs.size()=1 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.23pyLtKAPwc-yMkP7J4Y06pU8mW8Ge6_0 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5510509473852949020', time=2024-09-12T19:53:38.566702+0000, chain.objs.size()=1 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4__shadow_.aomPvNSXKAe4-BV_Me75NBi6ZMbqN7q_0 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_3N229wPxCZhfLOgCJFOEUcfkbs_RiEM', time=2024-09-12T19:53:38.686030+0000, chain.objs.size()=2 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.yK5DldQw2LI9QsY900AHv_jDSoGhSY6_0 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.yK5DldQw2LI9QsY900AHv_jDSoGhSY6_1 2024-09-12T18:02:40.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15838182471712464325', time=2024-09-12T19:53:38.848700+0000, chain.objs.size()=3 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_0 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.ViImFPTaWzk_iOh_U0_LXoE9ghQSpac_2 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3158164871008432843', time=2024-09-12T19:54:57.788771+0000, chain.objs.size()=1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.B6F5dlcVzWjbj0YkK2-GyShiktTK8XD_0 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3781163492788742979', time=2024-09-12T19:55:34.925146+0000, chain.objs.size()=1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.mVNJ1CTGNsJkxtks5ZHZ9-ZB1fo4a77_0 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16879958905484114928', time=2024-09-12T19:56:46.816015+0000, chain.objs.size()=1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.27__shadow_.NFHFqaMR-koNsYJP0HSoNVIp5qXqTyI_0 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2067188175350310626', time=2024-09-12T19:56:49.509927+0000, chain.objs.size()=1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.bujiQv4Rra6JltQhYHEy306Au5t75tV_0 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17778354424199321798', time=2024-09-12T19:58:00.022964+0000, chain.objs.size()=1 2024-09-12T18:02:40.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.100+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.SD_pHWUIWfsJrlJDGNwqV8sBnbB0En9_0 2024-09-12T18:02:40.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.102+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8927511998947198517', time=2024-09-12T19:58:00.058953+0000, chain.objs.size()=1 2024-09-12T18:02:40.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.102+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.huVwOOaT1M0erMPRWX4yCI8PMbNq2QR_0 2024-09-12T18:02:40.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5359152293285964430', time=2024-09-12T19:58:00.105918+0000, chain.objs.size()=1 2024-09-12T18:02:40.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.0H6DLcouN8M9At6CEb3ZjZF1TEbGe_n_0 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7235826488514521063', time=2024-09-12T19:58:03.404324+0000, chain.objs.size()=1 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.1zwn21QiEPyzhS4fI5dWNF4L3M5DHtQ_0 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319549920718869929', time=2024-09-12T19:58:41.681216+0000, chain.objs.size()=1 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.bCIfV7GBIIYa4WWhG41fN4j8sNUsaMv_0 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4551371651415869569', time=2024-09-12T19:59:17.706774+0000, chain.objs.size()=1 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.104+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.rSdTr-W82SJBLu7rnsGhSDbCuQ8R_zC_0 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.105+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16354466294080489535', time=2024-09-12T19:59:21.432793+0000, chain.objs.size()=1 2024-09-12T18:02:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.105+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.39__shadow_.GrmdvqIz3xosQVDp3WyIKzkeQR-YC1-_0 2024-09-12T18:02:40.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.108+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.111+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:02:40.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.112+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.112+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18190922734335442127', time=2024-09-12T19:53:38.611081+0000, chain.objs.size()=4 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.1 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.2 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.3 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12__multipart_foo.2~kpEq88E7Emw8onixAEvk_Q8G5nT0ihU.4 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_2Ycb0wf5s1Gm8Oe-tp86G4SK431C_65', time=2024-09-12T19:53:38.756652+0000, chain.objs.size()=3 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__0 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__1 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.CiOQ5Az6rSM9RHzIJYqDVwqJ9Vv97G__2 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5937306400431385859', time=2024-09-12T19:53:38.785074+0000, chain.objs.size()=3 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.1 2024-09-12T18:02:40.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.2 2024-09-12T18:02:40.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__multipart_foo-STANDARD.2~F1fhHTJZmU5GcGo-2Dhtx9Q5QkLCtj0.3 2024-09-12T18:02:40.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15571904557491706961', time=2024-09-12T19:55:34.966254+0000, chain.objs.size()=1 2024-09-12T18:02:40.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.mxDG8d_P8NMpqW_6jFGcuOcny7wKqN9_0 2024-09-12T18:02:40.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18095487331010671714', time=2024-09-12T19:56:08.939211+0000, chain.objs.size()=1 2024-09-12T18:02:40.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.113+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.sabNjJ0VOrzxTAnFNiE-7gaUtDqA1wP_0 2024-09-12T18:02:40.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.116+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6198086118634484816', time=2024-09-12T19:56:11.212891+0000, chain.objs.size()=1 2024-09-12T18:02:40.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.116+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.rdkvg8oiiq2JKtwt4NAZDKFjgr-PPjg_0 2024-09-12T18:02:40.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2734602507465022629', time=2024-09-12T19:56:11.285378+0000, chain.objs.size()=1 2024-09-12T18:02:40.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.BIVaEgczKCX1455ncd0Rj2C-5DDaJKc_0 2024-09-12T18:02:40.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17878269569304330885', time=2024-09-12T19:56:49.469258+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.6YGzNZUQiihjCChKvjkTVXoMFBKpMjB_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1989161791541425076', time=2024-09-12T19:57:26.803654+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.B53yXE43ydr2-ql7ZRZp3sDqIFhVAqb_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6602472529354204079', time=2024-09-12T19:58:00.079963+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.5FOhOE28yGkzGBTbBcmopEbl8IRfMAH_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3988809436950388528', time=2024-09-12T19:58:03.334564+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.WPnlkO2gxK50W5G4FzTgMFFxJMARH1J_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6016486743608758183', time=2024-09-12T19:59:17.666784+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.0qjjtGUNQpkvScnP2165FT2AYNJrz76_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1884603267269142362', time=2024-09-12T19:59:17.667508+0000, chain.objs.size()=1 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.-VkUYV6lMSaMn2IQoQVyqS6aZ6o1bah_0 2024-09-12T18:02:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5255682989833512352', time=2024-09-12T19:59:19.658165+0000, chain.objs.size()=1 2024-09-12T18:02:40.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.d-PL-dSmDRXj6qDfzP0lXAUL7Rfn1CP_0 2024-09-12T18:02:40.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6131224304063858257', time=2024-09-12T19:59:19.678985+0000, chain.objs.size()=1 2024-09-12T18:02:40.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.118+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.TRhpPLgSLXoJKTlDS3eHwoJiKQK69x4_0 2024-09-12T18:02:40.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.124+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.126+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:02:40.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.127+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.127+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_CfuZW394ABsJxHrnZ5rIi94fbXhif2h', time=2024-09-12T19:53:38.701974+0000, chain.objs.size()=2 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.zv_9OJ05kbSpIgX1t74anM4LUCsanwX_0 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.zv_9OJ05kbSpIgX1t74anM4LUCsanwX_1 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15151485537606547679', time=2024-09-12T19:53:38.718117+0000, chain.objs.size()=2 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_0 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15__shadow_.gMRxASqkbM2etDj5KEAqhcgQSmOHRng_1 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3557362931370887057', time=2024-09-12T19:53:38.859680+0000, chain.objs.size()=3 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_0 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_1 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13__shadow_.fa36yyrCoZJcjlS-C9ckF_l-TpXlfOi_2 2024-09-12T18:02:40.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9772332380737832802', time=2024-09-12T19:54:59.350232+0000, chain.objs.size()=1 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.RuyP4zomX059csKRvuQXfVwiAV6rLmY_0 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503877572662775301', time=2024-09-12T19:54:59.426017+0000, chain.objs.size()=1 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.20__shadow_.-oN0bnS-oVUVFDdgtdC2eVJRSw77Sf8_0 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14358570832330741110', time=2024-09-12T19:55:32.071638+0000, chain.objs.size()=1 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.eC9vjdE633iNMy3sqOKF41mK1PzbK9u_0 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3220946445455609577', time=2024-09-12T19:55:34.961918+0000, chain.objs.size()=1 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.IHyGOHkm98Jx6aAqDpWGTNhsZe1Jp4F_0 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13420107529336065453', time=2024-09-12T19:57:26.836800+0000, chain.objs.size()=1 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.128+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.VYB9ok1J9KnO9AI5iFDRIKwp2zIdQny_0 2024-09-12T18:02:40.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.131+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7100751823888209361', time=2024-09-12T19:57:26.883011+0000, chain.objs.size()=1 2024-09-12T18:02:40.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.131+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.NdrkShRRvV7_JSx5-dzN0OwFOIl1B6B_0 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10993132662176769542', time=2024-09-12T19:58:00.072789+0000, chain.objs.size()=1 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.AeppqUijknLBcnyQ_-F8XQfgWuniuJZ_0 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10486591497456977121', time=2024-09-12T19:58:00.108863+0000, chain.objs.size()=1 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.Lg_ylh8LXZtwiVoKVAHfhylaGTNwWfn_0 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.155373036479369828', time=2024-09-12T19:58:41.680663+0000, chain.objs.size()=1 2024-09-12T18:02:40.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.132+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.E8LqJVw_wfyo62SDj8s1d5R8cGsO6WN_0 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15142498048492645952', time=2024-09-12T19:59:17.660124+0000, chain.objs.size()=1 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.rV2ZFhZXaMFpD3h7iTxNaslpPZ0vSoB_0 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12230806007148501417', time=2024-09-12T19:59:17.703861+0000, chain.objs.size()=1 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.37__shadow_.fC5NLOMSA7gjPV4E8uuV9ADb7lLVsnG_0 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8643211908733698471', time=2024-09-12T19:59:19.599001+0000, chain.objs.size()=1 2024-09-12T18:02:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.133+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.38__shadow_.AWeutrx4RWYxRTyj4edjOVFjZcYtdxC_0 2024-09-12T18:02:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.136+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.139+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:02:40.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.140+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.140+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='_ruMZqTQ7C8Xgsz98r7YEZCU7_vtHaEv', time=2024-09-12T19:53:38.769081+0000, chain.objs.size()=3 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_0 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16__shadow_.YSo6LKRFnUpAsYfBwi-sqjDWjLmCP6d_2 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13922652384692646261', time=2024-09-12T19:53:38.955354+0000, chain.objs.size()=1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8__shadow_.VbG-6z5_4LmqbvBqqwEcfhoFnSrc1h6_0 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11545217494663965680', time=2024-09-12T19:54:57.846627+0000, chain.objs.size()=1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.19__shadow_.rbhtJS50kfpKWnO9savkojlDjmeDF6-_0 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2649657854308840238', time=2024-09-12T19:55:35.004738+0000, chain.objs.size()=1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.il09wla5TNEzLO7W8KEgAPHZD7XG6r5_0 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17816918925949082953', time=2024-09-12T19:56:11.250869+0000, chain.objs.size()=1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.IkunocoOwdxxTSjtDXKB9GoxKvlB11r_0 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3288091403665980086', time=2024-09-12T19:56:11.295463+0000, chain.objs.size()=1 2024-09-12T18:02:40.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.wzk1kbzvjZIAk5iKPbIFE-F5tKOhwPq_0 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13870723772872980506', time=2024-09-12T19:56:49.509284+0000, chain.objs.size()=1 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.4w91KIlrN4TL0pRO9Ly6pdj57SL-Kqq_0 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7849334592822285593', time=2024-09-12T19:57:26.867439+0000, chain.objs.size()=1 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.gHCs0w8vHJBE22FEpiuNk942AR0MfMm_0 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17463792273000389006', time=2024-09-12T19:58:00.079988+0000, chain.objs.size()=1 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.32__shadow_.RbH7edkJBgZiP2rQCk4BJSJAifeL4uf_0 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8470088851141511910', time=2024-09-12T19:58:03.387414+0000, chain.objs.size()=1 2024-09-12T18:02:40.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.141+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.33__shadow_.0oDtRaUY1jvpsgGLdZHdVG5sBs9rtRv_0 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8549930794110994439', time=2024-09-12T19:58:39.534253+0000, chain.objs.size()=1 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.frx0Dbcdx6qL5HC3XctYhwrO5dNiTRb_0 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1163599848066915085', time=2024-09-12T19:58:39.544175+0000, chain.objs.size()=1 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.jXSvCy49M1mOV9lneHporilPLSzRYgW_0 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7363731480210504120', time=2024-09-12T19:58:41.602634+0000, chain.objs.size()=1 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.SqtBm7MuBJ2eqqbmn1iiViNIqFVYDoV_0 2024-09-12T18:02:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14544955364503665236', time=2024-09-12T19:58:41.619046+0000, chain.objs.size()=1 2024-09-12T18:02:40.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.144+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.bGF9GMQ9MUJCJVATuDygfxXimD6eauS_0 2024-09-12T18:02:40.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.147+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.149+0000 7f851d533800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:02:40.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.151+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.151+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:02:40.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8002416787488267323', time=2024-09-12T19:55:32.028860+0000, chain.objs.size()=1 2024-09-12T18:02:40.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21__shadow_.NZPxxLR8Oq86FIwtlzAXjBLRNNblPJb_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5013445705377934375', time=2024-09-12T19:55:34.949655+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.wYATGphLt-YkvCU-tnB4B9JGNaOuZkt_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10109900388608582901', time=2024-09-12T19:55:34.964377+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.22__shadow_.1zhooXYG82PqUfPwHL8wusB6dBDwHNF_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3359396336544119857', time=2024-09-12T19:55:38.090721+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.24__shadow_.teV6mkO3yxB50Dk3oWYr7e5Gdg7w1yh_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6855059977861197627', time=2024-09-12T19:56:11.267191+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.25__shadow_.e8mE4vPGpphWiPrZGW-yyuNUbDFXwh0_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10775728615543616422', time=2024-09-12T19:56:49.530756+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.yyw2EP_TCiQleA-8GROikF3R4hjyITl_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11418056680595012037', time=2024-09-12T19:56:49.536539+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.28__shadow_.pgjXYPAg1kREoMC8ohi2zLTxYFmnR-x_0 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12972514826849646628', time=2024-09-12T19:57:22.177106+0000, chain.objs.size()=1 2024-09-12T18:02:40.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.29__shadow_.KudScw-Si5ZNr-i86cCcyCwSjb33Z2i_0 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7892870006213444641', time=2024-09-12T19:57:26.801450+0000, chain.objs.size()=1 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.QyRAm3_cMeTn4IEFotDHdgcuMzTBr2x_0 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11227958682048540021', time=2024-09-12T19:57:26.838160+0000, chain.objs.size()=1 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.31__shadow_.RJJHo7gScAKOh7Bz_EvSmy-WFlGtr5r_0 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11778870848290803302', time=2024-09-12T19:58:39.581521+0000, chain.objs.size()=1 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.34__shadow_.8w6XMMw74RDveVHXKUhibiVxmWKFuRM_0 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2067651109875496995', time=2024-09-12T19:58:41.645064+0000, chain.objs.size()=1 2024-09-12T18:02:40.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.152+0000 7f851d533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.35__shadow_.bY3O5vyidMWUb34rg5SyrFnHjauSu6n_0 2024-09-12T18:02:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.158+0000 7f851d533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:02:40.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.161+0000 7f83cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.163+0000 7f851d533800 20 remove_watcher() i=0 2024-09-12T18:02:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.163+0000 7f851d533800 2 removed watcher, disabling cache 2024-09-12T18:02:40.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.164+0000 7f851d533800 20 remove_watcher() i=1 2024-09-12T18:02:40.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.165+0000 7f851d533800 20 remove_watcher() i=2 2024-09-12T18:02:40.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.167+0000 7f851d533800 20 remove_watcher() i=3 2024-09-12T18:02:40.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.168+0000 7f851d533800 20 remove_watcher() i=4 2024-09-12T18:02:40.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.169+0000 7f851d533800 20 remove_watcher() i=5 2024-09-12T18:02:40.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.169+0000 7f851d533800 20 remove_watcher() i=6 2024-09-12T18:02:40.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.170+0000 7f851d533800 20 remove_watcher() i=7 2024-09-12T18:02:40.182 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:02:40.274 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:40.274 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.512+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 realm 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.513+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.514+0000 7fc493139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.514+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.514+0000 7fc493139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.514+0000 7fc493139800 20 searching for the correct realm 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.518+0000 7fc48f5c8640 0 -- 172.21.15.94:0/3630054688 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fc47809a040 msgr2=0x7fc47804f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.522+0000 7fc48edc7640 0 -- 172.21.15.94:0/3630054688 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fc478081710 msgr2=0x7fc4780519c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.728+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 zone default found 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 4 Realm: () 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 zonegroup default 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.729+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 rados->read ofs=0 len=0 2024-09-12T18:02:40.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:40.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 started sync module instance, tier type = 2024-09-12T18:02:40.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.730+0000 7fc493139800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=0 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=1 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=2 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=3 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=4 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=5 2024-09-12T18:02:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=6 2024-09-12T18:02:40.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 20 add_watcher() i=7 2024-09-12T18:02:40.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.739+0000 7fc493139800 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:40.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.741+0000 7fc345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:40.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.741+0000 7fc493139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:40.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.741+0000 7fc493139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.778+0000 7fc344fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.778+0000 7fc493139800 20 init_complete bucket index max shards: 11 2024-09-12T18:02:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.778+0000 7fc493139800 20 Filter name: none 2024-09-12T18:02:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.779+0000 7fc33dffb640 20 reqs_thread_entry: start 2024-09-12T18:02:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.779+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:02:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.780+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.781+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.781+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.782+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:02:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.783+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.784+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.784+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.785+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:02:40.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.786+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.787+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.787+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.788+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:02:40.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.790+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.790+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.790+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.791+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:02:40.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.793+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.793+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.793+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.794+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:02:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.796+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.796+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.797+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.798+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:02:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.800+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.800+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.801+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.802+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:02:40.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.803+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.803+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.804+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.805+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:02:40.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.806+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.806+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.806+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.807+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:02:40.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.809+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.809+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.809+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.810+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:02:40.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.812+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.813+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.813+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.814+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:02:40.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.815+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.816+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.816+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.817+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:02:40.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.819+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.819+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.819+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.820+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:02:40.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.821+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.822+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.822+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.823+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:02:40.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.824+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.825+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.825+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.826+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:02:40.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.828+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.828+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.828+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.829+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:02:40.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.830+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.831+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.831+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.832+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:02:40.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.833+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.834+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.834+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.835+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:02:40.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.836+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.837+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.837+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.838+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:02:40.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.839+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.840+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.841+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.842+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:02:40.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.843+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.843+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.844+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.844+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:02:40.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.846+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.846+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.846+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.847+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:02:40.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.848+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.849+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.849+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.850+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:02:40.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.851+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.852+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.852+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.853+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:02:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.854+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.855+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.855+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.856+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:02:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.857+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.858+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.858+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.859+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:02:40.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.860+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.861+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.862+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.863+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.864+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.864+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.865+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.866+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:02:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.867+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.868+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.868+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.869+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:02:40.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.870+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.871+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.871+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.872+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:02:40.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.873+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.874+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.875+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.876+0000 7fc493139800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:02:40.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.877+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.877+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:02:40.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.878+0000 7fc493139800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:02:40.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.879+0000 7fc345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:40.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.882+0000 7fc493139800 20 remove_watcher() i=0 2024-09-12T18:02:40.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.882+0000 7fc493139800 2 removed watcher, disabling cache 2024-09-12T18:02:40.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.883+0000 7fc493139800 20 remove_watcher() i=1 2024-09-12T18:02:40.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.884+0000 7fc493139800 20 remove_watcher() i=2 2024-09-12T18:02:40.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.885+0000 7fc493139800 20 remove_watcher() i=3 2024-09-12T18:02:40.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.886+0000 7fc493139800 20 remove_watcher() i=4 2024-09-12T18:02:40.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.887+0000 7fc493139800 20 remove_watcher() i=5 2024-09-12T18:02:40.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.888+0000 7fc493139800 20 remove_watcher() i=6 2024-09-12T18:02:40.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:02:40.889+0000 7fc493139800 20 remove_watcher() i=7 2024-09-12T18:02:40.901 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T18:02:41.412 INFO:teuthology.orchestra.run.smithi094.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean UP-TO-DATE 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-12T18:03:04.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-12T18:03:04.212 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:03:04.212 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:03:04.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:04.213 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:03:04.213 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-12T18:03:09.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:09.911 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-12T18:03:09.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:09.911 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T18:03:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:14.011 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T18:03:14.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:14.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T18:03:14.511 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:14.511 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T18:03:14.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:14.911 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T18:03:20.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:20.112 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T18:03:20.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:20.811 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T18:03:21.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:21.211 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T18:03:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:33.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T18:03:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:34.311 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:03:34.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:03:34.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T18:03:34.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12 18:03:34,538 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:04:26.812 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:26.813 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:04:27.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:27.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T18:04:27.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:27.612 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T18:04:28.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:28.011 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T18:04:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:28.111 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T18:04:28.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:28.811 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T18:04:32.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:32.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T18:04:33.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:33.111 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:04:33.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:33.111 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:04:33.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:33.211 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T18:04:39.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:39.011 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T18:04:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:39.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:04:47.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:47.011 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:04:47.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:47.611 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T18:04:49.711 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:49.711 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T18:04:50.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:04:50.111 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:05:39.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:39.112 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:05:39.711 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:39.711 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T18:05:44.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:44.111 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T18:05:44.511 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:44.511 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T18:05:48.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:48.211 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T18:05:48.711 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:48.711 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T18:05:50.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:50.211 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T18:05:55.711 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:55.711 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T18:05:55.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:55.811 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T18:05:56.211 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:56.211 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T18:05:56.310 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:56.311 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T18:05:56.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:56.811 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T18:05:56.910 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:56.911 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T18:05:57.311 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:57.311 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T18:05:57.410 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:57.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T18:05:57.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:57.811 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T18:05:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:57.911 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T18:05:58.311 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:58.311 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T18:05:58.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:58.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T18:05:58.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:58.911 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T18:05:59.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:59.011 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T18:05:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:05:59.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T18:06:07.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:07.411 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T18:06:07.902 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:07.902 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-12T18:06:07.902 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T18:06:07.902 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-12T18:06:07.902 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 3m 26s 2024-09-12T18:06:07.903 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T18:06:08.220 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:08.272 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:08.272 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:08.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.308+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 realm 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.310+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.311+0000 7f3db4c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.312+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.312+0000 7f3db4c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.312+0000 7f3db4c0e800 20 searching for the correct realm 2024-09-12T18:06:08.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.316+0000 7f3da7a58640 0 -- 172.21.15.94:0/2982662220 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3da0016ba0 msgr2=0x7f3da0046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:08.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.320+0000 7f3da7a58640 0 -- 172.21.15.94:0/2982662220 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3c78086bc0 msgr2=0x7f3c78088ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:08.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 zone default found 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 4 Realm: () 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 zonegroup default 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.324+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 started sync module instance, tier type = 2024-09-12T18:06:08.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.325+0000 7f3db4c0e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=0 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=1 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=2 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=3 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=4 2024-09-12T18:06:08.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=5 2024-09-12T18:06:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.334+0000 7f3db4c0e800 20 add_watcher() i=6 2024-09-12T18:06:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.335+0000 7f3db4c0e800 20 add_watcher() i=7 2024-09-12T18:06:08.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.335+0000 7f3db4c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:08.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.336+0000 7f3c677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:08.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.337+0000 7f3db4c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:08.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.337+0000 7f3db4c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.375+0000 7f3c667dc640 20 reqs_thread_entry: start 2024-09-12T18:06:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.375+0000 7f3db4c0e800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.375+0000 7f3db4c0e800 20 Filter name: none 2024-09-12T18:06:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.375+0000 7f3c5f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:08.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.375+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.377+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.377+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13321289591605071709', time=2024-09-12T20:05:06.226989+0000, chain.objs.size()=21 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.1 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.1_1 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.2 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.2_1 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.3 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.3_1 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.4 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.4_1 2024-09-12T18:06:08.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.5 2024-09-12T18:06:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.378+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.5_1 2024-09-12T18:06:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.380+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.6 2024-09-12T18:06:08.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.380+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.6_1 2024-09-12T18:06:08.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.381+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.7 2024-09-12T18:06:08.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.383+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.7_1 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.8 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.8_1 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.9 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.9_1 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.10 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.10_1 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~k6-BnAnjCKlV4I9n5ImDVxY1ZoRYqrC.11 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.370276720417437905', time=2024-09-12T20:05:48.354363+0000, chain.objs.size()=9 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__multipart_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.1 2024-09-12T18:06:08.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.385+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__shadow_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.1_1 2024-09-12T18:06:08.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.388+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__multipart_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.2 2024-09-12T18:06:08.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.388+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__shadow_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.2_1 2024-09-12T18:06:08.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.388+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__multipart_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.3 2024-09-12T18:06:08.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.389+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__shadow_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.3_1 2024-09-12T18:06:08.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.390+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__multipart_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.4 2024-09-12T18:06:08.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.390+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__shadow_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.4_1 2024-09-12T18:06:08.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.391+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.57__multipart_key1.2~ejMk-BBRdXSS6mGMQEI_HWw6UIm_yrs.5 2024-09-12T18:06:08.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.395+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.397+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:08.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12786924962186919205', time=2024-09-12T20:05:14.434265+0000, chain.objs.size()=21 2024-09-12T18:06:08.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.1_1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.2 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.2_1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.3 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.3_1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.4 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.4_1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.399+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.5 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.400+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.5_1 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.400+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.6 2024-09-12T18:06:08.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.400+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.6_1 2024-09-12T18:06:08.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.403+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.7 2024-09-12T18:06:08.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.403+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.7_1 2024-09-12T18:06:08.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.403+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.8 2024-09-12T18:06:08.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.403+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.8_1 2024-09-12T18:06:08.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.405+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.9 2024-09-12T18:06:08.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.405+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.9_1 2024-09-12T18:06:08.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.405+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.10 2024-09-12T18:06:08.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.405+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.10_1 2024-09-12T18:06:08.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.408+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~RuCOjIhZ9ctPwL44dMlN1WphkSs9dso.11 2024-09-12T18:06:08.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.411+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.413+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:08.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.414+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.415+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.415+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.415+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13113820895688315421', time=2024-09-12T20:05:56.461261+0000, chain.objs.size()=1 2024-09-12T18:06:08.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.415+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.60__shadow_.4DS_Jw6hPPpg33B48r7D-oK4TqDQGYG_0 2024-09-12T18:06:08.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.417+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.419+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:08.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:06:08.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6460798308070342525', time=2024-09-12T20:03:54.152680+0000, chain.objs.size()=9 2024-09-12T18:06:08.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.1 2024-09-12T18:06:08.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.420+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.1_1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.2 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.2_1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.3 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.3_1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.4 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.4_1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~UjNnOSBS0MpAogd55yrAgiCym3OxyqT.5 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18420065123672938102', time=2024-09-12T20:04:39.113347+0000, chain.objs.size()=9 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__multipart_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__shadow_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.1_1 2024-09-12T18:06:08.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.421+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__multipart_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.2 2024-09-12T18:06:08.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.423+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__shadow_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.2_1 2024-09-12T18:06:08.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.425+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__multipart_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.3 2024-09-12T18:06:08.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.427+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__shadow_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.3_1 2024-09-12T18:06:08.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.427+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__multipart_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.4 2024-09-12T18:06:08.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.427+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__shadow_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.4_1 2024-09-12T18:06:08.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.427+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52__multipart_key1.2~ImOvPK-C1iP_RkYm__9V11m2MfV7Wuv.5 2024-09-12T18:06:08.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.431+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.433+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:08.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.434+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.435+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.435+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.436+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:08.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.437+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3304278544816534338', time=2024-09-12T20:05:22.322139+0000, chain.objs.size()=19 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.1 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.1_1 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.2 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.2_1 2024-09-12T18:06:08.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.3 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.3_1 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.4 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.4_1 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.5 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.5_1 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.6 2024-09-12T18:06:08.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.438+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.6_1 2024-09-12T18:06:08.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.441+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.7 2024-09-12T18:06:08.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.442+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.7_1 2024-09-12T18:06:08.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.442+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.8 2024-09-12T18:06:08.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.443+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.8_1 2024-09-12T18:06:08.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.443+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.9 2024-09-12T18:06:08.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.443+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.9_1 2024-09-12T18:06:08.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.443+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~zZzOpCLX_oQsseKlmu2ehI1gjdOm6be.10 2024-09-12T18:06:08.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.449+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.452+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:08.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.453+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.453+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.453+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.454+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:08.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.455+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.456+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.456+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.457+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:08.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.458+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN', time=2024-09-12T20:05:53.986624+0000, chain.objs.size()=1 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.19 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN', time=2024-09-12T20:05:54.169175+0000, chain.objs.size()=1 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.20 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN', time=2024-09-12T20:05:54.350534+0000, chain.objs.size()=49 2024-09-12T18:06:08.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.1 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.2 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.3 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.4 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.5 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.6 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.7 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.8 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.9 2024-09-12T18:06:08.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.459+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.10 2024-09-12T18:06:08.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.463+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.11 2024-09-12T18:06:08.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.464+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.12 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.13 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.14 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.15 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.16 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.17 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.18 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.wr8OdCzxnY2nVXWwYZpIo3mXd3ozqAre.19 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.w6Ql7hPb-D-3dvMvAkqX6sBNSfQCxZDi.20 2024-09-12T18:06:08.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.465+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.21 2024-09-12T18:06:08.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.467+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.22 2024-09-12T18:06:08.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.468+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.23 2024-09-12T18:06:08.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.469+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.24 2024-09-12T18:06:08.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.469+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.25 2024-09-12T18:06:08.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.469+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.26 2024-09-12T18:06:08.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.27 2024-09-12T18:06:08.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.28 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.29 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.30 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.31 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.32 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.471+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.33 2024-09-12T18:06:08.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.472+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.34 2024-09-12T18:06:08.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.473+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.35 2024-09-12T18:06:08.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.475+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.36 2024-09-12T18:06:08.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.475+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.37 2024-09-12T18:06:08.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.475+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.38 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.476+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.39 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.476+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.40 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.477+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.41 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.477+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.42 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.477+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.43 2024-09-12T18:06:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.477+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.44 2024-09-12T18:06:08.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.478+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.45 2024-09-12T18:06:08.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.478+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.46 2024-09-12T18:06:08.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.479+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.47 2024-09-12T18:06:08.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.479+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.48 2024-09-12T18:06:08.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.479+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.58__multipart_key1.2~BcLvTdWQelIAUuW1LgZZIAMuhQwh0MN.49 2024-09-12T18:06:08.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.484+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.486+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:08.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.487+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7104743808185525439', time=2024-09-12T20:04:26.714934+0000, chain.objs.size()=7 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.1 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.1_1 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.1_2 2024-09-12T18:06:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.2 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.2_1 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.2_2 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~DIPF3plxAu4oKDqWu0Hs8m2xgM-hMuQ.3 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5504750004340176821', time=2024-09-12T20:04:47.171536+0000, chain.objs.size()=9 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.1 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.1_1 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.2 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.2_1 2024-09-12T18:06:08.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.488+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.3 2024-09-12T18:06:08.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.491+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.3_1 2024-09-12T18:06:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.493+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.4 2024-09-12T18:06:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.493+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.4_1 2024-09-12T18:06:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.493+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file.mpg.2~_AE357CqNAcuJO1reVUOAWhQJ1b-zib.5 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3935522488144123989', time=2024-09-12T20:04:47.206854+0000, chain.objs.size()=1 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_.5IjkowXxXW1Zo2-lKMiikpfeUQ2IxFf_0 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4654522791938707433', time=2024-09-12T20:05:55.943533+0000, chain.objs.size()=1 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.59__shadow_.jURHkII1igyhQnRKn226mMvnJ-cgPoL_0 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13612486901366411484', time=2024-09-12T20:05:58.039447+0000, chain.objs.size()=1 2024-09-12T18:06:08.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.495+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.63__shadow_.J24V3MtfJBJ0rAGajPwJk4skzVN_KZV_0 2024-09-12T18:06:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.498+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.500+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.502+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.502+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1029011356068191665', time=2024-09-12T20:05:44.165503+0000, chain.objs.size()=9 2024-09-12T18:06:08.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__multipart_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.1 2024-09-12T18:06:08.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__shadow_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.1_1 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__multipart_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.2 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__shadow_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.2_1 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__multipart_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.3 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__shadow_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.3_1 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__multipart_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.4 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__shadow_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.4_1 2024-09-12T18:06:08.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.503+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__multipart_key1.2~eR3KSJ06RJUi6pAArKZy-cKA4-gSdUT.5 2024-09-12T18:06:08.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.507+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.510+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.511+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.511+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.511+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.511+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13281950129956787838', time=2024-09-12T20:04:27.244525+0000, chain.objs.size()=7 2024-09-12T18:06:08.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.511+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.1 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.1_1 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.1_2 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.2 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.2_1 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.2_2 2024-09-12T18:06:08.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.512+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~NsBby9kMCN1Vg9g2SVa7k9tpolCFaYe.3 2024-09-12T18:06:08.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.515+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.517+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:08.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.519+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.519+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16789320863551616407', time=2024-09-12T20:04:26.934172+0000, chain.objs.size()=6 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_0 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_1 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_2 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_3 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_4 2024-09-12T18:06:08.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.520+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.46__shadow_.iNkEYFzsXbNcg8qBVPTHObiHLIv9_f-_5 2024-09-12T18:06:08.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.523+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.526+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:08.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.527+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.527+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:06:08.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt', time=2024-09-12T20:03:13.944542+0000, chain.objs.size()=9 2024-09-12T18:06:08.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__multipart_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.1 2024-09-12T18:06:08.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__shadow_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.1_1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__multipart_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.2 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__shadow_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.2_1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__multipart_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.3 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__shadow_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.3_1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__multipart_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.4 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__shadow_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.4_1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.40__multipart_key1.2~x1m_6DJehnRyL0b-oFwqpkxS0raAcQt.5 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9526797278621401891', time=2024-09-12T20:05:58.556376+0000, chain.objs.size()=1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.64__shadow_.SWELDxln6ZnFAKyW1ReHHMRHlharuos_0 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.411163426077202770', time=2024-09-12T20:06:07.532864+0000, chain.objs.size()=21 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.1 2024-09-12T18:06:08.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.528+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.1_1 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.2 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.2_1 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.3 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.3_1 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.4 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.4_1 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.5 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.5_1 2024-09-12T18:06:08.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.6 2024-09-12T18:06:08.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.6_1 2024-09-12T18:06:08.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.532+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.7 2024-09-12T18:06:08.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.536+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.7_1 2024-09-12T18:06:08.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.538+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.8 2024-09-12T18:06:08.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.538+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.8_1 2024-09-12T18:06:08.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.539+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.9 2024-09-12T18:06:08.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.539+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.9_1 2024-09-12T18:06:08.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.539+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.10 2024-09-12T18:06:08.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.539+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__shadow_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.10_1 2024-09-12T18:06:08.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.539+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.66__multipart_key1.2~TJH-Tj-PDnMK7S9D0dl3CUdk8QoVTTS.11 2024-09-12T18:06:08.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.544+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.547+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:08.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.548+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.548+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12204607740728049422', time=2024-09-12T20:03:20.243161+0000, chain.objs.size()=9 2024-09-12T18:06:08.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__multipart_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.1 2024-09-12T18:06:08.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__shadow_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.1_1 2024-09-12T18:06:08.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__multipart_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.2 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__shadow_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.2_1 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__multipart_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.3 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__shadow_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.3_1 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__multipart_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.4 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__shadow_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.4_1 2024-09-12T18:06:08.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.549+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.42__multipart_key1.2~WwoR3BgfCpW9YK5dPEB-un3iXHSXODF.5 2024-09-12T18:06:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.553+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.556+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:08.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.557+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.557+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.558+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.559+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:08.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.560+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.560+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.561+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.562+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:08.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.563+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.563+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15047358615827842064', time=2024-09-12T20:04:05.003044+0000, chain.objs.size()=9 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.1 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.1_1 2024-09-12T18:06:08.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.2 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.2_1 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.3 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.3_1 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.4 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.4_1 2024-09-12T18:06:08.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.564+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n-MkZLkQv6YXyeyk6ipR7B7vEVkSe6u.5 2024-09-12T18:06:08.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.568+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.571+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:08.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.572+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7960280769144884772', time=2024-09-12T20:03:34.035841+0000, chain.objs.size()=9 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.1 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.1_1 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.2 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.2_1 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.3 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.3_1 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.4 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.4_1 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.5 2024-09-12T18:06:08.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7363514032904618346', time=2024-09-12T20:04:47.278748+0000, chain.objs.size()=1 2024-09-12T18:06:08.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.573+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_.655ZuWldy5s-gkvX92lHqMnFrVmNiTs_0 2024-09-12T18:06:08.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.578+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.580+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:08.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.581+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.581+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11273880831738298623', time=2024-09-12T20:03:33.728114+0000, chain.objs.size()=9 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.1 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.1_1 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.2 2024-09-12T18:06:08.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.2_1 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.3 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.3_1 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.4 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__shadow_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.4_1 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44__multipart_key1.2~6PawCtJ2zszHF-db3wedsLa4DBDYkob.5 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3575929382763491195', time=2024-09-12T20:05:56.986689+0000, chain.objs.size()=1 2024-09-12T18:06:08.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.582+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.61__shadow_.AgWT39XLDdZ3hDv6GZRT8flwAXuEKBR_0 2024-09-12T18:06:08.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.586+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.588+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:08.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.590+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.590+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14551971555576601165', time=2024-09-12T20:03:51.542440+0000, chain.objs.size()=9 2024-09-12T18:06:08.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.1 2024-09-12T18:06:08.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.1_1 2024-09-12T18:06:08.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.2 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.2_1 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.3 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.3_1 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.4 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.4_1 2024-09-12T18:06:08.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.591+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~57dKW9hkmEZJd3va8T_eIpOy4I6fijT.5 2024-09-12T18:06:08.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.595+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.598+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:08.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.600+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.600+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12484006519789866917', time=2024-09-12T20:05:39.186992+0000, chain.objs.size()=16 2024-09-12T18:06:08.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.1 2024-09-12T18:06:08.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.1_1 2024-09-12T18:06:08.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.1_2 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.2 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.2_1 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.2_2 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.3 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.3_1 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.3_2 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.4 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.4_1 2024-09-12T18:06:08.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.601+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.4_2 2024-09-12T18:06:08.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.604+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.5 2024-09-12T18:06:08.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.604+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.5_1 2024-09-12T18:06:08.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.605+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.5_2 2024-09-12T18:06:08.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.605+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Jt1zqNZLdRh_pXrOlPoRSE9bl59zTvs.6 2024-09-12T18:06:08.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.610+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.613+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:08.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.614+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.614+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.615+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.615+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:08.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.617+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.617+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.617+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.618+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.620+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.620+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8885393757612582706', time=2024-09-12T20:04:15.874151+0000, chain.objs.size()=7 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.1 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.1_1 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.1_2 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.2 2024-09-12T18:06:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.2_1 2024-09-12T18:06:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__shadow_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.2_2 2024-09-12T18:06:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.621+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.47__multipart_key1.2~n9mr1OouNGRfXGENmq1wOQY-IPNXl2f.3 2024-09-12T18:06:08.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.625+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.627+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.628+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.628+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.629+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.630+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:08.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.631+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.631+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:06:08.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8960297287065039397', time=2024-09-12T20:04:47.313056+0000, chain.objs.size()=1 2024-09-12T18:06:08.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_.JihNrCyC4iaHNaOsxUnqRsHgECX36Bd_0 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3989479021149182987', time=2024-09-12T20:05:38.965153+0000, chain.objs.size()=16 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.1 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.1_1 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.1_2 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.2 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.2_1 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.2_2 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.3 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.3_1 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.3_2 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.4 2024-09-12T18:06:08.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.632+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.4_1 2024-09-12T18:06:08.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.635+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.4_2 2024-09-12T18:06:08.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.635+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.5 2024-09-12T18:06:08.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.635+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.5_1 2024-09-12T18:06:08.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.636+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.5_2 2024-09-12T18:06:08.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.636+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~oqdgV-cJz1kRt6KeK4JTf1AJwiPXmom.6 2024-09-12T18:06:08.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.637+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.581616318113468772', time=2024-09-12T20:05:43.263380+0000, chain.objs.size()=1 2024-09-12T18:06:08.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.637+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.56__shadow_.NGuoevs6HrEd7tRdeunyK48OhjAwFVU_0 2024-09-12T18:06:08.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.642+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.644+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:08.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.645+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.645+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.646+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.646+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12521281505500046579', time=2024-09-12T20:05:57.508162+0000, chain.objs.size()=1 2024-09-12T18:06:08.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.646+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.62__shadow_.Rl7JSqz3qu4zhHZ8IOwxrDmmux06LMa_0 2024-09-12T18:06:08.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.647+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.649+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:08.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.650+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3', time=2024-09-12T20:04:49.950923+0000, chain.objs.size()=5 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.54__multipart_key1.2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3.7 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.54__shadow_key1.2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3.7_1 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.54__multipart_key1.2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3.10 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.54__shadow_key1.2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3.10_1 2024-09-12T18:06:08.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.651+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.54__multipart_key1.2~GTmjUc7QLn36TbTjN7jtgBzDL-zOZh3.13 2024-09-12T18:06:08.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.654+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.657+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:08.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.658+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.658+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10447830407073230181', time=2024-09-12T20:04:32.750436+0000, chain.objs.size()=9 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__multipart_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__shadow_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.1_1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__multipart_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.2 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__shadow_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.2_1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__multipart_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.3 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__shadow_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.3_1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__multipart_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.4 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__shadow_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.4_1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.51__multipart_key1.2~BAAMSb8Kfm_hw-umA0Qy8QJoN7ZyYbQ.5 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13014458119912358341', time=2024-09-12T20:04:47.244939+0000, chain.objs.size()=9 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.1_1 2024-09-12T18:06:08.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.659+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.2 2024-09-12T18:06:08.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.661+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.2_1 2024-09-12T18:06:08.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.662+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.3 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.664+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.3_1 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.664+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.4 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.664+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__shadow_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.4_1 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.664+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.53__multipart_file2.mpg.2~5MAZgXd_wdzwb5ph7Q3a6-zP3tZ6ICn.5 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.665+0000 7f3db4c0e800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1400722727048326162', time=2024-09-12T20:05:31.088604+0000, chain.objs.size()=16 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.665+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.1 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.665+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.1_1 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.665+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.1_2 2024-09-12T18:06:08.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.665+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.2 2024-09-12T18:06:08.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.666+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.2_1 2024-09-12T18:06:08.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.666+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.2_2 2024-09-12T18:06:08.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.666+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.3 2024-09-12T18:06:08.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.669+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.3_1 2024-09-12T18:06:08.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.669+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.3_2 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.4 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.4_1 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.4_2 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.5 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.5_1 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__shadow_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.5_2 2024-09-12T18:06:08.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.671+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55__multipart_key1.2~Bb9VcU-IDj0zdq20fkA-NmV-OrlcvE8.6 2024-09-12T18:06:08.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.676+0000 7f3db4c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:08.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.679+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:08.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.680+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.681+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.681+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.682+0000 7f3db4c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:08.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.683+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.683+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:08.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.684+0000 7f3db4c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:08.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.686+0000 7f3c677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:08.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.688+0000 7f3db4c0e800 20 remove_watcher() i=0 2024-09-12T18:06:08.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.688+0000 7f3db4c0e800 2 removed watcher, disabling cache 2024-09-12T18:06:08.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.689+0000 7f3db4c0e800 20 remove_watcher() i=1 2024-09-12T18:06:08.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.690+0000 7f3db4c0e800 20 remove_watcher() i=2 2024-09-12T18:06:08.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.691+0000 7f3db4c0e800 20 remove_watcher() i=3 2024-09-12T18:06:08.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.692+0000 7f3db4c0e800 20 remove_watcher() i=4 2024-09-12T18:06:08.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.693+0000 7f3db4c0e800 20 remove_watcher() i=5 2024-09-12T18:06:08.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.693+0000 7f3db4c0e800 20 remove_watcher() i=6 2024-09-12T18:06:08.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.694+0000 7f3db4c0e800 20 remove_watcher() i=7 2024-09-12T18:06:08.707 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:08.758 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:08.758 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.795+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 realm 2024-09-12T18:06:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.796+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.797+0000 7f0b22725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:08.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.797+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:08.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.797+0000 7f0b22725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:08.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.797+0000 7f0b22725800 20 searching for the correct realm 2024-09-12T18:06:08.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:08.799+0000 7f0b1e333640 0 -- 172.21.15.94:0/3368201524 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f0b1806d060 msgr2=0x7f0b18063840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:09.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.003+0000 7f0b1eb34640 0 -- 172.21.15.94:0/3368201524 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f0b1401c7d0 msgr2=0x7f0b140734a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 20 zone default found 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.009+0000 7f0b22725800 4 Realm: () 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 zonegroup default 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 started sync module instance, tier type = 2024-09-12T18:06:09.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.010+0000 7f0b22725800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=0 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=1 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=2 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=3 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=4 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=5 2024-09-12T18:06:09.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.019+0000 7f0b22725800 20 add_watcher() i=6 2024-09-12T18:06:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.020+0000 7f0b22725800 20 add_watcher() i=7 2024-09-12T18:06:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.020+0000 7f0b22725800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:09.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.021+0000 7f09d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.022+0000 7f0b22725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:09.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.022+0000 7f0b22725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.054+0000 7f094f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.055+0000 7f0b22725800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.055+0000 7f0b22725800 20 Filter name: none 2024-09-12T18:06:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.055+0000 7f094d7fa640 20 reqs_thread_entry: start 2024-09-12T18:06:09.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.055+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:09.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.056+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.057+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.057+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.058+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:09.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.059+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.060+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.060+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.061+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:09.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.062+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.063+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.063+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.064+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:09.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.066+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.067+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.067+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.068+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:09.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.069+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.070+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.070+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.071+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:09.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.072+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.072+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.072+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.073+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:09.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.075+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.075+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.076+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.076+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:09.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.078+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.078+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.078+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.079+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:09.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.080+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.081+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.081+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.082+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:09.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.084+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.084+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.084+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.085+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:09.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.087+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.087+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.087+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.088+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:09.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.089+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.090+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.090+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.091+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:09.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.092+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.093+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.093+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.094+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.095+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.095+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.096+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.097+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:09.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.098+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.098+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.098+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.100+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:09.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.101+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.101+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.102+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.102+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:09.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.104+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.104+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.105+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.106+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:09.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.107+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.107+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.107+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.108+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:09.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.110+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.110+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.111+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.112+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:09.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.113+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.113+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.114+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.115+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:09.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.116+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.116+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.117+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.118+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:09.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.119+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.119+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.119+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.120+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:09.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.121+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.122+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.122+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.123+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:09.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.124+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.125+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.125+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.126+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:09.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.127+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.128+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.128+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.129+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:09.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.130+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.130+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.131+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.131+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:09.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.133+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.133+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.133+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.134+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:09.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.136+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.136+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.136+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.137+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:09.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.139+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.139+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.139+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.140+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:09.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.142+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.142+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.142+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.143+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:09.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.144+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.145+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.145+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.146+0000 7f0b22725800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:09.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.147+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.148+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.148+0000 7f0b22725800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.150+0000 7f09d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.152+0000 7f0b22725800 20 remove_watcher() i=0 2024-09-12T18:06:09.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.152+0000 7f0b22725800 2 removed watcher, disabling cache 2024-09-12T18:06:09.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.153+0000 7f0b22725800 20 remove_watcher() i=1 2024-09-12T18:06:09.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.154+0000 7f0b22725800 20 remove_watcher() i=2 2024-09-12T18:06:09.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.155+0000 7f0b22725800 20 remove_watcher() i=3 2024-09-12T18:06:09.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.156+0000 7f0b22725800 20 remove_watcher() i=4 2024-09-12T18:06:09.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.157+0000 7f0b22725800 20 remove_watcher() i=5 2024-09-12T18:06:09.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.158+0000 7f0b22725800 20 remove_watcher() i=6 2024-09-12T18:06:09.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.159+0000 7f0b22725800 20 remove_watcher() i=7 2024-09-12T18:06:09.171 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:09.222 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:09.222 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:09.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.257+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 20 realm 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.259+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.260+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.260+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.261+0000 7f5f66b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:09.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.261+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.261+0000 7f5f66b3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:09.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.261+0000 7f5f66b3d800 20 searching for the correct realm 2024-09-12T18:06:09.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.264+0000 7f5f5bfff640 0 -- 172.21.15.94:0/1439931507 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56332ee629f0 msgr2=0x56332ee64eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:09.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.267+0000 7f5f6282a640 0 -- 172.21.15.94:0/1439931507 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f5f4c066e00 msgr2=0x7f5f4c08d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:09.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:09.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:09.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.271+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 zone default found 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 4 Realm: () 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:09.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 zonegroup default 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.272+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.273+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.273+0000 7f5f66b3d800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.273+0000 7f5f66b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.273+0000 7f5f66b3d800 20 started sync module instance, tier type = 2024-09-12T18:06:09.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.273+0000 7f5f66b3d800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:09.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=0 2024-09-12T18:06:09.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=1 2024-09-12T18:06:09.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=2 2024-09-12T18:06:09.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=3 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=4 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=5 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.281+0000 7f5f66b3d800 20 add_watcher() i=6 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.282+0000 7f5f66b3d800 20 add_watcher() i=7 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.282+0000 7f5f66b3d800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.284+0000 7f5e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.284+0000 7f5f66b3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:09.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.284+0000 7f5f66b3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.318+0000 7f5d93fff640 20 reqs_thread_entry: start 2024-09-12T18:06:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.318+0000 7f5f66b3d800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.318+0000 7f5f66b3d800 20 Filter name: none 2024-09-12T18:06:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.318+0000 7f5d91ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.318+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:09.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.319+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.320+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.320+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.321+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:09.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.322+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.323+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.323+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.324+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:09.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.325+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.326+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.326+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.327+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.328+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.328+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.329+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.330+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.331+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.331+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.331+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.332+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.333+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.334+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.334+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.335+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.336+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.337+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.337+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.338+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:09.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.339+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.340+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.340+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.341+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.342+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.342+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.343+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.344+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:09.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.345+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.345+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.345+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.346+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:09.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.348+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.348+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.349+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.350+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:09.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.351+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.351+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.351+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.352+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:09.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.353+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.354+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.354+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.355+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:09.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.356+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.357+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.357+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.358+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:09.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.359+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.360+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.360+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.361+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.362+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.363+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.363+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.364+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:09.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.365+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.366+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.366+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.367+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.370+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.370+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.370+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.371+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:09.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.373+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.373+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.373+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.374+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:09.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.376+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.376+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.376+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.377+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:09.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.378+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.379+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.379+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.380+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:09.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.381+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.382+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.382+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.383+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:09.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.384+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.385+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.385+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.386+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:09.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.387+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.388+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.388+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.389+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:09.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.391+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.391+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.391+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.392+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:09.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.394+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.394+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.394+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.395+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:09.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.396+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.397+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.397+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.398+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:09.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.399+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.400+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.400+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.401+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:09.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.402+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.403+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.403+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.404+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:09.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.405+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.405+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.406+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.406+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:09.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.408+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.408+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.408+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.409+0000 7f5f66b3d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:09.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.411+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.411+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.411+0000 7f5f66b3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.413+0000 7f5e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.415+0000 7f5f66b3d800 20 remove_watcher() i=0 2024-09-12T18:06:09.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.415+0000 7f5f66b3d800 2 removed watcher, disabling cache 2024-09-12T18:06:09.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.417+0000 7f5f66b3d800 20 remove_watcher() i=1 2024-09-12T18:06:09.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.417+0000 7f5f66b3d800 20 remove_watcher() i=2 2024-09-12T18:06:09.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.418+0000 7f5f66b3d800 20 remove_watcher() i=3 2024-09-12T18:06:09.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.419+0000 7f5f66b3d800 20 remove_watcher() i=4 2024-09-12T18:06:09.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.420+0000 7f5f66b3d800 20 remove_watcher() i=5 2024-09-12T18:06:09.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.421+0000 7f5f66b3d800 20 remove_watcher() i=6 2024-09-12T18:06:09.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.422+0000 7f5f66b3d800 20 remove_watcher() i=7 2024-09-12T18:06:09.434 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:09.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.521+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 20 realm 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.522+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.523+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.523+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.523+0000 7f67aba13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:09.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.523+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.524+0000 7f67aba13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:09.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.524+0000 7f67aba13800 20 searching for the correct realm 2024-09-12T18:06:09.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.527+0000 7f67a6947640 0 -- 172.21.15.94:0/2551328946 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6798032040 msgr2=0x7f6798046460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:09.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.530+0000 7f67a7949640 0 -- 172.21.15.94:0/2551328946 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f679c0ed340 msgr2=0x7f679c0caa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:09.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 zone default found 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 4 Realm: () 2024-09-12T18:06:09.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 zonegroup default 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.534+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 rados->read ofs=0 len=0 2024-09-12T18:06:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 started sync module instance, tier type = 2024-09-12T18:06:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.535+0000 7f67aba13800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=0 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=1 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=2 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=3 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=4 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=5 2024-09-12T18:06:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.543+0000 7f67aba13800 20 add_watcher() i=6 2024-09-12T18:06:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.544+0000 7f67aba13800 20 add_watcher() i=7 2024-09-12T18:06:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.544+0000 7f67aba13800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.545+0000 7f665dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.546+0000 7f67aba13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:09.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.546+0000 7f67aba13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:09.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.580+0000 7f665cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:09.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.580+0000 7f67aba13800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:09.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.580+0000 7f67aba13800 20 Filter name: none 2024-09-12T18:06:09.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.580+0000 7f65d67fc640 20 reqs_thread_entry: start 2024-09-12T18:06:09.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.580+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:09.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.582+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.582+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.582+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.583+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:09.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.585+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.585+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.585+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.586+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:09.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.588+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.588+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.589+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.590+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.591+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.591+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.592+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.592+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.594+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.594+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.594+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.595+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.596+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.597+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.597+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.598+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.599+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.600+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.600+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.601+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:09.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.602+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.603+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.603+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.604+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:09.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.605+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.605+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.606+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.607+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:09.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.608+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.608+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.608+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.609+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:09.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.611+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.611+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.611+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.612+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:09.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.613+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.614+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.614+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.615+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:09.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.616+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.617+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.617+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.618+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:09.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.619+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.620+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.620+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.621+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:09.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.623+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.623+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.623+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.624+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:09.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.626+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.626+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.626+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.627+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:09.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.628+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.629+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.629+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.630+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:09.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.631+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.632+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.632+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.633+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:09.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.634+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.635+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.635+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.636+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:09.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.637+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.638+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.638+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.639+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:09.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.640+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.641+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.641+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.642+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:09.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.643+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.644+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.644+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.645+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:09.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.647+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.647+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.647+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.648+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.649+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.650+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.650+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.652+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.653+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.653+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.654+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.654+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:09.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.656+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.656+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.656+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.657+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:09.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.658+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.659+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.659+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.660+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:09.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.661+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.662+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.662+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.663+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:09.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.664+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.665+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.665+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.666+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:09.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.667+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.667+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.668+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.669+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:09.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.670+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.670+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.671+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.671+0000 7f67aba13800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:09.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.673+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.673+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:09.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.673+0000 7f67aba13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:09.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.675+0000 7f665dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:09.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.677+0000 7f67aba13800 20 remove_watcher() i=0 2024-09-12T18:06:09.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.677+0000 7f67aba13800 2 removed watcher, disabling cache 2024-09-12T18:06:09.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.678+0000 7f67aba13800 20 remove_watcher() i=1 2024-09-12T18:06:09.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.679+0000 7f67aba13800 20 remove_watcher() i=2 2024-09-12T18:06:09.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.680+0000 7f67aba13800 20 remove_watcher() i=3 2024-09-12T18:06:09.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.681+0000 7f67aba13800 20 remove_watcher() i=4 2024-09-12T18:06:09.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.682+0000 7f67aba13800 20 remove_watcher() i=5 2024-09-12T18:06:09.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.683+0000 7f67aba13800 20 remove_watcher() i=6 2024-09-12T18:06:09.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:09.684+0000 7f67aba13800 20 remove_watcher() i=7 2024-09-12T18:06:09.695 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T18:06:10.195 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-12T18:06:11.092 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-12T18:06:11.092 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-12T18:06:11.092 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-12T18:06:11.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:11.692 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-12T18:06:11.693 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:06:11.693 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:06:11.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:11.694 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:06:11.694 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-12T18:06:13.693 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12 18:06:12,844 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T18:06:13.892 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.892 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T18:06:13.892 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:13.893 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T18:06:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:14.192 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T18:06:14.392 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:14.392 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T18:06:14.592 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:14.592 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T18:06:14.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:14.692 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T18:06:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:15.092 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T18:06:15.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:15.191 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T18:06:15.291 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:15.292 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T18:06:15.392 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:15.392 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T18:06:16.092 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.092 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T18:06:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.192 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T18:06:16.592 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.592 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T18:06:16.592 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.592 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:06:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:06:16.694 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:06:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:16.694 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T18:06:16.694 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-12T18:06:16.729 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:16.784 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:16.784 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:16.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.824+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.825+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.825+0000 7f8b94c98800 20 realm 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.825+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.826+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.826+0000 7f8b94c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:16.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.826+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:16.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.826+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:16.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.826+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:16.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.827+0000 7f8b94c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:16.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.827+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:16.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.827+0000 7f8b94c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:16.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.827+0000 7f8b94c98800 20 searching for the correct realm 2024-09-12T18:06:16.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.830+0000 7f8b91f88640 0 -- 172.21.15.94:0/2056230161 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f8b8401c410 msgr2=0x7f8b8401c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:16.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:16.835+0000 7f8b92789640 0 -- 172.21.15.94:0/2056230161 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f8b880b0580 msgr2=0x7f8b880b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:17.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:17.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:17.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:17.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.041+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 zone default found 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 4 Realm: () 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 zonegroup default 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.042+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 started sync module instance, tier type = 2024-09-12T18:06:17.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.043+0000 7f8b94c98800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=0 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=1 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=2 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=3 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=4 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=5 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.051+0000 7f8b94c98800 20 add_watcher() i=6 2024-09-12T18:06:17.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.052+0000 7f8b94c98800 20 add_watcher() i=7 2024-09-12T18:06:17.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.052+0000 7f8b94c98800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:17.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.054+0000 7f8a48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.054+0000 7f8b94c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:17.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.054+0000 7f8b94c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:17.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.088+0000 7f89c37fe640 20 reqs_thread_entry: start 2024-09-12T18:06:17.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.088+0000 7f8b94c98800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:17.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.088+0000 7f8b94c98800 20 Filter name: none 2024-09-12T18:06:17.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.088+0000 7f89c17fa640 20 reqs_thread_entry: start 2024-09-12T18:06:17.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.088+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:17.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.090+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.091+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.091+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.092+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:17.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.094+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.095+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.095+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.096+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:17.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.097+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.097+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.098+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.099+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:17.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.100+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.100+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.100+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.101+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:17.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.103+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.103+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.103+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.104+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:17.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.106+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.106+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.106+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.107+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.109+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.109+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.109+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.110+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:17.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.111+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.112+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.112+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.113+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:17.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.114+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.115+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.115+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.116+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:17.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.117+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.118+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.118+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.119+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:17.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.120+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.121+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.121+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.122+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.123+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.124+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.124+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.125+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:17.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.126+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.126+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.127+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.128+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:17.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.129+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.130+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.130+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.131+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:17.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.132+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.133+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.133+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.134+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:17.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.135+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.136+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.136+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.137+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:17.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.139+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.139+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.139+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.141+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:17.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.142+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.143+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.143+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.144+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:17.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.145+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.146+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.146+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.147+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:17.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.148+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.149+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.149+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.149+0000 7f8b94c98800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.896422972976477879', time=2024-09-12T20:06:15.514026+0000, chain.objs.size()=1 2024-09-12T18:06:17.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.149+0000 7f8b94c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.72__shadow_.upheTVMKr9gdNozoDE3-H7Rv_6VXZwv_0 2024-09-12T18:06:17.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.150+0000 7f8b94c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:17.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.152+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:17.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.153+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.154+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.154+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.155+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:17.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.156+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.157+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.157+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.158+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:17.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.159+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.160+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.160+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.161+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:17.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.162+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.163+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.163+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.164+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:17.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.166+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.166+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.166+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.167+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.169+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.169+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.170+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:06:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.170+0000 7f8b94c98800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569086855569711182', time=2024-09-12T20:06:14.791552+0000, chain.objs.size()=1 2024-09-12T18:06:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.170+0000 7f8b94c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.71__shadow_.IgYswTEeYUOv3y47lj8zkaOrSPjGbED_0 2024-09-12T18:06:17.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.171+0000 7f8b94c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:06:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.174+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.175+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.175+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.176+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.177+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.178+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.178+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.179+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.180+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.181+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.182+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.182+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.183+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.184+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.184+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.185+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.185+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:17.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.187+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.187+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.188+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.189+0000 7f8b94c98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:17.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.190+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.190+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.191+0000 7f8b94c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.193+0000 7f8a48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.195+0000 7f8b94c98800 20 remove_watcher() i=0 2024-09-12T18:06:17.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.195+0000 7f8b94c98800 2 removed watcher, disabling cache 2024-09-12T18:06:17.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.196+0000 7f8b94c98800 20 remove_watcher() i=1 2024-09-12T18:06:17.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.197+0000 7f8b94c98800 20 remove_watcher() i=2 2024-09-12T18:06:17.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.198+0000 7f8b94c98800 20 remove_watcher() i=3 2024-09-12T18:06:17.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.199+0000 7f8b94c98800 20 remove_watcher() i=4 2024-09-12T18:06:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.200+0000 7f8b94c98800 20 remove_watcher() i=5 2024-09-12T18:06:17.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.201+0000 7f8b94c98800 20 remove_watcher() i=6 2024-09-12T18:06:17.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.201+0000 7f8b94c98800 20 remove_watcher() i=7 2024-09-12T18:06:17.213 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:17.264 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:17.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.302+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 realm 2024-09-12T18:06:17.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.303+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.304+0000 7f620ac0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.304+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.304+0000 7f620ac0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:17.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.304+0000 7f620ac0f800 20 searching for the correct realm 2024-09-12T18:06:17.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.307+0000 7f61fffff640 0 -- 172.21.15.94:0/950098444 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55829b2505a0 msgr2=0x55829b252a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.311+0000 7f6208700640 0 -- 172.21.15.94:0/950098444 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f61f006bb40 msgr2=0x7f61f0060ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.314+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 zone default found 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 4 Realm: () 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 zonegroup default 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.315+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.316+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.316+0000 7f620ac0f800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.316+0000 7f620ac0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.316+0000 7f620ac0f800 20 started sync module instance, tier type = 2024-09-12T18:06:17.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.316+0000 7f620ac0f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:17.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=0 2024-09-12T18:06:17.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=1 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=2 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=3 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=4 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=5 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.324+0000 7f620ac0f800 20 add_watcher() i=6 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.325+0000 7f620ac0f800 20 add_watcher() i=7 2024-09-12T18:06:17.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.325+0000 7f620ac0f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:17.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.327+0000 7f60befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.327+0000 7f620ac0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:17.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.327+0000 7f620ac0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:17.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.359+0000 7f60bdfdb640 20 reqs_thread_entry: start 2024-09-12T18:06:17.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.360+0000 7f620ac0f800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:17.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.360+0000 7f620ac0f800 20 Filter name: none 2024-09-12T18:06:17.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.360+0000 7f602f7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:17.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.360+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:17.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.361+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.362+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.362+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.363+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:17.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.365+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.365+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.366+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.367+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:17.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.368+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.368+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.369+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.370+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:17.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.371+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.372+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.372+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.373+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:17.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.374+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.375+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.375+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.376+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:17.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.377+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.378+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.378+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.379+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.380+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.380+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.381+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.382+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:17.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.383+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.383+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.384+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.384+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:17.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.386+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.386+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.386+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.387+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:17.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.389+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.389+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.389+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.391+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:17.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.392+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.393+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.393+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.394+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:17.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.396+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.396+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.397+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.399+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:17.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.400+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.400+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.401+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.401+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:17.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.403+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.403+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.404+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.404+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:17.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.406+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.406+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.406+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.407+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:17.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.409+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.409+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.409+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.410+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:17.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.412+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.412+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.413+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.414+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:17.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.415+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.415+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.416+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.416+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:17.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.418+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.418+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.419+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.420+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:17.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.421+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.421+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.422+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.423+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:17.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.424+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.424+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.425+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.425+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.427+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.427+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.427+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.428+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:17.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.430+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.431+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.431+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.432+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:17.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.434+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.434+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.434+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.435+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:17.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.437+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.437+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.438+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.439+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:17.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.440+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.440+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.441+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.441+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:17.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.442+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.443+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.443+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.444+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:17.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.447+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.447+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.448+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.449+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:17.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.450+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.451+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.451+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.452+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:17.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.453+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.453+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.454+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.455+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:17.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.456+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.456+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.457+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.458+0000 7f620ac0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:17.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.459+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.460+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.460+0000 7f620ac0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.462+0000 7f60befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.464+0000 7f620ac0f800 20 remove_watcher() i=0 2024-09-12T18:06:17.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.464+0000 7f620ac0f800 2 removed watcher, disabling cache 2024-09-12T18:06:17.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.465+0000 7f620ac0f800 20 remove_watcher() i=1 2024-09-12T18:06:17.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.466+0000 7f620ac0f800 20 remove_watcher() i=2 2024-09-12T18:06:17.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.467+0000 7f620ac0f800 20 remove_watcher() i=3 2024-09-12T18:06:17.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.468+0000 7f620ac0f800 20 remove_watcher() i=4 2024-09-12T18:06:17.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.468+0000 7f620ac0f800 20 remove_watcher() i=5 2024-09-12T18:06:17.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.469+0000 7f620ac0f800 20 remove_watcher() i=6 2024-09-12T18:06:17.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.470+0000 7f620ac0f800 20 remove_watcher() i=7 2024-09-12T18:06:17.482 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:17.534 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:17.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.570+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 realm 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.571+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.572+0000 7efc7c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.572+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.572+0000 7efc7c00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:17.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.573+0000 7efc7c00e800 20 searching for the correct realm 2024-09-12T18:06:17.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.576+0000 7efc77e5a640 0 -- 172.21.15.94:0/1298696050 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7efc6006d060 msgr2=0x7efc600a3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.579+0000 7efc77659640 0 -- 172.21.15.94:0/1298696050 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7efc600a5920 msgr2=0x7efc600db7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:17.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:17.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.583+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 zone default found 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 4 Realm: () 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:17.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 zonegroup default 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.584+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.585+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.585+0000 7efc7c00e800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.585+0000 7efc7c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.585+0000 7efc7c00e800 20 started sync module instance, tier type = 2024-09-12T18:06:17.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.585+0000 7efc7c00e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=0 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=1 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=2 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=3 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=4 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=5 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.593+0000 7efc7c00e800 20 add_watcher() i=6 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.594+0000 7efc7c00e800 20 add_watcher() i=7 2024-09-12T18:06:17.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.594+0000 7efc7c00e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:17.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.596+0000 7efb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.596+0000 7efc7c00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:17.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.596+0000 7efc7c00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.630+0000 7efb2cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.630+0000 7efc7c00e800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.630+0000 7efc7c00e800 20 Filter name: none 2024-09-12T18:06:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.630+0000 7efaa67fc640 20 reqs_thread_entry: start 2024-09-12T18:06:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.630+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.631+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.632+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.632+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.633+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.634+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.635+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.635+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.636+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:17.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.637+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.638+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.638+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.639+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:17.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.640+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.641+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.641+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.642+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:17.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.643+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.644+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.644+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.645+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:17.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.646+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.647+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.647+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.648+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:17.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.649+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.650+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.650+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.651+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.652+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.653+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.653+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.654+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:17.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.655+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.655+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.655+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.657+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.659+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.659+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.660+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.661+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.662+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.663+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.663+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.664+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:17.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.665+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.665+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.666+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.667+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.668+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.669+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.669+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.670+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.671+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.672+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.672+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.673+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:17.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.674+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.675+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.675+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.676+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:17.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.677+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.677+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.678+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.679+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.680+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.680+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.681+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.682+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.683+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.683+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.684+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.685+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:17.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.686+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.686+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.687+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.687+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:17.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.689+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.690+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.690+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.691+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:17.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.692+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.693+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.693+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.694+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:17.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.695+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.696+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.696+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.697+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:17.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.698+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.699+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.699+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.700+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:17.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.702+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.702+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.702+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.703+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:17.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.705+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.705+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.705+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.706+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:17.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.707+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.708+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.708+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.709+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.710+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.712+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.712+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.713+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:17.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.714+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.715+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.715+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.716+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:17.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.717+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.718+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.718+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.719+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:17.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.720+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.721+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.721+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.722+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:17.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.723+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.723+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.724+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.725+0000 7efc7c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:17.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.726+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.726+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.726+0000 7efc7c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.728+0000 7efb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.730+0000 7efc7c00e800 20 remove_watcher() i=0 2024-09-12T18:06:17.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.730+0000 7efc7c00e800 2 removed watcher, disabling cache 2024-09-12T18:06:17.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.731+0000 7efc7c00e800 20 remove_watcher() i=1 2024-09-12T18:06:17.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.732+0000 7efc7c00e800 20 remove_watcher() i=2 2024-09-12T18:06:17.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.733+0000 7efc7c00e800 20 remove_watcher() i=3 2024-09-12T18:06:17.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.735+0000 7efc7c00e800 20 remove_watcher() i=4 2024-09-12T18:06:17.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.735+0000 7efc7c00e800 20 remove_watcher() i=5 2024-09-12T18:06:17.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.736+0000 7efc7c00e800 20 remove_watcher() i=6 2024-09-12T18:06:17.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.737+0000 7efc7c00e800 20 remove_watcher() i=7 2024-09-12T18:06:17.750 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:06:17.802 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:17.802 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:17.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.837+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 realm 2024-09-12T18:06:17.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:17.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.839+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.840+0000 7f3e3a326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.840+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.840+0000 7f3e3a326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:17.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.840+0000 7f3e3a326800 20 searching for the correct realm 2024-09-12T18:06:17.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.844+0000 7f3e2ffff640 0 -- 172.21.15.94:0/1090328960 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f3e28097c20 msgr2=0x7f3e2808e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.847+0000 7f3e367b6640 0 -- 172.21.15.94:0/1090328960 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f3e2006da70 msgr2=0x7f3e20074170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:17.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:06:17.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.850+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 zone default found 2024-09-12T18:06:17.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 4 Realm: () 2024-09-12T18:06:17.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:06:17.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:06:17.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:17.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 zonegroup default 2024-09-12T18:06:17.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.851+0000 7f3e3a326800 20 rados->read ofs=0 len=0 2024-09-12T18:06:17.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.852+0000 7f3e3a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:17.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.852+0000 7f3e3a326800 20 started sync module instance, tier type = 2024-09-12T18:06:17.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.852+0000 7f3e3a326800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:06:17.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=0 2024-09-12T18:06:17.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=1 2024-09-12T18:06:17.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=2 2024-09-12T18:06:17.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=3 2024-09-12T18:06:17.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=4 2024-09-12T18:06:17.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=5 2024-09-12T18:06:17.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.860+0000 7f3e3a326800 20 add_watcher() i=6 2024-09-12T18:06:17.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.861+0000 7f3e3a326800 20 add_watcher() i=7 2024-09-12T18:06:17.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.861+0000 7f3e3a326800 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:17.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.863+0000 7f3ce7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:17.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.863+0000 7f3e3a326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:17.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.863+0000 7f3e3a326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:17.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.897+0000 7f3ce6ffd640 20 reqs_thread_entry: start 2024-09-12T18:06:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.897+0000 7f3e3a326800 20 init_complete bucket index max shards: 11 2024-09-12T18:06:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.897+0000 7f3e3a326800 20 Filter name: none 2024-09-12T18:06:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.897+0000 7f3ce4ff9640 20 reqs_thread_entry: start 2024-09-12T18:06:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.897+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:06:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.899+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.900+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.900+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.901+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:06:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.902+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.902+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.903+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.904+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:06:17.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.905+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.905+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.906+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.907+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:06:17.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.908+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.908+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.908+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.909+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:06:17.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.911+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.911+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.911+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.912+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:06:17.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.914+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.915+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.915+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.916+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:06:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.917+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.918+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.918+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.919+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:06:17.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.920+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.920+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.921+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.921+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:06:17.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.923+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.923+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.923+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.924+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:06:17.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.926+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.926+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.926+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.927+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:06:17.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.929+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.929+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.929+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.930+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:06:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.931+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.932+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.932+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.933+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:06:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.935+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.935+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.935+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.936+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:06:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.938+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.938+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.939+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.939+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:06:17.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.941+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.941+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.941+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.942+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:06:17.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.944+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.944+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.944+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.945+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:06:17.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.947+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.947+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.948+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.949+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:06:17.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.951+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.951+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.952+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.952+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:06:17.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.954+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.954+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.955+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.956+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:06:17.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.957+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.957+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.958+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.959+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:06:17.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.960+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.961+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.961+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.962+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:06:17.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.964+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.964+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.965+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.966+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:06:17.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.967+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.967+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.968+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.969+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:06:17.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.970+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.971+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.971+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.972+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:06:17.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.973+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.974+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.974+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.975+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:06:17.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.976+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.976+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.976+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.977+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:06:17.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.979+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.980+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.980+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.981+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:06:17.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.982+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.983+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.983+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.984+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:06:17.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.985+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.986+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.986+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.987+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:06:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.988+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.989+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.989+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.990+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:06:17.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.991+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.992+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.992+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.993+0000 7f3e3a326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:06:17.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.994+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.995+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:06:17.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.995+0000 7f3e3a326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:06:17.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.997+0000 7f3ce7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:18.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.999+0000 7f3e3a326800 20 remove_watcher() i=0 2024-09-12T18:06:18.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:17.999+0000 7f3e3a326800 2 removed watcher, disabling cache 2024-09-12T18:06:18.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.000+0000 7f3e3a326800 20 remove_watcher() i=1 2024-09-12T18:06:18.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.001+0000 7f3e3a326800 20 remove_watcher() i=2 2024-09-12T18:06:18.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.002+0000 7f3e3a326800 20 remove_watcher() i=3 2024-09-12T18:06:18.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.003+0000 7f3e3a326800 20 remove_watcher() i=4 2024-09-12T18:06:18.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.004+0000 7f3e3a326800 20 remove_watcher() i=5 2024-09-12T18:06:18.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.005+0000 7f3e3a326800 20 remove_watcher() i=6 2024-09-12T18:06:18.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:06:18.006+0000 7f3e3a326800 20 remove_watcher() i=7 2024-09-12T18:06:18.018 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T18:06:18.502 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-12T18:06:19.199 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-12T18:06:19.200 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-12T18:06:19.200 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-12T18:06:19.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:19.700 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-12T18:06:19.700 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:06:19.700 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:06:19.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:19.701 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:06:19.701 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-12T18:06:21.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12 18:06:20,982 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.701 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T18:06:21.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.900 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T18:06:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:21.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T18:06:22.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:22.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T18:06:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:22.500 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T18:06:22.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:22.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T18:06:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:24.800 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T18:06:25.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:25.200 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T18:06:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:25.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T18:06:25.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:25.599 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T18:06:25.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:25.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T18:06:26.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:26.200 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T18:06:26.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:26.200 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T18:06:26.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:26.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T18:06:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:26.400 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T18:06:26.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:26.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T18:06:28.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:28.300 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T18:06:28.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:28.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T18:06:28.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:28.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T18:06:29.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:29.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T18:06:29.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:29.201 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T18:06:29.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:29.600 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T18:06:29.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:29.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T18:06:29.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:29.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T18:06:30.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:30.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T18:06:30.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:30.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T18:06:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:30.600 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T18:06:30.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:30.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T18:06:30.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:30.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T18:06:31.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:31.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T18:06:31.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:31.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T18:06:31.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:31.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T18:06:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:34.200 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T18:06:34.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:34.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T18:06:55.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:55.800 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T18:06:56.400 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:56.400 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T18:06:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:56.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T18:06:56.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:56.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T18:06:56.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:56.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T18:06:57.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:06:57.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T18:07:08.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:08.200 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T18:07:08.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:08.600 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T18:07:08.600 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:08.600 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T18:07:08.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:08.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T18:07:20.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:20.400 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T18:07:20.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:20.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:07:24.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:24.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:07:25.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:25.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T18:07:26.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:26.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T18:07:27.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:27.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T18:07:55.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:55.900 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T18:07:56.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:56.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T18:07:58.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:58.900 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T18:07:59.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:07:59.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T18:08:01.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:01.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T18:08:02.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:02.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T18:08:04.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:04.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T18:08:12.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T18:08:12.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:12.900 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T18:08:12.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:12.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T18:08:13.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:13.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T18:08:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:13.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T18:08:13.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:13.599 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T18:08:13.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:13.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T18:08:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:13.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T18:08:14.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:14.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T18:08:14.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:14.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T18:08:14.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:14.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T18:08:14.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:14.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T18:08:15.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:15.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T18:08:15.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:15.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T18:08:15.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:15.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T18:08:15.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:15.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T18:08:16.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:16.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T18:08:16.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:16.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T18:08:17.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:17.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T18:08:17.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:17.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T18:08:17.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:17.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T18:08:17.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:17.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T18:08:18.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:18.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T18:08:18.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:18.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T18:08:19.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:19.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T18:08:19.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:19.400 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T18:08:19.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:19.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T18:08:19.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:19.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T18:08:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:20.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T18:08:20.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:20.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T18:08:21.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:21.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T18:08:21.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:21.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T18:08:21.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:21.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T18:08:22.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T18:08:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:22.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T18:08:22.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:22.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T18:08:23.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:23.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T18:08:23.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:23.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T18:08:23.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:23.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T18:08:23.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:23.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T18:08:24.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:24.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T18:08:24.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:24.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T18:08:25.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:25.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T18:08:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:25.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T18:08:25.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:25.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T18:08:25.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:25.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T18:08:26.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:26.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T18:08:26.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:26.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T18:08:27.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:27.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T18:08:27.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:27.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T18:08:27.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:27.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T18:08:27.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:28.002 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T18:08:28.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:28.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T18:08:28.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:28.599 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T18:08:29.099 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:29.099 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T18:08:29.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:29.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T18:08:29.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:29.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T18:08:29.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:29.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T18:08:30.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:30.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T18:08:30.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:30.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T18:08:30.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:30.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T18:08:30.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:30.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T18:08:31.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:31.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T18:08:31.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:31.300 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T18:08:31.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:31.599 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T18:08:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:31.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T18:08:31.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:31.999 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T18:08:32.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:32.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T18:08:32.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:32.699 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T18:08:32.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:32.700 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T18:08:32.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:32.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T18:08:32.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:32.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T18:08:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:33.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T18:08:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:33.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T18:08:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:33.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T18:08:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:34.101 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T18:08:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:34.399 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T18:08:34.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:34.499 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T18:08:34.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:34.899 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T18:08:36.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:36.799 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T18:08:37.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:37.199 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T18:08:39.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:39.299 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:39.750 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 2m 21s 2024-09-12T18:08:39.751 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-12T18:08:39.764 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:08:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:39.817 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:39.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.853+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 realm 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.855+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.856+0000 7fee91640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:39.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.856+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.856+0000 7fee91640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:39.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.856+0000 7fee91640800 20 searching for the correct realm 2024-09-12T18:08:39.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.860+0000 7fee8e930640 0 -- 172.21.15.94:0/2694158451 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fee800b0020 msgr2=0x7fee800aad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.864+0000 7fee8e930640 0 -- 172.21.15.94:0/2694158451 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fed58086bc0 msgr2=0x7fed58088ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.868+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 zone default found 2024-09-12T18:08:39.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 4 Realm: () 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 zonegroup default 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.869+0000 7fee91640800 20 rados->read ofs=0 len=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.870+0000 7fee91640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.870+0000 7fee91640800 20 started sync module instance, tier type = 2024-09-12T18:08:39.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.870+0000 7fee91640800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=0 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=1 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=2 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=3 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=4 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=5 2024-09-12T18:08:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.879+0000 7fee91640800 20 add_watcher() i=6 2024-09-12T18:08:39.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.880+0000 7fee91640800 20 add_watcher() i=7 2024-09-12T18:08:39.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.880+0000 7fee91640800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:39.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.881+0000 7fed467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.882+0000 7fee91640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:39.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.882+0000 7fee91640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.923+0000 7fed457e2640 20 reqs_thread_entry: start 2024-09-12T18:08:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.924+0000 7fee91640800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.924+0000 7fee91640800 20 Filter name: none 2024-09-12T18:08:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.924+0000 7fed3e7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:39.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.924+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:08:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.925+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.926+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:39.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.926+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:39.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.926+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7914971181074375314', time=2024-09-12T20:08:29.995167+0000, chain.objs.size()=1 2024-09-12T18:08:39.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.926+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.133__shadow_.KuBHx6dJYA4Rhi7PS6QhIkQUpwafuLT_0 2024-09-12T18:08:39.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.928+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:39.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.930+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:08:39.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.931+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6016185477212691366', time=2024-09-12T20:08:13.163279+0000, chain.objs.size()=1 2024-09-12T18:08:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.106__shadow_.TqVhPruSl4UYnpJZYs41zaKB_enNA5p_0 2024-09-12T18:08:39.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2419806931556833743', time=2024-09-12T20:08:20.856467+0000, chain.objs.size()=1 2024-09-12T18:08:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.119__shadow_.JxLFxI8eNiAnL3uQ2DldvtiDFnWYHIv_0 2024-09-12T18:08:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17090602702295837918', time=2024-09-12T20:08:20.882881+0000, chain.objs.size()=1 2024-09-12T18:08:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.119__shadow_.csn4uuhSh85NIkJfCA0BEXN1MPeV0wM_0 2024-09-12T18:08:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13536644229163298868', time=2024-09-12T20:08:22.226256+0000, chain.objs.size()=1 2024-09-12T18:08:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.932+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.121__shadow_.osaNjFMptxrJwPOYdQqsrGmDoQ9PSDN_0 2024-09-12T18:08:39.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.935+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:39.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.937+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:08:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.938+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN', time=2024-09-12T20:07:27.191535+0000, chain.objs.size()=9 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__multipart_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.7 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__shadow_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.7_1 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__multipart_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.8 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__shadow_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.8_1 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__multipart_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.9 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__shadow_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.9_1 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__multipart_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.10 2024-09-12T18:08:39.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__shadow_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.10_1 2024-09-12T18:08:39.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.939+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.101__multipart_key1.2~uETjnwwLhbV-VEZRxJaCnA_EmuvdFeN.11 2024-09-12T18:08:39.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.940+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6396836637026665554', time=2024-09-12T20:08:19.443578+0000, chain.objs.size()=1 2024-09-12T18:08:39.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.941+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.117__shadow_.IczxryLSpKSOF68g0TebnTJOmTm1Cuw_0 2024-09-12T18:08:39.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.945+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:39.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.947+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:08:39.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.949+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.949+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:39.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5239793986170864896', time=2024-09-12T20:06:34.254589+0000, chain.objs.size()=9 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.1_1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.2 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.2_1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.3 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.3_1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.4 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.4_1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.5 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16045623052553289937', time=2024-09-12T20:08:18.820119+0000, chain.objs.size()=1 2024-09-12T18:08:39.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.116__shadow_.6c1CdHLVYysLHCHnoCZNSSQF0Z_8nRj_0 2024-09-12T18:08:39.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6520431496528204683', time=2024-09-12T20:08:24.737622+0000, chain.objs.size()=1 2024-09-12T18:08:39.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.125__shadow_.hGq7Tyg2K24ELX_W_gxNpMvM_3QEUb6_0 2024-09-12T18:08:39.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6555425059361983105', time=2024-09-12T20:08:24.814400+0000, chain.objs.size()=1 2024-09-12T18:08:39.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.950+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.125__shadow_.s02ESuNl9Jo_HjcfmusRasYeOdXXx5Z_0 2024-09-12T18:08:39.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8324819215879021588', time=2024-09-12T20:08:28.083545+0000, chain.objs.size()=1 2024-09-12T18:08:39.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.130__shadow_.0WRT362h6j1hTSvmS6hMOuELcxRWJYG_0 2024-09-12T18:08:39.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11363421028489164066', time=2024-09-12T20:08:28.737223+0000, chain.objs.size()=1 2024-09-12T18:08:39.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.131__shadow_.KUwsqeTIw9jmxLSyTQVxPGcpH_I7pos_0 2024-09-12T18:08:39.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10530487235654160939', time=2024-09-12T20:08:29.969134+0000, chain.objs.size()=1 2024-09-12T18:08:39.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.133__shadow_.eI9lY6S9e5fhWkSj1iQrpvo7BLpzx1K_0 2024-09-12T18:08:39.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14585752169351949356', time=2024-09-12T20:08:32.111776+0000, chain.objs.size()=1 2024-09-12T18:08:39.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.955+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.138__shadow_._V6X1eRTyIkzwUOHfZKHPILW1fEqPFU_0 2024-09-12T18:08:39.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.958+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:39.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.961+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:08:39.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.962+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.962+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:39.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9287474336965768738', time=2024-09-12T20:06:22.065708+0000, chain.objs.size()=1 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.77__shadow_.MyIwoRP--LiF0QgeL3BITpKwoJI3RHP_0 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8997059082444431584', time=2024-09-12T20:07:41.654938+0000, chain.objs.size()=9 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.1 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.1_1 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.2 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.2_1 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.3 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.3_1 2024-09-12T18:08:39.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.4 2024-09-12T18:08:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.4_1 2024-09-12T18:08:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~FlyIsa_K6NRE8PqQd6bJZKRHe_beazi.5 2024-09-12T18:08:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq', time=2024-09-12T20:08:10.398389+0000, chain.objs.size()=50 2024-09-12T18:08:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.1 2024-09-12T18:08:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.963+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.2 2024-09-12T18:08:39.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.967+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.3 2024-09-12T18:08:39.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.967+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.4 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.967+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.5 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.967+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.6 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.967+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.7 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.968+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.8 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.968+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.9 2024-09-12T18:08:39.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.968+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.10 2024-09-12T18:08:39.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.968+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.11 2024-09-12T18:08:39.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.970+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.12 2024-09-12T18:08:39.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.970+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.13 2024-09-12T18:08:39.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.971+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.14 2024-09-12T18:08:39.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.972+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.15 2024-09-12T18:08:39.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.972+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.16 2024-09-12T18:08:39.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.972+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.17 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.972+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.18 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.973+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.19 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.973+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.20 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.973+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.21 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.973+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.22 2024-09-12T18:08:39.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.973+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.23 2024-09-12T18:08:39.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.24 2024-09-12T18:08:39.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.25 2024-09-12T18:08:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.26 2024-09-12T18:08:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.27 2024-09-12T18:08:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.28 2024-09-12T18:08:39.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.977+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.29 2024-09-12T18:08:39.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.980+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.30 2024-09-12T18:08:39.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.980+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.31 2024-09-12T18:08:39.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.980+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.32 2024-09-12T18:08:39.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.980+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.33 2024-09-12T18:08:39.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.980+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.34 2024-09-12T18:08:39.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.981+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.35 2024-09-12T18:08:39.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.982+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.36 2024-09-12T18:08:39.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.983+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.37 2024-09-12T18:08:39.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.983+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.38 2024-09-12T18:08:39.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.985+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.39 2024-09-12T18:08:39.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.985+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.40 2024-09-12T18:08:39.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.41 2024-09-12T18:08:39.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.42 2024-09-12T18:08:39.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.43 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.44 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.45 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.46 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.47 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.48 2024-09-12T18:08:39.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.986+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.49 2024-09-12T18:08:39.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.990+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.105__multipart_key1.2~OAYlbKmrn7QejD2DLGWB7NzX3qwLNqq.50 2024-09-12T18:08:39.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.991+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5834255488049707218', time=2024-09-12T20:08:29.352961+0000, chain.objs.size()=1 2024-09-12T18:08:39.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.991+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.132__shadow_.kxU0hFK1IEiVRcN5z8S9c3zuL32DplD_0 2024-09-12T18:08:39.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.991+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9037204621272802141', time=2024-09-12T20:08:31.294911+0000, chain.objs.size()=1 2024-09-12T18:08:39.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.991+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.136__shadow_.elvP4ZEt8RjMphqcb263IgjG26NRkWC_0 2024-09-12T18:08:39.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.994+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.996+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:08:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:08:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10374818771832472807', time=2024-09-12T20:06:52.766959+0000, chain.objs.size()=7 2024-09-12T18:08:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.1 2024-09-12T18:08:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.1_1 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.998+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.1_2 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.2 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.2_1 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.2_2 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~jRQmjEgdRRydMaHzdWpVjiCgFfdnjLU.3 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17463691368396603895', time=2024-09-12T20:07:08.282811+0000, chain.objs.size()=9 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__multipart_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.1 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__shadow_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.1_1 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__multipart_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.2 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__shadow_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.2_1 2024-09-12T18:08:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:39.999+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__multipart_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.3 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__shadow_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.3_1 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__multipart_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.4 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__shadow_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.4_1 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.98__multipart_key1.2~SD6z65KqY4AcID4Kfc1QFA2WOzAtL0I.5 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14200282046438663355', time=2024-09-12T20:07:55.761289+0000, chain.objs.size()=7 2024-09-12T18:08:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.1 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.1_1 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.1_2 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.2 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.2_1 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.2_2 2024-09-12T18:08:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.005+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~oSuMw5kY1gHe_c2-CQqnRVREdqT8zQW.3 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11332345144289527469', time=2024-09-12T20:08:16.062747+0000, chain.objs.size()=1 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.112__shadow_.rodkLR15_cPyaX6DM2bS2Aespd7EVlF_0 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8541806967401843399', time=2024-09-12T20:08:22.200364+0000, chain.objs.size()=1 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.121__shadow_.PIWieMONG1iljFOFKAcv18aK0lBhvOy_0 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12785306728252963390', time=2024-09-12T20:08:22.817344+0000, chain.objs.size()=1 2024-09-12T18:08:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.122__shadow_.byNBOtUmixXQa29iiiReVyz6mTm5iQ4_0 2024-09-12T18:08:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1725403728582380536', time=2024-09-12T20:08:26.091254+0000, chain.objs.size()=1 2024-09-12T18:08:40.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.010+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.127__shadow_.9NbJzoxp7l-JICNTlXQ9Ej_VHTnE19b_0 2024-09-12T18:08:40.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.012+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17368241327708745834', time=2024-09-12T20:08:26.843963+0000, chain.objs.size()=1 2024-09-12T18:08:40.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.012+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.128__shadow_.52GQU9f7lKHoAHR2Pww1qvXvJSKG48z_0 2024-09-12T18:08:40.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.015+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.017+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.019+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.019+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.019+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.019+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17244024051708378744', time=2024-09-12T20:08:16.768710+0000, chain.objs.size()=1 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.019+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113__shadow_.sTyZrDld9EzeeDNPhI3MKVBH3BBTTFZ_0 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.020+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2706110628955614972', time=2024-09-12T20:08:20.201135+0000, chain.objs.size()=1 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.020+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.118__shadow_.qalOqU92jXXQy8uVYGuuuhb0MNXvL6i_0 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.020+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6016864250565924212', time=2024-09-12T20:08:27.484450+0000, chain.objs.size()=1 2024-09-12T18:08:40.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.020+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.129__shadow_.9SM8UauztvMqi0VwPM_BKQ2CF_idjs4_0 2024-09-12T18:08:40.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.021+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.023+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:08:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.025+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.025+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14775115553090909167', time=2024-09-12T20:06:55.857156+0000, chain.objs.size()=7 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.1 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.1_1 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.1_2 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.2 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.2_1 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.2_2 2024-09-12T18:08:40.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~_RhtzvPnF1LVcI_wFcZbiB1AcOz3Vn2.3 2024-09-12T18:08:40.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1487338169917050637', time=2024-09-12T20:08:26.142083+0000, chain.objs.size()=1 2024-09-12T18:08:40.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.026+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.127__shadow_.WF3TilvXL2j4uQY5VLCx6hIGnZVAXZn_0 2024-09-12T18:08:40.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.030+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.032+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:08:40.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18034576725530780265', time=2024-09-12T20:08:17.471284+0000, chain.objs.size()=1 2024-09-12T18:08:40.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.114__shadow_.SYdfAa296Dkq56OYZlatVB-_j2JxBxU_0 2024-09-12T18:08:40.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18226979273386031878', time=2024-09-12T20:08:20.175300+0000, chain.objs.size()=1 2024-09-12T18:08:40.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.034+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.118__shadow_.o6abGrI6a9TS03MuJgQhl1m4yYOyRit_0 2024-09-12T18:08:40.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.036+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.038+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:08:40.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.039+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6165203490763610805', time=2024-09-12T20:06:34.527883+0000, chain.objs.size()=9 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.1 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.1_1 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.2 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.2_1 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.3 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.3_1 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.4 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__shadow_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.4_1 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.91__multipart_key1.2~UbQtCovxnfDvUFR5CwwaB-0_6vCq2po.5 2024-09-12T18:08:40.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8010160697744760874', time=2024-09-12T20:08:22.148816+0000, chain.objs.size()=1 2024-09-12T18:08:40.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.040+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.121__shadow_.noNgRkuyLopL5dsTrG9_gucUVZrfz2b_0 2024-09-12T18:08:40.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.046+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.048+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:08:40.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.049+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.049+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13819467015160088030', time=2024-09-12T20:08:17.419374+0000, chain.objs.size()=1 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.114__shadow_.MxTsO_pnh-Z2njzGyn5l4tXUE20Udt0_0 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9571554080747771460', time=2024-09-12T20:08:18.795193+0000, chain.objs.size()=1 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.116__shadow_.ezvPLnH5f1R8K7FZJEuQW8FoXW8_YAZ_0 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16403897689293217086', time=2024-09-12T20:08:24.080234+0000, chain.objs.size()=1 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.124__shadow_.WPoRm8AmVUG_blKvbRFx9iq9rO39uNL_0 2024-09-12T18:08:40.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14130465750137124949', time=2024-09-12T20:08:28.108904+0000, chain.objs.size()=1 2024-09-12T18:08:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.130__shadow_.lvi_S5V8dxSslocJLP9DvqxfeJ8J476_0 2024-09-12T18:08:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2418137045941982372', time=2024-09-12T20:08:29.943896+0000, chain.objs.size()=1 2024-09-12T18:08:40.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.050+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.133__shadow_.5By31w2M1urUFptGRifj505qTOL-24G_0 2024-09-12T18:08:40.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.052+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.055+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:08:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.057+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.057+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4955069367330279933', time=2024-09-12T20:07:45.371472+0000, chain.objs.size()=7 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.1 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.1_1 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.1_2 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.2 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.2_1 2024-09-12T18:08:40.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.2_2 2024-09-12T18:08:40.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.058+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~6KlSN1TeOla1UE6er3-okUw-CN8HzXm.3 2024-09-12T18:08:40.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.062+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.064+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:08:40.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.065+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:40.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18356087425833380392', time=2024-09-12T20:06:55.661914+0000, chain.objs.size()=7 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.1_1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.1_2 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.2 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.2_1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.2_2 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~3Lun8FmHQKR_xc2hkEk-aRziE-zG5-H.3 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12286730058593712127', time=2024-09-12T20:07:31.184530+0000, chain.objs.size()=9 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.1_1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.2 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.2_1 2024-09-12T18:08:40.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.066+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.3 2024-09-12T18:08:40.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.070+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.3_1 2024-09-12T18:08:40.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.070+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.4 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.4_1 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~cs_ftWX22NUUx7ZvwKH9wmtvPjbdESf.5 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8966955373847418958', time=2024-09-12T20:08:16.088741+0000, chain.objs.size()=1 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.112__shadow_.bUyT2tcAV_lq5pwxI-W_gJjoDREUaUP_0 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4253448752490394278', time=2024-09-12T20:08:25.486800+0000, chain.objs.size()=1 2024-09-12T18:08:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.072+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.126__shadow_.awvxnbiGCoXBZex0C4yRhKx5yfWhyLE_0 2024-09-12T18:08:40.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.076+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.078+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:08:40.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.079+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7019175342655220637', time=2024-09-12T20:08:18.169087+0000, chain.objs.size()=1 2024-09-12T18:08:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.115__shadow_.wkW8L8oEf_jy3mSygDQfZL6y2yEmb_c_0 2024-09-12T18:08:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7718134974651122760', time=2024-09-12T20:08:19.495329+0000, chain.objs.size()=1 2024-09-12T18:08:40.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.117__shadow_.hoRz6eJaijdO7siaF59GVJ-rylG_4HS_0 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6308627220536619611', time=2024-09-12T20:08:21.500075+0000, chain.objs.size()=1 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.120__shadow_.6oI2be4TDuiHIsnAXYdGD37tnkarVkl_0 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14392861906963801013', time=2024-09-12T20:08:25.461307+0000, chain.objs.size()=1 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.126__shadow_.MUhbgLtpd8wt-FS0s8oj8S9xjQ-T2RA_0 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9476877080093031133', time=2024-09-12T20:08:26.792061+0000, chain.objs.size()=1 2024-09-12T18:08:40.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.080+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.128__shadow_.h3OffzqsxHQGX-g-F3UTMNa3R_EysFX_0 2024-09-12T18:08:40.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.083+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.085+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:08:40.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:40.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17462644983768309250', time=2024-09-12T20:07:43.627489+0000, chain.objs.size()=9 2024-09-12T18:08:40.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.1_1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.2 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.2_1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.3 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.3_1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.4 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.4_1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~hJO520PzJvDrx5ZtGqd-DmG1F8jBz8t.5 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16697057346313634555', time=2024-09-12T20:08:18.092321+0000, chain.objs.size()=1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.087+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.115__shadow_.7gzFuGWXPq1u_KRFKufmwRtGq1OnO5e_0 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.088+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14688233944721038966', time=2024-09-12T20:08:18.143484+0000, chain.objs.size()=1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.088+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.115__shadow_._IRMDZ-44Gwb1N-Z8e4WlzjLpABtUFu_0 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.088+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17161390356002327702', time=2024-09-12T20:08:28.710907+0000, chain.objs.size()=1 2024-09-12T18:08:40.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.088+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.131__shadow_.rPwZ6szVjXEjMoJv0hRDQ3Kju1-JkGp_0 2024-09-12T18:08:40.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.093+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.095+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:08:40.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.097+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.097+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5221620686276210086', time=2024-09-12T20:06:25.910041+0000, chain.objs.size()=1 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.81__shadow_.9r4XZgyfGWL4XevsGVVxDs7xf78Xuv7_0 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16042278550380089236', time=2024-09-12T20:08:22.174845+0000, chain.objs.size()=1 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.121__shadow_.ahhVh0znyyBXCkuBIG84r6F2y3s8zuF_0 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12699268402508511294', time=2024-09-12T20:08:22.870813+0000, chain.objs.size()=1 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.122__shadow_.-FnlNCVSNoKaD0vMgxtzLtB9Jzhm1QJ_0 2024-09-12T18:08:40.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12300586081559882266', time=2024-09-12T20:08:26.167648+0000, chain.objs.size()=1 2024-09-12T18:08:40.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.127__shadow_.OAyxTNCjwo2MWsWBh4y5srfQaK3N-wb_0 2024-09-12T18:08:40.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4872817245947236096', time=2024-09-12T20:08:33.521526+0000, chain.objs.size()=1 2024-09-12T18:08:40.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.098+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.140__shadow_.6DFstN-1ne4gH2u30Z_s6xaRPSix3kf_0 2024-09-12T18:08:40.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.100+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.103+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:08:40.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.104+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.104+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5470956106127026372', time=2024-09-12T20:06:49.790682+0000, chain.objs.size()=9 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.1_1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.2 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.2_1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.3 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.3_1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.4 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.4_1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~Tds00X_M7-T1Bf86R5l_sb4wGrlLb3L.5 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4747129011593996737', time=2024-09-12T20:08:16.793988+0000, chain.objs.size()=1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113__shadow_.WPg7XCiVIHjAQD6POVqJ-pfETy0dnlJ_0 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6974536977326351277', time=2024-09-12T20:08:24.134777+0000, chain.objs.size()=1 2024-09-12T18:08:40.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.124__shadow_.bKfdGoG-iVQlVRQzCtX4_wJT12ycBHx_0 2024-09-12T18:08:40.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14860459089423766749', time=2024-09-12T20:08:36.873765+0000, chain.objs.size()=9 2024-09-12T18:08:40.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.105+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__multipart_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.1 2024-09-12T18:08:40.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__shadow_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.1_1 2024-09-12T18:08:40.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__multipart_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.2 2024-09-12T18:08:40.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__shadow_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.2_1 2024-09-12T18:08:40.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__multipart_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.3 2024-09-12T18:08:40.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__shadow_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.3_1 2024-09-12T18:08:40.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__multipart_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.4 2024-09-12T18:08:40.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__shadow_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.4_1 2024-09-12T18:08:40.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.110+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.143__multipart_key1.2~jWAexCYd8a-firTOFi9_rQ8XezFgZ4Q.5 2024-09-12T18:08:40.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.115+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.118+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:08:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.119+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7310668212903940414', time=2024-09-12T20:06:46.972630+0000, chain.objs.size()=9 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.1 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.1_1 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.2 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.2_1 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.3 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.3_1 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.4 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.4_1 2024-09-12T18:08:40.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~AlO6nt1WWMn--ynn7eNP2QrWOzDJxox.5 2024-09-12T18:08:40.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4436992693471430959', time=2024-09-12T20:08:39.427066+0000, chain.objs.size()=9 2024-09-12T18:08:40.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__multipart_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.1 2024-09-12T18:08:40.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__shadow_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.1_1 2024-09-12T18:08:40.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.120+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__multipart_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.2 2024-09-12T18:08:40.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.125+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__shadow_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.2_1 2024-09-12T18:08:40.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.125+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__multipart_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.3 2024-09-12T18:08:40.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.125+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__shadow_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.3_1 2024-09-12T18:08:40.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.125+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__multipart_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.4 2024-09-12T18:08:40.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.127+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__shadow_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.4_1 2024-09-12T18:08:40.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.127+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__multipart_key1/data/file.mpg.2~j7oyYKkUL2W1jXzmzVaF9Nbi6fsugTb.5 2024-09-12T18:08:40.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.131+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.133+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:08:40.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.134+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.134+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6998541954288993152', time=2024-09-12T20:06:43.490584+0000, chain.objs.size()=9 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.1 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.1_1 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.2 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.2_1 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.3 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.3_1 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.4 2024-09-12T18:08:40.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__shadow_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.4_1 2024-09-12T18:08:40.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.94__multipart_key1.2~YxJhmlu0pWbpPATVzHOPZi1MuSecK8B.5 2024-09-12T18:08:40.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1351562507455317992', time=2024-09-12T20:07:58.967030+0000, chain.objs.size()=9 2024-09-12T18:08:40.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__multipart_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.1 2024-09-12T18:08:40.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__shadow_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.1_1 2024-09-12T18:08:40.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.135+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__multipart_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.2 2024-09-12T18:08:40.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.138+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__shadow_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.2_1 2024-09-12T18:08:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.139+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__multipart_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.3 2024-09-12T18:08:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.139+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__shadow_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.3_1 2024-09-12T18:08:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.139+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__multipart_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.4 2024-09-12T18:08:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.139+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__shadow_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.4_1 2024-09-12T18:08:40.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.139+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__multipart_key1.2~RXyoNdK_0sfGa-LBuV6ayXR3zD0Jay2.5 2024-09-12T18:08:40.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.144+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.147+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:08:40.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.148+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1569390784212993062', time=2024-09-12T20:08:17.445066+0000, chain.objs.size()=1 2024-09-12T18:08:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.114__shadow_.tGSsUt7w1DqWs8v5Y0YQq3XBwq4-i6z_0 2024-09-12T18:08:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2671728345683298447', time=2024-09-12T20:08:19.521104+0000, chain.objs.size()=1 2024-09-12T18:08:40.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.117__shadow_.LJrdYHNwjQz8MzI_5PKUnmPD0BE-F28_0 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5771586921518885509', time=2024-09-12T20:08:20.123526+0000, chain.objs.size()=1 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.118__shadow_.IKD8ARAefqXdHRxACH51Yw_Fd1CHV4g_0 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5421885521055425969', time=2024-09-12T20:08:20.831218+0000, chain.objs.size()=1 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.119__shadow_.mEmpjpV9mMXupKpU2XQzzJdsLggFLa0_0 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17855448878711573050', time=2024-09-12T20:08:23.510035+0000, chain.objs.size()=1 2024-09-12T18:08:40.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.149+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.123__shadow_.LwYtatBHhnRxoFGLO7ibWFvzfRlchWk_0 2024-09-12T18:08:40.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.152+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.155+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:08:40.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.156+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1439943292334029688', time=2024-09-12T20:06:28.829097+0000, chain.objs.size()=1 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.84__shadow_.kzxGzsJV9buhr6N0YUqTryFGwH7d7N__0 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10577782896568752835', time=2024-09-12T20:06:29.285177+0000, chain.objs.size()=1 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.85__shadow_.RcqSU2KLBaJUl_B5Hcs16Pymqc7en2e_0 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15160038099896171063', time=2024-09-12T20:07:20.400623+0000, chain.objs.size()=9 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__multipart_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.1 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__shadow_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.1_1 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__multipart_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.2 2024-09-12T18:08:40.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__shadow_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.2_1 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__multipart_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.3 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__shadow_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.3_1 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__multipart_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.4 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__shadow_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.4_1 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.99__multipart_key1.2~B3E2KiVeN50x-YuNXx-JR00RhsvGp0w.5 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8533870026919614684', time=2024-09-12T20:08:18.845227+0000, chain.objs.size()=1 2024-09-12T18:08:40.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.157+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.116__shadow_.zx3XpevJez7a0LzpNTlFWNOuDEpzUQ4_0 2024-09-12T18:08:40.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.160+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1819440499222018461', time=2024-09-12T20:08:23.484279+0000, chain.objs.size()=1 2024-09-12T18:08:40.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.160+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.123__shadow_.makt8uZgpXkKObsWfBp07Dla_yj_-Og_0 2024-09-12T18:08:40.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.162+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8008055019862948601', time=2024-09-12T20:08:24.109267+0000, chain.objs.size()=1 2024-09-12T18:08:40.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.162+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.124__shadow_.OBSQCmY20t8kSUWZpFycYtb0gWUZ7JD_0 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16360892038493858120', time=2024-09-12T20:08:26.818773+0000, chain.objs.size()=1 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.128__shadow_.1I6isPSqRB3uYYcwY58vFnNSn47iOUv_0 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8649528210081464011', time=2024-09-12T20:08:28.762347+0000, chain.objs.size()=1 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.131__shadow_.t9DUlDHzsscpdVf8rPbm4cFLwYArZzc_0 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5770775999577776855', time=2024-09-12T20:08:39.453740+0000, chain.objs.size()=1 2024-09-12T18:08:40.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.163+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.144__shadow_.T8xWWJHRCSz-NjGzqeNdz7zZ9snDP-2_0 2024-09-12T18:08:40.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.166+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.168+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:08:40.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.169+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:40.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2904479890854855549', time=2024-09-12T20:08:16.114977+0000, chain.objs.size()=1 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.112__shadow_.pequXwMAfXOc-ZVzU-TUMoTn-BbORA6_0 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17148785692287690152', time=2024-09-12T20:08:21.525437+0000, chain.objs.size()=1 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.120__shadow_.2pdg7q76s_nKa1x0L15XnhqOhgqfOek_0 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3273992365253513949', time=2024-09-12T20:08:22.842586+0000, chain.objs.size()=1 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.122__shadow_.By485Ec2idw227BSt4rajMn6g36OpIF_0 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13888291138334784130', time=2024-09-12T20:08:24.788669+0000, chain.objs.size()=1 2024-09-12T18:08:40.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.170+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.125__shadow_.zwU05MA17gaUCIPVg4866AeRXYuQ3dL_0 2024-09-12T18:08:40.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.172+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.174+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:08:40.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.176+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.176+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.281591061341898352', time=2024-09-12T20:07:55.956474+0000, chain.objs.size()=7 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.1 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.1_1 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.1_2 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.2 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.2_1 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__shadow_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.2_2 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.102__multipart_key1.2~5KQpuHakSADtYN7Cd92t1xVUlV5fD4k.3 2024-09-12T18:08:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11204671154922272716', time=2024-09-12T20:08:16.743018+0000, chain.objs.size()=1 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113__shadow_.TEWTowo7335PxEMe7ZpYLXOi0iomMZo_0 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14397710411079361100', time=2024-09-12T20:08:21.550652+0000, chain.objs.size()=1 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.120__shadow_.PHLL0MlPyES4-szbjZiZUeSigGyrjZn_0 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4371384076412741563', time=2024-09-12T20:08:24.762341+0000, chain.objs.size()=1 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.125__shadow_.HqWfERkR3Ac1UzMN1kI_ge2JyS3Y8rD_0 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16048477654038115948', time=2024-09-12T20:08:25.435100+0000, chain.objs.size()=1 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.126__shadow_.z6WCaksdq5axesi1uFvKvu5YQvicaAq_0 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14924044537715548585', time=2024-09-12T20:08:26.115832+0000, chain.objs.size()=1 2024-09-12T18:08:40.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.177+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.127__shadow_.tSTGxRVO3ijXsXHx7uwNjiwLdLR_sez_0 2024-09-12T18:08:40.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.180+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13138563030099005853', time=2024-09-12T20:08:27.509964+0000, chain.objs.size()=1 2024-09-12T18:08:40.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.180+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.129__shadow_.qAerUYsMyzRfVTrrNmVNOdCkhCL1iTW_0 2024-09-12T18:08:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.181+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17967145853405098242', time=2024-09-12T20:08:28.134068+0000, chain.objs.size()=1 2024-09-12T18:08:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.182+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.130__shadow_.pRk06ZekhTj_XS68jB7cKdYoQPil5WT_0 2024-09-12T18:08:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.182+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4877676833312634116', time=2024-09-12T20:08:31.716672+0000, chain.objs.size()=1 2024-09-12T18:08:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.182+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.137__shadow_.MauWhAE6WM6qpnK1leseK04Pliqw0lV_0 2024-09-12T18:08:40.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.185+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.187+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:08:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='2~S6kVunsUvluG3QMFYlVviZnFNytxbfO', time=2024-09-12T20:06:24.773307+0000, chain.objs.size()=9 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__multipart_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.1 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__shadow_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.1_1 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__multipart_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.2 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__shadow_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.2_1 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__multipart_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.3 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__shadow_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.3_1 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__multipart_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.4 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__shadow_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.4_1 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.189+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.79__multipart_key1.2~S6kVunsUvluG3QMFYlVviZnFNytxbfO.5 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.190+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18042564596133752328', time=2024-09-12T20:08:18.117547+0000, chain.objs.size()=1 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.190+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.115__shadow_.BgoR_gdBcPc4TSfIdQ904y2Ib8O5vfk_0 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.190+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1915531218752573601', time=2024-09-12T20:08:19.469679+0000, chain.objs.size()=1 2024-09-12T18:08:40.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.190+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.117__shadow_.LpyeLDfT1XxZFj8AWdX0RbvP-OWmB_D_0 2024-09-12T18:08:40.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.195+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.197+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:08:40.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.198+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:40.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1336920928823390035', time=2024-09-12T20:07:58.120358+0000, chain.objs.size()=1 2024-09-12T18:08:40.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.103__shadow_.bteiSG3kFqh_813SN6vDeykM42QQoMa_0 2024-09-12T18:08:40.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4776512517259037241', time=2024-09-12T20:08:20.149888+0000, chain.objs.size()=1 2024-09-12T18:08:40.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.118__shadow_.EH-5GlTw_Q_noZ7hdLiRmBBvQUcJvt7_0 2024-09-12T18:08:40.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9772306492619871887', time=2024-09-12T20:08:22.897231+0000, chain.objs.size()=1 2024-09-12T18:08:40.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.199+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.122__shadow_.hPRHYVQQ4CMDTSuZrHNpIbs0ZttChLM_0 2024-09-12T18:08:40.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.201+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.204+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:08:40.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.205+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.205+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13152830385301977224', time=2024-09-12T20:07:24.868829+0000, chain.objs.size()=1 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_.msBveVPLVggZim_Xphlpyl52GV-I4MO_0 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14596452680922301865', time=2024-09-12T20:08:18.769076+0000, chain.objs.size()=1 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.116__shadow_.1t4W6JL4y1Cbx4cTPVVTnkS7CeAlZ_0_0 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15049185103618227554', time=2024-09-12T20:08:26.765815+0000, chain.objs.size()=1 2024-09-12T18:08:40.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.206+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.128__shadow_.ub1jmxLs7SdtZp7zlOC2f0u5vYNHQ26_0 2024-09-12T18:08:40.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.208+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.211+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:08:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.213+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.213+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:08:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5935711567809866385', time=2024-09-12T20:06:31.401687+0000, chain.objs.size()=1 2024-09-12T18:08:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.90__shadow_.pRAb9STUWqAyuB7PB92_PeNF1QX4j0U_0 2024-09-12T18:08:40.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6001120179561349273', time=2024-09-12T20:07:24.761179+0000, chain.objs.size()=9 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.1_1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.2 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.2_1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.3 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.3_1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.4 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.4_1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file.mpg.2~Qpk_GZ2x9excgLgDoRB21gpyUCLznXU.5 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12710775079306469062', time=2024-09-12T20:08:16.820265+0000, chain.objs.size()=1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113__shadow_.utTXlOBdDF_AnFEtuYGsKaiwRgmxsTD_0 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3820904167651693546', time=2024-09-12T20:08:17.496831+0000, chain.objs.size()=1 2024-09-12T18:08:40.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.214+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.114__shadow_.iXSLggGTvAXpsQQJQTNSIxBuclEe6ua_0 2024-09-12T18:08:40.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.217+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14851104403502373846', time=2024-09-12T20:08:25.408757+0000, chain.objs.size()=1 2024-09-12T18:08:40.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.217+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.126__shadow_.YXb6tjHSK9GsQGnP9YXTujmwPz6szOU_0 2024-09-12T18:08:40.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.217+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17363556456685219794', time=2024-09-12T20:08:29.327201+0000, chain.objs.size()=1 2024-09-12T18:08:40.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.217+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.132__shadow_.lXyszdQycHjcE2sgGJZhjm8RhwdL2z5_0 2024-09-12T18:08:40.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.221+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.223+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:08:40.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.224+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5691997273345139585', time=2024-09-12T20:06:56.136215+0000, chain.objs.size()=6 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_0 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_1 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_2 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_3 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_4 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93__shadow_.0CaOa2dIHd94rM1lbfB4a3SM1S0Y8S1_5 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11693177159861583617', time=2024-09-12T20:07:24.786602+0000, chain.objs.size()=1 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_.6DoLzbWoJH9ymCZsGHiiop65u5zSs6x_0 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.838679110319790056', time=2024-09-12T20:07:24.817322+0000, chain.objs.size()=9 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.1 2024-09-12T18:08:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.1_1 2024-09-12T18:08:40.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.2 2024-09-12T18:08:40.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.2_1 2024-09-12T18:08:40.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.225+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.3 2024-09-12T18:08:40.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.229+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.3_1 2024-09-12T18:08:40.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.229+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.4 2024-09-12T18:08:40.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.229+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.4_1 2024-09-12T18:08:40.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.229+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__multipart_file2.mpg.2~y_eRQqnYOSMYLG6HcA1nw-bYLxXHB8j.5 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13373574213902352157', time=2024-09-12T20:08:01.800771+0000, chain.objs.size()=9 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__multipart_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.1 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__shadow_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.1_1 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__multipart_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.2 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__shadow_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.2_1 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__multipart_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.3 2024-09-12T18:08:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__shadow_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.3_1 2024-09-12T18:08:40.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.230+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__multipart_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.4 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.235+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__shadow_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.4_1 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.235+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.104__multipart_key1.2~IIaaGQ0GSfeaHgs-1b3VepZRPOrjijs.5 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6539699008033726095', time=2024-09-12T20:08:21.474393+0000, chain.objs.size()=1 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.120__shadow_.rzcBGKcQNKSDjkvzt58UtMrv7Mmvh3a_0 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11624091632194246093', time=2024-09-12T20:08:29.378221+0000, chain.objs.size()=1 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.132__shadow_.4rj6wJHYA2U9X4qAkFzn8lQWdggoJ7V_0 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7410190414818527308', time=2024-09-12T20:08:32.197294+0000, chain.objs.size()=1 2024-09-12T18:08:40.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.236+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.138__shadow_.YRnLwuLSQzgVt6VBOgZ_ug6hcSMxZcW_0 2024-09-12T18:08:40.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.239+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.242+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:08:40.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.243+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.243+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7563772659260024606', time=2024-09-12T20:08:20.805202+0000, chain.objs.size()=1 2024-09-12T18:08:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.119__shadow_.mUdT3qBFyumc3nSFYwPdRNSv0cvYoNN_0 2024-09-12T18:08:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7652260518511339688', time=2024-09-12T20:08:23.458035+0000, chain.objs.size()=1 2024-09-12T18:08:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.123__shadow_.9WZeoHLLhr4ke3dMw8kMKz_6_2F4LCh_0 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8208952637125695882', time=2024-09-12T20:08:27.432445+0000, chain.objs.size()=1 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.129__shadow_.CrX9xXN55Cm3xK7YAugkXzUIrAhngEN_0 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3451528793976938766', time=2024-09-12T20:08:27.458347+0000, chain.objs.size()=1 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.129__shadow_.bkyofrcdNYuXaGkjrhWwW3XzxpV8Noi_0 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13853911004710421058', time=2024-09-12T20:08:33.022538+0000, chain.objs.size()=1 2024-09-12T18:08:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.244+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.139__shadow_.P1WJDQGb1nVBvpVs0vdhgCYVFRzpBep_0 2024-09-12T18:08:40.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.247+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.249+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:08:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.250+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.251+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.251+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.252+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:08:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.253+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13466344326497230321', time=2024-09-12T20:06:28.366258+0000, chain.objs.size()=3 2024-09-12T18:08:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.83__shadow_.i2ignHfENvMieEKdH8PYuF62CtKAkZS_0 2024-09-12T18:08:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.83__shadow_.i2ignHfENvMieEKdH8PYuF62CtKAkZS_1 2024-09-12T18:08:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.254+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.83__shadow_.i2ignHfENvMieEKdH8PYuF62CtKAkZS_2 2024-09-12T18:08:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.257+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.259+0000 7fee91640800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:08:40.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.260+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.260+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.261+0000 7fee91640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:40.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.261+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17391980882205381915', time=2024-09-12T20:07:24.842543+0000, chain.objs.size()=1 2024-09-12T18:08:40.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.261+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.100__shadow_.gYkqYtvOVki0p8SvxvU3Zb2N4x2NtCb_0 2024-09-12T18:08:40.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.261+0000 7fee91640800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4743748459330691525', time=2024-09-12T20:08:16.141178+0000, chain.objs.size()=1 2024-09-12T18:08:40.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.261+0000 7fee91640800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.112__shadow_.gO_Tpcrt89UyFFqcAIj2zyzRLwX6Et7_0 2024-09-12T18:08:40.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.262+0000 7fee91640800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:40.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.265+0000 7fed467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:40.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.268+0000 7fee91640800 20 remove_watcher() i=0 2024-09-12T18:08:40.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.268+0000 7fee91640800 2 removed watcher, disabling cache 2024-09-12T18:08:40.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.268+0000 7fee91640800 20 remove_watcher() i=1 2024-09-12T18:08:40.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.269+0000 7fee91640800 20 remove_watcher() i=2 2024-09-12T18:08:40.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.270+0000 7fee91640800 20 remove_watcher() i=3 2024-09-12T18:08:40.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.271+0000 7fee91640800 20 remove_watcher() i=4 2024-09-12T18:08:40.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.272+0000 7fee91640800 20 remove_watcher() i=5 2024-09-12T18:08:40.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.273+0000 7fee91640800 20 remove_watcher() i=6 2024-09-12T18:08:40.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.274+0000 7fee91640800 20 remove_watcher() i=7 2024-09-12T18:08:40.286 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-12T18:08:40.338 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:40.338 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:40.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.374+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 realm 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.375+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.376+0000 7f9c93011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.376+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.377+0000 7f9c93011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:40.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.377+0000 7f9c93011800 20 searching for the correct realm 2024-09-12T18:08:40.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.379+0000 7f9c8df21640 0 -- 172.21.15.94:0/1888373950 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f9c800c8ba0 msgr2=0x7f9c800db2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:40.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.383+0000 7f9c8e722640 0 -- 172.21.15.94:0/1888373950 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f9c84076390 msgr2=0x7f9c8407d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:40.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:40.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.588+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 zone default found 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 4 Realm: () 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:40.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 zonegroup default 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.589+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.590+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.590+0000 7f9c93011800 20 rados->read ofs=0 len=0 2024-09-12T18:08:40.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.590+0000 7f9c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:40.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.590+0000 7f9c93011800 20 started sync module instance, tier type = 2024-09-12T18:08:40.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.590+0000 7f9c93011800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=0 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=1 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=2 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=3 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=4 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=5 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=6 2024-09-12T18:08:40.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 20 add_watcher() i=7 2024-09-12T18:08:40.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.599+0000 7f9c93011800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:40.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.601+0000 7f9b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:40.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.601+0000 7f9c93011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:40.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.601+0000 7f9c93011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:40.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.635+0000 7f9abf7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:40.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.635+0000 7f9c93011800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:40.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.635+0000 7f9c93011800 20 Filter name: none 2024-09-12T18:08:40.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.635+0000 7f9abd7fa640 20 reqs_thread_entry: start 2024-09-12T18:08:40.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.635+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:08:40.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.637+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.637+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.637+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.639+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:08:40.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.640+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.640+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.640+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.642+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:08:40.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.643+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.643+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.643+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.644+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:08:40.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.646+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.646+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.646+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.647+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:08:40.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.649+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.649+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.649+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.650+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:08:40.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.652+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.652+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.653+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.654+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:08:40.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.655+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.655+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.656+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.656+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:08:40.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.658+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.658+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.659+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.660+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:08:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.661+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.661+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.662+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.662+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:08:40.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.664+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.664+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.664+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.665+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:08:40.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.666+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.667+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.667+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.668+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:08:40.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.669+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.670+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.670+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.671+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:08:40.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.672+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.673+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.673+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.674+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:08:40.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.675+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.676+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.676+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.677+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:08:40.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.678+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.678+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.679+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.680+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:08:40.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.681+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.681+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.682+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.683+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:08:40.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.684+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.684+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.684+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.685+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:08:40.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.686+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.687+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.687+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.688+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:08:40.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.689+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.690+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.690+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.691+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:08:40.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.693+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.693+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.693+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.694+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:08:40.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.696+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.696+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.696+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.697+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:08:40.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.699+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.699+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.699+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.700+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:08:40.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.702+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.702+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.703+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.704+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:08:40.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.705+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.705+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.705+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.707+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:08:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.708+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.708+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.709+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.709+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:08:40.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.711+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.711+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.711+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.712+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:08:40.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.713+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.714+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.714+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.715+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:08:40.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.716+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.717+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.717+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.718+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:08:40.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.719+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.719+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.720+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.721+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:08:40.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.722+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.722+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.722+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.723+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:08:40.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.725+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.725+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.725+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.726+0000 7f9c93011800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:08:40.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.728+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.728+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:40.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.728+0000 7f9c93011800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:40.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.730+0000 7f9b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:40.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.732+0000 7f9c93011800 20 remove_watcher() i=0 2024-09-12T18:08:40.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.732+0000 7f9c93011800 2 removed watcher, disabling cache 2024-09-12T18:08:40.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.733+0000 7f9c93011800 20 remove_watcher() i=1 2024-09-12T18:08:40.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.734+0000 7f9c93011800 20 remove_watcher() i=2 2024-09-12T18:08:40.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.735+0000 7f9c93011800 20 remove_watcher() i=3 2024-09-12T18:08:40.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.736+0000 7f9c93011800 20 remove_watcher() i=4 2024-09-12T18:08:40.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.737+0000 7f9c93011800 20 remove_watcher() i=5 2024-09-12T18:08:40.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.738+0000 7f9c93011800 20 remove_watcher() i=6 2024-09-12T18:08:40.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:40.739+0000 7f9c93011800 20 remove_watcher() i=7 2024-09-12T18:08:40.751 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T18:08:40.772 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T18:08:40.772 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T18:08:40.773 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T18:08:40.773 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:08:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T18:08:41.589 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T18:08:41.590 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T18:08:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:41.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.722+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:41.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:41.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 realm 2024-09-12T18:08:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:41.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.724+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.725+0000 7fdd60d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.725+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.725+0000 7fdd60d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.725+0000 7fdd60d2a800 20 searching for the correct realm 2024-09-12T18:08:41.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.728+0000 7fdd542ac640 0 -- 172.21.15.94:0/2835118776 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fdd4c06a020 msgr2=0x7fdd4c0c1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:41.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:41.934+0000 7fdd5caad640 0 -- 172.21.15.94:0/2835118776 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fdd4406d680 msgr2=0x7fdd4409d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:42.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:42.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:42.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:42.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:42.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:42.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:42.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:42.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.141+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 zone default found 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 4 Realm: () 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 zonegroup default 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.142+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.143+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.143+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.143+0000 7fdd60d2a800 20 started sync module instance, tier type = 2024-09-12T18:08:42.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.143+0000 7fdd60d2a800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=0 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=1 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=2 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=3 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=4 2024-09-12T18:08:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=5 2024-09-12T18:08:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.152+0000 7fdd60d2a800 20 add_watcher() i=6 2024-09-12T18:08:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.153+0000 7fdd60d2a800 20 add_watcher() i=7 2024-09-12T18:08:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.153+0000 7fdd60d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdc12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdd60d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdd60d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdd60d2a800 5 note: GC not initialized 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdc11fe3640 20 reqs_thread_entry: start 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdd60d2a800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.155+0000 7fdd60d2a800 20 Filter name: none 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdb837fe640 20 reqs_thread_entry: start 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T18:08:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.156+0000 7fdd60d2a800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdd60d2a800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdd60d2a800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdd60d2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T18:08:42.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdc33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529782 cookie 94003751225584 notifier 8949 bl.length()=384 2024-09-12T18:08:42.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdc33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:08:42.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.158+0000 7fdc33fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.161+0000 7fdd60d2a800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:08:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.161+0000 7fdd60d2a800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.161+0000 7fdd60d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T18:08:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.162+0000 7fdc33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529831 cookie 94003751235664 notifier 8949 bl.length()=225 2024-09-12T18:08:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.162+0000 7fdc33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:08:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.162+0000 7fdc33fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdd60d2a800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:08:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdd60d2a800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:08:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdd60d2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T18:08:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdc337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529776 cookie 94003751230528 notifier 8949 bl.length()=234 2024-09-12T18:08:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdc337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:08:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.164+0000 7fdc337fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:08:42.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.166+0000 7fdc12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:42.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.169+0000 7fdd60d2a800 20 remove_watcher() i=0 2024-09-12T18:08:42.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.169+0000 7fdd60d2a800 2 removed watcher, disabling cache 2024-09-12T18:08:42.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.170+0000 7fdd60d2a800 20 remove_watcher() i=1 2024-09-12T18:08:42.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.171+0000 7fdd60d2a800 20 remove_watcher() i=2 2024-09-12T18:08:42.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.172+0000 7fdd60d2a800 20 remove_watcher() i=3 2024-09-12T18:08:42.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.173+0000 7fdd60d2a800 20 remove_watcher() i=4 2024-09-12T18:08:42.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.174+0000 7fdd60d2a800 20 remove_watcher() i=5 2024-09-12T18:08:42.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.175+0000 7fdd60d2a800 20 remove_watcher() i=6 2024-09-12T18:08:42.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.176+0000 7fdd60d2a800 20 remove_watcher() i=7 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW11111111111111111", 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:42.186 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:42.187 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-12T18:08:42.188 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:42.189 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T18:08:42.189 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key QYQKEQTJGWXDSZCIYVYS --secret jWHuvXRa46hLPN8armXZfEGPINhYtHW7tf+OfsfSAmMOdv9jq8zvHw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T18:08:42.256 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:42.256 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:42.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.288+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.289+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.289+0000 7fadeff2c800 20 realm 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.289+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.290+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.290+0000 7fadeff2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.290+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.290+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.290+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.291+0000 7fadeff2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:42.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.291+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.291+0000 7fadeff2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:42.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.291+0000 7fadeff2c800 20 searching for the correct realm 2024-09-12T18:08:42.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.295+0000 7fade3fff640 0 -- 172.21.15.94:0/430779160 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55ba40ede580 msgr2=0x55ba40ee0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:42.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.298+0000 7fadebcad640 0 -- 172.21.15.94:0/430779160 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fadd4082a20 msgr2=0x7fadd40962b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.303+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 zone default found 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 4 Realm: () 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 zonegroup default 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 started sync module instance, tier type = 2024-09-12T18:08:42.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.304+0000 7fadeff2c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:42.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=0 2024-09-12T18:08:42.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=1 2024-09-12T18:08:42.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=2 2024-09-12T18:08:42.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=3 2024-09-12T18:08:42.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=4 2024-09-12T18:08:42.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=5 2024-09-12T18:08:42.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.313+0000 7fadeff2c800 20 add_watcher() i=6 2024-09-12T18:08:42.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.314+0000 7fadeff2c800 20 add_watcher() i=7 2024-09-12T18:08:42.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.314+0000 7fadeff2c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7faca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 5 note: GC not initialized 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7faca0fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 20 Filter name: none 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fac1a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.316+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS : miss 2024-09-12T18:08:42.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS info.flags=0x0 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 adding default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS to cache LRU end 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.317+0000 7fadeff2c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:08:42.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS : hit (negative entry) 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.318+0000 7fadeff2c800 10 cache get: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS : hit (negative entry) 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.319+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:08:42.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.319+0000 7fadeff2c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:42.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.319+0000 7fadeff2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:08:42.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.320+0000 7faccaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529832 cookie 94258441625312 notifier 8441 bl.length()=673 2024-09-12T18:08:42.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.320+0000 7faccaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:08:42.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.320+0000 7faccaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.322+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.322+0000 7fadeff2c800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.322+0000 7fadeff2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.323+0000 7facca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529833 cookie 94258441637328 notifier 8441 bl.length()=185 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.323+0000 7facca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:08:42.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.323+0000 7facca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:08:42.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7fadeff2c800 10 cache put: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS info.flags=0x7 2024-09-12T18:08:42.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7fadeff2c800 10 moving default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS to cache LRU end 2024-09-12T18:08:42.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7fadeff2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:QYQKEQTJGWXDSZCIYVYS, ofs0, ns] 2024-09-12T18:08:42.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7facca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529861 cookie 94258441641408 notifier 8441 bl.length()=186 2024-09-12T18:08:42.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7facca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS info.flags=0x7 2024-09-12T18:08:42.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.326+0000 7facca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QYQKEQTJGWXDSZCIYVYS to cache LRU end 2024-09-12T18:08:42.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.328+0000 7fadeff2c800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T18:08:42.329 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foo.client.0", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foo+test@test.test", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foo.client.0", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "QYQKEQTJGWXDSZCIYVYS", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "jWHuvXRa46hLPN8armXZfEGPINhYtHW7tf+OfsfSAmMOdv9jq8zvHw==", 2024-09-12T18:08:42.330 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:42.319353Z" 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:42.331 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:42.332 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW11111111111111111", 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:42.319342Z", 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.329+0000 7faca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.331+0000 7fadeff2c800 20 remove_watcher() i=0 2024-09-12T18:08:42.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.331+0000 7fadeff2c800 2 removed watcher, disabling cache 2024-09-12T18:08:42.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.333+0000 7fadeff2c800 20 remove_watcher() i=1 2024-09-12T18:08:42.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.334+0000 7fadeff2c800 20 remove_watcher() i=2 2024-09-12T18:08:42.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.335+0000 7fadeff2c800 20 remove_watcher() i=3 2024-09-12T18:08:42.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.336+0000 7fadeff2c800 20 remove_watcher() i=4 2024-09-12T18:08:42.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.337+0000 7fadeff2c800 20 remove_watcher() i=5 2024-09-12T18:08:42.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.338+0000 7fadeff2c800 20 remove_watcher() i=6 2024-09-12T18:08:42.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.339+0000 7fadeff2c800 20 remove_watcher() i=7 2024-09-12T18:08:42.350 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 2340564761 --totp-seed 2PNWXPHB73Q2HHMFCWLM7O5HLXRALFRC3URH7CMGAO475E5MHXTN6W2AC3RZ3CEU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:42.416 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:42.416 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:42.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.449+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.450+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.450+0000 7fcbaa840800 20 realm 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.450+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.451+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.451+0000 7fcbaa840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.451+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.451+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.451+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.452+0000 7fcbaa840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.452+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.452+0000 7fcbaa840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:42.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.452+0000 7fcbaa840800 20 searching for the correct realm 2024-09-12T18:08:42.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.455+0000 7fcba7b29640 0 -- 172.21.15.94:0/553654845 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fcb98060700 msgr2=0x7fcb980870c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:42.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.459+0000 7fcba832a640 0 -- 172.21.15.94:0/553654845 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fcb9c086ab0 msgr2=0x7fcb9c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:42.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:42.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:42.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:42.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:42.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.665+0000 7fcbaa840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:42.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:42.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 zone default found 2024-09-12T18:08:42.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 4 Realm: () 2024-09-12T18:08:42.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:42.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 zonegroup default 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.666+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 started sync module instance, tier type = 2024-09-12T18:08:42.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.667+0000 7fcbaa840800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:42.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=0 2024-09-12T18:08:42.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=1 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=2 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=3 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=4 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=5 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.676+0000 7fcbaa840800 20 add_watcher() i=6 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.677+0000 7fcbaa840800 20 add_watcher() i=7 2024-09-12T18:08:42.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.677+0000 7fcbaa840800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fca5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fcbaa840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fcbaa840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fcbaa840800 5 note: GC not initialized 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fca5dfdb640 20 reqs_thread_entry: start 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fcbaa840800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.679+0000 7fcbaa840800 20 Filter name: none 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fc9cf7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:08:42.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 20 rados->read ofs=0 len=0 2024-09-12T18:08:42.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T18:08:42.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T18:08:42.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:42.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:42.680+0000 7fcbaa840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:44.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fcbaa840800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:08:44.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fcbaa840800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:44.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fcbaa840800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:08:44.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fca7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94287551288448 notifier 8988 bl.length()=687 2024-09-12T18:08:44.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fca7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:08:44.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.189+0000 7fca7effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:08:44.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.192+0000 7fca5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:44.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.195+0000 7fcbaa840800 20 remove_watcher() i=0 2024-09-12T18:08:44.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.195+0000 7fcbaa840800 2 removed watcher, disabling cache 2024-09-12T18:08:44.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.196+0000 7fcbaa840800 20 remove_watcher() i=1 2024-09-12T18:08:44.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.197+0000 7fcbaa840800 20 remove_watcher() i=2 2024-09-12T18:08:44.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.198+0000 7fcbaa840800 20 remove_watcher() i=3 2024-09-12T18:08:44.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.199+0000 7fcbaa840800 20 remove_watcher() i=4 2024-09-12T18:08:44.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.201+0000 7fcbaa840800 20 remove_watcher() i=5 2024-09-12T18:08:44.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.202+0000 7fcbaa840800 20 remove_watcher() i=6 2024-09-12T18:08:44.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.203+0000 7fcbaa840800 20 remove_watcher() i=7 2024-09-12T18:08:44.216 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T18:08:44.217 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key CKAUQSHBMQDCSFNEVCCS --secret 8QD61riV6xk2P9S3OQ6KlH7ZMxDbN8XeXbLGGk3S1m2OR8ktUYl2Bg== --cluster ceph 2024-09-12T18:08:44.284 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:44.284 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:44.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.316+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.317+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.317+0000 7fbf5f087800 20 realm 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.317+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.318+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.318+0000 7fbf5f087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.318+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.318+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.318+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.319+0000 7fbf5f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:44.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.319+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.319+0000 7fbf5f087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:44.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.319+0000 7fbf5f087800 20 searching for the correct realm 2024-09-12T18:08:44.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.323+0000 7fbf5c370640 0 -- 172.21.15.94:0/425103141 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55ba5d15b120 msgr2=0x55ba5d15d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:44.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.526+0000 7fbf5cb71640 0 -- 172.21.15.94:0/425103141 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fbf5008cbb0 msgr2=0x7fbf5006b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.531+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:44.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 zone default found 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 4 Realm: () 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 zonegroup default 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.532+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 started sync module instance, tier type = 2024-09-12T18:08:44.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.533+0000 7fbf5f087800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:44.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=0 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=1 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=2 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=3 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=4 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=5 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.542+0000 7fbf5f087800 20 add_watcher() i=6 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.543+0000 7fbf5f087800 20 add_watcher() i=7 2024-09-12T18:08:44.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.543+0000 7fbf5f087800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbe12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbf5f087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbf5f087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbf5f087800 5 note: GC not initialized 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbe11fe3640 20 reqs_thread_entry: start 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbf5f087800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.545+0000 7fbf5f087800 20 Filter name: none 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbd837fe640 20 reqs_thread_entry: start 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:08:44.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T18:08:44.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T18:08:44.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache get: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS : miss 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS info.flags=0x0 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 adding default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS to cache LRU end 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache get: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS : hit (negative entry) 2024-09-12T18:08:44.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.546+0000 7fbf5f087800 10 cache get: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS : hit (negative entry) 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbf5f087800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbf5f087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbe33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94258913987792 notifier 8474 bl.length()=645 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbe33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:08:44.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.548+0000 7fbe33fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:08:44.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbf5f087800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:08:44.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbf5f087800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T18:08:44.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbe33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464454 cookie 94258914034352 notifier 8474 bl.length()=185 2024-09-12T18:08:44.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbe33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:08:44.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.551+0000 7fbe33fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:08:44.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbf5f087800 10 cache put: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS info.flags=0x7 2024-09-12T18:08:44.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbf5f087800 10 moving default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS to cache LRU end 2024-09-12T18:08:44.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbf5f087800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:CKAUQSHBMQDCSFNEVCCS, ofs0, ns] 2024-09-12T18:08:44.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbe337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464427 cookie 94258914041568 notifier 8474 bl.length()=186 2024-09-12T18:08:44.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbe337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS info.flags=0x7 2024-09-12T18:08:44.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.554+0000 7fbe337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CKAUQSHBMQDCSFNEVCCS to cache LRU end 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "bar.client.0", 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "bar+test@test.test", 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "bar.client.0", 2024-09-12T18:08:44.557 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "CKAUQSHBMQDCSFNEVCCS", 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "8QD61riV6xk2P9S3OQ6KlH7ZMxDbN8XeXbLGGk3S1m2OR8ktUYl2Bg==", 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:44.547936Z" 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:44.558 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T18:08:44.559 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:44.547925Z", 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:44.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.556+0000 7fbe12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:44.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.559+0000 7fbf5f087800 20 remove_watcher() i=0 2024-09-12T18:08:44.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.559+0000 7fbf5f087800 2 removed watcher, disabling cache 2024-09-12T18:08:44.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.560+0000 7fbf5f087800 20 remove_watcher() i=1 2024-09-12T18:08:44.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.561+0000 7fbf5f087800 20 remove_watcher() i=2 2024-09-12T18:08:44.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.563+0000 7fbf5f087800 20 remove_watcher() i=3 2024-09-12T18:08:44.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.564+0000 7fbf5f087800 20 remove_watcher() i=4 2024-09-12T18:08:44.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.564+0000 7fbf5f087800 20 remove_watcher() i=5 2024-09-12T18:08:44.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.565+0000 7fbf5f087800 20 remove_watcher() i=6 2024-09-12T18:08:44.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.566+0000 7fbf5f087800 20 remove_watcher() i=7 2024-09-12T18:08:44.578 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1692314761 --totp-seed MV747MTBXW5MXYGBJUXZ7X3DHUKRZDRADRRFHVIWMGUZESIWCDMHVIPUTLOHVNY2 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:44.644 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:44.644 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:44.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.676+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 20 realm 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.677+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.678+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.678+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.679+0000 7f6d3b62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:44.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.679+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.679+0000 7f6d3b62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:44.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.679+0000 7f6d3b62f800 20 searching for the correct realm 2024-09-12T18:08:44.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.682+0000 7f6d3718c640 0 -- 172.21.15.94:0/1382434630 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f6d2c06b020 msgr2=0x7f6d2c0db620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:44.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.686+0000 7f6d3698b640 0 -- 172.21.15.94:0/1382434630 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6d2c0b7bf0 msgr2=0x7f6d2c0d3a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.892+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 zone default found 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 4 Realm: () 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 zonegroup default 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.893+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.894+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.894+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.894+0000 7f6d3b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:44.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.894+0000 7f6d3b62f800 20 started sync module instance, tier type = 2024-09-12T18:08:44.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.894+0000 7f6d3b62f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=0 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=1 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=2 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=3 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=4 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=5 2024-09-12T18:08:44.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.903+0000 7f6d3b62f800 20 add_watcher() i=6 2024-09-12T18:08:44.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.904+0000 7f6d3b62f800 20 add_watcher() i=7 2024-09-12T18:08:44.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.904+0000 7f6d3b62f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6bed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6d3b62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6d3b62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6d3b62f800 5 note: GC not initialized 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6b67fff640 20 reqs_thread_entry: start 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6d3b62f800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:44.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.906+0000 7f6d3b62f800 20 Filter name: none 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6b65ffb640 20 reqs_thread_entry: start 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 20 rados->read ofs=0 len=0 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.907+0000 7f6d3b62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:44.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.910+0000 7f6d3b62f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:08:44.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.910+0000 7f6d3b62f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.910+0000 7f6d3b62f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:08:44.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.911+0000 7f6c1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94469207068480 notifier 8492 bl.length()=659 2024-09-12T18:08:44.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.911+0000 7f6c1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:08:44.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.911+0000 7f6c1a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:08:44.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.913+0000 7f6bed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:44.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.916+0000 7f6d3b62f800 20 remove_watcher() i=0 2024-09-12T18:08:44.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.916+0000 7f6d3b62f800 2 removed watcher, disabling cache 2024-09-12T18:08:44.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.917+0000 7f6d3b62f800 20 remove_watcher() i=1 2024-09-12T18:08:44.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.920+0000 7f6d3b62f800 20 remove_watcher() i=2 2024-09-12T18:08:44.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.922+0000 7f6d3b62f800 20 remove_watcher() i=3 2024-09-12T18:08:44.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.923+0000 7f6d3b62f800 20 remove_watcher() i=4 2024-09-12T18:08:44.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.924+0000 7f6d3b62f800 20 remove_watcher() i=5 2024-09-12T18:08:44.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.925+0000 7f6d3b62f800 20 remove_watcher() i=6 2024-09-12T18:08:44.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:44.926+0000 7f6d3b62f800 20 remove_watcher() i=7 2024-09-12T18:08:44.937 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T18:08:44.938 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key MDWAVOSJNMPGKPMPPMLO --secret R8tbKej5l2XiaMSUDoQfPs0cP/uD+qdREUQ119wEAeOwXQaTt4mFkQ== --cluster ceph 2024-09-12T18:08:45.002 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.002 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.034+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 realm 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.036+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.037+0000 7fa47ab75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.037+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.037+0000 7fa47ab75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.037+0000 7fa47ab75800 20 searching for the correct realm 2024-09-12T18:08:45.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.041+0000 7fa477e5e640 0 -- 172.21.15.94:0/1216871455 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x56400c84c390 msgr2=0x56400c84e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.044+0000 7fa47865f640 0 -- 172.21.15.94:0/1216871455 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fa468069bf0 msgr2=0x7fa46809e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:45.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:45.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.050+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 zone default found 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 4 Realm: () 2024-09-12T18:08:45.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 zonegroup default 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 started sync module instance, tier type = 2024-09-12T18:08:45.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.051+0000 7fa47ab75800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:45.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=0 2024-09-12T18:08:45.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=1 2024-09-12T18:08:45.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=2 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=3 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=4 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=5 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.060+0000 7fa47ab75800 20 add_watcher() i=6 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.061+0000 7fa47ab75800 20 add_watcher() i=7 2024-09-12T18:08:45.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.061+0000 7fa47ab75800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:45.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.062+0000 7fa32e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.062+0000 7fa47ab75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:45.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.062+0000 7fa47ab75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:45.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.062+0000 7fa47ab75800 5 note: GC not initialized 2024-09-12T18:08:45.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa32d7e2640 20 reqs_thread_entry: start 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 20 Filter name: none 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa29effd640 20 reqs_thread_entry: start 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.063+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 cache get: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO : miss 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO info.flags=0x0 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 adding default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO to cache LRU end 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 cache get: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO : hit (negative entry) 2024-09-12T18:08:45.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.064+0000 7fa47ab75800 10 cache get: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO : hit (negative entry) 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa47ab75800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa47ab75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa34f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464455 cookie 94833087949296 notifier 8510 bl.length()=719 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa34f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:08:45.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.065+0000 7fa34f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.068+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.068+0000 7fa47ab75800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.068+0000 7fa47ab75800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.069+0000 7fa34f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94833087950352 notifier 8510 bl.length()=215 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.069+0000 7fa34f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:08:45.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.069+0000 7fa34f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:08:45.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.071+0000 7fa47ab75800 10 cache put: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO info.flags=0x7 2024-09-12T18:08:45.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.071+0000 7fa47ab75800 10 moving default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO to cache LRU end 2024-09-12T18:08:45.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.071+0000 7fa47ab75800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:MDWAVOSJNMPGKPMPPMLO, ofs0, ns] 2024-09-12T18:08:45.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.072+0000 7fa34effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 94833087932656 notifier 8510 bl.length()=201 2024-09-12T18:08:45.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.072+0000 7fa34effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO info.flags=0x7 2024-09-12T18:08:45.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.072+0000 7fa34effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MDWAVOSJNMPGKPMPPMLO to cache LRU end 2024-09-12T18:08:45.074 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:45.074 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T18:08:45.074 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T18:08:45.074 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "MDWAVOSJNMPGKPMPPMLO", 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "R8tbKej5l2XiaMSUDoQfPs0cP/uD+qdREUQ119wEAeOwXQaTt4mFkQ==", 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.065363Z" 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:45.075 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.076 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:45.077 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.065348Z", 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:45.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.074+0000 7fa32e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.077+0000 7fa47ab75800 20 remove_watcher() i=0 2024-09-12T18:08:45.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.077+0000 7fa47ab75800 2 removed watcher, disabling cache 2024-09-12T18:08:45.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.078+0000 7fa47ab75800 20 remove_watcher() i=1 2024-09-12T18:08:45.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.079+0000 7fa47ab75800 20 remove_watcher() i=2 2024-09-12T18:08:45.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.080+0000 7fa47ab75800 20 remove_watcher() i=3 2024-09-12T18:08:45.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.081+0000 7fa47ab75800 20 remove_watcher() i=4 2024-09-12T18:08:45.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.082+0000 7fa47ab75800 20 remove_watcher() i=5 2024-09-12T18:08:45.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.083+0000 7fa47ab75800 20 remove_watcher() i=6 2024-09-12T18:08:45.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.083+0000 7fa47ab75800 20 remove_watcher() i=7 2024-09-12T18:08:45.095 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9704874862 --totp-seed CIRGLJNRBEKBOEBCXDXGCIXGU75Y7MCUH56CCHS7MKO6MF2HBUHL5FJZ4Z3RK3N4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:45.162 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.162 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:45.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.202+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 realm 2024-09-12T18:08:45.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.204+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.205+0000 7f57c6140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.205+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.205+0000 7f57c6140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:45.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.205+0000 7f57c6140800 20 searching for the correct realm 2024-09-12T18:08:45.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.216+0000 7f57c16bf640 0 -- 172.21.15.94:0/1074022363 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f57b407dc00 msgr2=0x7f57b404a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.227+0000 7f57c26c1640 0 -- 172.21.15.94:0/1074022363 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f57b8062900 msgr2=0x7f57b809c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:45.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:45.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:45.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:45.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:45.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:45.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.230+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 zone default found 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 4 Realm: () 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:45.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 zonegroup default 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.231+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.232+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.232+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.232+0000 7f57c6140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.232+0000 7f57c6140800 20 started sync module instance, tier type = 2024-09-12T18:08:45.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.232+0000 7f57c6140800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=0 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=1 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=2 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=3 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=4 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=5 2024-09-12T18:08:45.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=6 2024-09-12T18:08:45.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 20 add_watcher() i=7 2024-09-12T18:08:45.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.241+0000 7f57c6140800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:45.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.243+0000 7f56737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.243+0000 7f57c6140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.243+0000 7f57c6140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.243+0000 7f57c6140800 5 note: GC not initialized 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f56727fc640 20 reqs_thread_entry: start 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 20 Filter name: none 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f55e3fff640 20 reqs_thread_entry: start 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T18:08:45.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T18:08:45.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.244+0000 7f57c6140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f57c6140800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f57c6140800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f57c6140800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f56a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431752 cookie 94181478714400 notifier 9063 bl.length()=733 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f56a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:08:45.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.247+0000 7f56a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:08:45.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.249+0000 7f56737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.252+0000 7f57c6140800 20 remove_watcher() i=0 2024-09-12T18:08:45.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.252+0000 7f57c6140800 2 removed watcher, disabling cache 2024-09-12T18:08:45.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.253+0000 7f57c6140800 20 remove_watcher() i=1 2024-09-12T18:08:45.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.254+0000 7f57c6140800 20 remove_watcher() i=2 2024-09-12T18:08:45.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.255+0000 7f57c6140800 20 remove_watcher() i=3 2024-09-12T18:08:45.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.256+0000 7f57c6140800 20 remove_watcher() i=4 2024-09-12T18:08:45.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.257+0000 7f57c6140800 20 remove_watcher() i=5 2024-09-12T18:08:45.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.257+0000 7f57c6140800 20 remove_watcher() i=6 2024-09-12T18:08:45.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.258+0000 7f57c6140800 20 remove_watcher() i=7 2024-09-12T18:08:45.270 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T18:08:45.271 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ZSRBELBBYVOBLYPXUXJP --secret 5eiu2qg9o9T6ILjcIGRDlhRMPCPwFj7azbtAjwDQ/sUVwcKT6jVWww== --cluster ceph 2024-09-12T18:08:45.335 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.335 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:45.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.367+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.368+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.368+0000 7f6de7346800 20 realm 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.368+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.369+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.369+0000 7f6de7346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.369+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.369+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.369+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.370+0000 7f6de7346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.370+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.370+0000 7f6de7346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:45.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.370+0000 7f6de7346800 20 searching for the correct realm 2024-09-12T18:08:45.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.373+0000 7f6ddffff640 0 -- 172.21.15.94:0/3377681719 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f6dd8022020 msgr2=0x7f6dd80604b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.376+0000 7f6de4e37640 0 -- 172.21.15.94:0/3377681719 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6dd0043b80 msgr2=0x7f6dd000f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:45.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.582+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:45.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 zone default found 2024-09-12T18:08:45.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 4 Realm: () 2024-09-12T18:08:45.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 zonegroup default 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.583+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 started sync module instance, tier type = 2024-09-12T18:08:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.584+0000 7f6de7346800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:45.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=0 2024-09-12T18:08:45.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=1 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=2 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=3 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=4 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=5 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.593+0000 7f6de7346800 20 add_watcher() i=6 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.594+0000 7f6de7346800 20 add_watcher() i=7 2024-09-12T18:08:45.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.594+0000 7f6de7346800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.596+0000 7f6c9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.596+0000 7f6de7346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.596+0000 7f6de7346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.596+0000 7f6de7346800 5 note: GC not initialized 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.596+0000 7f6c99fe3640 20 reqs_thread_entry: start 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 Filter name: none 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6c0b7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 10 cache get: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP : miss 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.597+0000 7f6de7346800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.598+0000 7f6de7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.598+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP info.flags=0x0 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.598+0000 7f6de7346800 10 adding default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP to cache LRU end 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.598+0000 7f6de7346800 10 cache get: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP : hit (negative entry) 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.598+0000 7f6de7346800 10 cache get: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP : hit (negative entry) 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6de7346800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6de7346800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:08:45.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6cbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94246202624736 notifier 9081 bl.length()=660 2024-09-12T18:08:45.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6cbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.599+0000 7f6cbbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:08:45.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6de7346800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:08:45.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6de7346800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T18:08:45.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6cbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431673 cookie 94246202613344 notifier 9081 bl.length()=191 2024-09-12T18:08:45.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6cbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:08:45.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.602+0000 7f6cbbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:08:45.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.605+0000 7f6de7346800 10 cache put: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP info.flags=0x7 2024-09-12T18:08:45.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.605+0000 7f6de7346800 10 moving default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP to cache LRU end 2024-09-12T18:08:45.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.605+0000 7f6de7346800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZSRBELBBYVOBLYPXUXJP, ofs0, ns] 2024-09-12T18:08:45.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.606+0000 7f6cbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431725 cookie 94246202629808 notifier 9081 bl.length()=189 2024-09-12T18:08:45.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.606+0000 7f6cbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP info.flags=0x7 2024-09-12T18:08:45.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.606+0000 7f6cbbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZSRBELBBYVOBLYPXUXJP to cache LRU end 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-12T18:08:45.609 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "ZSRBELBBYVOBLYPXUXJP", 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "5eiu2qg9o9T6ILjcIGRDlhRMPCPwFj7azbtAjwDQ/sUVwcKT6jVWww==", 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.599097Z" 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.610 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:45.611 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.599085Z", 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.609+0000 7f6c9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.611+0000 7f6de7346800 20 remove_watcher() i=0 2024-09-12T18:08:45.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.611+0000 7f6de7346800 2 removed watcher, disabling cache 2024-09-12T18:08:45.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.612+0000 7f6de7346800 20 remove_watcher() i=1 2024-09-12T18:08:45.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.613+0000 7f6de7346800 20 remove_watcher() i=2 2024-09-12T18:08:45.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.614+0000 7f6de7346800 20 remove_watcher() i=3 2024-09-12T18:08:45.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.615+0000 7f6de7346800 20 remove_watcher() i=4 2024-09-12T18:08:45.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.616+0000 7f6de7346800 20 remove_watcher() i=5 2024-09-12T18:08:45.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.617+0000 7f6de7346800 20 remove_watcher() i=6 2024-09-12T18:08:45.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.618+0000 7f6de7346800 20 remove_watcher() i=7 2024-09-12T18:08:45.630 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1760558051 --totp-seed UBESITKXNFZPR6TOXMKQMSNL467UZQMYGALAUMQUEHVQCCFEXY2NQQRUDKFQSIRG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:45.696 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.696 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:45.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.729+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 20 realm 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.730+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.731+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.731+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.732+0000 7f1da4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.732+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.732+0000 7f1da4f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:45.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.732+0000 7f1da4f2a800 20 searching for the correct realm 2024-09-12T18:08:45.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.736+0000 7f1d98360640 0 -- 172.21.15.94:0/1458563490 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f1d9007d030 msgr2=0x7f1d900aae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:45.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.740+0000 7f1d98360640 0 -- 172.21.15.94:0/1458563490 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f1c6c0878f0 msgr2=0x7f1c6c089d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:45.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:45.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:45.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.744+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 zone default found 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 4 Realm: () 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:45.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 zonegroup default 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 started sync module instance, tier type = 2024-09-12T18:08:45.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.745+0000 7f1da4f2a800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:45.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=0 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=1 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=2 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=3 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=4 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=5 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.754+0000 7f1da4f2a800 20 add_watcher() i=6 2024-09-12T18:08:45.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.755+0000 7f1da4f2a800 20 add_watcher() i=7 2024-09-12T18:08:45.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.755+0000 7f1da4f2a800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:45.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1c56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 5 note: GC not initialized 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1c55fe3640 20 reqs_thread_entry: start 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 20 Filter name: none 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1bc77fe640 20 reqs_thread_entry: start 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.757+0000 7f1da4f2a800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.758+0000 7f1da4f2a800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.758+0000 7f1da4f2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:08:45.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.758+0000 7f1da4f2a800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.758+0000 7f1da4f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:45.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1da4f2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1da4f2a800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1da4f2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:08:45.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1c77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94387503229808 notifier 8558 bl.length()=674 2024-09-12T18:08:45.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1c77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.760+0000 7f1c77fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.763+0000 7f1c56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.765+0000 7f1da4f2a800 20 remove_watcher() i=0 2024-09-12T18:08:45.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.765+0000 7f1da4f2a800 2 removed watcher, disabling cache 2024-09-12T18:08:45.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.766+0000 7f1da4f2a800 20 remove_watcher() i=1 2024-09-12T18:08:45.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.767+0000 7f1da4f2a800 20 remove_watcher() i=2 2024-09-12T18:08:45.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.768+0000 7f1da4f2a800 20 remove_watcher() i=3 2024-09-12T18:08:45.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.769+0000 7f1da4f2a800 20 remove_watcher() i=4 2024-09-12T18:08:45.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.769+0000 7f1da4f2a800 20 remove_watcher() i=5 2024-09-12T18:08:45.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.770+0000 7f1da4f2a800 20 remove_watcher() i=6 2024-09-12T18:08:45.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.771+0000 7f1da4f2a800 20 remove_watcher() i=7 2024-09-12T18:08:45.783 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T18:08:45.841 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.841 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:45.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.872+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 realm 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.874+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.875+0000 7f0812525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.875+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.875+0000 7f0812525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.875+0000 7f0812525800 20 searching for the correct realm 2024-09-12T18:08:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.879+0000 7f080d932640 0 -- 172.21.15.94:0/1014832133 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55e9095f42f0 msgr2=0x55e9095f6760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.882+0000 7f080e133640 0 -- 172.21.15.94:0/1014832133 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f07f80ab040 msgr2=0x7f07f80ab930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:45.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.886+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 zone default found 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 4 Realm: () 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 zonegroup default 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.887+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.888+0000 7f0812525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.888+0000 7f0812525800 20 started sync module instance, tier type = 2024-09-12T18:08:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.888+0000 7f0812525800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=0 2024-09-12T18:08:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=1 2024-09-12T18:08:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=2 2024-09-12T18:08:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=3 2024-09-12T18:08:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=4 2024-09-12T18:08:45.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=5 2024-09-12T18:08:45.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.896+0000 7f0812525800 20 add_watcher() i=6 2024-09-12T18:08:45.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.897+0000 7f0812525800 20 add_watcher() i=7 2024-09-12T18:08:45.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.897+0000 7f0812525800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.898+0000 7f06c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.898+0000 7f0812525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.898+0000 7f0812525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.898+0000 7f0812525800 5 note: GC not initialized 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f063f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:45.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 20 Filter name: none 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f063d7fa640 20 reqs_thread_entry: start 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 20 rados->read ofs=0 len=0 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.899+0000 7f0812525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f0812525800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f0812525800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f0812525800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f06f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94459373049856 notifier 8576 bl.length()=727 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f06f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:08:45.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.901+0000 7f06f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:08:45.903 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "ZSRBELBBYVOBLYPXUXJP", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "5eiu2qg9o9T6ILjcIGRDlhRMPCPwFj7azbtAjwDQ/sUVwcKT6jVWww==", 2024-09-12T18:08:45.904 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.599097Z" 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [ 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "oidc-provider", 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "roles", 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:45.905 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "user-policy", 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [ 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "1760558051" 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-12T18:08:45.907 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:45.599085Z", 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:45.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.904+0000 7f06c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.906+0000 7f0812525800 20 remove_watcher() i=0 2024-09-12T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.906+0000 7f0812525800 2 removed watcher, disabling cache 2024-09-12T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.907+0000 7f0812525800 20 remove_watcher() i=1 2024-09-12T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.907+0000 7f0812525800 20 remove_watcher() i=2 2024-09-12T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.908+0000 7f0812525800 20 remove_watcher() i=3 2024-09-12T18:08:45.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.909+0000 7f0812525800 20 remove_watcher() i=4 2024-09-12T18:08:45.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.910+0000 7f0812525800 20 remove_watcher() i=5 2024-09-12T18:08:45.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.911+0000 7f0812525800 20 remove_watcher() i=6 2024-09-12T18:08:45.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:45.912+0000 7f0812525800 20 remove_watcher() i=7 2024-09-12T18:08:45.925 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T18:08:45.985 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:45.985 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:46.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.017+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 realm 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.019+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.020+0000 7fd824728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:46.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.020+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.020+0000 7fd824728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:46.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.020+0000 7fd824728800 20 searching for the correct realm 2024-09-12T18:08:46.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.023+0000 7fd81fc4a640 0 -- 172.21.15.94:0/3727782314 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fd810056c20 msgr2=0x7fd81007f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:46.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.026+0000 7fd82044b640 0 -- 172.21.15.94:0/3727782314 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7fd80804c8b0 msgr2=0x7fd8080767d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.233+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 zone default found 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 4 Realm: () 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 zonegroup default 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.234+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.235+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.235+0000 7fd824728800 20 started sync module instance, tier type = 2024-09-12T18:08:46.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.235+0000 7fd824728800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:46.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=0 2024-09-12T18:08:46.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=1 2024-09-12T18:08:46.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=2 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=3 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=4 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=5 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.243+0000 7fd824728800 20 add_watcher() i=6 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.244+0000 7fd824728800 20 add_watcher() i=7 2024-09-12T18:08:46.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.244+0000 7fd824728800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:46.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd6d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:46.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd824728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:46.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd824728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd824728800 5 note: GC not initialized 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd6d5fdb640 20 reqs_thread_entry: start 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd824728800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.246+0000 7fd824728800 20 Filter name: none 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd6477fe640 20 reqs_thread_entry: start 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T18:08:46.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:08:46.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.247+0000 7fd824728800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.248+0000 7fd824728800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.248+0000 7fd824728800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.248+0000 7fd824728800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.249+0000 7fd6f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431674 cookie 94265692225552 notifier 9135 bl.length()=384 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.249+0000 7fd6f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:08:46.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.249+0000 7fd6f77fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd824728800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:08:46.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd824728800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd824728800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T18:08:46.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431726 cookie 94265692233328 notifier 9135 bl.length()=225 2024-09-12T18:08:46.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:08:46.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.252+0000 7fd6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd824728800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:08:46.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd824728800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:08:46.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd824728800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T18:08:46.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431665 cookie 94265692230688 notifier 9135 bl.length()=234 2024-09-12T18:08:46.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:08:46.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.255+0000 7fd6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:08:46.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.257+0000 7fd6d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:46.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.259+0000 7fd824728800 20 remove_watcher() i=0 2024-09-12T18:08:46.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.259+0000 7fd824728800 2 removed watcher, disabling cache 2024-09-12T18:08:46.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.260+0000 7fd824728800 20 remove_watcher() i=1 2024-09-12T18:08:46.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.261+0000 7fd824728800 20 remove_watcher() i=2 2024-09-12T18:08:46.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.262+0000 7fd824728800 20 remove_watcher() i=3 2024-09-12T18:08:46.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.263+0000 7fd824728800 20 remove_watcher() i=4 2024-09-12T18:08:46.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.264+0000 7fd824728800 20 remove_watcher() i=5 2024-09-12T18:08:46.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.265+0000 7fd824728800 20 remove_watcher() i=6 2024-09-12T18:08:46.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.266+0000 7fd824728800 20 remove_watcher() i=7 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW88888888888888888", 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:46.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:46.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-12T18:08:46.278 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:46.279 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T18:08:46.279 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key XVBLOTZMTWTUYGSFNUST --secret Nl4WtmOBhweAPtHVr/JUzCcfHKItlmtcl2MxUrQ8FKNFEnO31qVtEQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T18:08:46.346 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:46.346 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:46.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.581+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.582+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.582+0000 7fab6d216800 20 realm 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.582+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.583+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.583+0000 7fab6d216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.583+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.583+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.583+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.584+0000 7fab6d216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:46.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.584+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.584+0000 7fab6d216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:46.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.584+0000 7fab6d216800 20 searching for the correct realm 2024-09-12T18:08:46.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.586+0000 7fab689e7640 0 -- 172.21.15.94:0/3413755523 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x55fc0ed4ab20 msgr2=0x7fab600113c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:46.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.791+0000 7fab691e8640 0 -- 172.21.15.94:0/3413755523 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7fab50061930 msgr2=0x7fab50055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.797+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 zone default found 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 4 Realm: () 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 zonegroup default 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 started sync module instance, tier type = 2024-09-12T18:08:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.798+0000 7fab6d216800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=0 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=1 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=2 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=3 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=4 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=5 2024-09-12T18:08:46.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.807+0000 7fab6d216800 20 add_watcher() i=6 2024-09-12T18:08:46.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.808+0000 7fab6d216800 20 add_watcher() i=7 2024-09-12T18:08:46.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.808+0000 7fab6d216800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:46.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.809+0000 7faa1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.809+0000 7fab6d216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.809+0000 7fab6d216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.809+0000 7fab6d216800 5 note: GC not initialized 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.809+0000 7faa1e7e4640 20 reqs_thread_entry: start 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 Filter name: none 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7faa177fe640 20 reqs_thread_entry: start 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T18:08:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache get: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST : miss 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST info.flags=0x0 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 adding default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST to cache LRU end 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T18:08:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.810+0000 7fab6d216800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:08:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:08:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 10 cache get: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST : hit (negative entry) 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.811+0000 7fab6d216800 10 cache get: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST : hit (negative entry) 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7fab6d216800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7fab6d216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7faa3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431675 cookie 94541070328880 notifier 8609 bl.length()=681 2024-09-12T18:08:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7faa3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:08:46.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.813+0000 7faa3ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7fab6d216800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7fab6d216800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7faa3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431753 cookie 94541070345152 notifier 8609 bl.length()=189 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7faa3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:08:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.816+0000 7faa3ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7fab6d216800 10 cache put: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST info.flags=0x7 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7fab6d216800 10 moving default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST to cache LRU end 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7fab6d216800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:XVBLOTZMTWTUYGSFNUST, ofs0, ns] 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7faa3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431754 cookie 94541070349040 notifier 8609 bl.length()=188 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7faa3f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST info.flags=0x7 2024-09-12T18:08:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.819+0000 7faa3f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XVBLOTZMTWTUYGSFNUST to cache LRU end 2024-09-12T18:08:46.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.822+0000 7fab6d216800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T18:08:46.823 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:46.823 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root1.client.0", 2024-09-12T18:08:46.823 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T18:08:46.823 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root1+test@test.test", 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root1.client.0", 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "XVBLOTZMTWTUYGSFNUST", 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "Nl4WtmOBhweAPtHVr/JUzCcfHKItlmtcl2MxUrQ8FKNFEnO31qVtEQ==", 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:46.812567Z" 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:46.825 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW88888888888888888", 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:46.812556Z", 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:46.826 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:46.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.823+0000 7faa1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:46.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.825+0000 7fab6d216800 20 remove_watcher() i=0 2024-09-12T18:08:46.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.825+0000 7fab6d216800 2 removed watcher, disabling cache 2024-09-12T18:08:46.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.826+0000 7fab6d216800 20 remove_watcher() i=1 2024-09-12T18:08:46.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.828+0000 7fab6d216800 20 remove_watcher() i=2 2024-09-12T18:08:46.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.829+0000 7fab6d216800 20 remove_watcher() i=3 2024-09-12T18:08:46.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.829+0000 7fab6d216800 20 remove_watcher() i=4 2024-09-12T18:08:46.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.830+0000 7fab6d216800 20 remove_watcher() i=5 2024-09-12T18:08:46.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.832+0000 7fab6d216800 20 remove_watcher() i=6 2024-09-12T18:08:46.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.833+0000 7fab6d216800 20 remove_watcher() i=7 2024-09-12T18:08:46.844 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2322944698 --totp-seed C5HKCLANDHA7HMAB6V262OVUMAIJJ2BERV6BHRX6JPXOEU2YDLV34HCBSB4E2O3A --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:46.912 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:46.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.947+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 realm 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:46.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:46.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.949+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.950+0000 7f5d37d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:46.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.950+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:46.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.950+0000 7f5d37d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:46.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.950+0000 7f5d37d42800 20 searching for the correct realm 2024-09-12T18:08:46.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:46.952+0000 7f5d33a8d640 0 -- 172.21.15.94:0/3857526804 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f5d2c011bd0 msgr2=0x7f5d2c0213f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:47.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.157+0000 7f5d3428e640 0 -- 172.21.15.94:0/3857526804 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f5d1c0854c0 msgr2=0x7f5d1c0636b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.162+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 zone default found 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 4 Realm: () 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 zonegroup default 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.163+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.164+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.164+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.164+0000 7f5d37d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.164+0000 7f5d37d42800 20 started sync module instance, tier type = 2024-09-12T18:08:47.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.164+0000 7f5d37d42800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=0 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=1 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=2 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=3 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=4 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=5 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=6 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 20 add_watcher() i=7 2024-09-12T18:08:47.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.173+0000 7f5d37d42800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5bea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5d37d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5d37d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5d37d42800 5 note: GC not initialized 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5be97e2640 20 reqs_thread_entry: start 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5d37d42800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.175+0000 7f5d37d42800 20 Filter name: none 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5be27fc640 20 reqs_thread_entry: start 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:08:47.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:08:47.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T18:08:47.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:47.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.176+0000 7f5d37d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:47.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.178+0000 7f5d37d42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:08:47.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.178+0000 7f5d37d42800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:47.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.178+0000 7f5d37d42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:08:47.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.179+0000 7f5c12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431676 cookie 94837647250432 notifier 9171 bl.length()=695 2024-09-12T18:08:47.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.179+0000 7f5c12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:08:47.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.179+0000 7f5c12ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:08:47.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.181+0000 7f5bea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.184+0000 7f5d37d42800 20 remove_watcher() i=0 2024-09-12T18:08:47.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.184+0000 7f5d37d42800 2 removed watcher, disabling cache 2024-09-12T18:08:47.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.185+0000 7f5d37d42800 20 remove_watcher() i=1 2024-09-12T18:08:47.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.186+0000 7f5d37d42800 20 remove_watcher() i=2 2024-09-12T18:08:47.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.187+0000 7f5d37d42800 20 remove_watcher() i=3 2024-09-12T18:08:47.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.188+0000 7f5d37d42800 20 remove_watcher() i=4 2024-09-12T18:08:47.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.189+0000 7f5d37d42800 20 remove_watcher() i=5 2024-09-12T18:08:47.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.190+0000 7f5d37d42800 20 remove_watcher() i=6 2024-09-12T18:08:47.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.191+0000 7f5d37d42800 20 remove_watcher() i=7 2024-09-12T18:08:47.202 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T18:08:47.263 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:47.263 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:47.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.295+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 realm 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.296+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.298+0000 7f18eb015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.298+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.298+0000 7f18eb015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:47.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.298+0000 7f18eb015800 20 searching for the correct realm 2024-09-12T18:08:47.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.301+0000 7f18e6f93640 0 -- 172.21.15.94:0/2544832803 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x557745741b40 msgr2=0x557745743fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.305+0000 7f18ddf91640 0 -- 172.21.15.94:0/2544832803 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f18d800be10 msgr2=0x7f18d805d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:47.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.308+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 zone default found 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 4 Realm: () 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:47.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 zonegroup default 2024-09-12T18:08:47.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.309+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.310+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.310+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.310+0000 7f18eb015800 20 started sync module instance, tier type = 2024-09-12T18:08:47.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.310+0000 7f18eb015800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=0 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=1 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=2 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=3 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=4 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=5 2024-09-12T18:08:47.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.318+0000 7f18eb015800 20 add_watcher() i=6 2024-09-12T18:08:47.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.319+0000 7f18eb015800 20 add_watcher() i=7 2024-09-12T18:08:47.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.319+0000 7f18eb015800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.320+0000 7f179cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.320+0000 7f18eb015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.320+0000 7f18eb015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 5 note: GC not initialized 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f17177fe640 20 reqs_thread_entry: start 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:47.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 Filter name: none 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f17157fa640 20 reqs_thread_entry: start 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.321+0000 7f18eb015800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.322+0000 7f18eb015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.322+0000 7f18eb015800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.322+0000 7f18eb015800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.322+0000 7f18eb015800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f18eb015800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:08:47.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f18eb015800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f18eb015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T18:08:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f17c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431677 cookie 93970754758960 notifier 9189 bl.length()=384 2024-09-12T18:08:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f17c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:08:47.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.323+0000 7f17c9ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f18eb015800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:08:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f18eb015800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f18eb015800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T18:08:47.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f17c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431727 cookie 93970754766480 notifier 9189 bl.length()=225 2024-09-12T18:08:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f17c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:08:47.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.326+0000 7f17c97fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f18eb015800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:08:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f18eb015800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:08:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f18eb015800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T18:08:47.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f17c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431666 cookie 93970754763840 notifier 9189 bl.length()=234 2024-09-12T18:08:47.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f17c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:08:47.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.329+0000 7f17c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:08:47.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.331+0000 7f179cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.333+0000 7f18eb015800 20 remove_watcher() i=0 2024-09-12T18:08:47.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.333+0000 7f18eb015800 2 removed watcher, disabling cache 2024-09-12T18:08:47.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.334+0000 7f18eb015800 20 remove_watcher() i=1 2024-09-12T18:08:47.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.335+0000 7f18eb015800 20 remove_watcher() i=2 2024-09-12T18:08:47.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.336+0000 7f18eb015800 20 remove_watcher() i=3 2024-09-12T18:08:47.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.337+0000 7f18eb015800 20 remove_watcher() i=4 2024-09-12T18:08:47.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.338+0000 7f18eb015800 20 remove_watcher() i=5 2024-09-12T18:08:47.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.339+0000 7f18eb015800 20 remove_watcher() i=6 2024-09-12T18:08:47.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.340+0000 7f18eb015800 20 remove_watcher() i=7 2024-09-12T18:08:47.349 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:47.349 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW99999999999999999", 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:47.350 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-12T18:08:47.351 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:47.352 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T18:08:47.352 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key TSMSKNJHMVEIIUSRNDCH --secret I0zWlPZ0dKWnlEqmVF++C7AL8XH3c7n70xhl2Ek9xzXJiYxrZUf5mQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T18:08:47.420 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:47.420 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:47.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.452+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 realm 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.454+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.455+0000 7f70ff53c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.455+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.456+0000 7f70ff53c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:47.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.456+0000 7f70ff53c800 20 searching for the correct realm 2024-09-12T18:08:47.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.459+0000 7f70f2a80640 0 -- 172.21.15.94:0/3235105659 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f70ec088040 msgr2=0x7f70ec067290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.462+0000 7f70fba82640 0 -- 172.21.15.94:0/3235105659 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f70e401efd0 msgr2=0x7f70e4066a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.466+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 zone default found 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 4 Realm: () 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 zonegroup default 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 started sync module instance, tier type = 2024-09-12T18:08:47.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.467+0000 7f70ff53c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=0 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=1 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=2 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=3 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=4 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=5 2024-09-12T18:08:47.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.476+0000 7f70ff53c800 20 add_watcher() i=6 2024-09-12T18:08:47.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.477+0000 7f70ff53c800 20 add_watcher() i=7 2024-09-12T18:08:47.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.477+0000 7f70ff53c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.478+0000 7f6fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.478+0000 7f70ff53c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.478+0000 7f70ff53c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.478+0000 7f70ff53c800 5 note: GC not initialized 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.478+0000 7f6fb0fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 Filter name: none 2024-09-12T18:08:47.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f6f2a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T18:08:47.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH : miss 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.479+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH info.flags=0x0 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 adding default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH to cache LRU end 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH : hit (negative entry) 2024-09-12T18:08:47.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.480+0000 7f70ff53c800 10 cache get: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH : hit (negative entry) 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f70ff53c800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f70ff53c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f6fdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431678 cookie 94141464879008 notifier 9204 bl.length()=681 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f6fdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:08:47.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.482+0000 7f6fdeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:08:47.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f70ff53c800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:08:47.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f70ff53c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T18:08:47.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f6fde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431755 cookie 94141464897824 notifier 9204 bl.length()=189 2024-09-12T18:08:47.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f6fde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:08:47.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.485+0000 7f6fde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f70ff53c800 10 cache put: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH info.flags=0x7 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f70ff53c800 10 moving default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH to cache LRU end 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f70ff53c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:TSMSKNJHMVEIIUSRNDCH, ofs0, ns] 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f6fde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431756 cookie 94141464900160 notifier 9204 bl.length()=188 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f6fde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH info.flags=0x7 2024-09-12T18:08:47.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.488+0000 7f6fde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TSMSKNJHMVEIIUSRNDCH to cache LRU end 2024-09-12T18:08:47.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.490+0000 7f70ff53c800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T18:08:47.491 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:08:47.491 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root2.client.0", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root2+test@test.test", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root2.client.0", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "TSMSKNJHMVEIIUSRNDCH", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "I0zWlPZ0dKWnlEqmVF++C7AL8XH3c7n70xhl2Ek9xzXJiYxrZUf5mQ==", 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:47.481562Z" 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-12T18:08:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-12T18:08:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW99999999999999999", 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-12T18:08:47.481551Z", 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:08:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:08:47.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.491+0000 7f6fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.493+0000 7f70ff53c800 20 remove_watcher() i=0 2024-09-12T18:08:47.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.493+0000 7f70ff53c800 2 removed watcher, disabling cache 2024-09-12T18:08:47.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.494+0000 7f70ff53c800 20 remove_watcher() i=1 2024-09-12T18:08:47.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.495+0000 7f70ff53c800 20 remove_watcher() i=2 2024-09-12T18:08:47.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.496+0000 7f70ff53c800 20 remove_watcher() i=3 2024-09-12T18:08:47.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.497+0000 7f70ff53c800 20 remove_watcher() i=4 2024-09-12T18:08:47.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.498+0000 7f70ff53c800 20 remove_watcher() i=5 2024-09-12T18:08:47.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.499+0000 7f70ff53c800 20 remove_watcher() i=6 2024-09-12T18:08:47.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.500+0000 7f70ff53c800 20 remove_watcher() i=7 2024-09-12T18:08:47.511 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 7265026004 --totp-seed C7ZXCJT3NF5CYA27MSOTXHZ7TPC2JNKJM53IZ4ROFEDW7I7X5DQP5CDUNJIKSVOS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:08:47.578 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:47.578 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:47.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.610+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 realm 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:47.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.612+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.613+0000 7f9f28f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.613+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.613+0000 7f9f28f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:47.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.613+0000 7f9f28f2e800 20 searching for the correct realm 2024-09-12T18:08:47.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.616+0000 7f9f25365640 0 -- 172.21.15.94:0/2950230027 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f9f18008920 msgr2=0x7f9f1800a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:47.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.620+0000 7f9f24b64640 0 -- 172.21.15.94:0/2950230027 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f9f18048910 msgr2=0x7f9f180383e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.825+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 zone default found 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 4 Realm: () 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 zonegroup default 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.826+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:47.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 started sync module instance, tier type = 2024-09-12T18:08:47.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.827+0000 7f9f28f2e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:08:47.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=0 2024-09-12T18:08:47.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=1 2024-09-12T18:08:47.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=2 2024-09-12T18:08:47.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=3 2024-09-12T18:08:47.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=4 2024-09-12T18:08:47.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=5 2024-09-12T18:08:47.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.837+0000 7f9f28f2e800 20 add_watcher() i=6 2024-09-12T18:08:47.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.838+0000 7f9f28f2e800 20 add_watcher() i=7 2024-09-12T18:08:47.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.838+0000 7f9f28f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9ddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9f28f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9f28f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9f28f2e800 5 note: GC not initialized 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9dda7e4640 20 reqs_thread_entry: start 2024-09-12T18:08:47.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9f28f2e800 20 init_complete bucket index max shards: 11 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9f28f2e800 20 Filter name: none 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.840+0000 7f9dd3fff640 20 reqs_thread_entry: start 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 20 rados->read ofs=0 len=0 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.841+0000 7f9f28f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.843+0000 7f9f28f2e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.843+0000 7f9f28f2e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.843+0000 7f9f28f2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.844+0000 7f9dfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431679 cookie 94344160141440 notifier 8681 bl.length()=695 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.844+0000 7f9dfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:08:47.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.844+0000 7f9dfbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:08:47.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.847+0000 7f9ddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.849+0000 7f9f28f2e800 20 remove_watcher() i=0 2024-09-12T18:08:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.849+0000 7f9f28f2e800 2 removed watcher, disabling cache 2024-09-12T18:08:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.850+0000 7f9f28f2e800 20 remove_watcher() i=1 2024-09-12T18:08:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.851+0000 7f9f28f2e800 20 remove_watcher() i=2 2024-09-12T18:08:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.852+0000 7f9f28f2e800 20 remove_watcher() i=3 2024-09-12T18:08:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.853+0000 7f9f28f2e800 20 remove_watcher() i=4 2024-09-12T18:08:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.855+0000 7f9f28f2e800 20 remove_watcher() i=5 2024-09-12T18:08:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.857+0000 7f9f28f2e800 20 remove_watcher() i=6 2024-09-12T18:08:47.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:08:47.858+0000 7f9f28f2e800 20 remove_watcher() i=7 2024-09-12T18:08:47.869 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T18:08:47.870 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T18:08:47.870 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T18:08:47.899 INFO:tasks.s3tests:Configuring boto... 2024-09-12T18:08:47.899 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T18:08:47.899 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:08:47.968 DEBUG:teuthology.orchestra.run.smithi094:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:08:48.149 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T18:08:48.329 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T18:08:48.594 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:10:42.911 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T18:10:44.305 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=31eb8d4b3c5d838a95a15c456f840547631a9b8e5df7a3c554f356894d994967,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T18:10:44.305 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='1744699497' 2024-09-12T18:10:44.305 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-12T18:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T18:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-12T18:10:46.179 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T18:10:46.180 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:10:46.569 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T18:10:46.880 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T18:10:47.251 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T18:10:47.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T18:10:47.924 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T18:10:48.266 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T18:10:48.689 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T18:10:48.989 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T18:10:49.111 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T18:10:49.231 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T18:10:49.531 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T18:10:49.839 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T18:10:50.149 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T18:10:50.466 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T18:10:50.588 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T18:10:50.709 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T18:10:50.783 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T18:10:50.857 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T18:10:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T18:10:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T18:10:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T18:10:51.157 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T18:10:51.232 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.531 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.605 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.681 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T18:10:51.756 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T18:10:51.832 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:10:51.908 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:10:51.983 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:10:52.058 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:10:52.132 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:10:52.208 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:10:52.282 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T18:10:52.357 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.432 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.510 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.587 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.661 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.735 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.813 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:10:52.886 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T18:10:52.961 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.036 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.115 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.268 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.344 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.419 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T18:10:53.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T18:10:54.070 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T18:10:57.651 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T18:11:01.627 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T18:11:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T18:11:12.139 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T18:11:14.392 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T18:11:17.312 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T18:11:18.096 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T18:11:18.349 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T18:11:18.741 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T18:11:19.144 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T18:11:19.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T18:11:20.227 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T18:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T18:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T18:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T18:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T18:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T18:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T18:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T18:11:20.505 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T18:11:20.505 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T18:11:20.506 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T18:11:20.507 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T18:11:20.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T18:11:20.600 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T18:11:21.188 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T18:11:29.460 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T18:11:29.882 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T18:11:30.391 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T18:11:30.887 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T18:11:31.386 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T18:11:31.880 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T18:11:32.259 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T18:11:32.791 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T18:11:33.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T18:11:33.718 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T18:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T18:11:34.477 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T18:11:34.839 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T18:11:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T18:11:35.394 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T18:11:35.875 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T18:11:36.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T18:11:36.763 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T18:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T18:11:37.519 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T18:11:37.894 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T18:11:38.270 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T18:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T18:11:38.984 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T18:11:39.128 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T18:11:39.295 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T18:11:39.425 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T18:11:39.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T18:11:39.689 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T18:11:40.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T18:11:40.195 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:11:40.369 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T18:11:40.701 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T18:11:41.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:11:41.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T18:11:41.795 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:11:42.251 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:11:42.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T18:11:42.791 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T18:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T18:11:43.721 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:11:44.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:11:44.752 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:11:45.309 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:47.135 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:48.313 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:48.996 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:49.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:11:50.265 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T18:11:50.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T18:11:51.289 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T18:11:52.506 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T18:11:53.222 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T18:11:54.152 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T18:11:56.213 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T18:11:59.024 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T18:12:00.533 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T18:12:01.870 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T18:12:02.823 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T18:12:03.370 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T18:12:04.551 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T18:12:05.328 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T18:12:06.439 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T18:12:07.149 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T18:12:08.680 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T18:12:09.794 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T18:12:11.463 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T18:12:13.105 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T18:12:14.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T18:12:15.150 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T18:12:15.889 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T18:12:17.950 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T18:12:19.409 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T18:12:21.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T18:12:22.670 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T18:12:24.120 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T18:12:25.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T18:12:26.776 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T18:12:27.532 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T18:12:28.427 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T18:12:30.290 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T18:12:32.766 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T18:12:33.685 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T18:12:35.216 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T18:12:36.740 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T18:12:38.126 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:12:39.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:12:41.099 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T18:12:42.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T18:12:43.850 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T18:12:44.766 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T18:12:45.466 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:12:46.151 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:12:46.892 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:12:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:12:49.588 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:12:50.996 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:12:52.300 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:12:53.682 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:12:55.048 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:12:56.362 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:12:57.734 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:12:59.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:13:00.432 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:13:01.793 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:13:03.173 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:13:03.990 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:13:04.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:13:05.575 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:13:06.368 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:13:06.875 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:13:07.619 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:13:08.250 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:13:08.895 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:13:09.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:13:10.163 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:13:10.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:13:11.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:13:12.025 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:13:12.921 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:13:13.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:13:14.326 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:13:14.858 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:13:15.466 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:13:16.065 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:13:16.960 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:13:17.857 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:13:18.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:13:19.096 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:13:19.719 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:13:20.326 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:13:20.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:13:21.528 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:13:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:13:22.775 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:13:23.382 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:13:23.989 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:13:24.591 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:13:25.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:13:25.759 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:13:26.319 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:13:26.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:13:27.527 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:13:28.137 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:14:15.485 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:14:16.047 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:14:16.613 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:14:17.172 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:14:17.739 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:14:18.903 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:14:19.474 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:14:20.054 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:14:20.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:14:21.188 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:14:22.961 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:14:23.579 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:14:24.185 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:14:24.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:14:26.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:14:26.670 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:14:27.276 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:14:27.885 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:14:28.489 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:14:29.169 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:14:29.848 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:14:31.094 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:14:32.302 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:14:32.467 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:14:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:14:34.894 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:14:36.770 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:14:37.372 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:14:37.979 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:14:38.593 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:14:39.211 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:14:39.937 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:14:41.217 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:14:41.821 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:14:42.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:14:43.013 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:14:43.609 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:14:44.244 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:14:45.108 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:14:46.200 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:14:46.620 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:14:47.044 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:14:47.421 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:14:47.977 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:14:48.259 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:14:48.768 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:14:50.327 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:14:50.472 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:14:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:14:51.308 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:14:51.729 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:14:53.946 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:14:54.715 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:14:55.463 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:15:43.140 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:16:31.303 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:16:31.781 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:16:32.237 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:16:32.762 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:16:33.246 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:16:33.858 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:16:34.348 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:16:34.834 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:16:35.399 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:16:35.933 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:16:36.457 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:16:37.035 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:16:37.625 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:16:38.151 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:16:38.535 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:16:38.992 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:16:39.446 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:16:40.161 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:16:40.649 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:16:41.109 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:16:41.605 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:16:42.092 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:16:42.637 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:16:43.021 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:16:43.411 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:16:43.800 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:16:44.176 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:16:44.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:16:44.942 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:16:45.485 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:16:45.876 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:16:46.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:16:46.634 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:16:47.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:16:47.644 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:16:48.028 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:16:48.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:16:48.800 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:16:49.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:16:49.604 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:16:49.998 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:16:50.388 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:16:51.727 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:16:52.114 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:16:52.642 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:16:53.169 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:16:53.699 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:16:54.227 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:16:54.763 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:16:56.284 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:16:56.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:16:57.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:16:57.981 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:16:58.642 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:16:59.274 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:16:59.815 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:17:00.452 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:17:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:17:01.651 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:17:02.314 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:17:02.787 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:17:03.161 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:17:03.537 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:17:04.030 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:17:04.425 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:17:04.567 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:17:05.213 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:17:05.705 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:17:06.186 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:17:09.126 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:17:09.610 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:17:10.140 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:17:10.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:17:11.114 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:17:11.543 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:17:12.034 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:17:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:17:13.042 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:17:13.511 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:17:14.017 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:17:14.486 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:17:14.960 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:17:15.477 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:17:15.936 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:17:16.424 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:17:16.912 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:17:17.386 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:17:17.528 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:17:17.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:17:17.848 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:17:18.209 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:17:18.569 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:17:18.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:17:19.290 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:17:19.723 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:17:19.867 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:17:20.019 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:17:20.404 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:17:20.585 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:17:20.726 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:17:20.867 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:17:21.010 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:17:21.435 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:17:21.866 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:17:22.255 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:17:22.675 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:17:23.094 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:17:23.517 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:17:23.932 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:17:24.439 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:17:24.853 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:17:25.269 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:17:25.817 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:17:26.343 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:17:26.959 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:17:27.486 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:17:28.014 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:17:28.632 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:17:29.216 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:17:29.827 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:17:30.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:17:30.807 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:17:31.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:17:32.040 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:17:32.653 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:17:33.274 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:17:33.926 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:17:34.613 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:17:35.187 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:17:35.764 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:17:36.406 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:17:36.976 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:17:37.423 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:17:37.948 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:17:38.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:17:38.974 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:17:39.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:17:40.021 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:17:40.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:17:41.671 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:17:42.483 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:17:43.298 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:17:44.110 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:17:44.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:17:45.783 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:17:46.605 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:17:47.430 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:17:48.278 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:17:49.131 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:17:49.967 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:17:51.425 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:17:52.795 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:17:52.927 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:17:53.063 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:17:53.205 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:17:53.612 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:17:54.010 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:17:54.371 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:17:54.740 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:17:55.394 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:17:57.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:17:58.178 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:17:58.812 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:18:01.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:18:02.024 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:18:02.650 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:18:03.238 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:18:03.820 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:18:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:18:05.481 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:18:06.180 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:18:06.867 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:18:08.114 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:18:09.273 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:18:09.657 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:18:10.051 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:18:12.108 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:18:12.830 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:18:21.235 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:18:21.683 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:18:22.296 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:18:24.414 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:18:25.002 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:18:26.129 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:18:32.723 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:18:40.185 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:18:52.800 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:19:46.138 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:19:54.288 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:20:05.989 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:20:06.899 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:20:10.113 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:20:13.255 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:20:15.071 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:20:15.598 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:20:18.657 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:20:19.311 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:20:19.855 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:20:20.391 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T18:20:37.484 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T18:20:40.289 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T18:20:40.887 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T18:20:41.302 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T18:20:41.891 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T18:20:45.839 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T18:20:49.344 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T18:20:52.786 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T18:20:53.312 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T18:20:53.834 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T18:20:54.391 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T18:20:54.902 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T18:20:55.418 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T18:20:55.931 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T18:20:56.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T18:20:57.438 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T18:20:59.085 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T18:21:01.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T18:21:02.859 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T18:21:05.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T18:21:08.815 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T18:21:09.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T18:21:12.843 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T18:21:17.591 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T18:21:18.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T18:21:19.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T18:21:20.250 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T18:21:20.775 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T18:21:26.576 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T18:21:27.150 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T18:21:27.686 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T18:21:28.215 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T18:21:28.752 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T18:21:29.489 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:21:40.742 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:21:41.778 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:21:42.512 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:21:43.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:21:44.392 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:21:49.004 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:21:49.976 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:21:55.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:22:17.016 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:22:29.847 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:22:32.062 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:22:34.191 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:22:35.036 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:22:35.974 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:22:36.599 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:22:37.651 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:22:38.533 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:22:40.237 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:22:40.698 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T18:22:41.179 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T18:22:41.645 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T18:22:42.028 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T18:22:42.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T18:22:42.921 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T18:22:43.331 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T18:22:43.725 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T18:22:44.257 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T18:22:44.666 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T18:22:45.080 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T18:22:45.513 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T18:22:45.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T18:22:46.306 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T18:22:46.849 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T18:22:47.392 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T18:22:48.204 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T18:22:48.737 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T18:22:49.274 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T18:22:49.813 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T18:22:50.374 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T18:22:50.801 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T18:22:51.243 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:22:51.673 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:22:52.141 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:23:18.533 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:23:45.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:23:52.545 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:23:53.044 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:24:53.756 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:25:54.626 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:25:55.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:25:55.775 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:25:56.201 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:25:56.594 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:26:15.091 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:26:21.571 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:26:27.956 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:26:28.451 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:26:29.013 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:26:29.584 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:26:30.367 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:26:30.898 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:26:31.429 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:26:31.962 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:26:32.503 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:26:33.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:26:33.771 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:26:34.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:26:34.841 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:26:35.843 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:26:36.831 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:26:38.303 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:26:39.673 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:26:41.119 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:26:42.518 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:26:45.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:26:47.698 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:26:49.187 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:26:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:26:51.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:26:51.763 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:26:52.353 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:26:53.771 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:26:55.697 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:26:57.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:26:58.629 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:27:12.086 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:27:12.900 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:27:13.814 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:27:14.668 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:27:15.916 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:27:16.973 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:27:17.587 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:27:18.665 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:27:19.053 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:27:19.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:27:19.813 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:27:20.196 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:27:20.772 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:27:21.222 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:27:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:27:22.666 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:27:23.088 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:27:23.517 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:27:23.940 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:27:24.358 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:27:24.843 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:27:25.262 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:27:25.680 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:27:26.169 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:27:26.592 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:27:27.176 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:27:27.697 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:27:28.310 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:27:28.875 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:27:29.408 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:27:29.927 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:27:30.623 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:27:31.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:27:31.863 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:27:32.444 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:27:33.042 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:27:33.603 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:27:34.300 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:27:35.001 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:27:35.642 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:27:36.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:27:36.714 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:27:37.304 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:27:37.982 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:27:38.506 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:27:39.119 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:27:39.856 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:27:40.359 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:27:40.999 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:27:41.530 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:27:51.904 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:27:52.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:28:02.320 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:28:02.936 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:28:03.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:28:03.941 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:28:04.388 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:28:04.837 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:28:05.311 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:28:05.818 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:28:06.314 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:28:06.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:28:07.161 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:28:07.721 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:28:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:28:08.800 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:28:09.360 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:28:09.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:28:10.247 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:28:11.012 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:28:17.900 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:28:18.309 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:28:18.792 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:28:19.316 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:28:19.838 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:28:21.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:28:21.769 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:28:22.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:28:26.192 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:28:27.151 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:28:31.517 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:28:35.213 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:28:35.526 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:28:36.035 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:28:48.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:29:08.570 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:29:10.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:29:13.479 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:29:15.111 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:29:16.395 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:29:16.722 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:29:19.871 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:29:23.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:29:36.463 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:29:38.701 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:29:40.134 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:29:41.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:29:41.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:29:46.660 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:29:49.229 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:29:49.710 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:29:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:29:55.661 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:29:58.408 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:30:02.214 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:30:04.202 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:30:04.368 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:30:07.404 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:30:10.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:30:12.226 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:30:15.304 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:30:16.691 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:31:26.063 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:31:26.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:31:27.157 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:31:27.878 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:31:28.634 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:31:29.537 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:31:29.553 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:31:29.553 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.553 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-12T18:31:29.553 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: if boto_type is 'S3Connection': 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:31:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: if k is 'BucketName': 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.timeout(10) 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:31:29.555 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.556 INFO:teuthology.orchestra.run.smithi094.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:31:29.558 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:31:29.559 INFO:teuthology.orchestra.run.smithi094.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1245.11s (0:20:45) = 2024-09-12T18:31:29.684 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:31:29.684 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-12T18:31:29.684 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-12T18:31:29.702 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:31:29.703 DEBUG:teuthology.orchestra.run.smithi094:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:31:29.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:31:29.813 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:31:29.813 DEBUG:teuthology.orchestra.run.smithi094:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:31:29.841 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:31:29.842 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:31:30.032 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:31:30.046 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:31:30.046 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:31:30.046 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:31:30.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:31:30.075 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:31:30.076 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:31:30.144 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:31:30.144 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:31:30.213 INFO:tasks.workunit:timeout=3h 2024-09-12T18:31:30.213 INFO:tasks.workunit:cleanup=True 2024-09-12T18:31:30.214 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:31:30.283 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:32:31.115 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.116 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:31.117 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:32:31.121 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:32:31.190 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:32:31.192 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:32:31.192 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:32:31.240 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:32:31.288 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:32:31.327 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:32:31.328 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:32:31.328 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:32:31.367 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:32:31.370 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-12T18:32:31.370 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:32:31.441 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:32:31.442 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:32:31.442 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:32:31.514 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:32:31.515 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:32:31.515 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:32:33.878 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:32:33.878 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-12T18:32:33.878 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T18:32:33.878 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T18:32:33.878 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:32:33.879 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-12T18:32:33.880 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:32:33.881 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-12T18:32:33.881 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-12T18:32:34.104 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:32:34.296 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-12T18:32:34.301 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:32:34.346 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-12T18:32:34.346 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-12T18:32:34.346 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:32:34.495 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:32:34.500 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:32:35.234 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-12T18:32:35.281 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-12T18:32:36.054 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-12T18:32:36.056 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:32:36.594 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:32:36.595 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:32:36.651 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:32:36.652 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:32:36.702 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:32:36.703 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:32:36.753 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:32:36.754 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:32:36.830 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:32:36.831 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:32:36.984 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:32:36.985 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:32:36.989 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:32:36.990 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:32:37.000 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:32:37.001 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:32:37.003 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:32:37.004 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:32:37.005 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:32:37.078 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:32:38.147 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:32:38.264 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:32:38.384 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:32:38.418 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:38.419 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:38.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.453+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.454+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.454+0000 7fad5440f800 20 realm 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.454+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.455+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.455+0000 7fad5440f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.455+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.455+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.455+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.456+0000 7fad5440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:38.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.456+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.456+0000 7fad5440f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:32:38.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.456+0000 7fad5440f800 20 searching for the correct realm 2024-09-12T18:32:38.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.460+0000 7fad50349640 0 -- 172.21.15.94:0/1963620482 >> [v2:172.21.15.94:6800/316134373,v1:172.21.15.94:6801/316134373] conn(0x55df7f2ddd90 msgr2=0x55df7f2e0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:38.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.464+0000 7fad4f347640 0 -- 172.21.15.94:0/1963620482 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7fad40076280 msgr2=0x7fad40008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:38.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:32:38.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:32:38.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:32:38.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.468+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 zone default found 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 4 Realm: () 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:32:38.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 zonegroup default 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.469+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.470+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.470+0000 7fad5440f800 20 started sync module instance, tier type = 2024-09-12T18:32:38.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.470+0000 7fad5440f800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:32:38.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=0 2024-09-12T18:32:38.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=1 2024-09-12T18:32:38.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=2 2024-09-12T18:32:38.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=3 2024-09-12T18:32:38.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=4 2024-09-12T18:32:38.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=5 2024-09-12T18:32:38.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.478+0000 7fad5440f800 20 add_watcher() i=6 2024-09-12T18:32:38.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.479+0000 7fad5440f800 20 add_watcher() i=7 2024-09-12T18:32:38.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.479+0000 7fad5440f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:32:38.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.481+0000 7fac05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.481+0000 7fad5440f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.481+0000 7fad5440f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.481+0000 7fad5440f800 5 note: GC not initialized 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fac04fe1640 20 reqs_thread_entry: start 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 20 init_complete bucket index max shards: 11 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 20 Filter name: none 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fab7e7fc640 20 reqs_thread_entry: start 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.482+0000 7fad5440f800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.483+0000 7fad5440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.483+0000 7fad5440f800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.483+0000 7fad5440f800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.483+0000 7fad5440f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:32:38.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.483+0000 7fad5440f800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.484+0000 7fad5440f800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.484+0000 7fad5440f800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.484+0000 7fad5440f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.485+0000 7fac2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432938 cookie 94418399848352 notifier 9243 bl.length()=613 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.485+0000 7fac2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:32:38.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.485+0000 7fac2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:32:38.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.487+0000 7fad5440f800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:32:38.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.487+0000 7fad5440f800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:32:38.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.487+0000 7fad5440f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:32:38.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.488+0000 7fac2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432075 cookie 94418399846016 notifier 9243 bl.length()=191 2024-09-12T18:32:38.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.488+0000 7fac2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:32:38.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.488+0000 7fac2effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:32:38.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.490+0000 7fac05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:38.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.492+0000 7fad5440f800 20 remove_watcher() i=0 2024-09-12T18:32:38.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.492+0000 7fad5440f800 2 removed watcher, disabling cache 2024-09-12T18:32:38.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.493+0000 7fad5440f800 20 remove_watcher() i=1 2024-09-12T18:32:38.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.494+0000 7fad5440f800 20 remove_watcher() i=2 2024-09-12T18:32:38.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.495+0000 7fad5440f800 20 remove_watcher() i=3 2024-09-12T18:32:38.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.497+0000 7fad5440f800 20 remove_watcher() i=4 2024-09-12T18:32:38.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.498+0000 7fad5440f800 20 remove_watcher() i=5 2024-09-12T18:32:38.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.498+0000 7fad5440f800 20 remove_watcher() i=6 2024-09-12T18:32:38.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.499+0000 7fad5440f800 20 remove_watcher() i=7 2024-09-12T18:32:38.764 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:32:38.764 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:38.882 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:32:38.910 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:38.910 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:38.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.943+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 20 realm 2024-09-12T18:32:38.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.945+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.946+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.946+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.947+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:38.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.947+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:38.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.947+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:32:38.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:38.947+0000 7f8319d0c800 20 searching for the correct realm 2024-09-12T18:32:39.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.150+0000 7f8316ff5640 0 -- 172.21.15.94:0/113389230 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7f83080b6070 msgr2=0x7f83080c6260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:39.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.154+0000 7f83177f6640 0 -- 172.21.15.94:0/113389230 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f830c069990 msgr2=0x7f830c037090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:39.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.361+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 zone default found 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 4 Realm: () 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 zonegroup default 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:39.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:39.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.362+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.363+0000 7f8319d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:39.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.363+0000 7f8319d0c800 20 started sync module instance, tier type = 2024-09-12T18:32:39.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.363+0000 7f8319d0c800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:32:39.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=0 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=1 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=2 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=3 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=4 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=5 2024-09-12T18:32:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.373+0000 7f8319d0c800 20 add_watcher() i=6 2024-09-12T18:32:39.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.374+0000 7f8319d0c800 20 add_watcher() i=7 2024-09-12T18:32:39.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.374+0000 7f8319d0c800 2 all 8 watchers are set, enabling cache 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.375+0000 7f81cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 5 note: GC not initialized 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f81ccfe1640 20 reqs_thread_entry: start 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 20 init_complete bucket index max shards: 11 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 20 Filter name: none 2024-09-12T18:32:39.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f81467fc640 20 reqs_thread_entry: start 2024-09-12T18:32:39.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.376+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.377+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:32:39.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.377+0000 7f8319d0c800 20 rados->read ofs=0 len=0 2024-09-12T18:32:39.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:32:39.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:32:39.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:32:39.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 INFO: main: starting shard=0 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.0 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 INFO: main: starting shard=1 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.378+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.1 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 INFO: main: starting shard=2 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.2 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 INFO: main: starting shard=3 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.379+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.3 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 INFO: main: starting shard=4 2024-09-12T18:32:39.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.4 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 INFO: main: starting shard=5 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.380+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.5 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 INFO: main: starting shard=6 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.6 2024-09-12T18:32:39.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 INFO: main: starting shard=7 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.381+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.7 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 INFO: main: starting shard=8 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.8 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 INFO: main: starting shard=9 2024-09-12T18:32:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.382+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.9 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.383+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.383+0000 7f8319d0c800 20 INFO: main: starting shard=10 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.383+0000 7f8319d0c800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.10 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.384+0000 7f8319d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.384+0000 7f8319d0c800 20 INFO: main: done 2024-09-12T18:32:39.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.385+0000 7f81cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:39.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.387+0000 7f8319d0c800 20 remove_watcher() i=0 2024-09-12T18:32:39.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.387+0000 7f8319d0c800 2 removed watcher, disabling cache 2024-09-12T18:32:39.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.388+0000 7f8319d0c800 20 remove_watcher() i=1 2024-09-12T18:32:39.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.389+0000 7f8319d0c800 20 remove_watcher() i=2 2024-09-12T18:32:39.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.391+0000 7f8319d0c800 20 remove_watcher() i=3 2024-09-12T18:32:39.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.392+0000 7f8319d0c800 20 remove_watcher() i=4 2024-09-12T18:32:39.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.393+0000 7f8319d0c800 20 remove_watcher() i=5 2024-09-12T18:32:39.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.394+0000 7f8319d0c800 20 remove_watcher() i=6 2024-09-12T18:32:39.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.395+0000 7f8319d0c800 20 remove_watcher() i=7 2024-09-12T18:32:39.411 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep 34dcd668-e4e2-44cf-a9f6-823a3fb264f8 2024-09-12T18:32:39.433 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:39.434 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:39.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:39.507+0000 7f68a21e7640 0 -- 172.21.15.94:0/3434446306 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f6898079040 msgr2=0x7f68980930c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:39.525 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:32:39.526 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:39.527 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:32:40.963 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:32:41.363 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:32:41.391 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:41.391 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:41.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.426+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 realm 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:32:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.428+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.429+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.429+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.430+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:32:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.430+0000 7f829e620800 20 searching for the correct realm 2024-09-12T18:32:41.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.431+0000 7f829c10a640 0 -- 172.21.15.94:0/3183507023 >> [v2:172.21.15.94:6816/4230056768,v1:172.21.15.94:6817/4230056768] conn(0x7f8294029040 msgr2=0x7f829401ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:32:41.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.637+0000 7f829c90b640 0 -- 172.21.15.94:0/3183507023 >> [v2:172.21.15.204:6808/287274657,v1:172.21.15.204:6809/287274657] conn(0x7f8290060040 msgr2=0x7f82900aa130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:41.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:32:41.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:32:41.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:32:41.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:32:41.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:32:41.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:32:41.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.643+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 zone default found 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 4 Realm: () 2024-09-12T18:32:41.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 zonegroup default 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.644+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.645+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.645+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.645+0000 7f829e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.645+0000 7f829e620800 20 started sync module instance, tier type = 2024-09-12T18:32:41.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.645+0000 7f829e620800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=0 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=1 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=2 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=3 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=4 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=5 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.654+0000 7f829e620800 20 add_watcher() i=6 2024-09-12T18:32:41.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.655+0000 7f829e620800 20 add_watcher() i=7 2024-09-12T18:32:41.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.655+0000 7f829e620800 2 all 8 watchers are set, enabling cache 2024-09-12T18:32:41.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.656+0000 7f8152fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 5 note: GC not initialized 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f8151fdb640 20 reqs_thread_entry: start 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 20 init_complete bucket index max shards: 11 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 20 Filter name: none 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f80c37fe640 20 reqs_thread_entry: start 2024-09-12T18:32:41.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.657+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:32:41.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 rados->read ofs=0 len=0 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 INFO: main: starting shard=0 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.658+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.0 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 INFO: main: starting shard=1 2024-09-12T18:32:41.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.1 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 INFO: main: starting shard=2 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.659+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.2 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.660+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.660+0000 7f829e620800 20 INFO: main: starting shard=3 2024-09-12T18:32:41.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.660+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.3 2024-09-12T18:32:41.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 INFO: main: starting shard=4 2024-09-12T18:32:41.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.4 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 INFO: main: starting shard=5 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.661+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.5 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 INFO: main: starting shard=6 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.6 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 INFO: main: starting shard=7 2024-09-12T18:32:41.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.662+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.7 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 INFO: main: starting shard=8 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.8 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 INFO: main: starting shard=9 2024-09-12T18:32:41.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.663+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.9 2024-09-12T18:32:41.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.664+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.664+0000 7f829e620800 20 INFO: main: starting shard=10 2024-09-12T18:32:41.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.664+0000 7f829e620800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.10 2024-09-12T18:32:41.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.665+0000 7f829e620800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:32:41.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.665+0000 7f829e620800 20 INFO: main: done 2024-09-12T18:32:41.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.666+0000 7f8152fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:41.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.668+0000 7f829e620800 20 remove_watcher() i=0 2024-09-12T18:32:41.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.668+0000 7f829e620800 2 removed watcher, disabling cache 2024-09-12T18:32:41.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.670+0000 7f829e620800 20 remove_watcher() i=1 2024-09-12T18:32:41.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.670+0000 7f829e620800 20 remove_watcher() i=2 2024-09-12T18:32:41.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.672+0000 7f829e620800 20 remove_watcher() i=3 2024-09-12T18:32:41.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.673+0000 7f829e620800 20 remove_watcher() i=4 2024-09-12T18:32:41.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.674+0000 7f829e620800 20 remove_watcher() i=5 2024-09-12T18:32:41.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.675+0000 7f829e620800 20 remove_watcher() i=6 2024-09-12T18:32:41.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.676+0000 7f829e620800 20 remove_watcher() i=7 2024-09-12T18:32:41.690 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep 8dbd71ff-f3f2-48b6-9cbb-ec81124afc24 2024-09-12T18:32:41.713 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:41.713 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:41.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:41.789+0000 7f0093105640 0 -- 172.21.15.94:0/1248606943 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x7f007c0078b0 msgr2=0x7f007c013390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:32:41.804 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:32:41.804 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:41.917 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:32:43.403 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:32:43.404 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:32:43.855 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:32:43.855 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-12T18:32:44.022 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:32:47.509 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:32:47.916 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:32:47.947 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:47.947 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:47.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.981+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 realm 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:47.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.983+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:47.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.984+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:47.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.984+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:47.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.985+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:32:47.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.985+0000 7f7333726800 20 searching for the correct realm 2024-09-12T18:32:47.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.988+0000 7f732eb08640 0 -- 172.21.15.94:0/3358911459 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x55cc83edf9d0 msgr2=0x55cc83ee1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:32:47.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:47.992+0000 7f732f309640 0 -- 172.21.15.94:0/3358911459 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7f732406c530 msgr2=0x7f73240665d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:32:48.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:32:48.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:32:48.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:32:48.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:32:48.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:48.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.197+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 zone default found 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 4 Realm: () 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:32:48.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 zonegroup default 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.198+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.199+0000 7f7333726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.199+0000 7f7333726800 20 started sync module instance, tier type = 2024-09-12T18:32:48.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.199+0000 7f7333726800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=0 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=1 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=2 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=3 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=4 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=5 2024-09-12T18:32:48.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.208+0000 7f7333726800 20 add_watcher() i=6 2024-09-12T18:32:48.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.209+0000 7f7333726800 20 add_watcher() i=7 2024-09-12T18:32:48.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.209+0000 7f7333726800 2 all 8 watchers are set, enabling cache 2024-09-12T18:32:48.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f71e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:48.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f7333726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:32:48.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f7333726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f7333726800 5 note: GC not initialized 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f71e4fe1640 20 reqs_thread_entry: start 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f7333726800 20 init_complete bucket index max shards: 11 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.211+0000 7f7333726800 20 Filter name: none 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f715e7fc640 20 reqs_thread_entry: start 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:32:48.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782 : miss 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.212+0000 7f7333726800 20 rados->read ofs=0 len=0 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:32:48.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782 info.flags=0x17 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782 to cache LRU end 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.0 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.213+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.1 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.214+0000 7f7333726800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.214+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.2 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.214+0000 7f7333726800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:32:48.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.214+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.3 2024-09-12T18:32:48.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.215+0000 7f7333726800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:32:48.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.215+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.4 2024-09-12T18:32:48.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:32:48.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.5 2024-09-12T18:32:48.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:32:48.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.6 2024-09-12T18:32:48.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:32:48.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.216+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.7 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.217+0000 7f7333726800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.217+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.8 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.217+0000 7f7333726800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.217+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.9 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.218+0000 7f7333726800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:32:48.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.218+0000 7f7333726800 20 bucket index object: :.dir.42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782.10 2024-09-12T18:32:48.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.218+0000 7f7333726800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:32:48.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.218+0000 7f7333726800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:32:48.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.219+0000 7f71e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:48.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.222+0000 7f7333726800 20 remove_watcher() i=0 2024-09-12T18:32:48.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.222+0000 7f7333726800 2 removed watcher, disabling cache 2024-09-12T18:32:48.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.223+0000 7f7333726800 20 remove_watcher() i=1 2024-09-12T18:32:48.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.224+0000 7f7333726800 20 remove_watcher() i=2 2024-09-12T18:32:48.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.225+0000 7f7333726800 20 remove_watcher() i=3 2024-09-12T18:32:48.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.226+0000 7f7333726800 20 remove_watcher() i=4 2024-09-12T18:32:48.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.227+0000 7f7333726800 20 remove_watcher() i=5 2024-09-12T18:32:48.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.228+0000 7f7333726800 20 remove_watcher() i=6 2024-09-12T18:32:48.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-12T18:32:48.229+0000 7f7333726800 20 remove_watcher() i=7 2024-09-12T18:32:48.243 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket versioning-bucket 2024-09-12T18:32:48.407 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket versioning tests 2024-09-12T18:32:48.407 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-12T18:32:48.467 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-12T18:32:48.521 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:32:48.523 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:32:48.523 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-12T18:32:48.523 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:32:48.523 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T18:32:48.523 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-12T18:32:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-12T18:32:48.525 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-12T18:32:48.525 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:32:48.526 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:32:48.618 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:32:48.619 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:32:48.985 DEBUG:teuthology.parallel:result is None 2024-09-12T18:32:48.986 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:32:49.024 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:32:49.024 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:32:49.094 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:32:49.094 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:32:49.106 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:32:49.216 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:32:49.216 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:32:49.217 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:32:49.278 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:32:49.279 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:32:49.337 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:49.337 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:49.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.366+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:49.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 realm 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.368+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:49.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.369+0000 7ff9e7d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:49.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.369+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:49.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.369+0000 7ff9e7d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:32:49.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.369+0000 7ff9e7d3e800 20 searching for the correct realm 2024-09-12T18:32:49.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.573+0000 7ff9dbfff640 0 -- 172.21.15.94:0/2968855561 >> [v2:172.21.15.204:6816/3161618081,v1:172.21.15.204:6817/3161618081] conn(0x7ff9d406b020 msgr2=0x7ff9d40dd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:32:49.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:49.979+0000 7ff9e3ac0640 0 -- 172.21.15.94:0/2968855561 >> [v2:172.21.15.94:6826/311581689,v1:172.21.15.94:6827/311581689] conn(0x7ff9cc0152a0 msgr2=0x7ff9cc0160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:32:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:32:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:32:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:32:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:32:50.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:32:50.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:32:50.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:50.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.186+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 zone default found 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 4 Realm: () 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:32:50.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 zonegroup default 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.187+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.188+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.188+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.188+0000 7ff9e7d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.188+0000 7ff9e7d3e800 20 started sync module instance, tier type = 2024-09-12T18:32:50.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.188+0000 7ff9e7d3e800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:32:50.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=0 2024-09-12T18:32:50.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=1 2024-09-12T18:32:50.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=2 2024-09-12T18:32:50.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=3 2024-09-12T18:32:50.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=4 2024-09-12T18:32:50.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=5 2024-09-12T18:32:50.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.198+0000 7ff9e7d3e800 20 add_watcher() i=6 2024-09-12T18:32:50.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.199+0000 7ff9e7d3e800 20 add_watcher() i=7 2024-09-12T18:32:50.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.199+0000 7ff9e7d3e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:32:50.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.201+0000 7ff899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:50.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.201+0000 7ff9e7d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:32:50.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.201+0000 7ff9e7d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:32:50.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff898fe1640 20 reqs_thread_entry: start 2024-09-12T18:32:50.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff9e7d3e800 20 init_complete bucket index max shards: 11 2024-09-12T18:32:50.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff9e7d3e800 20 Filter name: none 2024-09-12T18:32:50.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff8127fc640 20 reqs_thread_entry: start 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff9e7d3e800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.240+0000 7ff9e7d3e800 20 rados->read ofs=0 len=0 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.241+0000 7ff9e7d3e800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.241+0000 7ff9e7d3e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.241+0000 7ff9e7d3e800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.241+0000 7ff9e7d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:32:50.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.242+0000 7ff9e7d3e800 10 removing key index: RJNMIZGWATACSRBIFIJA 2024-09-12T18:32:50.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.243+0000 7ff9e7d3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:RJNMIZGWATACSRBIFIJA, ofs0, ns] 2024-09-12T18:32:50.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.243+0000 7ff8c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431848 cookie 94864368843520 notifier 8810 bl.length()=170 2024-09-12T18:32:50.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.245+0000 7ff9e7d3e800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:32:50.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.246+0000 7ff9e7d3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:32:50.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.246+0000 7ff8c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431849 cookie 94864368843520 notifier 8810 bl.length()=181 2024-09-12T18:32:50.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.247+0000 7ff9e7d3e800 10 removing user buckets index 2024-09-12T18:32:50.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.248+0000 7ff9e7d3e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:32:50.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.249+0000 7ff8c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432939 cookie 94864368856096 notifier 8810 bl.length()=172 2024-09-12T18:32:50.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.250+0000 7ff9e7d3e800 10 removing user index: tester.client.0 2024-09-12T18:32:50.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.251+0000 7ff9e7d3e800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:32:50.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.251+0000 7ff9e7d3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:32:50.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.251+0000 7ff8c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432083 cookie 94864368851200 notifier 8810 bl.length()=164 2024-09-12T18:32:50.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.253+0000 7ff899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:32:50.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.256+0000 7ff9e7d3e800 20 remove_watcher() i=0 2024-09-12T18:32:50.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.256+0000 7ff9e7d3e800 2 removed watcher, disabling cache 2024-09-12T18:32:50.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.257+0000 7ff9e7d3e800 20 remove_watcher() i=1 2024-09-12T18:32:50.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.258+0000 7ff9e7d3e800 20 remove_watcher() i=2 2024-09-12T18:32:50.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.259+0000 7ff9e7d3e800 20 remove_watcher() i=3 2024-09-12T18:32:50.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.259+0000 7ff9e7d3e800 20 remove_watcher() i=4 2024-09-12T18:32:50.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.261+0000 7ff9e7d3e800 20 remove_watcher() i=5 2024-09-12T18:32:50.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.263+0000 7ff9e7d3e800 20 remove_watcher() i=6 2024-09-12T18:32:50.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:32:50.264+0000 7ff9e7d3e800 20 remove_watcher() i=7 2024-09-12T18:32:50.279 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:32:50.291 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:32:50.402 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:32:50.458 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:32:50.530 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:32:50.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:32:50.537 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-12T18:32:50.531+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45295) UID: 0 2024-09-12T18:32:50.540 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-12T18:32:50.535+0000 a1be240 -1 shutting down 2024-09-12T18:33:00.719 INFO:tasks.rgw.client.0.smithi094.stderr:==00:00:57:07.263 45299== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45299-by-root-on-??? 2024-09-12T18:33:00.719 INFO:tasks.rgw.client.0.smithi094.stderr:==00:00:57:07.263 45299== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45299-by-root-on-??? 2024-09-12T18:33:00.719 INFO:tasks.rgw.client.0.smithi094.stderr:==00:00:57:07.263 45299== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45299-by-root-on-??? 2024-09-12T18:33:02.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T18:33:02.733 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:33:02.733 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:33:02.768 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:33:02.850 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:33:02.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:33:02.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:33:02.931 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:33:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:33:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:33:03.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.060+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.061+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.061+0000 7f4497220800 20 realm 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.061+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.062+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.062+0000 7f4497220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.062+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.062+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.062+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.063+0000 7f4497220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:33:03.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.063+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.063+0000 7f4497220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:33:03.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.063+0000 7f4497220800 20 searching for the correct realm 2024-09-12T18:33:03.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.067+0000 7f449550b640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.204:6800/31982016,v1:172.21.15.204:6801/31982016] conn(0x7f4488061950 msgr2=0x7f448806c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:33:03.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.273+0000 7f4494d0a640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x5615083c4b60 msgr2=0x5615083c6f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:33:03.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got zone_info.42c5264b-1887-4ec0-ad3b-497d0463fb19 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got zonegroup_info.337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.276+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:33:03.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 zone default found 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 4 Realm: () 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 4 ZoneGroup: default (337ae7e7-94ca-4050-9d5f-e3fb58bf8fd0) 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 4 Zone: default (42c5264b-1887-4ec0-ad3b-497d0463fb19) 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 zonegroup default 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.277+0000 7f4497220800 20 rados->read ofs=0 len=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.278+0000 7f4497220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:33:03.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.278+0000 7f4497220800 20 started sync module instance, tier type = 2024-09-12T18:33:03.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.278+0000 7f4497220800 20 started zone id=42c5264b-1887-4ec0-ad3b-497d0463fb19 (name=default) with tier type = 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=0 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=1 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=2 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=3 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=4 2024-09-12T18:33:03.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=5 2024-09-12T18:33:03.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.287+0000 7f4497220800 20 add_watcher() i=6 2024-09-12T18:33:03.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.288+0000 7f4497220800 20 add_watcher() i=7 2024-09-12T18:33:03.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.288+0000 7f4497220800 2 all 8 watchers are set, enabling cache 2024-09-12T18:33:03.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.290+0000 7f434afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:33:03.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.290+0000 7f4497220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:33:03.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.290+0000 7f4497220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:33:03.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.330+0000 7f4349fe3640 20 reqs_thread_entry: start 2024-09-12T18:33:03.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.330+0000 7f4497220800 20 init_complete bucket index max shards: 11 2024-09-12T18:33:03.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.330+0000 7f4497220800 20 Filter name: none 2024-09-12T18:33:03.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.330+0000 7f42bb7fe640 20 reqs_thread_entry: start 2024-09-12T18:33:03.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.330+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:33:03.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.332+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.332+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49713' 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4859641594074619029', time=2024-09-12T20:11:44.993466+0000, chain.objs.size()=1 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.199__shadow_.QCkKVkyrZvNm8e85bnaur1573Xl551Y_0 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13452505541517179607', time=2024-09-12T20:13:17.637284+0000, chain.objs.size()=1 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.244__shadow_.3-yY1dg9FcjEvE80zIEPNfzqJmF-f6x_0 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18263396942555299468', time=2024-09-12T20:13:25.532530+0000, chain.objs.size()=1 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.257__shadow_.WOz5vKGjKw97wZP4mlreshrdOLo_bIW_0 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8425577267796886311', time=2024-09-12T20:14:04.029654+0000, chain.objs.size()=1 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.A5zbVvJBS6c84DJygxL6pbrkR9EFxxn_0 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11389743600825837513', time=2024-09-12T20:14:04.276390+0000, chain.objs.size()=1 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.p72yvSAjt2V6wXF6ZuXV0SWNo4ohlEm_0 2024-09-12T18:33:03.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10694859757184946146', time=2024-09-12T20:14:04.343848+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9gEQBg3Gc7kFqwVjwkQ2ToSOUaThERX_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10765793101617185162', time=2024-09-12T20:14:04.392562+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.I2HtSoVPRFe4HGROwHF-_xn3yQrgtj8_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4861531806793463647', time=2024-09-12T20:14:04.581834+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6eyTDFugiGWhWUCnCCchIYeQJ7K6lpn_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1355045527702754905', time=2024-09-12T20:14:05.901927+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wqhIrPENjw2D2APK0XVB7yMNfGmFnt7_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17672534505405872820', time=2024-09-12T20:14:06.068161+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mQRy7g2RpQtqRNqUnN1xJFdrN1iK30V_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.333+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9234384107791017617', time=2024-09-12T20:14:06.550738+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.334+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TXPJxwlfMsaErDtabEjz2GUdK-29xtt_0 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.334+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2070771163891335142', time=2024-09-12T20:14:06.697421+0000, chain.objs.size()=1 2024-09-12T18:33:03.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.334+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KgjQPmblwzTJp0etNVe9ABiT-Hk9wB__0 2024-09-12T18:33:03.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15689137129070780008', time=2024-09-12T20:14:07.157802+0000, chain.objs.size()=1 2024-09-12T18:33:03.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rNtrDafASM5PMqW7T3q9BgcUQdEdojI_0 2024-09-12T18:33:03.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2579487181777531872', time=2024-09-12T20:14:07.479307+0000, chain.objs.size()=1 2024-09-12T18:33:03.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WcWOuSn9R9LLvp2OepzD8iLgo7IosSY_0 2024-09-12T18:33:03.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13368299218344293111', time=2024-09-12T20:14:07.587863+0000, chain.objs.size()=1 2024-09-12T18:33:03.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.337+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-etg-4N81y-cPASCfslzvt9cDujWyRT_0 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10246274385499063565', time=2024-09-12T20:14:07.588542+0000, chain.objs.size()=1 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kO9Qr0EPqxFhhy0hLpsB7-BQIFNtsAi_0 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15477544418381323137', time=2024-09-12T20:14:07.773776+0000, chain.objs.size()=1 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.yzQBffhsjMHcQ4Xja2qZiD_P7nr0C_P_0 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13847223029016736643', time=2024-09-12T20:14:07.775066+0000, chain.objs.size()=1 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dZ6hqxGdHrjWszmQ93PxUxnvxpz-QVj_0 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1893713889764018203', time=2024-09-12T20:14:07.905084+0000, chain.objs.size()=1 2024-09-12T18:33:03.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.97XlQQBIoXU7wXDkTTBdhyJXM8lMQ5s_0 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2610678642304065282', time=2024-09-12T20:14:08.044854+0000, chain.objs.size()=1 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.yY2y2hlRoT9Q9DZx81zKkfaPI3vqnmE_0 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8743120963527422850', time=2024-09-12T20:14:08.087481+0000, chain.objs.size()=1 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-6cydSYMy-EK0RRe6M1BQ_o3MJFvHyd_0 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15189003901690583090', time=2024-09-12T20:14:08.088150+0000, chain.objs.size()=1 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G4LfQW0_EvdATkoS4TY2RAs93lhWsYY_0 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16318606236288879725', time=2024-09-12T20:14:08.897740+0000, chain.objs.size()=1 2024-09-12T18:33:03.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IvAWcmuTPqdO_o8bfUkPcI2AFpmDHaA_0 2024-09-12T18:33:03.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.342+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.201491725410603796', time=2024-09-12T20:14:09.145127+0000, chain.objs.size()=1 2024-09-12T18:33:03.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.342+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oarhpzu45BtYnrkDlRbT7RdbX83rihK_0 2024-09-12T18:33:03.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.343+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6953717946135946948', time=2024-09-12T20:14:10.213738+0000, chain.objs.size()=1 2024-09-12T18:33:03.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XnQ5DLnAWt0X2ulIC0bUompqcmayJIi_0 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613959150270443091', time=2024-09-12T20:14:10.882365+0000, chain.objs.size()=1 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oyC-OnDpbnNaFRQUu75igmfr7YkLnBx_0 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4474667642550996865', time=2024-09-12T20:14:10.922581+0000, chain.objs.size()=1 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cbJmgAzhiHQe9TFPwRVtgT5bPurqvET_0 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9933572455027665599', time=2024-09-12T20:14:10.970527+0000, chain.objs.size()=1 2024-09-12T18:33:03.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.344+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JrCqpActTBCVpp-AkSLnBxKo7Q_DP1N_0 2024-09-12T18:33:03.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.345+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9272044651437544799', time=2024-09-12T20:14:11.117961+0000, chain.objs.size()=1 2024-09-12T18:33:03.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.345+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.i-xXBN9c3wHeyOYM14irsx96ExXTfC9_0 2024-09-12T18:33:03.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4142458612538504477', time=2024-09-12T20:14:11.483459+0000, chain.objs.size()=1 2024-09-12T18:33:03.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WtQgBIfxERkALU0eRwBybIn2PApPi5M_0 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2406502990154654909', time=2024-09-12T20:14:11.686260+0000, chain.objs.size()=1 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bxOyZYtrasFzsgSceRvwWXnHsgVuoCH_0 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13071433205324344441', time=2024-09-12T20:14:12.225383+0000, chain.objs.size()=1 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SYNyBKbQqPROfo9mRaUMVhpsyuNkArQ_0 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13474798732983648434', time=2024-09-12T20:14:12.307082+0000, chain.objs.size()=1 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5p4yh9ijvpnRrqnmK4omCV3uLaeXbuf_0 2024-09-12T18:33:03.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1432296689618062473', time=2024-09-12T20:14:12.494853+0000, chain.objs.size()=1 2024-09-12T18:33:03.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EWmwR8cDNhD576xrOVq3m77IzIxADGW_0 2024-09-12T18:33:03.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11621861635511209650', time=2024-09-12T20:14:12.541073+0000, chain.objs.size()=1 2024-09-12T18:33:03.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.347+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IYQJ3kSMIl_6_ldAnLOm1SrIidcYh1h_0 2024-09-12T18:33:03.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11863535138820311572', time=2024-09-12T20:14:12.896454+0000, chain.objs.size()=1 2024-09-12T18:33:03.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Nw65vwz8YP8sg3OJfYp9qRiWfQlG4V1_0 2024-09-12T18:33:03.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7990643517836556876', time=2024-09-12T20:14:13.028160+0000, chain.objs.size()=1 2024-09-12T18:33:03.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QsJvVFJMHxVawAD46zLaG892EVYzq3a_0 2024-09-12T18:33:03.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5607327485214454829', time=2024-09-12T20:14:13.187099+0000, chain.objs.size()=1 2024-09-12T18:33:03.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cjQ5MnctlZtKCKVXDoIm4vrmwKlT4s8_0 2024-09-12T18:33:03.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.341507520142014381', time=2024-09-12T20:14:13.208984+0000, chain.objs.size()=1 2024-09-12T18:33:03.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1zmzV141OlNOZGBWY9424h83qjjGoCZ_0 2024-09-12T18:33:03.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.258064687067731128', time=2024-09-12T20:14:13.406237+0000, chain.objs.size()=1 2024-09-12T18:33:03.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.350+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-6sSPGqBaSHl6w1GWnU2MMOSyt9kddU_0 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9357423827687903563', time=2024-09-12T20:14:13.407417+0000, chain.objs.size()=1 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4cpKwFyVLyYEG6m7Y8nhqm7OJ670Eoa_0 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11475374148446738092', time=2024-09-12T20:14:25.183874+0000, chain.objs.size()=1 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.279__shadow_.INnx-_elklhyoJkkVmhSxXRdoIfdmHt_0 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10313762449856826690', time=2024-09-12T20:14:25.802934+0000, chain.objs.size()=1 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.351+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.280__shadow_.NMwNNuNX9T53kPZghqDqp933PBeRrA4_0 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.352+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17659305206824439360', time=2024-09-12T20:14:26.447877+0000, chain.objs.size()=1 2024-09-12T18:33:03.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.281__shadow_.FZLGGQN8Ro24HaaTLdyJDtE3-sr3GBb_0 2024-09-12T18:33:03.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.353+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12540050307270335095', time=2024-09-12T20:14:34.473251+0000, chain.objs.size()=1 2024-09-12T18:33:03.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.353+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.haZCzspOCeeWLQ781IA4F8h_g-rfZfs_0 2024-09-12T18:33:03.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.353+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11668296346314122998', time=2024-09-12T20:14:36.530809+0000, chain.objs.size()=1 2024-09-12T18:33:03.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.353+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.lE_qofm50s8EEGjTTQprFIWDNDJL6Wv_0 2024-09-12T18:33:03.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.354+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686013710762539149', time=2024-09-12T20:14:53.146078+0000, chain.objs.size()=1 2024-09-12T18:33:03.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.354+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319__shadow:E4xk8pxspNVsXiN4wKhNQl1p2VPtLcM_.2G6uiXpNzxhUn97QimXWaY0NWwG5jks_0 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9066160256800069666', time=2024-09-12T20:15:32.337089+0000, chain.objs.size()=1 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DCNwJfun1m9DyzLvMN42QGssd57Nww2_0 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14528792947525826373', time=2024-09-12T20:15:33.062894+0000, chain.objs.size()=1 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.P_q2KP30zRWcQDANslFZzNodFA21V12_0 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5926609092931709226', time=2024-09-12T20:15:34.629783+0000, chain.objs.size()=1 2024-09-12T18:33:03.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Hh0hZakUHCbf558AQ-qNeF_mvul2-TY_0 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12366910000954510038', time=2024-09-12T20:15:35.408032+0000, chain.objs.size()=1 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qln5IAU1Spscqk0rFV1NwcRsc50PYZb_0 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6362983536521026801', time=2024-09-12T20:15:35.857589+0000, chain.objs.size()=1 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mhczJPPghPi9Tu-ZYYv-LI6BLnTp1bq_0 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18261343182644455729', time=2024-09-12T20:15:37.617655+0000, chain.objs.size()=1 2024-09-12T18:33:03.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tIn3T0V1dM94q9rxD5oIUhwnuoO-D_u_0 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13429732177539404986', time=2024-09-12T20:15:38.024039+0000, chain.objs.size()=1 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rGCvz5brbsvKPLu0sgUGMk0PvFSTslw_0 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7799443905245139961', time=2024-09-12T20:15:38.817821+0000, chain.objs.size()=1 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.c6QnqqU9A6W-MtLNbWYtU1byquZ9xsY_0 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9162967111896705334', time=2024-09-12T20:15:39.062125+0000, chain.objs.size()=1 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6XScj-CV_q6p9Wq8ZjekWnl_GCBklUP_0 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13233782925310799551', time=2024-09-12T20:15:39.062901+0000, chain.objs.size()=1 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wNWytn5aXzvFDK4P7Wp8AsC2DKYrA02_0 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.360+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9659647961713446003', time=2024-09-12T20:15:39.414890+0000, chain.objs.size()=1 2024-09-12T18:33:03.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.360+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.s0jOffIXhyfe5xrYzxtNO-_n5msWy-X_0 2024-09-12T18:33:03.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.361+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18433985021892599079', time=2024-09-12T20:15:39.730261+0000, chain.objs.size()=1 2024-09-12T18:33:03.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.361+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rD668qrxP8uGZKku2-BiOqhsR-fWwxE_0 2024-09-12T18:33:03.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15147008918291967667', time=2024-09-12T20:15:39.772698+0000, chain.objs.size()=1 2024-09-12T18:33:03.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uCXi023YMklYEENRK9npRVlWyd_4G40_0 2024-09-12T18:33:03.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6096673761983548729', time=2024-09-12T20:15:39.904331+0000, chain.objs.size()=1 2024-09-12T18:33:03.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FIi6mGVcO3h8kIbq-_TmDuNs2L8wDmI_0 2024-09-12T18:33:03.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6466599054689338643', time=2024-09-12T20:15:40.088443+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._H4W7W0IuGCOiHPTZjl3K6SJkbLFz0u_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10328754745377769501', time=2024-09-12T20:15:40.380994+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7ndytOmmTDCvHmAfJC-AAEEWtZ-adjB_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5991076025734501196', time=2024-09-12T20:15:40.945756+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7_kHuAXKHBjYQdW2nwTrgFysXLEM-Pd_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13647401494166048543', time=2024-09-12T20:15:41.316976+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._iuRFUOCxXdxmxpfzKel2S7qNGL-QDe_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7322963773993358150', time=2024-09-12T20:15:41.430235+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XJfvx8CxxBalPuP9b-B2fCUoJg1YdQN_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14726694524628878545', time=2024-09-12T20:15:41.561254+0000, chain.objs.size()=1 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NuwxA5uQ3Tdpd9Fd5x7gj24TKgZH0tf_0 2024-09-12T18:33:03.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12149302463620915191', time=2024-09-12T20:15:41.562025+0000, chain.objs.size()=1 2024-09-12T18:33:03.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.364+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SoHrppk_B0AWsjynJO-FxxB-mgokpgu_0 2024-09-12T18:33:03.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.373671572886259644', time=2024-09-12T20:15:41.771981+0000, chain.objs.size()=1 2024-09-12T18:33:03.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QXwaw0Fw5SpOumOh7Z1osY2lcuwHmb4_0 2024-09-12T18:33:03.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13868308547833371454', time=2024-09-12T20:15:42.091108+0000, chain.objs.size()=1 2024-09-12T18:33:03.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9xAHCGLdIYvVAhbGGdW89a8DWkH5OCl_0 2024-09-12T18:33:03.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.368+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9394340820777550413', time=2024-09-12T20:15:42.220084+0000, chain.objs.size()=1 2024-09-12T18:33:03.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.368+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.f094OfAVskXDr7v_g8LNe6L0TzI80j1_0 2024-09-12T18:33:03.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.322135650851979434', time=2024-09-12T20:15:42.220816+0000, chain.objs.size()=1 2024-09-12T18:33:03.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1ZJWKkZHLJ-2_R9tAETc9HkKnygkFKN_0 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6962482831795375248', time=2024-09-12T20:15:42.374795+0000, chain.objs.size()=1 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hzR_PABROTJ63zxbuVIdUHAqdZsLGj4_0 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7515051998649771900', time=2024-09-12T20:15:42.582267+0000, chain.objs.size()=1 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WXhC--VKdY45Png8w8wva-wMjgMua7W_0 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3231774857857958666', time=2024-09-12T20:15:42.583496+0000, chain.objs.size()=1 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3ADbfRTRXzlUlF8hf23UdmpDxcgWrn4_0 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1145440957900316711', time=2024-09-12T20:16:20.125336+0000, chain.objs.size()=1 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.foswQh9q5r8Ar9I1PJuKwpkCzsgiuB3_0 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11538908155512668766', time=2024-09-12T20:16:20.149738+0000, chain.objs.size()=1 2024-09-12T18:33:03.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.369+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4r2pFusDWcB02AP1A9bVfcA7ri6HTky_0 2024-09-12T18:33:03.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11790012422094211569', time=2024-09-12T20:16:20.407877+0000, chain.objs.size()=1 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hlVV8rBavZEaXt5bqOgA97v4J5DaNON_0 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1646562175076473492', time=2024-09-12T20:16:20.604688+0000, chain.objs.size()=1 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NgeYEOA2SZCrWWKNJhKF6fMXrNG9zMq_0 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9791775143312838991', time=2024-09-12T20:16:21.645101+0000, chain.objs.size()=1 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5xRHBWnPrNb5O3fM1w9CtfSR9ZYR0R5_0 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4444134489698379211', time=2024-09-12T20:16:21.917489+0000, chain.objs.size()=1 2024-09-12T18:33:03.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.372+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ONHEfqyhOOXFcO6cbkELWmuYaQDq7CJ_0 2024-09-12T18:33:03.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.862656814026678831', time=2024-09-12T20:16:22.336252+0000, chain.objs.size()=1 2024-09-12T18:33:03.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7VqCZ3fCAvy_ECkehc2psYzQe0lTmiM_0 2024-09-12T18:33:03.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13717061409484565877', time=2024-09-12T20:16:23.329196+0000, chain.objs.size()=1 2024-09-12T18:33:03.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gWGcLyNmXYErRaJScH-Iupud9LdevtT_0 2024-09-12T18:33:03.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10016625924794781810', time=2024-09-12T20:16:23.329747+0000, chain.objs.size()=1 2024-09-12T18:33:03.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.374+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.r23w2YDnfeSLNLv73bYlzshF4ib3qxv_0 2024-09-12T18:33:03.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12493714332095749328', time=2024-09-12T20:16:23.789507+0000, chain.objs.size()=1 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-5DMgrpjDfhv2I9s87ScK8jBjGTtdUc_0 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12855891726636687664', time=2024-09-12T20:16:23.889009+0000, chain.objs.size()=1 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YOF-wRE5YSDEkPd5oqFSsBiBEI9S4Py_0 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8919475513228971440', time=2024-09-12T20:16:23.889873+0000, chain.objs.size()=1 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8VzgFx5NAYdy3zimxBcA8VupxFfk_eV_0 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.768725580149303138', time=2024-09-12T20:16:23.933766+0000, chain.objs.size()=1 2024-09-12T18:33:03.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NjW4i12OKcoR72uHNdxRR0dQDI5kBlC_0 2024-09-12T18:33:03.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3230328469057752364', time=2024-09-12T20:16:23.984932+0000, chain.objs.size()=1 2024-09-12T18:33:03.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CDz_j9StIsyia1naILjHvc_xs6uqJYB_0 2024-09-12T18:33:03.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5174673813795226250', time=2024-09-12T20:16:24.647427+0000, chain.objs.size()=1 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.taNml1TqcsfbmQQcvY91QFspRbY8eDv_0 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14596709644384023292', time=2024-09-12T20:16:24.695281+0000, chain.objs.size()=1 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.R6zLjdSksaS5N9rs1QxbuMnCmQcf2WH_0 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14655901392648733158', time=2024-09-12T20:16:24.785555+0000, chain.objs.size()=1 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Kv83ixGAJndMt4YNAzIml3SD5wSKBbd_0 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.378+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13926619116532135512', time=2024-09-12T20:16:24.910971+0000, chain.objs.size()=1 2024-09-12T18:33:03.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.378+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Ldv1iJ9tmEFJocCHkEjE4qt70QYb-o3_0 2024-09-12T18:33:03.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.379+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4415093884020687835', time=2024-09-12T20:16:24.948404+0000, chain.objs.size()=1 2024-09-12T18:33:03.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.379+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DZmKVRu3Tuj1f5941G8EQBoFbx8daGe_0 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11621972214604535526', time=2024-09-12T20:16:25.047915+0000, chain.objs.size()=1 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nRhvQwl0IqhrOONMKNOmSijyM9eZ91f_0 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10166549011001687135', time=2024-09-12T20:16:25.262375+0000, chain.objs.size()=1 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.k8AVdXxry73M0HFPZVhvLRa08QaW9zD_0 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13833592673988152749', time=2024-09-12T20:16:25.532788+0000, chain.objs.size()=1 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wihlcRvlf9pb8TiakBbdNSe58mFaop7_0 2024-09-12T18:33:03.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8760580052016369408', time=2024-09-12T20:16:25.931676+0000, chain.objs.size()=1 2024-09-12T18:33:03.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0rC-DkxA6PXiUjrjA_7mBRJjjiXKtyu_0 2024-09-12T18:33:03.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6645222934692220824', time=2024-09-12T20:16:25.932508+0000, chain.objs.size()=1 2024-09-12T18:33:03.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.d6lOy8hcbkQFA21X_Rn9RqtfvTfLPYK_0 2024-09-12T18:33:03.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.383+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15246931437913532356', time=2024-09-12T20:16:26.096392+0000, chain.objs.size()=1 2024-09-12T18:33:03.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.383+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HR7GzvfRZGBMcKZ_9uxLek1BzPOIw5q_0 2024-09-12T18:33:03.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/49713 2024-09-12T18:33:03.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:33:03.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10768978222749248756', time=2024-09-12T20:16:26.216943+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-p_glmIUue6nZGfy50vOTOlOOV91ir6_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4583530000398911664', time=2024-09-12T20:16:26.357065+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EdICTFXyzK90LSIOwrv-uxSCuqtj-Li_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12217012813603084699', time=2024-09-12T20:16:26.399554+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zQcrRWcYWOSW-h8rQl_Xcvt5LD7cVu5_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18150907722732105363', time=2024-09-12T20:16:26.400336+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HNR2fdoNOVHuFvsu9hpIOCiGItFPua5_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16389009326351714922', time=2024-09-12T20:16:26.558461+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6_Kz4a3BDWUO_ZMIg8xHSfzAvr2ybws_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18294642941003337266', time=2024-09-12T20:16:27.408078+0000, chain.objs.size()=1 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.c-IYEa0I0So0tHQwV6bOTUvSsIi0LqZ_0 2024-09-12T18:33:03.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8526371006877278988', time=2024-09-12T20:16:28.292482+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4WfB3PcCRvtokoTh-6VZjxiYHmwVMwE_0 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5715053619900124181', time=2024-09-12T20:16:28.644196+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wUtVEQINJszuqhAYaxVIjGCeMPnBGJK_0 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2949592123633717501', time=2024-09-12T20:16:28.943353+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QvTSufbxQjLwi--xfvBimOnZwfg0MDT_0 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7624772117571175736', time=2024-09-12T20:16:29.052796+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oHgNpyFl31vfniAkXLXtkNMFejKjTAE_0 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7263302047401976075', time=2024-09-12T20:16:30.381901+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2cPB7Qze2_mLDxBce1BQo2ptbEgszZ6_0 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8319601668105597551', time=2024-09-12T20:16:30.490344+0000, chain.objs.size()=1 2024-09-12T18:33:03.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TD2YN9NqpnnzMtjAUhbyVURuDWie4lX_0 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14638305044520832652', time=2024-09-12T20:16:31.054984+0000, chain.objs.size()=1 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vlJgwmOndincCzH6ltB8DC7zJ9oqEub_0 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17647603573492840087', time=2024-09-12T20:17:25.572211+0000, chain.objs.size()=1 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.429__shadow_.x-rGGNbKaAh5cUyBwQ9AbnZuLasTeBM_0 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5928393023705617615', time=2024-09-12T20:21:02.615340+0000, chain.objs.size()=1 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.553__shadow_.D17jG3SK4VbbL7z2C_ZK9GGeubpulKJ_0 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6718204547876645258', time=2024-09-12T20:21:19.542393+0000, chain.objs.size()=1 2024-09-12T18:33:03.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.561__multipart_mymultipart.2~QumXXLfanI7wLxsEDDR7rncjhoIz_Cj.1 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15697484001619497793', time=2024-09-12T20:21:40.099325+0000, chain.objs.size()=1 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:8CLXsiCpj9gkNQDMWJrlmianLU5qqdP_.yyenEQWkdqCFMdnHNrzadL12iyAzs1M_0 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4035583379809894086', time=2024-09-12T20:21:40.345686+0000, chain.objs.size()=1 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:nzXCegV7wrdmAaFe-IAJ.7ewZ04dcZH_.0BgM4B7jTioAJcHaNTjEwtsyzVwHfOU_0 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7858893649919289147', time=2024-09-12T20:21:42.868534+0000, chain.objs.size()=1 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.572__shadow:YWrxAZYzD3CV53rGhcnSrSRcWpukCe9_.SMli21x-6aflbjs2hlU7LX6zx4U8jY-_0 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7083176682327282230', time=2024-09-12T20:21:47.238244+0000, chain.objs.size()=1 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:PULuYaGM3jHybCu9wLtTovs8s6wfQAi_.JRf4_IvaVrM3Le0-ZUVmBcJy6HrBdXn_0 2024-09-12T18:33:03.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8412404377609851802', time=2024-09-12T20:21:55.286859+0000, chain.objs.size()=1 2024-09-12T18:33:03.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:xgvMhaBepqfKEE2nhgZK9D0EhiLv-.L_.0afgvCsL4xDKNcmG6thGCph9g2Z8BGU_0 2024-09-12T18:33:03.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14872914931356994593', time=2024-09-12T20:22:10.339335+0000, chain.objs.size()=1 2024-09-12T18:33:03.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:iMujsHLBWQii4CpsvVOFduSO6xEThiF_.-bzjlpsk3j0510KEpnrDh5z4u5PGEdv_0 2024-09-12T18:33:03.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16508917290502794324', time=2024-09-12T20:22:33.962083+0000, chain.objs.size()=1 2024-09-12T18:33:03.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:6qkXM.SgrWj36dkPfIZYG8RDbPIOm2p_.GlfyLQiGbnvyGClyHNx-Ahlfqliwlpv_0 2024-09-12T18:33:03.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12266431291600587455', time=2024-09-12T20:26:44.203296+0000, chain.objs.size()=1 2024-09-12T18:33:03.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.646__shadow_.fY7XOkMxP65vADhHrCQpxd3CVuqqv4o_0 2024-09-12T18:33:03.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3451399020524563976', time=2024-09-12T20:27:40.663728+0000, chain.objs.size()=1 2024-09-12T18:33:03.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.713__shadow:DV6JbJaVHVbvN21ppMkGLWAuo6-tFH9_.y6rR_vVFLmam00IvriR_F1pSRfvOn6A_0 2024-09-12T18:33:03.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15195851782415515144', time=2024-09-12T20:27:52.214522+0000, chain.objs.size()=1 2024-09-12T18:33:03.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.716__shadow:Dfad78dS99S5WC2DXwbihgGo.IqzRXU_.xa2mhKz6TT1y6hcYEksZUM8ag3aMv1E_0 2024-09-12T18:33:03.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12017772250639998920', time=2024-09-12T20:28:10.758010+0000, chain.objs.size()=1 2024-09-12T18:33:03.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.397+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.734__shadow_.m5XM06oDqXSFPvRBn0TPFJ7K1-kGdbT_0 2024-09-12T18:33:03.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.401+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.403+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:33:03.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.405+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.405+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50053' 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9026830153958743163', time=2024-09-12T20:10:47.473847+0000, chain.objs.size()=1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.148__shadow_.9QJpuF4Ml-uWfHuOx92fihksdq23e1L_0 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16805328950409383619', time=2024-09-12T20:11:43.928848+0000, chain.objs.size()=1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.197__shadow_.lysYJNVYjR9_InXp56swjS2VmLAisE4_0 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~T0V-Ac_-QU6D-9lVfKxnBt6Ii6jv-QW', time=2024-09-12T20:11:46.838214+0000, chain.objs.size()=2 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.201__multipart_mymultipart.2~T0V-Ac_-QU6D-9lVfKxnBt6Ii6jv-QW.1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.201__shadow_mymultipart.2~T0V-Ac_-QU6D-9lVfKxnBt6Ii6jv-QW.1_1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7330483379975019498', time=2024-09-12T20:13:15.230195+0000, chain.objs.size()=1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.241__shadow_.wb58vsr_1MNqa8BQKfUck9v2Nt3BoCU_0 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15193188761593601716', time=2024-09-12T20:13:17.637120+0000, chain.objs.size()=1 2024-09-12T18:33:03.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.244__shadow_.HNDoWW4RZL7f1O6d_SzO9xwaIGA4Nvb_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14218338245281082916', time=2024-09-12T20:13:24.963148+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.256__shadow_.2JeMIPn4y4y_WNxqVwk2JDElA72ISwA_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13906204534839580550', time=2024-09-12T20:13:26.691534+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.259__shadow_.OcSVbiFxEK5IW2G4B3qrbPwiofHjd4w_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8477191120475122244', time=2024-09-12T20:14:04.349926+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UTtu7FbAUs2hGr8-W91NHHfoTP5Qx-1_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6359359137728767086', time=2024-09-12T20:14:04.634779+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.N5VAuDWL0OqnPqCBb4dmGF5oGvbOgaK_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8251201493732864059', time=2024-09-12T20:14:04.635567+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EqI2xyrW05fQoSWlSR3dyM9Z2qjuCFt_0 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14914209934835403795', time=2024-09-12T20:14:04.886326+0000, chain.objs.size()=1 2024-09-12T18:33:03.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.406+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.T_y3ieSat2Foljpb4pLZbsXJgHuqNz8_0 2024-09-12T18:33:03.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2667592620590644461', time=2024-09-12T20:14:05.047046+0000, chain.objs.size()=1 2024-09-12T18:33:03.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4cehKYwdGhcluHzp1-1l5M7cHSQbkS__0 2024-09-12T18:33:03.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13000316878820989848', time=2024-09-12T20:14:05.778890+0000, chain.objs.size()=1 2024-09-12T18:33:03.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3lZvoqn3TZo_aNSk445FCGA7Y1LIGNB_0 2024-09-12T18:33:03.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13675562711293171913', time=2024-09-12T20:14:05.916101+0000, chain.objs.size()=1 2024-09-12T18:33:03.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dZcOH8M3HyRhIoPsgTH85E3MWnVIfiK_0 2024-09-12T18:33:03.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1161376059807688265', time=2024-09-12T20:14:06.112785+0000, chain.objs.size()=1 2024-09-12T18:33:03.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2E6VBUqLUkP4Fr8Y7RjGinpYBd6PD7f_0 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6232387204914656605', time=2024-09-12T20:14:06.461105+0000, chain.objs.size()=1 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.O9v2ogkP7N9PZCEQp_kcArA91ZUXKZH_0 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15857191810713509271', time=2024-09-12T20:14:08.606773+0000, chain.objs.size()=1 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Leh77PHtu5al-n9n3cBREnxti6xId0m_0 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2776526080031057637', time=2024-09-12T20:14:08.714121+0000, chain.objs.size()=1 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qZins85XXDV3Jh0oeWvhMu4sv6GHJGW_0 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8640893843057084498', time=2024-09-12T20:14:09.069171+0000, chain.objs.size()=1 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.e9ovQrHOYc3ncI74N9ennLyBYDz6qwD_0 2024-09-12T18:33:03.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12191344331249420510', time=2024-09-12T20:14:09.607686+0000, chain.objs.size()=1 2024-09-12T18:33:03.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tuAgdJfuH8ukO_WZf3eAMtCjneWP4F2_0 2024-09-12T18:33:03.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11381118985600998267', time=2024-09-12T20:14:10.077547+0000, chain.objs.size()=1 2024-09-12T18:33:03.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.A8SD6x5gD0HQiCO0xwBQlLQXTp9-SXR_0 2024-09-12T18:33:03.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16835282458529712519', time=2024-09-12T20:14:10.556230+0000, chain.objs.size()=1 2024-09-12T18:33:03.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qYzCwZRUvOOgMYD18FT3cWtUEqKnK-k_0 2024-09-12T18:33:03.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14903970536709853511', time=2024-09-12T20:14:11.852001+0000, chain.objs.size()=1 2024-09-12T18:33:03.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gxPXX7_ciAhZoueyb1An9Il5jEv5hJ6_0 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10588237877969795689', time=2024-09-12T20:14:11.904246+0000, chain.objs.size()=1 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RY_9FS5TRxt1gYA3BI7r8F7FnX5N3HS_0 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7285497179702743210', time=2024-09-12T20:14:12.854944+0000, chain.objs.size()=1 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FlqH7hle8dayA5s49wRhyC2OxDFcHye_0 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9781977275575443219', time=2024-09-12T20:14:13.001510+0000, chain.objs.size()=1 2024-09-12T18:33:03.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.417+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4e8kcVIGcaGZDFkKLIEs_RVBvwAOk9J_0 2024-09-12T18:33:03.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.644061312667129557', time=2024-09-12T20:14:13.458419+0000, chain.objs.size()=1 2024-09-12T18:33:03.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4oyp_uNOvIeE1AXy4Qjcm-X0YPO9lOe_0 2024-09-12T18:33:03.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3071184578550229127', time=2024-09-12T20:14:13.499747+0000, chain.objs.size()=1 2024-09-12T18:33:03.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aLcPTVKaLPdiNK7U_iasPh3pKb5ywje_0 2024-09-12T18:33:03.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9960455649537631932', time=2024-09-12T20:14:13.579291+0000, chain.objs.size()=1 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.K-YWehZfX-KRUOFFhmwpYOVtmj_o72T_0 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15558903432980922010', time=2024-09-12T20:14:13.660176+0000, chain.objs.size()=1 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4HS_uvqs_GP1rBow_CCWMJeqrPG8C17_0 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15621417130369075171', time=2024-09-12T20:14:13.692365+0000, chain.objs.size()=1 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ozMbgQar7GjH194Ita8ekKB4lzJ_C5-_0 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10812747591282275789', time=2024-09-12T20:14:13.771919+0000, chain.objs.size()=1 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5M7aSWooMRoMZt2Y6ulf9c13P4NqpRi_0 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8543853185291096202', time=2024-09-12T20:14:14.239380+0000, chain.objs.size()=1 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4t-kBBtZpw8eFiBEBuNS9KuvnNKqBcG_0 2024-09-12T18:33:03.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4265548478718485232', time=2024-09-12T20:14:14.504990+0000, chain.objs.size()=1 2024-09-12T18:33:03.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ogPYrEYD0e0zgO9Q9FdZni9RWM8xD5M_0 2024-09-12T18:33:03.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.421+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10538082485191795565', time=2024-09-12T20:14:14.730793+0000, chain.objs.size()=1 2024-09-12T18:33:03.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.421+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Hz2WGBVPyOO-eg6Se_PiLdVXR5SX8g__0 2024-09-12T18:33:03.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.421+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6839126632609196627', time=2024-09-12T20:14:15.815239+0000, chain.objs.size()=1 2024-09-12T18:33:03.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.421+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.263__shadow_.KlP1cvAQyWoxaSxXvaIOANhV7EQYNhY_0 2024-09-12T18:33:03.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.423+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4925439856898329661', time=2024-09-12T20:14:24.579382+0000, chain.objs.size()=1 2024-09-12T18:33:03.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.423+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.278__shadow_.yXL_il16bX0_SuPIiAmLnrltMMfEgvI_0 2024-09-12T18:33:03.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17346013519041085851', time=2024-09-12T20:14:26.440985+0000, chain.objs.size()=1 2024-09-12T18:33:03.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.281__shadow_.VDxHw81gObtz6bd5ikYPAZJADTiNV5G_0 2024-09-12T18:33:03.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14441897814198086372', time=2024-09-12T20:14:34.525439+0000, chain.objs.size()=1 2024-09-12T18:33:03.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.qNzeaqsXnqzI2sqr4UmNfT5hG34zd_S_0 2024-09-12T18:33:03.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7074673441680562897', time=2024-09-12T20:14:41.596898+0000, chain.objs.size()=1 2024-09-12T18:33:03.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.424+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.301__shadow_.Osi3UMXbh9VvYyrBlFkikcgEpYlFH80_0 2024-09-12T18:33:03.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.426+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16286598588150126905', time=2024-09-12T20:15:32.398723+0000, chain.objs.size()=1 2024-09-12T18:33:03.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.426+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wZuW8JOqJnglOdkcPw7iIfeleeT66gH_0 2024-09-12T18:33:03.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2225337655035519530', time=2024-09-12T20:15:32.709673+0000, chain.objs.size()=1 2024-09-12T18:33:03.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NkHwoatzkefiRHVOAKHZ15elLUg6aMC_0 2024-09-12T18:33:03.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1918655007271699515', time=2024-09-12T20:15:32.853899+0000, chain.objs.size()=1 2024-09-12T18:33:03.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5tuG90ivxcvOspsb74kVn1ebnpfe3-g_0 2024-09-12T18:33:03.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3938804154454069910', time=2024-09-12T20:15:33.215216+0000, chain.objs.size()=1 2024-09-12T18:33:03.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FSmeu_dNRh8oP9Ycw83k4L3pj2ujzLG_0 2024-09-12T18:33:03.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12152597702133724072', time=2024-09-12T20:15:34.048839+0000, chain.objs.size()=1 2024-09-12T18:33:03.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pQCKwWtMZwllJg3oxuF-QyMC9RCDHaK_0 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13096689464228519403', time=2024-09-12T20:15:34.211496+0000, chain.objs.size()=1 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NFlFYFRxTP7UBUcabCuv7yzJUik1zb2_0 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15629556678929042624', time=2024-09-12T20:15:34.384920+0000, chain.objs.size()=1 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mqMUnECzLYZa7V54LKXvnrGvuGaDiws_0 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7384710976929774321', time=2024-09-12T20:15:34.478587+0000, chain.objs.size()=1 2024-09-12T18:33:03.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.D-VYJ-Wa95LaQfWzuJT7hY2_PNYvbtm_0 2024-09-12T18:33:03.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18162481564754247965', time=2024-09-12T20:15:34.497702+0000, chain.objs.size()=1 2024-09-12T18:33:03.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.R-U5YTD4suhpEFD-u9aAAcgscrRs9Cg_0 2024-09-12T18:33:03.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5844449616865708262', time=2024-09-12T20:15:35.189710+0000, chain.objs.size()=1 2024-09-12T18:33:03.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pbYr501L6ysJUdx5V3OtnOfYH1h9cgn_0 2024-09-12T18:33:03.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.551068802777821454', time=2024-09-12T20:15:35.259670+0000, chain.objs.size()=1 2024-09-12T18:33:03.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xSKtzVSRbUzbqGeIXU-tGXU0lq-oYqz_0 2024-09-12T18:33:03.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2741317618974431152', time=2024-09-12T20:15:35.260968+0000, chain.objs.size()=1 2024-09-12T18:33:03.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.431+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dGISb4OcHfKgsJpsCce0BkY4QM3CZMW_0 2024-09-12T18:33:03.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16190085824650527775', time=2024-09-12T20:15:35.694674+0000, chain.objs.size()=1 2024-09-12T18:33:03.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J2SNggQ3m6okI4RB6uZanzMDLNf1_Bi_0 2024-09-12T18:33:03.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14706492405893641138', time=2024-09-12T20:15:35.734059+0000, chain.objs.size()=1 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-ilf7mIad8AYGJZy5kEszZ1ESPiWkvq_0 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3533027531398511178', time=2024-09-12T20:15:36.148421+0000, chain.objs.size()=1 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Oiu7UB3SQnAcRm0JbaHOgA8LRLRTqqG_0 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14454686056988965433', time=2024-09-12T20:15:36.684205+0000, chain.objs.size()=1 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.udjlbEISjhVpo2-ZFWpQpSm8UAa_iF8_0 2024-09-12T18:33:03.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16383300892187208268', time=2024-09-12T20:15:36.803020+0000, chain.objs.size()=1 2024-09-12T18:33:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.RSNiBJhmjZQUwJD1ijtKFGyLClxZ1Ku_0 2024-09-12T18:33:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3529491884504989853', time=2024-09-12T20:15:36.864165+0000, chain.objs.size()=1 2024-09-12T18:33:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zinB1a0gnBMVzeECwBodZszMfsGK1RK_0 2024-09-12T18:33:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2542298824088142583', time=2024-09-12T20:15:37.027977+0000, chain.objs.size()=1 2024-09-12T18:33:03.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KR4QRf-MS5wnjiBCcv81telrY-Lzgls_0 2024-09-12T18:33:03.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1310593481660688278', time=2024-09-12T20:15:37.276350+0000, chain.objs.size()=1 2024-09-12T18:33:03.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.433+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nKabiPhdE7B67Kmat9NDuOyhpDosx9y_0 2024-09-12T18:33:03.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18075130360312769383', time=2024-09-12T20:15:38.039952+0000, chain.objs.size()=1 2024-09-12T18:33:03.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Xiybo92BeUYganYS-Qs031kHftWGhqQ_0 2024-09-12T18:33:03.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1712074687194890232', time=2024-09-12T20:15:38.453481+0000, chain.objs.size()=1 2024-09-12T18:33:03.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Wnarux48v-vyp-zTnmL04dr8qPXZGgY_0 2024-09-12T18:33:03.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12000185879799186246', time=2024-09-12T20:15:38.567039+0000, chain.objs.size()=1 2024-09-12T18:33:03.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZkCquXqri_608Ofdb3xjzntkCIJVZ97_0 2024-09-12T18:33:03.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8143835007390593588', time=2024-09-12T20:15:38.567542+0000, chain.objs.size()=1 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hpQdXVwV0aA3FV9vf0AbQIIIVYqDtrE_0 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6527869360052623039', time=2024-09-12T20:15:38.771259+0000, chain.objs.size()=1 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nQmpeJfPq4ZmsPjlz7Bb7x2ZQ80JtPH_0 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1898255554719835938', time=2024-09-12T20:15:38.909956+0000, chain.objs.size()=1 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2EdBnsvlfzLatVzgqCm0zTHOUGyg1Un_0 2024-09-12T18:33:03.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3427758283261272690', time=2024-09-12T20:15:38.946245+0000, chain.objs.size()=1 2024-09-12T18:33:03.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.436+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4Qom7nwOR-rzhqKWZZcxG3zPDTyNUH6_0 2024-09-12T18:33:03.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.437+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7139208744455277028', time=2024-09-12T20:15:38.967545+0000, chain.objs.size()=1 2024-09-12T18:33:03.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.437+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PFS5Icr5THZFwVwJiyKhQd2pKYTk583_0 2024-09-12T18:33:03.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.437+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11122704646804493779', time=2024-09-12T20:15:39.391515+0000, chain.objs.size()=1 2024-09-12T18:33:03.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.437+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aOlXY4-e1cBfLd5pZdkf1IHOpx_iELu_0 2024-09-12T18:33:03.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4651850208297276796', time=2024-09-12T20:15:39.852255+0000, chain.objs.size()=1 2024-09-12T18:33:03.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IKTThFnYMOg4JBbZgKOF5eI9SjNjNJm_0 2024-09-12T18:33:03.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10979729806903708722', time=2024-09-12T20:15:40.289060+0000, chain.objs.size()=1 2024-09-12T18:33:03.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jodKR7lurW0qjbUN4amEYtn6U0e_MSB_0 2024-09-12T18:33:03.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8064896517861755383', time=2024-09-12T20:15:40.289843+0000, chain.objs.size()=1 2024-09-12T18:33:03.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.AOD_pywc0yfNKI1eX6ibsXyOKc0bfl2_0 2024-09-12T18:33:03.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2189878542020986179', time=2024-09-12T20:15:40.465291+0000, chain.objs.size()=1 2024-09-12T18:33:03.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KWMQvIKIX5Qf9ZnuvgysxoZXhQQYwln_0 2024-09-12T18:33:03.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16751148639267120209', time=2024-09-12T20:15:40.940501+0000, chain.objs.size()=1 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yQKn-nQFP7NRygya-4KH6FtxaXZK8P1_0 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5265393943932557502', time=2024-09-12T20:15:41.010805+0000, chain.objs.size()=1 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.442+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.llnfJGma3597HJAQTmFGkLeVzT8ldga_0 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2428150939339964032', time=2024-09-12T20:15:41.525548+0000, chain.objs.size()=1 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wVp5FKtmQ9mu1f7227ecm__clOORWEN_0 2024-09-12T18:33:03.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.837848652567060461', time=2024-09-12T20:15:41.661699+0000, chain.objs.size()=1 2024-09-12T18:33:03.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1AomGrF24RH4qgVtxfltfOoOpX0kXxy_0 2024-09-12T18:33:03.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13954369080879991217', time=2024-09-12T20:15:41.791346+0000, chain.objs.size()=1 2024-09-12T18:33:03.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vAVY4znqG4Igg3p_oMdV0nQOtgc8UNF_0 2024-09-12T18:33:03.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6325951495389611382', time=2024-09-12T20:15:42.549525+0000, chain.objs.size()=1 2024-09-12T18:33:03.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ivoV_RsNIaC3B-cbNiUS25xNnjJnL6E_0 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18132093189939670212', time=2024-09-12T20:15:42.626471+0000, chain.objs.size()=1 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NoW3imJRN1Wvr3o3wPMPG5qtkPSETov_0 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11309571200486630538', time=2024-09-12T20:16:20.259754+0000, chain.objs.size()=1 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qBlvQAwgEj-Fb6MUfXDG5dur_2KysCt_0 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2106367306762273970', time=2024-09-12T20:16:20.526820+0000, chain.objs.size()=1 2024-09-12T18:33:03.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xR_Jkz6PB1prmSBGfuL-lV_PTFQHFBV_0 2024-09-12T18:33:03.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9029574107630228802', time=2024-09-12T20:16:21.671915+0000, chain.objs.size()=1 2024-09-12T18:33:03.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ezB27L7qde_tzj1Ez7wEz0mOZQtsBVq_0 2024-09-12T18:33:03.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3641578905410809335', time=2024-09-12T20:16:21.811972+0000, chain.objs.size()=1 2024-09-12T18:33:03.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.d3X3DqZzphQ792nvzonPfz883-yOgLS_0 2024-09-12T18:33:03.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12522215023947016097', time=2024-09-12T20:16:21.848364+0000, chain.objs.size()=1 2024-09-12T18:33:03.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.K33tZZDAXpERyNgd0a8S2WOwgibEMlq_0 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13069483225520375574', time=2024-09-12T20:16:21.962588+0000, chain.objs.size()=1 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KVSnqttD_R-qUCQt9NqgmoHeK3A59Lp_0 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17315225953957284934', time=2024-09-12T20:16:22.047079+0000, chain.objs.size()=1 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._czmv0i8c6m1TbHbSp5cV9UWMKoqvMd_0 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18038539497379450990', time=2024-09-12T20:16:22.144870+0000, chain.objs.size()=1 2024-09-12T18:33:03.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CgWO6TkR6xhouMNRsfn3DBuKumIyLy4_0 2024-09-12T18:33:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9496526455834137711', time=2024-09-12T20:16:22.292956+0000, chain.objs.size()=1 2024-09-12T18:33:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8vNa__SxvW7iqXh17cZJcA2sxP6UTgL_0 2024-09-12T18:33:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12555101036278604036', time=2024-09-12T20:16:22.525140+0000, chain.objs.size()=1 2024-09-12T18:33:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jmiCs2RR_zGZnjFHpf5F3Ejdfkfnn35_0 2024-09-12T18:33:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2801322307830675492', time=2024-09-12T20:16:22.525735+0000, chain.objs.size()=1 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rqSp-ranpP6U8n1YH9qyAvd4Cdwk5Hp_0 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2683446965743480950', time=2024-09-12T20:16:23.376708+0000, chain.objs.size()=1 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.S9cV11mlCKDZMFvZZQfxiJwiRQ1iuEC_0 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8618057900916092651', time=2024-09-12T20:16:23.700785+0000, chain.objs.size()=1 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.T0sSMgFUs_1kzZCtaTZigJPPNfZj6Ow_0 2024-09-12T18:33:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6848617356241785721', time=2024-09-12T20:16:24.102844+0000, chain.objs.size()=1 2024-09-12T18:33:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aNe1PAlFUjhwG2KH7iseoDOkYqCtPgd_0 2024-09-12T18:33:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9340401124176042935', time=2024-09-12T20:16:24.522665+0000, chain.objs.size()=1 2024-09-12T18:33:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BlE1TflV2PX932SzxYUuAiM10YWCjLM_0 2024-09-12T18:33:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4571234263214456782', time=2024-09-12T20:16:24.628192+0000, chain.objs.size()=1 2024-09-12T18:33:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tzCzhP79rOR8nfU3_fp2eT4vz7Nl-x-_0 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6848810828852614203', time=2024-09-12T20:16:24.823963+0000, chain.objs.size()=1 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KCMCegkzFZd9DmEuje3SUdkkxPXgKym_0 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4159069159173406727', time=2024-09-12T20:16:25.499089+0000, chain.objs.size()=1 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qM6hUwxbQIJViTQVUefXFcMlF_WGnNZ_0 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4184262090436723172', time=2024-09-12T20:16:26.064835+0000, chain.objs.size()=1 2024-09-12T18:33:03.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IREcqJMYFCzdMN7nAp-6SPEp_2eyQiR_0 2024-09-12T18:33:03.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1526115748809275711', time=2024-09-12T20:16:26.200961+0000, chain.objs.size()=1 2024-09-12T18:33:03.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sUAz55ixOdQyb1AN-AxJddkWrzplmTR_0 2024-09-12T18:33:03.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.457+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/50053 2024-09-12T18:33:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14015834716441995940', time=2024-09-12T20:16:26.364931+0000, chain.objs.size()=1 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.L8hw9u50FVFNiYNIwk2PEecp0EmDBLD_0 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2613474204706437417', time=2024-09-12T20:16:26.949063+0000, chain.objs.size()=1 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JWbsS81ncsE2I2v9LrX6iI3HsGrp2OJ_0 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14469334456082332118', time=2024-09-12T20:16:27.437609+0000, chain.objs.size()=1 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wjXtyy5AxPLRUUcjz8G67dNfdw8kgbX_0 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.931530260991762628', time=2024-09-12T20:16:27.616478+0000, chain.objs.size()=1 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tI0tkQvZ-I9RtNVZ07scZp0EwDnl0p4_0 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17657604145945511788', time=2024-09-12T20:16:28.045967+0000, chain.objs.size()=1 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TNtK-qyREPrcx-P3A7CG1lHvOo8pjvP_0 2024-09-12T18:33:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14858986151075460008', time=2024-09-12T20:16:28.241052+0000, chain.objs.size()=1 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bW8Cd0IG64s_BrT59OQKa8J3tuLbiXM_0 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18293098755032518150', time=2024-09-12T20:16:28.340616+0000, chain.objs.size()=1 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3P8X3x9uHdE7m4eDo4SzaB3M34jAeG0_0 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5268961429667811811', time=2024-09-12T20:16:28.679833+0000, chain.objs.size()=1 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JAPNRe0wSFJiYWgfYyPTBSH5dVGZO8u_0 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12641162067545328895', time=2024-09-12T20:16:28.682917+0000, chain.objs.size()=1 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.msO37K_nO6t-Q8_Yr7Fglt5EsdEIBeK_0 2024-09-12T18:33:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9299772971128334717', time=2024-09-12T20:16:28.794447+0000, chain.objs.size()=1 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-Y3uMtgzhNMRg4TxG46rx6BbYR0YoUj_0 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6163619387054354519', time=2024-09-12T20:16:28.996540+0000, chain.objs.size()=1 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.96A1xsPbFt73hvq9DU-ckcRGHD6xJE9_0 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4644599965444935691', time=2024-09-12T20:16:30.750979+0000, chain.objs.size()=1 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QDiOQhwIc4E_hQAvmC3QsjZIScD5cXx_0 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.462+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16163669604114099904', time=2024-09-12T20:16:31.054440+0000, chain.objs.size()=1 2024-09-12T18:33:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.462+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lwrWWKu8xmJXFJXNLQreQzS8rApntqS_0 2024-09-12T18:33:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.464+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16889404559524696911', time=2024-09-12T20:17:41.434146+0000, chain.objs.size()=1 2024-09-12T18:33:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.464+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.456__shadow_.CgxMklhDObd0PeMaBXAFpYwo7_36igZ_0 2024-09-12T18:33:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.464+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17362503925910628663', time=2024-09-12T20:17:48.893278+0000, chain.objs.size()=1 2024-09-12T18:33:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.464+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.465__shadow_.njM5xzEA51Dzb4wYqnWMkVOQ562RvZH_0 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7960433692652159708', time=2024-09-12T20:18:06.632993+0000, chain.objs.size()=1 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.496__shadow_.9IGfIcpiVPM6y_RJvvNfTt6eV29nL3V_0 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5427371489205488188', time=2024-09-12T20:19:06.698512+0000, chain.objs.size()=12 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart._GCq8VzWeK7DrVlYkCklBzlOoUorCJem.1 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart._GCq8VzWeK7DrVlYkCklBzlOoUorCJem.1_1 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.2 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.2_1 2024-09-12T18:33:03.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.3 2024-09-12T18:33:03.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.3_1 2024-09-12T18:33:03.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.4 2024-09-12T18:33:03.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.467+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.4_1 2024-09-12T18:33:03.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.467+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.5 2024-09-12T18:33:03.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.5_1 2024-09-12T18:33:03.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.6 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.6_1 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15744279425926034710', time=2024-09-12T20:19:53.903869+0000, chain.objs.size()=3 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~Ad7iSWtXSfllB0UQfqItd8lPQG4Dk1Q.1 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~Ad7iSWtXSfllB0UQfqItd8lPQG4Dk1Q.2 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~Ad7iSWtXSfllB0UQfqItd8lPQG4Dk1Q.3 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14778389808376791785', time=2024-09-12T20:21:59.527812+0000, chain.objs.size()=1 2024-09-12T18:33:03.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:F9kElVEXj85cVO9m2IbWDVk3nrAw9hm_.7f5MX5oJp693cMeMeI5wXeCiQvF5rcB_0 2024-09-12T18:33:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7590249868809334483', time=2024-09-12T20:22:02.983833+0000, chain.objs.size()=1 2024-09-12T18:33:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:5y342WgVoJ8A-9QC5RQiodzp0lazrlD_.LLKkA1ug_g0TJXstRGSFEJJhyLQlD1a_0 2024-09-12T18:33:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14677596537451497862', time=2024-09-12T20:22:33.629813+0000, chain.objs.size()=1 2024-09-12T18:33:03.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.470+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:gObDvdW3CTq7muuS1t8NLyu9AhQc1LK_.7bV0fcPle49Vhji7-p5GpbKaRwptKSc_0 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.472+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16496904591730561195', time=2024-09-12T20:22:33.630532+0000, chain.objs.size()=1 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.472+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:MUwriHlaR-kqwP2vTsUzNPn6hwIeFdz_.8jT8nCTiYnC5zc_7ORWWTx9-OruPCPc_0 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.472+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8427609602095710469', time=2024-09-12T20:25:54.369748+0000, chain.objs.size()=1 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.472+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.618__shadow_.B_5ObvEIR_yD3S_WM00I5XY_p6NoEce_0 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.473+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13211648114150273539', time=2024-09-12T20:27:28.072426+0000, chain.objs.size()=1 2024-09-12T18:33:03.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.473+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.692__shadow:IB.IcO3Xwfw9oEub3--N0WWc1XpcGJz_.6alsJ3_O7uHOdDgGyYnCgTD48lmxj7d_0 2024-09-12T18:33:03.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.480+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:33:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.481+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.481+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46268' 2024-09-12T18:33:03.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18169448054076699662', time=2024-09-12T20:13:23.153573+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.253__shadow_.w6C5DC7Z6F-2LedMoOdC55-lIuoRyYP_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3876520042044362879', time=2024-09-12T20:13:24.956466+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.256__shadow_.wGeq1N3f_6SfyeQ0BkAyfpb6_QOTcyA_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6348311991667777682', time=2024-09-12T20:13:26.088591+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.258__shadow_.HOdUzaw_VcnZa-BwERwCRFKAj97I-dC_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10238943602789749954', time=2024-09-12T20:14:04.397898+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tjFlfaMqpqSzoq_2M2-0A7J8zRhOl0G_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4078949714047870279', time=2024-09-12T20:14:04.523520+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zaX8V2mIRilyqnTkPc6VFsygc4mF3OX_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2678487682817052858', time=2024-09-12T20:14:04.705698+0000, chain.objs.size()=1 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-UR7iKcljVFRTAXcl4XRKq_Jke7uSHd_0 2024-09-12T18:33:03.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3485001005212214821', time=2024-09-12T20:14:05.759976+0000, chain.objs.size()=1 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nVCZXuBNo4nMCzkgnT9QlHnj_cJNqMQ_0 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5874082455923360684', time=2024-09-12T20:14:06.136594+0000, chain.objs.size()=1 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.a3Up67LWNbygX2kgvkpRU8tCSr5h1zZ_0 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5498550776127123835', time=2024-09-12T20:14:06.400562+0000, chain.objs.size()=1 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.naaWs4c2k24aXuaYScBfTy6ybLqtDWQ_0 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6556699587995919917', time=2024-09-12T20:14:07.167385+0000, chain.objs.size()=1 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zKYJukccYKMGj-eCuOYF4fhmefkzX9b_0 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12544575423587645206', time=2024-09-12T20:14:07.284023+0000, chain.objs.size()=1 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mgDm4uG9ySh1X2VK1_Sl557T49X9f91_0 2024-09-12T18:33:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8339046700588582561', time=2024-09-12T20:14:07.519491+0000, chain.objs.size()=1 2024-09-12T18:33:03.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TWI4yPsmmqfhfEG7GUHpKWxmN_HnPVc_0 2024-09-12T18:33:03.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1945146892839088388', time=2024-09-12T20:14:07.920907+0000, chain.objs.size()=1 2024-09-12T18:33:03.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-8ZJc-13IWkBmwNdu1jMsc-0-6dVDf4_0 2024-09-12T18:33:03.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3086160087060130837', time=2024-09-12T20:14:08.206699+0000, chain.objs.size()=1 2024-09-12T18:33:03.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iidR_QKjOTtiemkGUyk5dBgN2GQAZST_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12620943988586741598', time=2024-09-12T20:14:08.757251+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.K9-p-zevs70kjSivq28XvSSM0M48f7C_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2194511774248619381', time=2024-09-12T20:14:08.833267+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.senQIeycyS1m-PgdSD69M3WsGXDUD3i_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9543085302900753530', time=2024-09-12T20:14:08.853064+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jR6p4mY3cFMaJ18mjMqvv4kSb7OuEiA_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6586869817566964671', time=2024-09-12T20:14:09.086255+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Cf4zmufvUBSlq41ToWQqTZEr856v4KZ_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.425950111314756743', time=2024-09-12T20:14:09.387310+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.B_CPdhq2Lpk5kJ9yvDAe8JXX1kU7mbp_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1365131476183436074', time=2024-09-12T20:14:09.637779+0000, chain.objs.size()=1 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.m2u43V9v0Gd-4CF3ikbkO8A8w_Xzrx4_0 2024-09-12T18:33:03.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13293901734488616764', time=2024-09-12T20:14:09.686101+0000, chain.objs.size()=1 2024-09-12T18:33:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.348bHauLb_WImkZAuIQpFKTix85YDBU_0 2024-09-12T18:33:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17765062547454671112', time=2024-09-12T20:14:10.401019+0000, chain.objs.size()=1 2024-09-12T18:33:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.s4WTYy1VgP02YRiZiTGsUE-Wpe0xRk7_0 2024-09-12T18:33:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.487+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12664337606817973156', time=2024-09-12T20:14:11.090876+0000, chain.objs.size()=1 2024-09-12T18:33:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.487+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Tw02TGhTauktNZX4KqShtY1wLjj-L33_0 2024-09-12T18:33:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17843978425951256486', time=2024-09-12T20:14:11.753569+0000, chain.objs.size()=1 2024-09-12T18:33:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KAzdcDvBzQsdh4d50v9tBpgP5bKODW4_0 2024-09-12T18:33:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16022367916176355231', time=2024-09-12T20:14:11.900192+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9Cq2RE9KzGkz47JKDk8Dz7HEzKwkIN__0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8878783308832752044', time=2024-09-12T20:14:11.900710+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.47cGW82TNRQ3edpxLDZCKW4bY4OQMxU_0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17451749665989346946', time=2024-09-12T20:14:12.031548+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wT-9HwwGqQcZD2TnHFGGRlLb69ezuTt_0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5033263990619671215', time=2024-09-12T20:14:12.081928+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.f5qbsU5GZMHokgdaVjUbiLUaeXOFln9_0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11371497734743375380', time=2024-09-12T20:14:12.256179+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6If5RJEJxnvsY7akQZDncm_j_RZlO2m_0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15886871042223447852', time=2024-09-12T20:14:13.455901+0000, chain.objs.size()=1 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F-h57UlPHeHnadHbzB-5vZ_Zu7WlETw_0 2024-09-12T18:33:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4450301870479714207', time=2024-09-12T20:14:13.769392+0000, chain.objs.size()=1 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DBqW-tyfM4Y6jbv9wTkXDYFvPpLPgjO_0 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8646530247908880273', time=2024-09-12T20:14:14.240518+0000, chain.objs.size()=1 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZIsmAjCuQ9xR-tDDmzpXGAcee3mlb6a_0 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4687554847186102090', time=2024-09-12T20:14:14.542373+0000, chain.objs.size()=1 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VMlPU5HMyMz2YoijyAZfxWZ6xSCsj3N_0 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4265204631683436331', time=2024-09-12T20:14:14.843073+0000, chain.objs.size()=1 2024-09-12T18:33:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.B2EVg1rByNapmQaCS2UIQAgsP0YKUIM_0 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10899995393576925615', time=2024-09-12T20:14:15.184349+0000, chain.objs.size()=1 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.c9576XEDDSt6uZagzz7-TO3u2R5ApuW_0 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11605616262738355044', time=2024-09-12T20:14:15.242255+0000, chain.objs.size()=1 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F8ZWrFp9zXSSX4qxUAb9ny2WHeB3aMb_0 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2555236363258014657', time=2024-09-12T20:14:34.501990+0000, chain.objs.size()=1 2024-09-12T18:33:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.496+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.fpltqlfXHvXt-VsLw6EXgxBfEZqu1Cx_0 2024-09-12T18:33:03.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17265417612285009587', time=2024-09-12T20:14:36.403585+0000, chain.objs.size()=1 2024-09-12T18:33:03.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.6eHSGvFkJq8Ed4Gsizc5qB6M99EaDkg_0 2024-09-12T18:33:03.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9644445355030639543', time=2024-09-12T20:14:36.522612+0000, chain.objs.size()=1 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.3I_LMRWTdaC-g_-ap9tEamtW0pLauGX_0 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5333541690364509497', time=2024-09-12T20:14:43.387069+0000, chain.objs.size()=1 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.304__shadow_.0AVDYz_justQS5W3LE8g_9ZFy9knsvB_0 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9142272178314995322', time=2024-09-12T20:15:32.160334+0000, chain.objs.size()=1 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.K1GYW3_WWkq43zmmuZWp4c3duerfVHr_0 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8041017476768161981', time=2024-09-12T20:15:32.288127+0000, chain.objs.size()=1 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5VzRb1CouTXcsdushfZf1a6cJ29hZsq_0 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17017735026895464658', time=2024-09-12T20:15:32.547800+0000, chain.objs.size()=1 2024-09-12T18:33:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vnzh6owZNDj73bZeR6Ohn5kcJeIwVVS_0 2024-09-12T18:33:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10715320248142202148', time=2024-09-12T20:15:32.902716+0000, chain.objs.size()=1 2024-09-12T18:33:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vjhoSCntdVx0YPLUG0oFtGoyw6pQv6B_0 2024-09-12T18:33:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.239289389108572287', time=2024-09-12T20:15:33.077683+0000, chain.objs.size()=1 2024-09-12T18:33:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.497+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vLb90D0TOI4nRSjTbHl2Np7SfPUA2ff_0 2024-09-12T18:33:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.501+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7928153339873364971', time=2024-09-12T20:15:34.148895+0000, chain.objs.size()=1 2024-09-12T18:33:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.501+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.r0LtN_2-EA6z6cUP6WJqH3ywWjpLRe9_0 2024-09-12T18:33:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.501+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10297283712504745480', time=2024-09-12T20:15:35.176254+0000, chain.objs.size()=1 2024-09-12T18:33:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.501+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n00Edh1Y5bzqxs4qvnd2n2-Ai6hPZcH_0 2024-09-12T18:33:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10165875292864520651', time=2024-09-12T20:15:35.294624+0000, chain.objs.size()=1 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Y_-TsOelbDpSsXRicZ-HxgkIl-g9_nY_0 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1615827283883783759', time=2024-09-12T20:15:35.525346+0000, chain.objs.size()=1 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.23ltysIV2tow2U2p1qXVuYv-i3Zt1Da_0 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7508787767745490251', time=2024-09-12T20:15:35.708612+0000, chain.objs.size()=1 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JioxJcmQU8S7rvlRFx0PdbOJa1NTWZD_0 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15748185535975236224', time=2024-09-12T20:15:35.856342+0000, chain.objs.size()=1 2024-09-12T18:33:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5WfkU-S5_vW_13q-TjXlRJsrQA7sHge_0 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8442035434242128234', time=2024-09-12T20:15:36.116402+0000, chain.objs.size()=1 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-LEIqTcBaJFisX8l9LblfIY7FNAncRp_0 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.912909980352820398', time=2024-09-12T20:15:36.640569+0000, chain.objs.size()=1 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.x_AXbDOpovwbPyLC_aJ_t4oih-Sy85K_0 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16362617821398000628', time=2024-09-12T20:15:36.860016+0000, chain.objs.size()=1 2024-09-12T18:33:03.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zM70fWqoJdLDzL5WmPHS3uQHuURqApN_0 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16058887559404650332', time=2024-09-12T20:15:36.917941+0000, chain.objs.size()=1 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.voIfmGyTeYBoyjLBZ5PGIS6v7Gnm8mo_0 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6060020748239620063', time=2024-09-12T20:15:37.047925+0000, chain.objs.size()=1 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YleCxMJgOAqXtDz4HdCJTXdrpQrNXM8_0 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12127265529088535560', time=2024-09-12T20:15:37.194342+0000, chain.objs.size()=1 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EjpAi4Y8SPP06Mp9Y0NI6UaDhWiuxI6_0 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12256686971786987238', time=2024-09-12T20:15:37.465055+0000, chain.objs.size()=1 2024-09-12T18:33:03.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Swycsg1rZ74Pb5q3cklr6JPQIeJl0Yt_0 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4189577456855781359', time=2024-09-12T20:15:37.664613+0000, chain.objs.size()=1 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0-a5WIAmsENeL-Busk3IpEnOCgRgXbV_0 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2980944569384209603', time=2024-09-12T20:15:38.030946+0000, chain.objs.size()=1 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qh8vuuntEVHJaO8o7q3yTr6iiXzXsXF_0 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11515107163175572808', time=2024-09-12T20:15:38.199889+0000, chain.objs.size()=1 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GRUMgLjQUOjfCSDyT5Vjdwt0TYIfEmN_0 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13516553179151507427', time=2024-09-12T20:15:38.317242+0000, chain.objs.size()=1 2024-09-12T18:33:03.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NPdUQa-aEn28rBFCkZCWbQfGIG7NwHx_0 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.508+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16088263299708052788', time=2024-09-12T20:15:38.364262+0000, chain.objs.size()=1 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.508+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QkgUV53DvfkpAD-nJKtwNm3hRtHzEL0_0 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5757200923358370441', time=2024-09-12T20:15:39.057122+0000, chain.objs.size()=1 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SR3E2ierUwRhGb3Xw1T4lya_Z6O9dxS_0 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2123372280510394630', time=2024-09-12T20:15:39.415150+0000, chain.objs.size()=1 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CGzAA9Ed4ST1EsqyCk2l37BLg_6r130_0 2024-09-12T18:33:03.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4664598782459771235', time=2024-09-12T20:15:39.435618+0000, chain.objs.size()=1 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tRe36iD_AL1OmDDaj9et-gbFudd3OaC_0 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15489439635993774448', time=2024-09-12T20:15:39.814744+0000, chain.objs.size()=1 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bDU9pGUfuRidB1AQUtyEfRJehTTPq0P_0 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4801786898919535070', time=2024-09-12T20:15:40.167246+0000, chain.objs.size()=1 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nw5CcfFGpCiAD397pcyA8Ol6cVr0z4F_0 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18290851206828262532', time=2024-09-12T20:15:40.177993+0000, chain.objs.size()=1 2024-09-12T18:33:03.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.76EVt52NKZfB6SUWS_JDYgT9cjHDQX2_0 2024-09-12T18:33:03.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.511+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8854392365908659773', time=2024-09-12T20:15:40.297133+0000, chain.objs.size()=1 2024-09-12T18:33:03.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.511+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pHE8w9v_WiYUC1gz2ibTs2rPpX6DIHG_0 2024-09-12T18:33:03.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2523094702500992825', time=2024-09-12T20:15:40.368113+0000, chain.objs.size()=1 2024-09-12T18:33:03.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8INxUUL-l7iPso7qmo7Kf7mDeTkwGhL_0 2024-09-12T18:33:03.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9082304810869123669', time=2024-09-12T20:15:40.424140+0000, chain.objs.size()=1 2024-09-12T18:33:03.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8FJTMavsV3Apl6HL1YP_6dpdqmLoN5Z_0 2024-09-12T18:33:03.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6925641121481625572', time=2024-09-12T20:15:41.015436+0000, chain.objs.size()=1 2024-09-12T18:33:03.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6eQXEhasBcIkzreahjxNr6QbNEm9hkK_0 2024-09-12T18:33:03.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9857367422188081963', time=2024-09-12T20:15:41.227000+0000, chain.objs.size()=1 2024-09-12T18:33:03.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FtzoJX_AOvWtgPcST4GDz5xlmEXZcjR_0 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7991048411866983208', time=2024-09-12T20:15:41.273114+0000, chain.objs.size()=1 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VtYw614IlNN3o_sGRXmJwZVebSLsAA9_0 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.55340618522106058', time=2024-09-12T20:15:41.400724+0000, chain.objs.size()=1 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EqJkQcx02KBZ2O8BBdmtmAPhbYe69qP_0 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5507822439680970146', time=2024-09-12T20:15:41.402107+0000, chain.objs.size()=1 2024-09-12T18:33:03.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.514+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yN1T9ZaH06AP-SrNfFk61xvWlkw1KVs_0 2024-09-12T18:33:03.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14693443351320245680', time=2024-09-12T20:15:41.675924+0000, chain.objs.size()=1 2024-09-12T18:33:03.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.acQZZQ-4hCWjxQqnThlDPr0y2qu3N-d_0 2024-09-12T18:33:03.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13545694279260397391', time=2024-09-12T20:15:41.719547+0000, chain.objs.size()=1 2024-09-12T18:33:03.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SuqRMEChJT7IqgO98p7BLh3D7olMET9_0 2024-09-12T18:33:03.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6495976583860618448', time=2024-09-12T20:15:42.073785+0000, chain.objs.size()=1 2024-09-12T18:33:03.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zfGpOhp2WUhXSLBKNuCRNu9c_fg30l0_0 2024-09-12T18:33:03.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7508212445931596580', time=2024-09-12T20:15:42.363944+0000, chain.objs.size()=1 2024-09-12T18:33:03.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.515+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.M70rnRhTaNJIAgNO7T4s8xInQsSwQid_0 2024-09-12T18:33:03.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14220763260775274001', time=2024-09-12T20:15:42.795314+0000, chain.objs.size()=1 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gzbTf_sY3v6aFQm266mYB8bLVbIMRA7_0 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16861563979247709612', time=2024-09-12T20:15:42.868495+0000, chain.objs.size()=1 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.R0hImFZ07FUzxfPvEAqNijxKezkTtnE_0 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15717954671728901015', time=2024-09-12T20:16:20.359704+0000, chain.objs.size()=1 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hxGWO3YFXX_RjLRSjkxFsuvX4At3fjT_0 2024-09-12T18:33:03.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16728268211654261273', time=2024-09-12T20:16:20.449248+0000, chain.objs.size()=1 2024-09-12T18:33:03.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.517+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1hDujOffseJuAaWVbfnBr3gD7MmBB8G_0 2024-09-12T18:33:03.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15692177012599706759', time=2024-09-12T20:16:20.994139+0000, chain.objs.size()=1 2024-09-12T18:33:03.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gdetIHOQAY9n_-nv08Hr7dtzJOkCDeD_0 2024-09-12T18:33:03.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11790149922253233059', time=2024-09-12T20:16:21.119316+0000, chain.objs.size()=1 2024-09-12T18:33:03.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TKP34aLJ8R4h-bGJdj6w3mY1d_YNx1K_0 2024-09-12T18:33:03.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16676068011894789161', time=2024-09-12T20:16:21.120038+0000, chain.objs.size()=1 2024-09-12T18:33:03.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.519+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3ZVpyHDQgO5Ngrg0X2hGGf9BIW35t4z_0 2024-09-12T18:33:03.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.200232276524847950', time=2024-09-12T20:16:22.387486+0000, chain.objs.size()=1 2024-09-12T18:33:03.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.P8Da_UfScITaBI2lyPNh9bWvhYjHbTP_0 2024-09-12T18:33:03.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17751644389093382214', time=2024-09-12T20:16:22.552504+0000, chain.objs.size()=1 2024-09-12T18:33:03.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5ilVZ8raKtL7-FRakvHrj0wL0X9LRTU_0 2024-09-12T18:33:03.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1004626198510319776', time=2024-09-12T20:16:23.122885+0000, chain.objs.size()=1 2024-09-12T18:33:03.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Cj_UbCr3IdTsyJopRqjJML_wUEyxw70_0 2024-09-12T18:33:03.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12596036133713576803', time=2024-09-12T20:16:23.367153+0000, chain.objs.size()=1 2024-09-12T18:33:03.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.520+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hNloq9ecbxMFyAw60VR8I-gI4f07A9h_0 2024-09-12T18:33:03.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3368549430155454679', time=2024-09-12T20:16:23.854089+0000, chain.objs.size()=1 2024-09-12T18:33:03.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.a36rm2SXoO35luKMtw7hHB9Wvrjyd1u_0 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16919765880128567770', time=2024-09-12T20:16:24.523532+0000, chain.objs.size()=1 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hjqFZj3PeW7DF3IcrnlQODyiHiTcnXu_0 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14046830198224672217', time=2024-09-12T20:16:24.906891+0000, chain.objs.size()=1 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.owhmOJQdEt_COvTWD5m2jyWauhDxWF0_0 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14399395069349828658', time=2024-09-12T20:16:25.250674+0000, chain.objs.size()=1 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5LEeT1P5JGkmouTAbZS1TAZd5KBpr8n_0 2024-09-12T18:33:03.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10689575327657413877', time=2024-09-12T20:16:25.251558+0000, chain.objs.size()=1 2024-09-12T18:33:03.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.523+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5EfMItsaTv9DZ7sFHBrPTZMO-PvocRx_0 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1207049679270021177', time=2024-09-12T20:16:25.408874+0000, chain.objs.size()=1 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1GkgqkbTm6a_THHer3sf1WTJzSlVMrw_0 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14278429027430488026', time=2024-09-12T20:16:25.469595+0000, chain.objs.size()=1 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.duBS1c4_7czDkyPoqVCkhuBODXZarPa_0 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14473533852415917101', time=2024-09-12T20:16:26.030869+0000, chain.objs.size()=1 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.525+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hc1x9KECpIflLFL2tERHA2ulVTh4V0m_0 2024-09-12T18:33:03.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/46268 2024-09-12T18:33:03.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T18:33:03.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16099331650188531920', time=2024-09-12T20:16:26.063454+0000, chain.objs.size()=1 2024-09-12T18:33:03.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6MgyH4ACVxAq5EMjSpvMvgjWiB2k8mX_0 2024-09-12T18:33:03.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17078349554340366932', time=2024-09-12T20:16:26.252331+0000, chain.objs.size()=1 2024-09-12T18:33:03.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zeMHxUvxp5i3B_CI36yb2YPGq0CyeIC_0 2024-09-12T18:33:03.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8666749722742778826', time=2024-09-12T20:16:26.839345+0000, chain.objs.size()=1 2024-09-12T18:33:03.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NY5mzyWHIDUHn9LCKT4J6ayXvZ4kzqT_0 2024-09-12T18:33:03.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.478309032832710085', time=2024-09-12T20:16:27.273140+0000, chain.objs.size()=1 2024-09-12T18:33:03.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.42TjcwAPvro54rw983x6ZSzJzKg3VEp_0 2024-09-12T18:33:03.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8974149932012996967', time=2024-09-12T20:16:27.308053+0000, chain.objs.size()=1 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.iJpz4Ah7y4bbMBCzRNiJF2pMDrxjvCZ_0 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13119415237448738285', time=2024-09-12T20:16:27.313937+0000, chain.objs.size()=1 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VbEcUUhzs-zPhLlsTcrkShYr1JGVKYZ_0 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17949461206501054929', time=2024-09-12T20:16:27.395863+0000, chain.objs.size()=1 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.snrZu-pUcfMB2qZdkaKVrD0c-x3Hd0K_0 2024-09-12T18:33:03.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16294542172998757202', time=2024-09-12T20:16:27.464415+0000, chain.objs.size()=1 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eGzJaMV4INtZQfbQXG67I-TaNCAdj2z_0 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16674473484218350819', time=2024-09-12T20:16:27.537015+0000, chain.objs.size()=1 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nOsKYwZ0nz042PXNYU9A5fHyVrK1L1h_0 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6184354657137090036', time=2024-09-12T20:16:27.743515+0000, chain.objs.size()=1 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZkdmswPj4DJFtPpYHjNQ6LLxf_3NC9y_0 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3804262084972638991', time=2024-09-12T20:16:27.984920+0000, chain.objs.size()=1 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lq5D5zA7vWTmL4qWiVzkfQ9EhOmFRJI_0 2024-09-12T18:33:03.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11506516862860472049', time=2024-09-12T20:16:29.097723+0000, chain.objs.size()=1 2024-09-12T18:33:03.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bpNJyFeWiwGR4m8GtF1LyMZ8ClDwGWr_0 2024-09-12T18:33:03.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11928375066681817818', time=2024-09-12T20:16:29.209108+0000, chain.objs.size()=1 2024-09-12T18:33:03.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ilqjSRaHo2bUQwmzftUr22hg9lkSLFp_0 2024-09-12T18:33:03.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8343362716934267709', time=2024-09-12T20:16:29.787807+0000, chain.objs.size()=1 2024-09-12T18:33:03.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nt7cviEvM6Uxtz6SzT-OwTfbc1nP6Mn_0 2024-09-12T18:33:03.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9235662834788323238', time=2024-09-12T20:16:30.529917+0000, chain.objs.size()=1 2024-09-12T18:33:03.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.A3iO-Oh5Bh5koab05ZqHO0bQfwfyvSQ_0 2024-09-12T18:33:03.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4916050035722042031', time=2024-09-12T20:17:48.036493+0000, chain.objs.size()=1 2024-09-12T18:33:03.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.464__shadow_.BuXEjsMeoaWyUVVP8Eg6HrsHelxQMMy_0 2024-09-12T18:33:03.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3841210128771335768', time=2024-09-12T20:17:57.250249+0000, chain.objs.size()=1 2024-09-12T18:33:03.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.-08Su-O1SLbf5av9Xmm-P8q4onoDpLf_0 2024-09-12T18:33:03.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9197249190650367620', time=2024-09-12T20:18:05.036328+0000, chain.objs.size()=1 2024-09-12T18:33:03.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.537+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.493__shadow_.v3P_P22ZQCN1Gr_Io2HcANMl6M9fENy_0 2024-09-12T18:33:03.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8081448158559215037', time=2024-09-12T20:18:05.947605+0000, chain.objs.size()=1 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.495__shadow_.49wjxiK3wvH213eSI0M0WgyerESt9c7_0 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3191178384736933104', time=2024-09-12T20:20:09.878179+0000, chain.objs.size()=7 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__multipart_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.1 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__shadow_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.1_1 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__multipart_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.2 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__shadow_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.2_1 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__multipart_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.3 2024-09-12T18:33:03.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__shadow_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.3_1 2024-09-12T18:33:03.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527__multipart_mymultipart.2~ITAsD9f-4eIXbcNbAnuzGZYhlWTz9Yv.4 2024-09-12T18:33:03.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.542+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7106333965698558732', time=2024-09-12T20:20:40.004510+0000, chain.objs.size()=1 2024-09-12T18:33:03.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.542+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.536__multipart_mymultipart.2~4fLq9N1J_C3f7Zd7a9mvERrcAxm--H3.1 2024-09-12T18:33:03.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.542+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13951022508516353824', time=2024-09-12T20:21:09.424015+0000, chain.objs.size()=1 2024-09-12T18:33:03.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.542+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.556__shadow_.LBUgHU1zj0elIF73NlAgRqtIwTRfsbi_0 2024-09-12T18:33:03.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13788998630921132856', time=2024-09-12T20:21:09.556668+0000, chain.objs.size()=1 2024-09-12T18:33:03.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.556__shadow_.S5bxfVLHBB63eFSbKD18lAvKVBxmW0Y_0 2024-09-12T18:33:03.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5496009230815834805', time=2024-09-12T20:21:37.570229+0000, chain.objs.size()=1 2024-09-12T18:33:03.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:M8hre0gtHmVr8jesnhgzUIH3SyZc-jo_.G2OWocKmhKb_kKgQhX74mZ_BODumBzK_0 2024-09-12T18:33:03.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.352231115194736187', time=2024-09-12T20:21:49.593374+0000, chain.objs.size()=1 2024-09-12T18:33:03.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.575__shadow_.ty1A_P9FZ57UBqJem9oVA0HnAea-3sG_0 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4509877306207877030', time=2024-09-12T20:21:52.824685+0000, chain.objs.size()=1 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:quDuf6PMJP4dcbPxzhW9-vDi3h6GMTA_.ebOXIUOjaP9v-mCBm61RxkLtBt9WPif_0 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7920206164403977258', time=2024-09-12T20:21:56.375887+0000, chain.objs.size()=1 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:jOcep4Ww-2ofytX8wYKeMt9P4xw3V4R_.9QD2MnM5RP7G9ERzFfeJZGicYVq_JK2_0 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18122884164679020199', time=2024-09-12T20:22:03.619281+0000, chain.objs.size()=1 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:dX4kgU0yDjInwqVDFnGzmPu8Fop1aqg_.R3L8MKonD45aqcPajvoJj6_m4gdBqYM_0 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8301632052186425238', time=2024-09-12T20:22:04.722020+0000, chain.objs.size()=1 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:ZJgrOA-IEW3n5TYQPalz6B77TePl.0a_._8_G0fQJb8d9jJgBcDmQX19MYxpTyd0_0 2024-09-12T18:33:03.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.545+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17887021028790927029', time=2024-09-12T20:22:39.538423+0000, chain.objs.size()=1 2024-09-12T18:33:03.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.545+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:Ej84zGDu6m05b5p2iuNkA80xyAtnbH4_.RAS7sQWDyf_QN4OtZwNeyw80MbUOQi2_0 2024-09-12T18:33:03.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.546+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9152034333119857704', time=2024-09-12T20:22:47.959906+0000, chain.objs.size()=1 2024-09-12T18:33:03.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.546+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.604__shadow_.GbUoGHP5Z2ZXdnAxcyf4KLhNxoDdfvs_0 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7334291533938557870', time=2024-09-12T20:26:31.181212+0000, chain.objs.size()=1 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.631__shadow_.8dP3pgSP2o-icNkxR6afOYASf-9G70P_0 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13347875024439710521', time=2024-09-12T20:27:16.476008+0000, chain.objs.size()=1 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.668__shadow_.aoazcmvWUISVImEovTBFRQxxK5rba_D_0 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6201792077346465824', time=2024-09-12T20:27:37.065987+0000, chain.objs.size()=1 2024-09-12T18:33:03.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.547+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.707__shadow:MjLMTKz6evVYGhEWDkPgbWnzcM49e1E_.4vjWnizbesqs-wD05ptuF9PN6h9KsPP_0 2024-09-12T18:33:03.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.553+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.555+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:33:03.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.556+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.557+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45297' 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8499612146201056802', time=2024-09-12T20:10:53.909280+0000, chain.objs.size()=1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.157__shadow:ni0tDKcRSyf4ZaWKMFXaAhbNI-mz39v_.-2PkXgdUiLxwklr5RKwFrGilh9i_04S_0 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18430536718137485364', time=2024-09-12T20:11:09.010629+0000, chain.objs.size()=5 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-LUKEWARM.2~KJJg-EGi86Q-NTBNz7q4JTf8Afe3yye.1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_foo-LUKEWARM.2~KJJg-EGi86Q-NTBNz7q4JTf8Afe3yye.1_1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-LUKEWARM.2~KJJg-EGi86Q-NTBNz7q4JTf8Afe3yye.2 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_foo-LUKEWARM.2~KJJg-EGi86Q-NTBNz7q4JTf8Afe3yye.2_1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-LUKEWARM.2~KJJg-EGi86Q-NTBNz7q4JTf8Afe3yye.3 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.928986669112558695', time=2024-09-12T20:13:09.928040+0000, chain.objs.size()=1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.233__shadow_.eiegnOCqXLDJjnZ56zEcOcSMN43mheV_0 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503912299892600764', time=2024-09-12T20:13:11.787336+0000, chain.objs.size()=1 2024-09-12T18:33:03.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.236__shadow_.B1_WQkr6_swbro8u0BReWtRMlwMCp6i_0 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14641312386975395094', time=2024-09-12T20:13:18.877261+0000, chain.objs.size()=1 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.246__shadow_.c1jmy55vP00R2V4RUyJVbqW82Y2HKeZ_0 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5907471384943568946', time=2024-09-12T20:13:27.289665+0000, chain.objs.size()=1 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.260__shadow_.5kLW1GyjmSBCfmOusNLrNbw7EtNBhFC_0 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10209814490028388636', time=2024-09-12T20:13:27.294898+0000, chain.objs.size()=1 2024-09-12T18:33:03.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.260__shadow_.MAeic8AB1oZj-Pm41SKIkfsToPszJ9s_0 2024-09-12T18:33:03.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2715116077615805138', time=2024-09-12T20:14:04.349823+0000, chain.objs.size()=1 2024-09-12T18:33:03.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.558+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.x2N1sGGM2kKWx0dAYrpuzS5e0mL8xaI_0 2024-09-12T18:33:03.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5347695180798461902', time=2024-09-12T20:14:04.450029+0000, chain.objs.size()=1 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.g9W8dGfzfCTpYfwI3ew8sae3Vj9U6g-_0 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14159618831151042200', time=2024-09-12T20:14:04.525882+0000, chain.objs.size()=1 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VJ-LLoZnogzXqexUJTdLvdnbjpu-yUG_0 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12544738706637105414', time=2024-09-12T20:14:04.596967+0000, chain.objs.size()=1 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fh-rrKdM9j4IxtBuz22EJ5Df2rsnycs_0 2024-09-12T18:33:03.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4047371761422292294', time=2024-09-12T20:14:04.851229+0000, chain.objs.size()=1 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vgtNY-7CvPnVCVehPvZuy9YcFLcdErw_0 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11514743138226250713', time=2024-09-12T20:14:05.006531+0000, chain.objs.size()=1 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.X69DEHxhoe6-pwHeZM8a8JfQ7ydMHbe_0 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11880074272475149760', time=2024-09-12T20:14:05.066268+0000, chain.objs.size()=1 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WoJQfkEwn84hhpjjtbJKbbTobaPo2ga_0 2024-09-12T18:33:03.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5060497515468554056', time=2024-09-12T20:14:05.635092+0000, chain.objs.size()=1 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hENIPO6PzfyYwhNRHUvcthnNiv8WDZ-_0 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11537791592717070534', time=2024-09-12T20:14:06.080676+0000, chain.objs.size()=1 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.h3PCtWMzkRRPAxmfg9GQjzz2uVsk0HB_0 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4294331805251888590', time=2024-09-12T20:14:06.303261+0000, chain.objs.size()=1 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.27DDJOwNF5w3f_Kvzb9YOiugUqtEXRs_0 2024-09-12T18:33:03.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9874863651697363156', time=2024-09-12T20:14:06.334935+0000, chain.objs.size()=1 2024-09-12T18:33:03.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hcJ0fEfPCFM-Pp-wJyCAMRmJ-EK-jB3_0 2024-09-12T18:33:03.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11088531474241321288', time=2024-09-12T20:14:07.514431+0000, chain.objs.size()=1 2024-09-12T18:33:03.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wGao9hF8NOYjK_zmqw-5V5mGO6t9VFh_0 2024-09-12T18:33:03.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.566+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.176444510643042019', time=2024-09-12T20:14:07.750063+0000, chain.objs.size()=1 2024-09-12T18:33:03.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.566+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Vl0foJ9sajgQ7rd2AxFKdOtgZ-vyYOP_0 2024-09-12T18:33:03.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6613281618547460268', time=2024-09-12T20:14:07.752072+0000, chain.objs.size()=1 2024-09-12T18:33:03.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fCcINPxOWtChOOqOgFD_PvzgYHA1KwX_0 2024-09-12T18:33:03.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7974566126844153642', time=2024-09-12T20:14:07.955052+0000, chain.objs.size()=1 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gkcpEqjLrdr6yc-Q6fqNjGGJPpa-ILf_0 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4046964137918773393', time=2024-09-12T20:14:08.168730+0000, chain.objs.size()=1 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oliQhI6lldVgp2OLJcytA17h8h3-mG3_0 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12721597568902568777', time=2024-09-12T20:14:08.607968+0000, chain.objs.size()=1 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3xqFUqgRneDy_2Kx9lNNixd-ZHkhuB-_0 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5090584207271977110', time=2024-09-12T20:14:08.663449+0000, chain.objs.size()=1 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MbTMmodFziN3IpwfULaA4lPJkgW53h6_0 2024-09-12T18:33:03.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14664593886067890828', time=2024-09-12T20:14:08.884256+0000, chain.objs.size()=1 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2fPuW0gu5jDQAjjl-xrya47dO04zaEq_0 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10184418523334726500', time=2024-09-12T20:14:09.233441+0000, chain.objs.size()=1 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xjdIQTaw7vSZ9c5WybwQ_B7lyCJ9yCU_0 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2292766265843224544', time=2024-09-12T20:14:09.276076+0000, chain.objs.size()=1 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.J6nsZc9zI9hWaHOY6X-QCYorfn6BuOn_0 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4249838778458677364', time=2024-09-12T20:14:09.277604+0000, chain.objs.size()=1 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bcyEWnrP9zPeglrI93MkRQNRdQb5KHs_0 2024-09-12T18:33:03.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13130717710576120736', time=2024-09-12T20:14:09.347975+0000, chain.objs.size()=1 2024-09-12T18:33:03.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nKBayX29rcLMD-PgzTUeoW75S0N0bb3_0 2024-09-12T18:33:03.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.570+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11262074686002153199', time=2024-09-12T20:14:09.609334+0000, chain.objs.size()=1 2024-09-12T18:33:03.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.570+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1t50OeJPfqb1IaqFKZrAq89EBvlAxcW_0 2024-09-12T18:33:03.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.570+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13305842775465734189', time=2024-09-12T20:14:09.661686+0000, chain.objs.size()=1 2024-09-12T18:33:03.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.570+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gqNu8F7lSfAc7FR2ulIIt2uCFTuubZC_0 2024-09-12T18:33:03.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4235045448854721809', time=2024-09-12T20:14:09.677971+0000, chain.objs.size()=1 2024-09-12T18:33:03.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PUB4h71oUgl0A4svuPYIF1MSkmp_W9S_0 2024-09-12T18:33:03.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10981583359642320177', time=2024-09-12T20:14:10.258719+0000, chain.objs.size()=1 2024-09-12T18:33:03.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2Hu7bSthx9Eg5A9Xi7JVWnMhPc5W2vM_0 2024-09-12T18:33:03.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8447276071940422927', time=2024-09-12T20:14:10.568329+0000, chain.objs.size()=1 2024-09-12T18:33:03.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TVYpkgZnD1Iic4vfjBNnfWPgrGcL2y0_0 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5599949970747766679', time=2024-09-12T20:14:10.588912+0000, chain.objs.size()=1 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WyekO8LhsaeZRG5RrTrRC5mWpQtR2Tm_0 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11759227418978451081', time=2024-09-12T20:14:10.829369+0000, chain.objs.size()=1 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TTH3qwRXFWIg3TzGOHuwCV5qLqIxvZ4_0 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10979376371279137176', time=2024-09-12T20:14:10.976598+0000, chain.objs.size()=1 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zJ1DoyXxEh77GxNPQ3RjXvnbZNNIxrR_0 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.694540881376029102', time=2024-09-12T20:14:11.042991+0000, chain.objs.size()=1 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Lx832fkurMIUbWGJJnIY2cub2rO7c7D_0 2024-09-12T18:33:03.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11226349562106506738', time=2024-09-12T20:14:11.093504+0000, chain.objs.size()=1 2024-09-12T18:33:03.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RJqKPSDKs4xVoQ95MCPTE3NNvs4oovU_0 2024-09-12T18:33:03.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11327439241781859598', time=2024-09-12T20:14:11.854901+0000, chain.objs.size()=1 2024-09-12T18:33:03.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.j0X1oZnaW6uYpdhnjFx_1g0UsE5dHJq_0 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.575+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10766240067328986217', time=2024-09-12T20:14:12.082595+0000, chain.objs.size()=1 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.575+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cUYQLzvSe2SiZ3vYWW1UtZsnSYuxp4e_0 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.575+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8914441937524371813', time=2024-09-12T20:14:12.100853+0000, chain.objs.size()=1 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.575+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.g1ElE1J0BsIP6L98Km06CiQCInC4hMW_0 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.577+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13022188335558463111', time=2024-09-12T20:14:12.148171+0000, chain.objs.size()=1 2024-09-12T18:33:03.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.577+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.D2bwrKKPJpD9O_u3LyDpwHAq2P5e2-g_0 2024-09-12T18:33:03.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3446980443852227648', time=2024-09-12T20:14:12.539061+0000, chain.objs.size()=1 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.C2cdFyZPmsbJkc5ZNwJSL29TYDauE8p_0 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6868371714690037657', time=2024-09-12T20:14:13.158760+0000, chain.objs.size()=1 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fJr76oG1F_jZOb7Bq4jciciJevQfksv_0 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10083948653092668465', time=2024-09-12T20:14:13.413438+0000, chain.objs.size()=1 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mKin6e1VKB7DWi-vjeZSuLw0oSv3Bk5_0 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18079474339261869850', time=2024-09-12T20:14:13.418313+0000, chain.objs.size()=1 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Fd4pTYfSgzA9gUjV11b9lI3kh9O3NQ5_0 2024-09-12T18:33:03.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1549271994937850220', time=2024-09-12T20:14:13.879829+0000, chain.objs.size()=1 2024-09-12T18:33:03.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qWZui1TWc-sEyPvaS29oG0kwIpgrLhM_0 2024-09-12T18:33:03.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6095471597672393464', time=2024-09-12T20:14:14.200055+0000, chain.objs.size()=1 2024-09-12T18:33:03.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Kb79BcbNqlElwcuLs97nNlxSgl4D6lR_0 2024-09-12T18:33:03.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12318289104625301900', time=2024-09-12T20:14:14.731533+0000, chain.objs.size()=1 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ndOz2-fhRxyC5_XCFO_d2BIlwOBe5dX_0 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7996385152358066910', time=2024-09-12T20:14:14.751896+0000, chain.objs.size()=1 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7DP6FxyzZvUNtcs_SKmcLKnwcVgAKkA_0 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1374181601443050452', time=2024-09-12T20:14:14.820304+0000, chain.objs.size()=1 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Bxo4YtXgdS-U75OUjdfJWqibRMZFqfN_0 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18178825520682881183', time=2024-09-12T20:14:14.820926+0000, chain.objs.size()=1 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.AVxKBmjB5wdNtIrDBM-qdjPW0qNYKyy_0 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16085181688097823794', time=2024-09-12T20:14:14.976959+0000, chain.objs.size()=1 2024-09-12T18:33:03.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5ClxlSeKslDnGeFjTHqW4xbRF6xqSCh_0 2024-09-12T18:33:03.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.585+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8060528514825087205', time=2024-09-12T20:14:15.008429+0000, chain.objs.size()=1 2024-09-12T18:33:03.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.585+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._yBMbqeMIA11cCgD3XfMeJbG41AAjiL_0 2024-09-12T18:33:03.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.585+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10520546578464144744', time=2024-09-12T20:14:16.376954+0000, chain.objs.size()=1 2024-09-12T18:33:03.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.585+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.264__shadow_.Y5QE0nc4TOjlH0AoMw127eCUnLyhmwE_0 2024-09-12T18:33:03.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6964459406244937261', time=2024-09-12T20:14:36.432031+0000, chain.objs.size()=1 2024-09-12T18:33:03.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.ZtDpFTHacXgA1muhv74n5tPrkHbuKHN_0 2024-09-12T18:33:03.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12719687788159596423', time=2024-09-12T20:14:36.525944+0000, chain.objs.size()=1 2024-09-12T18:33:03.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.y_0TdA-3jaTmh-fvUDrtTbjLMDbpr5b_0 2024-09-12T18:33:03.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16638737721605443390', time=2024-09-12T20:14:37.132024+0000, chain.objs.size()=1 2024-09-12T18:33:03.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.294__shadow_.R74O_Zij3g9EvzmoxAOierhH2c3N19K_0 2024-09-12T18:33:03.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12491507356617569045', time=2024-09-12T20:14:40.997070+0000, chain.objs.size()=1 2024-09-12T18:33:03.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.300__shadow_.ZANu8DRGBU-YwE-qBPDKqWiOeEXfLaS_0 2024-09-12T18:33:03.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2234467914274537603', time=2024-09-12T20:14:42.194413+0000, chain.objs.size()=1 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.302__shadow_.-qWwQ0b35vPyrI7YE1Pk9Tl127i99QN_0 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12665014344340759752', time=2024-09-12T20:14:42.788720+0000, chain.objs.size()=1 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.303__shadow_.9dPRvc3CZGLHViCtdmLdEFIBmrMDUE3_0 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1139802933833162568', time=2024-09-12T20:15:32.336550+0000, chain.objs.size()=1 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GVLv4-lbd9eT4uUAb_MmB8lWedImqBM_0 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2801548862685982439', time=2024-09-12T20:15:32.913129+0000, chain.objs.size()=1 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.U6kJzCkUBBZ1xLHARcADuVeintIyLc4_0 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18386605348612785370', time=2024-09-12T20:15:33.030143+0000, chain.objs.size()=1 2024-09-12T18:33:03.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3YWahE-8M4Lpe0gUKf3qj_Cxc2B150r_0 2024-09-12T18:33:03.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.591+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5790445987028214521', time=2024-09-12T20:15:33.122082+0000, chain.objs.size()=1 2024-09-12T18:33:03.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uxerR9CTpubF6TcOjyEKn6N7WJKCcPS_0 2024-09-12T18:33:03.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.591+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7792944746381285118', time=2024-09-12T20:15:33.174316+0000, chain.objs.size()=1 2024-09-12T18:33:03.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VFcGOFfVmKCYmxRYJSKXvyw6ZsDS_tT_0 2024-09-12T18:33:03.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.593+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10794819825851948346', time=2024-09-12T20:15:33.230858+0000, chain.objs.size()=1 2024-09-12T18:33:03.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.593+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ePZeGUxkvQ0yjKjUWjvrHDzhOEBuZX6_0 2024-09-12T18:33:03.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11469527372303032372', time=2024-09-12T20:15:34.211506+0000, chain.objs.size()=1 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QD7_OtJ_kE_NOnJ9hjDSyqyw69wssqZ_0 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12056219073659936581', time=2024-09-12T20:15:34.414899+0000, chain.objs.size()=1 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bmBGSPQnB6vhp1jSBo51V6-nEDq9O0k_0 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16532502248589319388', time=2024-09-12T20:15:34.633148+0000, chain.objs.size()=1 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mp_xV-C1XgC95M8KqgRhqLgVd1-a93W_0 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8113615389604130740', time=2024-09-12T20:15:35.300935+0000, chain.objs.size()=1 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zxqQ0eCDwnAbQQsEX3NDD3ymh2oxR4w_0 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3218027483382190350', time=2024-09-12T20:15:35.852805+0000, chain.objs.size()=1 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dXHrjvOHuQcVNRKO-pAh3__6px80jez_0 2024-09-12T18:33:03.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1163295508597700025', time=2024-09-12T20:15:35.960273+0000, chain.objs.size()=1 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VV59aLRaFr-J0QQqcmcGe_r4KUZ86GC_0 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12133039197874302995', time=2024-09-12T20:15:36.071938+0000, chain.objs.size()=1 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JaHJeKizDkwTeHn0UetE-0w_Kf_FsYV_0 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15555621180403352420', time=2024-09-12T20:15:36.148440+0000, chain.objs.size()=1 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.448XuSDtBW2xvaen7gtzA9t2dQ5I0lY_0 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6818732516595958755', time=2024-09-12T20:15:36.226261+0000, chain.objs.size()=1 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dLcUKdFh8W_xBM5vF6ScI43Uae7stes_0 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10941717337325428453', time=2024-09-12T20:15:36.682794+0000, chain.objs.size()=1 2024-09-12T18:33:03.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.596+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Csg-P80NqumQn9wjVJxbTN0Sp7dK5mA_0 2024-09-12T18:33:03.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.599+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3528526514331284633', time=2024-09-12T20:15:36.684048+0000, chain.objs.size()=1 2024-09-12T18:33:03.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.599+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MawIoN3mlNcsjbQ4GtZWW7i60bAChW8_0 2024-09-12T18:33:03.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5927685765906392983', time=2024-09-12T20:15:36.796877+0000, chain.objs.size()=1 2024-09-12T18:33:03.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.whBPG0dXTIsZWPJKt8TTuFXbXMw1Cr0_0 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6446346785376022327', time=2024-09-12T20:15:37.001073+0000, chain.objs.size()=1 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zuyuuAozSBT7qc_sgH0YKIB8u0rFLYL_0 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14162582476266386998', time=2024-09-12T20:15:37.421635+0000, chain.objs.size()=1 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FxNSBYzMHSD344HFQ-LZYNZ2PGKDrh__0 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6209550032255921995', time=2024-09-12T20:15:38.066753+0000, chain.objs.size()=1 2024-09-12T18:33:03.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._Yl0PCdlFcuinzamKf_oXFfpq0VaBgT_0 2024-09-12T18:33:03.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8359051962252277558', time=2024-09-12T20:15:38.224768+0000, chain.objs.size()=1 2024-09-12T18:33:03.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qu9lp0hXu3Gzvv6VYWDuR7sQG1N_G1W_0 2024-09-12T18:33:03.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1367043127399302991', time=2024-09-12T20:15:38.690179+0000, chain.objs.size()=1 2024-09-12T18:33:03.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.g2smBHARTDOY6_RnYlij9Shg6QjSXs0_0 2024-09-12T18:33:03.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5451875721368494827', time=2024-09-12T20:15:38.787626+0000, chain.objs.size()=1 2024-09-12T18:33:03.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UVp6dYUn8lFrhZ5XFFzEfBAvfNYa4UM_0 2024-09-12T18:33:03.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8914671423717780299', time=2024-09-12T20:15:39.424271+0000, chain.objs.size()=1 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mbUg7_dL0MhXo3fmtpiTT8a6EN4cUdP_0 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11122056758802792785', time=2024-09-12T20:15:39.556993+0000, chain.objs.size()=1 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J7aXV_eDSOZuCt9E4VY8eiTS6qIeBp7_0 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4198623480389530507', time=2024-09-12T20:15:41.105006+0000, chain.objs.size()=1 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.602+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hMM4f3aml7liB2rQbgg2rNhRvoEw4Y8_0 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9354183683299216397', time=2024-09-12T20:15:41.214042+0000, chain.objs.size()=1 2024-09-12T18:33:03.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.sApWCFKAMSY_qW0YYums_AfnwKzk3dc_0 2024-09-12T18:33:03.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.605+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11872031380763054578', time=2024-09-12T20:15:41.753193+0000, chain.objs.size()=1 2024-09-12T18:33:03.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.605+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._YeyDLnpZuQLxLHpp1SaGlwNcK3NSj9_0 2024-09-12T18:33:03.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.605+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9721170048619875543', time=2024-09-12T20:15:42.832224+0000, chain.objs.size()=1 2024-09-12T18:33:03.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.605+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0FAdjLKdC0rQhh0IfQlkRFU1o1-b6PB_0 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.606+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10639459549820270244', time=2024-09-12T20:16:20.087361+0000, chain.objs.size()=1 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.606+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EAwahw5uokZgNVe7RilHQmQHrMF2f4B_0 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.606+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18370899606196312381', time=2024-09-12T20:16:20.087921+0000, chain.objs.size()=1 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.606+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Fp6f-lzB2WmfXhKlw17LSDp8PSqFmMt_0 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.607+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.633686091580411576', time=2024-09-12T20:16:20.149339+0000, chain.objs.size()=1 2024-09-12T18:33:03.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.607+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CE9fA6iex653YMpQdsQUB_No7Sp3oOF_0 2024-09-12T18:33:03.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13717071874254290152', time=2024-09-12T20:16:20.565485+0000, chain.objs.size()=1 2024-09-12T18:33:03.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6TOH1A6M2nE0L_UNEXAUSx3ZMoQx2ah_0 2024-09-12T18:33:03.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8018203898696904482', time=2024-09-12T20:16:20.931395+0000, chain.objs.size()=1 2024-09-12T18:33:03.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZgIQ1vmX9E_X2D7wTZHlzl4YH14PLqq_0 2024-09-12T18:33:03.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3564526178979860326', time=2024-09-12T20:16:23.115931+0000, chain.objs.size()=1 2024-09-12T18:33:03.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OJDORlG7h16CpN5KaR5CL5XvV_ReRvS_0 2024-09-12T18:33:03.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7859610202100474363', time=2024-09-12T20:16:23.426749+0000, chain.objs.size()=1 2024-09-12T18:33:03.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9D2ciVkX7oTSBd7NRjs1R91wHvXYPL2_0 2024-09-12T18:33:03.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/45297 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6870933253230527311', time=2024-09-12T20:16:23.467924+0000, chain.objs.size()=1 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.W-Yh-E6F5r2-wwynovNGjitk5xZSKzI_0 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1886314039145118400', time=2024-09-12T20:16:23.633468+0000, chain.objs.size()=1 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Q7ntNDyudk_SypUFRG4Yn6LIJLncfYL_0 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15778826257125544648', time=2024-09-12T20:16:23.700765+0000, chain.objs.size()=1 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yzwr6LC99YvkF8mE0dztUCIL3CSDELC_0 2024-09-12T18:33:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16856515199239902745', time=2024-09-12T20:16:23.819986+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BkLeF7MKNNesunr1c4K90Fy1IM_liCk_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16417751652806469604', time=2024-09-12T20:16:24.546600+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dIh_IhpvULjo-n0kTNVLCRRYzyCKsU0_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9253179347439383016', time=2024-09-12T20:16:24.943927+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YqGLZLEi1XFLMGsB90FQv4t2Z7M--dZ_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10293602780763060540', time=2024-09-12T20:16:24.962539+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7aol5RhZjzoEbzFKSDPN9pIfykZcNk3_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15836318297436612332', time=2024-09-12T20:16:26.065413+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oxtUhKPbAKrHqnOxat6nPt-EQfBNEuY_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4409509684904904490', time=2024-09-12T20:16:26.100613+0000, chain.objs.size()=1 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DgnGeqV5WD73K0xkFMN4yxA1rIThDt-_0 2024-09-12T18:33:03.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8448515392304432804', time=2024-09-12T20:16:26.220600+0000, chain.objs.size()=1 2024-09-12T18:33:03.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.SXUQYI_BgH1YMpaolAGFPTMMPxkg555_0 2024-09-12T18:33:03.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14867360206684928673', time=2024-09-12T20:16:26.221271+0000, chain.objs.size()=1 2024-09-12T18:33:03.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._qOslHXA-QggZnhf9WVYawk5QkFjJFN_0 2024-09-12T18:33:03.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7374347880630613978', time=2024-09-12T20:16:26.547674+0000, chain.objs.size()=1 2024-09-12T18:33:03.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.617+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JCHVC_WSJ3ux11qE4SJ_M3r_gk0EeMq_0 2024-09-12T18:33:03.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5679487804030582619', time=2024-09-12T20:16:26.806546+0000, chain.objs.size()=1 2024-09-12T18:33:03.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LqAXXDqIrVTCQ1vn1sbY5xivOJ_UpMt_0 2024-09-12T18:33:03.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14210807674162108550', time=2024-09-12T20:16:26.902355+0000, chain.objs.size()=1 2024-09-12T18:33:03.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7MDyW9CTHjvwu0XLfVKi67CodU30r-g_0 2024-09-12T18:33:03.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3956622575603831952', time=2024-09-12T20:16:27.297730+0000, chain.objs.size()=1 2024-09-12T18:33:03.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kwQh-BNfXSIr5cq82ZT0A9Ez8UizJdC_0 2024-09-12T18:33:03.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7986934112386348803', time=2024-09-12T20:16:27.328157+0000, chain.objs.size()=1 2024-09-12T18:33:03.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jhJzOaWOmChdiHEdcx3x5yN719qGksZ_0 2024-09-12T18:33:03.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7689631583391786570', time=2024-09-12T20:16:27.655192+0000, chain.objs.size()=1 2024-09-12T18:33:03.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BauUSE4WifuOlj52c3Yekwed61tWqhh_0 2024-09-12T18:33:03.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16043290757538657580', time=2024-09-12T20:16:29.844786+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ED9crwRgPtTwysOPXIjLegVDYRh2wr__0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3136543701153772630', time=2024-09-12T20:16:29.913235+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7DIlY2FuF1P3oDInm4MX6_xsmE5s7Rt_0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2108058729659168478', time=2024-09-12T20:16:30.216368+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BUXtqZE5-Ub96rUXIBzv04H0NbCXKVN_0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3882832192273752770', time=2024-09-12T20:16:30.621352+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eozoHXUTNZaSJNREqMGry3rf62udqOn_0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16217909437526435921', time=2024-09-12T20:16:58.399894+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.378__shadow_.zMf_nMyB5OBcxBQka3GUehnX0BXm9PG_0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15812754900254635388', time=2024-09-12T20:17:33.684815+0000, chain.objs.size()=1 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.443__shadow_.e2HIKCnvaA4AbaDru0BbADOul4Ru81L_0 2024-09-12T18:33:03.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12668138304659938712', time=2024-09-12T20:17:49.387505+0000, chain.objs.size()=1 2024-09-12T18:33:03.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466__shadow_.iyn9ELgGqmZPZOnsY_U5xIt6FJLrFq9_0 2024-09-12T18:33:03.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2153991337676149996', time=2024-09-12T20:17:57.240038+0000, chain.objs.size()=1 2024-09-12T18:33:03.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.acjveRaDHtGR1yeVXnMKlxjmQ0EJklg_0 2024-09-12T18:33:03.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16411374242185813496', time=2024-09-12T20:18:20.453834+0000, chain.objs.size()=6 2024-09-12T18:33:03.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv', time=2024-09-12T20:19:29.454127+0000, chain.objs.size()=1 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.2 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv', time=2024-09-12T20:19:29.457990+0000, chain.objs.size()=1 2024-09-12T18:33:03.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.3 2024-09-12T18:33:03.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4303163035790311872', time=2024-09-12T20:19:41.457029+0000, chain.objs.size()=6 2024-09-12T18:33:03.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.1 2024-09-12T18:33:03.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.qtNfXa2naqm9PoiOvzaUbkFLNMGmpE6m.2 2024-09-12T18:33:03.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.631+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.IvcAn-OsWZE81pDl_HKhy0poeqAMFosb.3 2024-09-12T18:33:03.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.4 2024-09-12T18:33:03.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.5 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~tz3-Gorr4UjPPDYFao4xY8EyiBpOIJv.6 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8502028777853479375', time=2024-09-12T20:19:50.340762+0000, chain.objs.size()=2 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~bZpUoUXucepFhr1iFHAnBS8Vl39vGHk.1 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~bZpUoUXucepFhr1iFHAnBS8Vl39vGHk.2 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17997711289632025845', time=2024-09-12T20:20:00.032772+0000, chain.objs.size()=2 2024-09-12T18:33:03.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~Xi-a8QkHNuxNTWIpLrPMNvh-tcGn537.1 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~Xi-a8QkHNuxNTWIpLrPMNvh-tcGn537.2 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12588316116547123330', time=2024-09-12T20:21:01.520067+0000, chain.objs.size()=1 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.552__shadow_.Bjcuyi393CqpFqn8W8PH0H5u1sCv0Za_0 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6578282040564912993', time=2024-09-12T20:26:36.589801+0000, chain.objs.size()=1 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.641__shadow_.p95jKPtOyL2QfBCLZ4-RYxgSqNrRKEA_0 2024-09-12T18:33:03.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6562197219220942379', time=2024-09-12T20:27:37.746207+0000, chain.objs.size()=1 2024-09-12T18:33:03.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.708__shadow:coQRzbJSh7fGXX665nIY4TQ5b-v8pxw_.dxxNbA7CzeXzGc3dVciJjwvfjSE45Tn_0 2024-09-12T18:33:03.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12416198626042121243', time=2024-09-12T20:28:26.899567+0000, chain.objs.size()=1 2024-09-12T18:33:03.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.744__shadow_.0bE69acPnBn3KU3b059vpGcg4kTZqFB_0 2024-09-12T18:33:03.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.642+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.645+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:33:03.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.646+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.646+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45931' 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_r08vXn7bcj_GdtZLgSPBUZT6LusU_yi', time=2024-09-12T20:11:11.969475+0000, chain.objs.size()=3 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.iUxbyHtpxANZV1fg1W2vWQmwqo3Xlr8_0 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.iUxbyHtpxANZV1fg1W2vWQmwqo3Xlr8_1 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.iUxbyHtpxANZV1fg1W2vWQmwqo3Xlr8_2 2024-09-12T18:33:03.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12408131527704919845', time=2024-09-12T20:13:15.836961+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.242__shadow_.EJNUdG_-febO3tP5UOVTC2PG9aGcpTK_0 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4324306741131720718', time=2024-09-12T20:13:16.737034+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.243__shadow_.Yqw8Vhkx_aliY-zElYxURQ_TfQPtUUf_0 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15021485515335998323', time=2024-09-12T20:13:17.637029+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.244__shadow_.eTsxmIIg7KmoT0bHdnMhV7U9EOaQ8gY_0 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1433092302028441690', time=2024-09-12T20:14:04.793646+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Kug7dSHoPKpB33hXxGvNKID7oRkHqKW_0 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4880055157851976075', time=2024-09-12T20:14:04.891975+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zw4mg9PQFLF49eXcg6BPXTJG3Uqlhg3_0 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10835558738383020492', time=2024-09-12T20:14:05.066688+0000, chain.objs.size()=1 2024-09-12T18:33:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TArJlrvBbHxQxzkqoypkgn0_i6Cv14n_0 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15409759333235888776', time=2024-09-12T20:14:05.657468+0000, chain.objs.size()=1 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.AWVtO32jA0HtB1wsk9zMoifNgywwNh3_0 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18066143463908992684', time=2024-09-12T20:14:05.936431+0000, chain.objs.size()=1 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GQuvmzPkf8BMNtnxSeGoBI2_SJUz7Yh_0 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1366849330515906106', time=2024-09-12T20:14:05.979392+0000, chain.objs.size()=1 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.648+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tLIK0O1XS9dLSDfu9UYgDClSupc2Xmr_0 2024-09-12T18:33:03.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4816206428152123280', time=2024-09-12T20:14:06.080713+0000, chain.objs.size()=1 2024-09-12T18:33:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HST3uqikHIPjFqmQSRd-Yf7TXkWBpSJ_0 2024-09-12T18:33:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3711851373758590807', time=2024-09-12T20:14:06.170748+0000, chain.objs.size()=1 2024-09-12T18:33:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4lft7nAYsATdV_E1a80ksag6A4Yp-ek_0 2024-09-12T18:33:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7563221599906248929', time=2024-09-12T20:14:06.587395+0000, chain.objs.size()=1 2024-09-12T18:33:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.E5vSYzONENxv50o-ZaQv0Vvc7vh73lq_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17026869063587779558', time=2024-09-12T20:14:07.164891+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.i1IOM1rqrJNDDAE1cxHKrf3ZUHrd7DK_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9996441282418247723', time=2024-09-12T20:14:07.166081+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LGfNq_ZciN3GgDWozru_GV8qeashZYK_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14887960362481645983', time=2024-09-12T20:14:07.278019+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Pqye3mB8dOwgrcwJ686ZchguRo-05Fv_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15977867222806526795', time=2024-09-12T20:14:07.762243+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FQB-cL0DlrOMyUEwiaH0p34PW50r7Rp_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15540135810188382191', time=2024-09-12T20:14:08.605427+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vPQqzNeMqjoy05a3F2d87FbTWYbS-Fh_0 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10933600464222727421', time=2024-09-12T20:14:10.371629+0000, chain.objs.size()=1 2024-09-12T18:33:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZiuuIqgDs_Zu4Sp0OdoSDjDh7adNm1l_0 2024-09-12T18:33:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8358695829367120238', time=2024-09-12T20:14:10.801902+0000, chain.objs.size()=1 2024-09-12T18:33:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.651+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wA6nZq24fYJoDI3kV-mHbPJ8ogB45Zv_0 2024-09-12T18:33:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.652+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13126431754941759876', time=2024-09-12T20:14:10.802619+0000, chain.objs.size()=1 2024-09-12T18:33:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.652+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dwTz9pJUbC3CoAX8J6TEioC-vZ1rCk7_0 2024-09-12T18:33:03.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6224099508888421688', time=2024-09-12T20:14:11.122691+0000, chain.objs.size()=1 2024-09-12T18:33:03.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sVxnFWTCfkKAFoSy5AOMnDQQT0NxKXR_0 2024-09-12T18:33:03.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17576356745534457137', time=2024-09-12T20:14:11.690000+0000, chain.objs.size()=1 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cUwPyxvF-A67YpuJZyawyOvQY3Mr--u_0 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15742951319303296001', time=2024-09-12T20:14:12.068574+0000, chain.objs.size()=1 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oH2aZ2bUtgRgqmIT8WQORqjY12JvzNm_0 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5926481247934724424', time=2024-09-12T20:14:12.303102+0000, chain.objs.size()=1 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5KKS0uSi7IS25gM8ZY-3BiGzBP2mTKM_0 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13962484863052462125', time=2024-09-12T20:14:12.853636+0000, chain.objs.size()=1 2024-09-12T18:33:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jxmIiRageDUREzFoomWDca8EtJrO6uJ_0 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16609058086365419645', time=2024-09-12T20:14:12.944555+0000, chain.objs.size()=1 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Z5JcwOIIf4SocClqeBEKNlAzj_i6rm1_0 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4397436881889992797', time=2024-09-12T20:14:13.036753+0000, chain.objs.size()=1 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PDHnvYMZCNaK6P9rvxU6XhRPqRlNg4I_0 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6944926105050832592', time=2024-09-12T20:14:13.285218+0000, chain.objs.size()=1 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jsfB3vLHjp6391N15iU3Wudjoqo6Ab0_0 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4937279733424090356', time=2024-09-12T20:14:13.458433+0000, chain.objs.size()=1 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ggiqRbnA9NfvgqKRHpUrGpLQQL0_gpH_0 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1438579466336256230', time=2024-09-12T20:14:13.660078+0000, chain.objs.size()=1 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.656+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6I3RRx4pV5rneh7R3pLyjeRTLNm5PID_0 2024-09-12T18:33:03.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.657+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14247653256419174985', time=2024-09-12T20:14:13.771875+0000, chain.objs.size()=1 2024-09-12T18:33:03.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.657+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.diJqkC1jVsSVH4BcQQ8S4MN7JInKldN_0 2024-09-12T18:33:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9687715708883369354', time=2024-09-12T20:14:13.879880+0000, chain.objs.size()=1 2024-09-12T18:33:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WV7uA1HZvQsx2fuNdzPx6ZHcOOBb_Qi_0 2024-09-12T18:33:03.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17032352083219719808', time=2024-09-12T20:14:14.677353+0000, chain.objs.size()=1 2024-09-12T18:33:03.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.D_D2Fn9130M36s7G1JdwGPBC4q_6bM3_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11362558890809751815', time=2024-09-12T20:14:15.008809+0000, chain.objs.size()=1 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4y26cz2oA1DrhDStkr1hxPVyYG_JkqP_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17147405190948899149', time=2024-09-12T20:14:15.151366+0000, chain.objs.size()=1 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UAkMYEruHEJVszzKJLPJhEu2Z64xD_V_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14928676479295409534', time=2024-09-12T20:14:22.742458+0000, chain.objs.size()=1 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.275__shadow_.XEQ6NjrPcDMcwnRdWRGeHkgJjdGWltu_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4453089843615502246', time=2024-09-12T20:14:28.260422+0000, chain.objs.size()=1 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.284__shadow_.JDOe5V3KJvtMwO3ePCAGxduH7aUJuJw_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8201586641851437624', time=2024-09-12T20:14:31.478889+0000, chain.objs.size()=1 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.289__shadow_.YEUZdZOqRlaa0zAGRnnJuJyLCW7q36j_0 2024-09-12T18:33:03.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.259385406288911517', time=2024-09-12T20:14:34.474808+0000, chain.objs.size()=1 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.mDEUeDTqGDClnvnf9bByIsjwBTKnPdf_0 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14513955800322627806', time=2024-09-12T20:14:36.490619+0000, chain.objs.size()=1 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.nrkzKlPnaJF_EXkcYhSe4HqOkU538wZ_0 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7068227961738031242', time=2024-09-12T20:14:42.200516+0000, chain.objs.size()=1 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.302__shadow_.Xw7CjNU5cQCxU4CDjrDL8_mEReeBWSK_0 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2991485684880938640', time=2024-09-12T20:15:32.854031+0000, chain.objs.size()=1 2024-09-12T18:33:03.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.661+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nB22q1hi2pZXJAJpw4AE5PdIP32a0mI_0 2024-09-12T18:33:03.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.665+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9213831798304376340', time=2024-09-12T20:15:33.855037+0000, chain.objs.size()=1 2024-09-12T18:33:03.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.665+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ywLrl-o2WEAtAyQq-cJdUw8bl3iDxPl_0 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10334934229471674411', time=2024-09-12T20:15:35.820901+0000, chain.objs.size()=1 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.s2Cl0zZChrpForVhumeVBKF6nUSxK3V_0 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18316396102678340218', time=2024-09-12T20:15:35.852919+0000, chain.objs.size()=1 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5a4IobT3a_PpYlT1bpmPJAfCgDQJSyP_0 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13924064379125580509', time=2024-09-12T20:15:36.190680+0000, chain.objs.size()=1 2024-09-12T18:33:03.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.667+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.c3aZNkoteTBanhuEkdQO8bQbngj5a_U_0 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13067184465872834071', time=2024-09-12T20:15:36.913979+0000, chain.objs.size()=1 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IyqizmKicxg_MpVetNCtzuuHG-7KHnD_0 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14454591418791485370', time=2024-09-12T20:15:37.247918+0000, chain.objs.size()=1 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gUUkgMl0bnLMdnG8esUpH8VI24WqRa8_0 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7523603145736596757', time=2024-09-12T20:15:37.248574+0000, chain.objs.size()=1 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Cdh9z7u63VWJe9KlRlsm3BHvkjaCduT_0 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3996272413345121072', time=2024-09-12T20:15:38.066865+0000, chain.objs.size()=1 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8FppKkvdp9P-BB4n0vwz5L4FDMFLRkU_0 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11285573288800462227', time=2024-09-12T20:15:38.850389+0000, chain.objs.size()=1 2024-09-12T18:33:03.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.i0GbDL_OUUq-VQRbOho8APWftE8nhsp_0 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3428087544473244815', time=2024-09-12T20:15:38.947506+0000, chain.objs.size()=1 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1CtrTPalG870Zu7rkSf4TQDft8slO60_0 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6742361318761323791', time=2024-09-12T20:15:39.007192+0000, chain.objs.size()=1 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-nYvikKbq2hpNSKQpYE3GhKWZsyIyyS_0 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16570805472548965845', time=2024-09-12T20:15:39.035517+0000, chain.objs.size()=1 2024-09-12T18:33:03.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.668+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9ZrvHXRvY8h7uyjdMFCesH8gyFIAHbd_0 2024-09-12T18:33:03.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.672+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.130429318348639933', time=2024-09-12T20:15:39.036435+0000, chain.objs.size()=1 2024-09-12T18:33:03.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.672+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0HRLbj4Vu5Ys6sqheKHtUpH2rJD0q4S_0 2024-09-12T18:33:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.673+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.232687362825518291', time=2024-09-12T20:15:39.064179+0000, chain.objs.size()=1 2024-09-12T18:33:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.673+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.68nEROdRwwvNpKNbVof7O3X2bUDznu3_0 2024-09-12T18:33:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.673+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4030724535479652804', time=2024-09-12T20:15:39.422493+0000, chain.objs.size()=1 2024-09-12T18:33:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.673+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ySoznI_wucPiUHqMNe9F64aDAwtx9Vx_0 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9543413254137449325', time=2024-09-12T20:15:39.733177+0000, chain.objs.size()=1 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BfIf0CRmK82zSYK-7nyLPV5EL1itYvX_0 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10531996597757651013', time=2024-09-12T20:15:40.182443+0000, chain.objs.size()=1 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jGKPDx5J-mluNezNZMBUNg4dIFl-D19_0 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17067358668496245222', time=2024-09-12T20:15:40.328554+0000, chain.objs.size()=1 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UWYKrmqdxJ56sXhqMs3jFqIMZaynv4i_0 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5878870630308694642', time=2024-09-12T20:15:40.468507+0000, chain.objs.size()=1 2024-09-12T18:33:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.09J-VgpeEvK7fT7b8nFZGnSZxCxtIYE_0 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4659800115387240725', time=2024-09-12T20:15:40.788373+0000, chain.objs.size()=1 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BLT3Ngbr9jNhA_MQPPaPBexxRFoKzU9_0 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.605535418680495630', time=2024-09-12T20:15:41.249231+0000, chain.objs.size()=1 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qFbvxCQ-zpbncuZcDjPOdK0I8emEuSV_0 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8383008757894755925', time=2024-09-12T20:15:41.503544+0000, chain.objs.size()=1 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.W9li-XyupO1b6UqLcWbreszf9UhiX9m_0 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12669099850135320333', time=2024-09-12T20:15:41.606654+0000, chain.objs.size()=1 2024-09-12T18:33:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.676+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tx4A7jNA7NSybvUDe4H9UjWeqe1dtJa_0 2024-09-12T18:33:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.677+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10658063857350859866', time=2024-09-12T20:15:42.280223+0000, chain.objs.size()=1 2024-09-12T18:33:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.677+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.O9C3Vjz62aSlgROhIOF8zTBBkSvb7bg_0 2024-09-12T18:33:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12044636036040854233', time=2024-09-12T20:15:42.516113+0000, chain.objs.size()=1 2024-09-12T18:33:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KUHml4hbEiLu5IajuEVSObo7rV9NZqF_0 2024-09-12T18:33:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17430251073313060326', time=2024-09-12T20:15:42.626455+0000, chain.objs.size()=1 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aBqFpPFveWf5ORWzNsqMunp2z3iB8I1_0 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16178467883706599624', time=2024-09-12T20:16:20.259821+0000, chain.objs.size()=1 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2T8W5Piop_jJMlalQbqQXyqgRBMHqbm_0 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7631074750078541125', time=2024-09-12T20:16:20.375342+0000, chain.objs.size()=1 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WZ8G-8119xgd3XsjSpG8RmaarxBXSAg_0 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5903931359296607148', time=2024-09-12T20:16:20.537310+0000, chain.objs.size()=1 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VzUjWKGAesuN11A0b1aNRpVtR52TStA_0 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11257593597739130494', time=2024-09-12T20:16:20.723710+0000, chain.objs.size()=1 2024-09-12T18:33:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MMWzNQdObsIXCiX3t6kcH8Z1d9hUesf_0 2024-09-12T18:33:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3539482666503079521', time=2024-09-12T20:16:20.815076+0000, chain.objs.size()=1 2024-09-12T18:33:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QlJYfvhnR4GiRZE-T1tNBkcgW6EJbrD_0 2024-09-12T18:33:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6530314553461070512', time=2024-09-12T20:16:21.037412+0000, chain.objs.size()=1 2024-09-12T18:33:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.si0DYZTNHMCA-vSMwbE5Wthf__-4aGs_0 2024-09-12T18:33:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10865670607481754518', time=2024-09-12T20:16:21.082332+0000, chain.objs.size()=1 2024-09-12T18:33:03.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8lDYBOb9J749w3-NEWaEhNbP_F1qc7N_0 2024-09-12T18:33:03.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1479016231996092635', time=2024-09-12T20:16:21.847180+0000, chain.objs.size()=1 2024-09-12T18:33:03.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.X9joryCzo_H_UyO0tU7xpw3pg4fEtLu_0 2024-09-12T18:33:03.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.682+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15771586229932875270', time=2024-09-12T20:16:21.997933+0000, chain.objs.size()=1 2024-09-12T18:33:03.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.682+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BSGbhbs1B18rzAs-pNNhL8oV4srNASr_0 2024-09-12T18:33:03.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.152572337255914117', time=2024-09-12T20:16:22.264599+0000, chain.objs.size()=1 2024-09-12T18:33:03.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.L9AeUWWyyFlTkvrmAXaed1FarTXovLS_0 2024-09-12T18:33:03.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17180955910505735978', time=2024-09-12T20:16:22.553962+0000, chain.objs.size()=1 2024-09-12T18:33:03.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4GqlcmQ06HU-O5nxukKJQWJ40JTEU8r_0 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9824250504165269299', time=2024-09-12T20:16:23.078435+0000, chain.objs.size()=1 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8wtmNQ-_QvJc7VyX_hVkOiNqaorpnuG_0 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17686738756308032786', time=2024-09-12T20:16:23.697215+0000, chain.objs.size()=1 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9xW1uVvxbBqVCotUi5KmzM2KZOgvvrM_0 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.908269654931190937', time=2024-09-12T20:16:23.852842+0000, chain.objs.size()=1 2024-09-12T18:33:03.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.O7K5-yrUGCQtuNNgnzn60_7Xr5dq5Rf_0 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14769250323475827624', time=2024-09-12T20:16:24.059571+0000, chain.objs.size()=1 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.n9sVBHG8BFoycgk1Ukeb3pg26u9ra6P_0 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12624187150213565229', time=2024-09-12T20:16:25.079228+0000, chain.objs.size()=1 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oC4MnFKuV_MdUQp6aC8F8oVPkWzpLpX_0 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3412447056005536684', time=2024-09-12T20:16:26.100661+0000, chain.objs.size()=1 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.P6KO33KXJZ83waPz5vC0VEY6fGuJp2U_0 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5359732182833321632', time=2024-09-12T20:16:26.688103+0000, chain.objs.size()=1 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6naUcuUomISxB3uVYQo4QqwqJaD0ue3_0 2024-09-12T18:33:03.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12733367089018471480', time=2024-09-12T20:16:27.563494+0000, chain.objs.size()=1 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.G3eMC2KE_8AN2t0b3-hEtqHXN2FU-no_0 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.689+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1482633131716770474', time=2024-09-12T20:16:27.736900+0000, chain.objs.size()=1 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.689+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.43CEyERQfreEEIMGFzN8a8f2Uh3dneH_0 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.689+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16889946842044121177', time=2024-09-12T20:16:28.207690+0000, chain.objs.size()=1 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.689+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hgvsJw91YvfgPTKQ5LuVvt2C8bBulXY_0 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5606662230376590424', time=2024-09-12T20:16:28.793825+0000, chain.objs.size()=1 2024-09-12T18:33:03.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wnJ7Ygd7bz1QThwKpbAS3X3zNzetZ4u_0 2024-09-12T18:33:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10745300314400616493', time=2024-09-12T20:16:28.840810+0000, chain.objs.size()=1 2024-09-12T18:33:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Cn0Og9bYfbbOj59t8MDTi1VLqEUFtu1_0 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10219380930231932798', time=2024-09-12T20:16:28.932855+0000, chain.objs.size()=1 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZjBnluWFgH9jBRJLHqDaO5dlLWXjJit_0 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1607755010070507437', time=2024-09-12T20:16:29.122722+0000, chain.objs.size()=1 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2psLxMQI0uxwIZhBN4JhLCNdqXYNk1K_0 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.898331420121668920', time=2024-09-12T20:16:29.325558+0000, chain.objs.size()=1 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WnzJlK0MlqDCimdaxcsxjvR2sw3juTB_0 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14378899078062584113', time=2024-09-12T20:16:30.251800+0000, chain.objs.size()=1 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UzEfgAUdo_2ez9TQWD3IheWtzddZoIZ_0 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3838314660352872361', time=2024-09-12T20:16:30.750165+0000, chain.objs.size()=1 2024-09-12T18:33:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TzAtVTP7BxBkob1lOd48gdQVB8aYtkK_0 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15993651945994660218', time=2024-09-12T20:16:30.783205+0000, chain.objs.size()=1 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.v0ODeoDNBlhLGx10AW8GwX75W8XFPAE_0 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1236325283774783890', time=2024-09-12T20:16:33.537870+0000, chain.objs.size()=1 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.329__shadow_.uXNgBIMRXW3Pj1ITKo7Hafu4SHZ967z_0 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7774723226511475452', time=2024-09-12T20:16:41.848628+0000, chain.objs.size()=1 2024-09-12T18:33:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.694+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.345__shadow_.KPnVi6fa0jX-vj9LQBAiYeJ6vDYm1jS_0 2024-09-12T18:33:03.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.699+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/45931 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12147993650142246234', time=2024-09-12T20:17:32.412882+0000, chain.objs.size()=1 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.441__shadow_.EiH1P1TNxOoW0dx_XDP7WIPlIYGzSHA_0 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3180986839363960213', time=2024-09-12T20:17:48.033735+0000, chain.objs.size()=1 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.464__shadow_.NHJYEFbP7cEu0RQAe6mHU9j2WfgKUqA_0 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8280105451809230592', time=2024-09-12T20:17:57.238684+0000, chain.objs.size()=1 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.Pl9nW27U48I3owVv-Hyf0FrlBgkKmbs_0 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3000804299237205696', time=2024-09-12T20:17:57.943761+0000, chain.objs.size()=1 2024-09-12T18:33:03.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484__shadow_.u3k8X3lFDG5BaDpGbVflKcpatxnKDMz_0 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15848825733068240307', time=2024-09-12T20:18:20.453819+0000, chain.objs.size()=6 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7559923900357920910', time=2024-09-12T20:19:18.750036+0000, chain.objs.size()=6 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.1 2024-09-12T18:33:03.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.5OiSZKk28kIhsq4Yt1eiVL0SwoIeHiLY.2 2024-09-12T18:33:03.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.707+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.3 2024-09-12T18:33:03.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.4 2024-09-12T18:33:03.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.5 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.6 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~aJRPtiAVg810Zp9sjwhi9FuWP_Z4nUZ', time=2024-09-12T20:20:23.167587+0000, chain.objs.size()=1 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535__multipart_mymultipart.2~aJRPtiAVg810Zp9sjwhi9FuWP_Z4nUZ.3 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16162316144101013077', time=2024-09-12T20:20:58.614842+0000, chain.objs.size()=1 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.551__shadow_.m15lXhd7PgFIWxynaAfMtpev2Jjtvrz_0 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9627070774979536247', time=2024-09-12T20:21:11.903042+0000, chain.objs.size()=1 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.557__shadow_.DbuwmsIue3bBlvFeN4MOxof2e73D7OD_0 2024-09-12T18:33:03.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3451995748622973151', time=2024-09-12T20:21:20.536347+0000, chain.objs.size()=1 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.562__shadow_.SYX8NhSpVBsJRIUc3xN6ldV9RDLd-ST_0 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10127065834328070792', time=2024-09-12T20:21:38.506366+0000, chain.objs.size()=1 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:40pHfFL53eUb9bjV7Kksj96FY3PxYmM_.btx1sXiywDmuNtn8vbqOF1Daiq8G9BU_0 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8823677180180126768', time=2024-09-12T20:21:46.736161+0000, chain.objs.size()=1 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:OHF9k6jAj5mx.L7OVNKakTS7MjTI1kO_.n-RGqI9io6VMWrjyrtK5pTUlMAjxJOh_0 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2548235597680815821', time=2024-09-12T20:22:00.891385+0000, chain.objs.size()=1 2024-09-12T18:33:03.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:WAFXeeCDnuIdjNDhZsxd-ofZyIZ5j7T_.5IR420MYr7RSxFZQKH2KCwh7Mh_jatf_0 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10053424777442007771', time=2024-09-12T20:22:37.405502+0000, chain.objs.size()=1 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.585__shadow:CDGIuKJ.VouSzWi9nLQ4N.FILF22FGb_.b4KqQkze3J-cBBCQ2IT5YGeJ27NfDKi_0 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12534843911466763487', time=2024-09-12T20:22:38.265625+0000, chain.objs.size()=1 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.586__shadow:ybhpXUmr572K2Eh98qaQsYvcPDDhRx3_.ExKx0DF36Fu2v9tHGjuuF54fPhs8yU1_0 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15305956449948053590', time=2024-09-12T20:27:15.675038+0000, chain.objs.size()=1 2024-09-12T18:33:03.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.666__shadow_.4FF7zeBkqJZxIx3TtRUy4yxOSGXJrWJ_0 2024-09-12T18:33:03.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.714+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10997049728773299068', time=2024-09-12T20:27:33.970150+0000, chain.objs.size()=1 2024-09-12T18:33:03.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.714+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.702__multipart_file1.2~z-JUsASaXCLvYsQ5L093s3kjGgNd5lo.1 2024-09-12T18:33:03.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.715+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5860387542736175511', time=2024-09-12T20:28:03.308170+0000, chain.objs.size()=1 2024-09-12T18:33:03.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.715+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.719__shadow_.vu1PmPvcolqu0lLJJgUBiZ9U6GKtDTp_0 2024-09-12T18:33:03.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.718+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.720+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:33:03.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.722+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.722+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45674' 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13370817106790591893', time=2024-09-12T20:11:19.680056+0000, chain.objs.size()=1 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.170__shadow_.XskTYAJPn37xZgCt830FGLfY_QQ1o5F_0 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15433637747259333096', time=2024-09-12T20:13:24.962490+0000, chain.objs.size()=1 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.256__shadow_.pEwQNWAUVqbUVto4tJ7REdqbsl0RGM4_0 2024-09-12T18:33:03.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5776616837882713224', time=2024-09-12T20:13:26.694396+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.259__shadow_.4UpvB__dw6_gUQfIVjJ5joVNtb4QTQW_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10576947052884887116', time=2024-09-12T20:14:04.510066+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VusJ52TrYjK-_8TO5m-beO_G4LKS7Pb_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3099699160434425900', time=2024-09-12T20:14:04.650362+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IgdUIkRzz9F3PhHaDoNrYSK3NaiY8ny_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4000162303323401077', time=2024-09-12T20:14:04.872997+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ymF1rjsx53PSXTO2t5kZ6lkgRMCgque_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1040078624208425679', time=2024-09-12T20:14:05.135487+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9MYQbt1A-CL5fM3rudPTcmQWRB_Fl1V_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17113661505591340746', time=2024-09-12T20:14:05.646733+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.P0yvcZc-LpTakF3YwoO1Y0V95tAXXXr_0 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4185534888185278060', time=2024-09-12T20:14:06.067922+0000, chain.objs.size()=1 2024-09-12T18:33:03.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gNYINn4l1BbA8PCv7rW5uew0jPa4Vc7_0 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4519384106028857282', time=2024-09-12T20:14:06.122398+0000, chain.objs.size()=1 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gcNLfqyVJADIzeiWyEnVSyiq-marUof_0 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9637978211103554830', time=2024-09-12T20:14:06.283838+0000, chain.objs.size()=1 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Q8Px9lcjIjcfkEcYxlohCwtj18MXwJt_0 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17878781026602252789', time=2024-09-12T20:14:06.378961+0000, chain.objs.size()=1 2024-09-12T18:33:03.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.em3enKL2phQgL6gCwKletd8Q-KF2BA__0 2024-09-12T18:33:03.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10136477841331538365', time=2024-09-12T20:14:06.562538+0000, chain.objs.size()=1 2024-09-12T18:33:03.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.u2smGTusgCoXv0uXZ7HN72Y2oYuU8LL_0 2024-09-12T18:33:03.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16167097581777409168', time=2024-09-12T20:14:06.603232+0000, chain.objs.size()=1 2024-09-12T18:33:03.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pQNCHoGwRGbzTFZanEJtC55l5N4E0Xc_0 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13694250743423922646', time=2024-09-12T20:14:06.678423+0000, chain.objs.size()=1 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.U8aHJTop1sslbMAS_PtKOvD1VDsmvtG_0 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16115375928871433541', time=2024-09-12T20:14:06.712446+0000, chain.objs.size()=1 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gSQHPaLdv-INKbtRuVvIYJifRnetDYy_0 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15891286775605184408', time=2024-09-12T20:14:07.154915+0000, chain.objs.size()=1 2024-09-12T18:33:03.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LR5zGqMbm5uJd_nWju5q1mfDH8-dyK2_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5051922468849187762', time=2024-09-12T20:14:07.582581+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OwaJbaZbgwnPMPIfwO8pAbI6J8BsOcw_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18206302307940595311', time=2024-09-12T20:14:07.748469+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6jbETfLteBu4kpqN6ta1V9C7NSr84QX_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16064138290355074125', time=2024-09-12T20:14:07.788112+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XcJeoMjEgAmJP1WIBY_LvVA7c9fDC3V_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15169044338836527933', time=2024-09-12T20:14:07.846325+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GEK6QCZu4awtEl5TOEOdkWZvONirGGC_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4744737258734322169', time=2024-09-12T20:14:07.969902+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wAEvBqCiJgL90xkxHUIDu-jfH7JcQZy_0 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13094913191441209606', time=2024-09-12T20:14:08.188811+0000, chain.objs.size()=1 2024-09-12T18:33:03.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.728+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XM5qns20VHUkNztoS4JY9ETYb_7_gdw_0 2024-09-12T18:33:03.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.731+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16801282887755660095', time=2024-09-12T20:14:09.209564+0000, chain.objs.size()=1 2024-09-12T18:33:03.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7haHmkFdvcSAhwAm2IhN1iz1TXDX8NP_0 2024-09-12T18:33:03.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.731+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4352280404159280880', time=2024-09-12T20:14:09.439059+0000, chain.objs.size()=1 2024-09-12T18:33:03.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mvdr88QIew4XXyBHJdD4_JTzg-qGYMB_0 2024-09-12T18:33:03.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.209496851179715714', time=2024-09-12T20:14:09.660966+0000, chain.objs.size()=1 2024-09-12T18:33:03.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MRw1bNGYTbsAMlzDZYB9IdDPo01W0Sv_0 2024-09-12T18:33:03.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13003740484173393610', time=2024-09-12T20:14:10.344248+0000, chain.objs.size()=1 2024-09-12T18:33:03.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dIJK39UreyoqwUva4HhDtwnZcobu2NY_0 2024-09-12T18:33:03.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5695204193754301582', time=2024-09-12T20:14:10.466479+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._Gbcb2l-1OJIdkH1iT2sDdhbc4uPA0D_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11930819673822641622', time=2024-09-12T20:14:10.718454+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QI1X6E2C4EvNRaqQHT0CJ-uAGJ-xZ0o_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14057709839250327621', time=2024-09-12T20:14:11.099474+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.g4w2EczPva2vJUCMRS8Q7NJA7yw3iIA_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13184816371603660633', time=2024-09-12T20:14:11.640326+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nHxEJaDkAMkZSKxPbUJ_auYOGBTqwJM_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5716628873759996848', time=2024-09-12T20:14:12.225867+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rA9bKxFsQjWasnibwGl1jTca8K32mDC_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2626046058909154033', time=2024-09-12T20:14:12.367677+0000, chain.objs.size()=1 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QEVDBagG_ce7gVpY7L3t0DH-t_igeQh_0 2024-09-12T18:33:03.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17022940443438829698', time=2024-09-12T20:14:12.524827+0000, chain.objs.size()=1 2024-09-12T18:33:03.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BkeD2Q_jcRpVEs15bp3Co5WPQQFWX4I_0 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.735+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2836061426220763856', time=2024-09-12T20:14:13.360378+0000, chain.objs.size()=1 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.735+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OgdEWCOaeZzs2v7-rGeHEYzcfOU8Ht6_0 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.735+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7539004331786308933', time=2024-09-12T20:14:13.399342+0000, chain.objs.size()=1 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.735+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fuIzIbDgjfc3ilrFOIE_ax2glSTVPEm_0 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.736+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4166625029995234692', time=2024-09-12T20:14:14.672067+0000, chain.objs.size()=1 2024-09-12T18:33:03.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.736+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kIuJ8dnO8t1KNugWZEkzd7vqPe25vty_0 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3617455160935597489', time=2024-09-12T20:14:15.011849+0000, chain.objs.size()=1 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hT49TZrv2H_R96y_uCxIvtOu9zr0ZmQ_0 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4744894625420034362', time=2024-09-12T20:14:21.523670+0000, chain.objs.size()=1 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.273__shadow_.xxJgl-X96Uqub7akTlNarnDp6gzJ4WN_0 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7073832343063088687', time=2024-09-12T20:14:23.961200+0000, chain.objs.size()=1 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.277__shadow_.X7aMl9fqpzaIAdTbHqcEbqrzYgFpkv5_0 2024-09-12T18:33:03.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.638873338122443783', time=2024-09-12T20:14:24.576981+0000, chain.objs.size()=1 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.278__shadow_.41rIu2maIvc9lugPUBtsqoMAbCZgRfq_0 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13651230324263948399', time=2024-09-12T20:14:24.586050+0000, chain.objs.size()=1 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.278__shadow_._C1h1tuwL81Vt5JK13wmt2AowyigZYd_0 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3531438200673169096', time=2024-09-12T20:14:25.793134+0000, chain.objs.size()=1 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.280__shadow_.QsGnHsNBR3-tp2UNIcjmsWCOctA-MIn_0 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5733263444482466809', time=2024-09-12T20:14:37.143390+0000, chain.objs.size()=1 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.294__shadow_.AvRmZ1blI7aHAqJUMI3tYaLfbjDryoR_0 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1291109912282074183', time=2024-09-12T20:14:38.974436+0000, chain.objs.size()=1 2024-09-12T18:33:03.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.297__shadow_.y9UlHK_h4bUnXr1aiCg61PdK_PKmcMS_0 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2313367450292658841', time=2024-09-12T20:14:40.393392+0000, chain.objs.size()=1 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.299__shadow_.p54WDuJ3ENRXNFARKEHgwJrx2_-2AgL_0 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13923350397502420728', time=2024-09-12T20:14:44.016741+0000, chain.objs.size()=1 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.305__shadow_.bIm3uToFTLYg5h5x6jd-J4d0gYlP_XL_0 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.322500418836441461', time=2024-09-12T20:15:32.170907+0000, chain.objs.size()=1 2024-09-12T18:33:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.741+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.88OkbzjHRD4i1IpA8wea8SeDRfUAQW3_0 2024-09-12T18:33:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9915483107368236724', time=2024-09-12T20:15:32.171685+0000, chain.objs.size()=1 2024-09-12T18:33:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.H3iRL4fgIl7-BAXZXQTz-wo_2YSD3kI_0 2024-09-12T18:33:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7385770759813378427', time=2024-09-12T20:15:32.193592+0000, chain.objs.size()=1 2024-09-12T18:33:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mqBi_gzUVX34lo9Tjqm9IS6PZdQ4fpL_0 2024-09-12T18:33:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4637799402745001845', time=2024-09-12T20:15:32.306259+0000, chain.objs.size()=1 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aIMktrs4HbXJkpfP9iG5vRUiDU-IZDR_0 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.604939070689666636', time=2024-09-12T20:15:32.542864+0000, chain.objs.size()=1 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TnJnhZdPUCg9uAF2NgeNzplfiTTdtrq_0 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12657663007904610478', time=2024-09-12T20:15:32.754024+0000, chain.objs.size()=1 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HzIkhjzNApA3CkXCxQHtWwl1pEcZFTg_0 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4209762545912426476', time=2024-09-12T20:15:32.817825+0000, chain.objs.size()=1 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6vqOJX_q8aVJ4oGUOPso_VbuCg3zrZP_0 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5560688935816026368', time=2024-09-12T20:15:34.338321+0000, chain.objs.size()=1 2024-09-12T18:33:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pCNbg2qhtkn2hPi2Kg2TYikPwC4JPuq_0 2024-09-12T18:33:03.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7792873913226343366', time=2024-09-12T20:15:35.306019+0000, chain.objs.size()=1 2024-09-12T18:33:03.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.744+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.x1hycIEJqnmZwHbLlyzh1OMKlEYIpo-_0 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16553271354689192373', time=2024-09-12T20:15:35.397342+0000, chain.objs.size()=1 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.N-EdNYbK4IZlACrtI4xm43PZriuDxR9_0 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9012233812423857651', time=2024-09-12T20:15:37.267599+0000, chain.objs.size()=1 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.h1Hhan1IeF4g2kNPj1vKsVmnzKIm42u_0 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7614045258317748564', time=2024-09-12T20:15:37.268736+0000, chain.objs.size()=1 2024-09-12T18:33:03.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.747+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IiXwc37sSFsd06KkhCPpbxaIZV2QxbC_0 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3010332127382604918', time=2024-09-12T20:15:38.072752+0000, chain.objs.size()=1 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mLfv2vAyS2h4SHY336R-LpYw3Ob83qB_0 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9860113682275054124', time=2024-09-12T20:15:38.323018+0000, chain.objs.size()=1 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.C23GZtVRhpmFYnIwhMJBZy5ZAj6yfNp_0 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10911641498989294861', time=2024-09-12T20:15:38.487502+0000, chain.objs.size()=1 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gyIGljWvKTetwOeigxe-UzLRwNX9Ueq_0 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10379960555789915004', time=2024-09-12T20:15:38.688635+0000, chain.objs.size()=1 2024-09-12T18:33:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1gBB-upWLCb4oVQuy60N6SDkp6OgYjc_0 2024-09-12T18:33:03.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6871065861383516867', time=2024-09-12T20:15:38.723033+0000, chain.objs.size()=1 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PcSz6UP-rGm6pq1kOvfykQj8109qg6F_0 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8352050286134886650', time=2024-09-12T20:15:39.417612+0000, chain.objs.size()=1 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VINdsK7_Cw_upZKQ0m_WxGS08CM3wmj_0 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17013535868934413152', time=2024-09-12T20:15:39.655014+0000, chain.objs.size()=1 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EwzzrHni_OqpxCDKaAX_TU2syLGUvCK_0 2024-09-12T18:33:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5650759977498886593', time=2024-09-12T20:15:39.835674+0000, chain.objs.size()=1 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FdCI2QZBYEGzer2OYcxqF421P8TFP2f_0 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12655077657879081154', time=2024-09-12T20:15:40.053137+0000, chain.objs.size()=1 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EEvl0pLaC3egIhOkTwWpugX540XGmY1_0 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7035460012538864690', time=2024-09-12T20:15:40.421836+0000, chain.objs.size()=1 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3Hi8kJZDLpu2nJEi0U_lG0DGlTR1JBa_0 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5473238160368543988', time=2024-09-12T20:15:40.787722+0000, chain.objs.size()=1 2024-09-12T18:33:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.752+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hzOZDu42UJ7q2YQoErWdBSNIBY7ahr-_0 2024-09-12T18:33:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10585732616826177353', time=2024-09-12T20:15:40.788457+0000, chain.objs.size()=1 2024-09-12T18:33:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nx7aMfZGWtF08Eqe0GUjZgrPWR8hKqP_0 2024-09-12T18:33:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16473058622143977605', time=2024-09-12T20:15:40.886606+0000, chain.objs.size()=1 2024-09-12T18:33:03.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eJdv9gxmtSx92tYmYqFfy5uJN92c4JY_0 2024-09-12T18:33:03.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9616474316248632947', time=2024-09-12T20:15:41.097199+0000, chain.objs.size()=1 2024-09-12T18:33:03.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TcmYdiKV2vXVoGiNvIzCROoD-pwXjVY_0 2024-09-12T18:33:03.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16311953956347708270', time=2024-09-12T20:15:41.253957+0000, chain.objs.size()=1 2024-09-12T18:33:03.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.757+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.k_pasGu1W6ZIZEQbmb-jjbc1vMj1DJw_0 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12247598122799204364', time=2024-09-12T20:15:42.258429+0000, chain.objs.size()=1 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2f0t3DaFqFQHWC9LVzwXFCgXMe6CGNz_0 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9387486980738861284', time=2024-09-12T20:15:42.878356+0000, chain.objs.size()=1 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-r-7nr_KtP4wDPzJ4DWSQ88LCFHvDnz_0 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12437067870088117618', time=2024-09-12T20:16:20.277556+0000, chain.objs.size()=1 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nhSMJzJaaEqWdg0rb_CC5X3HNNhODiL_0 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14323370518890833307', time=2024-09-12T20:16:20.638227+0000, chain.objs.size()=1 2024-09-12T18:33:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xtss_ZdfhSIDCqaV3LXw0VagAt-Q5v0_0 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3678109058506321418', time=2024-09-12T20:16:21.046123+0000, chain.objs.size()=1 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.758+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yQC92Wo91z1dBVAoGpLmn-p60sekbm4_0 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5654945232542005377', time=2024-09-12T20:16:21.711723+0000, chain.objs.size()=1 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.c0lO7K8s3-YODlrFECXigTESpfSHfHp_0 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17346127695197670502', time=2024-09-12T20:16:21.953628+0000, chain.objs.size()=1 2024-09-12T18:33:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Hp7kuVc4wkhnjTdAOe7xRv-JoxNCWPV_0 2024-09-12T18:33:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.761+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2019051469505772651', time=2024-09-12T20:16:22.268710+0000, chain.objs.size()=1 2024-09-12T18:33:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.761+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JdqKDoCSdLDgN1UJk3jVtrmmUfMi2zu_0 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.959214359353224370', time=2024-09-12T20:16:22.527493+0000, chain.objs.size()=1 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Q6gidXiULZQE1Ph9GOvNebUK458JRfN_0 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3298914327057154501', time=2024-09-12T20:16:22.640492+0000, chain.objs.size()=1 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mkvHof105brU1qPEoOD_lM44FbjC5tK_0 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1055240338187606113', time=2024-09-12T20:16:23.092467+0000, chain.objs.size()=1 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1UD002j4dD8-kj3huouwGMVASfB1OUC_0 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15165034974818045726', time=2024-09-12T20:16:23.120973+0000, chain.objs.size()=1 2024-09-12T18:33:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jvAUfu92QICQpi9cfc7l_jvRXc9ZkQB_0 2024-09-12T18:33:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.763+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12145900670430612550', time=2024-09-12T20:16:23.251738+0000, chain.objs.size()=1 2024-09-12T18:33:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.763+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ESFDpkIBG30MMGwtJH-anoWh532LPti_0 2024-09-12T18:33:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16656721620550128606', time=2024-09-12T20:16:23.407385+0000, chain.objs.size()=1 2024-09-12T18:33:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OevgYM0gjMHoluxTTLhLcden72v-5Yf_0 2024-09-12T18:33:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.852572665151394082', time=2024-09-12T20:16:23.483684+0000, chain.objs.size()=1 2024-09-12T18:33:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kjk9XTqdmTQ_ahbY8MdAfIhN9Djg9PN_0 2024-09-12T18:33:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12225694936742538026', time=2024-09-12T20:16:23.547812+0000, chain.objs.size()=1 2024-09-12T18:33:03.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nnIpYfBFMW0lmOkAV5tBB46kjGaOrKn_0 2024-09-12T18:33:03.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.540754821961521674', time=2024-09-12T20:16:24.980698+0000, chain.objs.size()=1 2024-09-12T18:33:03.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VmJvIac-5m53ePczSr4_H5ZPDFRDJ0u_0 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15054816296486440704', time=2024-09-12T20:16:25.081813+0000, chain.objs.size()=1 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GaE-QMCn3RmkDXH2b0i3SF4PnKl4Z0N_0 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9398524544652829402', time=2024-09-12T20:16:25.126537+0000, chain.objs.size()=1 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MZLRdfJIi0ky1Q6Lk6TxUENQSPjGRVq_0 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6610951060860711194', time=2024-09-12T20:16:25.169883+0000, chain.objs.size()=1 2024-09-12T18:33:03.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RPOXPwZEmNTjC_FjMD2xusTabkApPtR_0 2024-09-12T18:33:03.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13093452536795510831', time=2024-09-12T20:16:25.526076+0000, chain.objs.size()=1 2024-09-12T18:33:03.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.766+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zEQf6nCU3UlQ8pECa0E4CSsGiiDCkf7_0 2024-09-12T18:33:03.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17446588582445333638', time=2024-09-12T20:16:25.899734+0000, chain.objs.size()=1 2024-09-12T18:33:03.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.G4Fs6A-X07brYSVpsLDifygH-T073Y6_0 2024-09-12T18:33:03.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13160375497146535659', time=2024-09-12T20:16:25.928123+0000, chain.objs.size()=1 2024-09-12T18:33:03.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pHUT_eJwSP2yH8mZp2FsvEc5Xtw1Leg_0 2024-09-12T18:33:03.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9561205767841746375', time=2024-09-12T20:16:26.826428+0000, chain.objs.size()=1 2024-09-12T18:33:03.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.767+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DLJU1HoxjWI4v4ajnU_rgiBFLTIpmc2_0 2024-09-12T18:33:03.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.768+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2041424573759081708', time=2024-09-12T20:16:26.857039+0000, chain.objs.size()=1 2024-09-12T18:33:03.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.768+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.15GhcXiiKrUw2sw23YuiSGKubgcPF3__0 2024-09-12T18:33:03.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.774+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3943290639385747810', time=2024-09-12T20:16:27.629211+0000, chain.objs.size()=1 2024-09-12T18:33:03.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.774+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ilSSPxJlfXdExky0TEqG09pxvSiOdCi_0 2024-09-12T18:33:03.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/45674 2024-09-12T18:33:03.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:33:03.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10592463823851481111', time=2024-09-12T20:16:27.640662+0000, chain.objs.size()=1 2024-09-12T18:33:03.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5RIyCxoQ-u1fbiZg7RtVZeG_6tWRZ1l_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17424414555779035393', time=2024-09-12T20:16:28.213807+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qtp_jF2Y5logO38H_YgLUakMS4F9MYw_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18199370303180417888', time=2024-09-12T20:16:29.957349+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.227vjrR2otx220N1JrrtkIRjUvqOniq_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15262328496467373866', time=2024-09-12T20:16:31.030195+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.34p8ucg6ts5j3zqnTZBdyHeb1B_5bBA_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8675268940792868479', time=2024-09-12T20:16:53.982562+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.372__shadow_.ydW6Tfetj76XUuKlRp0UaDbCpTseoUQ_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6739845094627876084', time=2024-09-12T20:16:58.831521+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.379__shadow_.rHp5Hz4XAfotiUq3tDigKJUk3UUA_3X_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4821469612457674020', time=2024-09-12T20:17:00.224927+0000, chain.objs.size()=1 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.381__shadow_.Fg541XZe2S1gVRuFL40Y6K2vbvfMD2i_0 2024-09-12T18:33:03.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12691385956997777907', time=2024-09-12T20:18:06.629339+0000, chain.objs.size()=1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.496__shadow_.9IGfIcpiVPM6y_RJvvNfTt6eV29nL3V_0 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNwu_gz3GVeDIhSGyNOwICDR19AxCW5', time=2024-09-12T20:21:19.729332+0000, chain.objs.size()=1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.561__multipart_mymultipart.2~jNwu_gz3GVeDIhSGyNOwICDR19AxCW5.1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16951683741273363854', time=2024-09-12T20:21:31.293313+0000, chain.objs.size()=1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:jL0ovTR.f0xvKJuX8wUAIn5ua.aS6nv_.X6JRrDqgJQWUKpjKZ0RMwuNyTlO2KG3_0 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9156099819915178613', time=2024-09-12T20:21:51.493023+0000, chain.objs.size()=1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:NyGlNU3-6e-0TmGnzpj7m1jYI7D.Ydu_.B-QOLUiaWtPPdm3ahFTNWTX-EO8KKlQ_0 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3414210802422687326', time=2024-09-12T20:22:06.093511+0000, chain.objs.size()=1 2024-09-12T18:33:03.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.781+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:GfiUgj88Cks2oCQarP9LzSFZA7bY4id_.d5hKS7Jm51nZnBDr7aV_GSV_AJJpJH-_0 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1372901506487939464', time=2024-09-12T20:22:11.026720+0000, chain.objs.size()=1 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:csx5JZpuOfItmNLFEsDSqdVIwNmI1FO_.tbDHRmi5oiMj_a25OyPhdJqnP7NgQIN_0 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn', time=2024-09-12T20:26:21.368048+0000, chain.objs.size()=12 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.1 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.1_1 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.2 2024-09-12T18:33:03.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.2_1 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.3 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.3_1 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.4 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.4_1 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.786+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.5 2024-09-12T18:33:03.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.786+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.5_1 2024-09-12T18:33:03.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.789+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__multipart_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.6 2024-09-12T18:33:03.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.790+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.624__shadow_multipart_enc.2~jcCiwBdhFnXySJoEDw-Oerm7obA1xQn.6_1 2024-09-12T18:33:03.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.790+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.760746787030745906', time=2024-09-12T20:26:32.861573+0000, chain.objs.size()=1 2024-09-12T18:33:03.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.790+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.634__shadow_.F2vHmWISZqq2WtNNiQpmgeGIR8bf3bf_0 2024-09-12T18:33:03.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17149170923803985622', time=2024-09-12T20:26:53.523074+0000, chain.objs.size()=2 2024-09-12T18:33:03.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.654__shadow_.6ssQO0QCrTICJPd6pKcBLROzQqo7n3y_0 2024-09-12T18:33:03.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.654__shadow_.6ssQO0QCrTICJPd6pKcBLROzQqo7n3y_1 2024-09-12T18:33:03.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18785661796361825', time=2024-09-12T20:27:12.658287+0000, chain.objs.size()=1 2024-09-12T18:33:03.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.663__shadow_.pM8CTHpCLITNfmPabxxkQ5laLr51mjw_0 2024-09-12T18:33:03.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13935318692407787176', time=2024-09-12T20:27:38.875939+0000, chain.objs.size()=1 2024-09-12T18:33:03.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.710__shadow:VXZIFBMalR3rMUJkw.2JQPZpWsLXoR._.gx0MsjJuLyX377R8oVY9zEf1piyXEkn_0 2024-09-12T18:33:03.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.796+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.799+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:33:03.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.800+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.800+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49626' 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16867291500396242530', time=2024-09-12T20:11:02.390287+0000, chain.objs.size()=1 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.sRSgRrjWztR2vIPl2qUAVNDPyDF-Hdz_0 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13629261319465881258', time=2024-09-12T20:11:33.010738+0000, chain.objs.size()=1 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.182__shadow_.bFIinVPM4OMLX4igqb2xC8-xUR1CVi-_0 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.274427190957793713', time=2024-09-12T20:13:10.589347+0000, chain.objs.size()=1 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.234__shadow_.GeEEcicol_me8pCjBWkPKeye2CWl_Et_0 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11038187887408606156', time=2024-09-12T20:13:12.690636+0000, chain.objs.size()=1 2024-09-12T18:33:03.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.237__shadow_.6Xbx_OhdIQYoJhQiCDzeD224u45hgW5_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5391534602943766248', time=2024-09-12T20:13:17.636090+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.244__shadow_.QoeuPY0BDOV8zqsTECZtlZbP_-LbPZW_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10841067858735466504', time=2024-09-12T20:13:24.364396+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.255__shadow_._KaVWHEtav_U4fBk4pBRFVMIYUn3K-l_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4798983133065432475', time=2024-09-12T20:14:04.203835+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.h00e6MDH1q5o5VA3tnblaIVj8Am0DTB_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2158670567215986005', time=2024-09-12T20:14:04.241768+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pUGCoX_btMVBGc65rVLb5fgM5u5-I8N_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1610829234279178111', time=2024-09-12T20:14:04.494095+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gxLirombAsG2G_WMyB0FW0V-1iEV1P6_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15952659155960017606', time=2024-09-12T20:14:05.782748+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rxboJ1CydpFIJhWbdigMYPB-t1jadYo_0 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8144919473644421282', time=2024-09-12T20:14:06.659970+0000, chain.objs.size()=1 2024-09-12T18:33:03.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sBw7JR3VZXMxhCnn6nm8wzz8y7f6iak_0 2024-09-12T18:33:03.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7395743685345218206', time=2024-09-12T20:14:07.169299+0000, chain.objs.size()=1 2024-09-12T18:33:03.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.801+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.C7qCNIOGVhRxbECBo23K_6DiObobUR-_0 2024-09-12T18:33:03.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.806+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11090539902565102650', time=2024-09-12T20:14:07.420959+0000, chain.objs.size()=1 2024-09-12T18:33:03.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.806+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Jz9fu3tv-SN9_aLEnjmI5Bsy-1CMelo_0 2024-09-12T18:33:03.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.807+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7152926809844845994', time=2024-09-12T20:14:07.468967+0000, chain.objs.size()=1 2024-09-12T18:33:03.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.807+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1fRveJAQZ17YMQfc1Fi47DMu59KSGMA_0 2024-09-12T18:33:03.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.807+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1666047127445379319', time=2024-09-12T20:14:07.916813+0000, chain.objs.size()=1 2024-09-12T18:33:03.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.807+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cVeEcojz9FMi57n8DJYcmgm6PZYnN0E_0 2024-09-12T18:33:03.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17888685391034613284', time=2024-09-12T20:14:08.095292+0000, chain.objs.size()=1 2024-09-12T18:33:03.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5hgHz02dJoG_6v9mqNSDMIs2ljCtSVC_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6789690987493072589', time=2024-09-12T20:14:08.978283+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sMe0WrXq3IqaeDDwm2gOjNJgchoxxho_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11874319722885915384', time=2024-09-12T20:14:09.116965+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wIjANr44G17TnJnOPVYBN5-WXn94GeR_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4005877021074233209', time=2024-09-12T20:14:09.400952+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YRfyWL6c5wujmJLnBfqJ8TUYKvL9PQa_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11203453189302784277', time=2024-09-12T20:14:10.379086+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Xtz4LuTC1msPrF-1YDVEHRb5OR-05rP_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3418499107422543768', time=2024-09-12T20:14:10.432832+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zKY5SgqyspN_ZrsmhCZ4V20VVa_aeW3_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14462893256108220098', time=2024-09-12T20:14:10.433930+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nTR11hOoqMyU8BqRK842upItjkJUMTK_0 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8888876079922355588', time=2024-09-12T20:14:10.522069+0000, chain.objs.size()=1 2024-09-12T18:33:03.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.809+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.H7YA4WgUy1awJWh9ZNcIsoIK-TMQDez_0 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3688527373484629750', time=2024-09-12T20:14:10.873609+0000, chain.objs.size()=1 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5hC1_Va9v0RJkwPT23nhiMQP55k2gN5_0 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16841030383080049390', time=2024-09-12T20:14:11.474559+0000, chain.objs.size()=1 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Nd_3DED8POkp8x6hsXFdJcH0wJnruv0_0 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4453275514357168173', time=2024-09-12T20:14:11.475418+0000, chain.objs.size()=1 2024-09-12T18:33:03.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rwU0zCz0WajEb0v1PrFgirZTuXqgmas_0 2024-09-12T18:33:03.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.814+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9298552632520828907', time=2024-09-12T20:14:11.601515+0000, chain.objs.size()=1 2024-09-12T18:33:03.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.814+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9o8FKyJIUXEwubMEUi0Umn6wIYXZvO4_0 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11379122282629690285', time=2024-09-12T20:14:11.629599+0000, chain.objs.size()=1 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BTnoEX1nRTolTB51oXAJA_u1lZicDaU_0 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6922784726833904500', time=2024-09-12T20:14:11.756366+0000, chain.objs.size()=1 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.msRMXohBTgHZpGNEaqj6-ehTCdNAeji_0 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4664476520963981039', time=2024-09-12T20:14:11.947532+0000, chain.objs.size()=1 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EaHt-DWhz4fg2XpDEiPqzmnBep_ZPsb_0 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3581722462805853297', time=2024-09-12T20:14:12.224119+0000, chain.objs.size()=1 2024-09-12T18:33:03.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LBGv1Vv4KWny7NEB8TMJ9V4cEtk27yf_0 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3766000316361737246', time=2024-09-12T20:14:12.273251+0000, chain.objs.size()=1 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.v8KxEVb30Rq_4_CGUJ6ARJELvxLozs9_0 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5520267720206986942', time=2024-09-12T20:14:13.185861+0000, chain.objs.size()=1 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QObBNuc0ur2_p5sz7AKGjrAMjDEXMW8_0 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10812376788821540832', time=2024-09-12T20:14:13.626954+0000, chain.objs.size()=1 2024-09-12T18:33:03.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.815+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LgO5QcNZnXcDlXJFAawwyJvW55LpHf-_0 2024-09-12T18:33:03.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6064675547814302744', time=2024-09-12T20:14:13.905393+0000, chain.objs.size()=1 2024-09-12T18:33:03.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qI1R2hzLKAUGASTZK8QW95CZ1PWTF5R_0 2024-09-12T18:33:03.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7647014993102013967', time=2024-09-12T20:14:14.803343+0000, chain.objs.size()=1 2024-09-12T18:33:03.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lg4pDb632Voux9H6MiwtDbuHmpeGgXT_0 2024-09-12T18:33:03.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18068867744328828390', time=2024-09-12T20:14:14.893625+0000, chain.objs.size()=1 2024-09-12T18:33:03.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.818+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jun17VQkl6PAS58A7GCgdrQ0XAyKZN7_0 2024-09-12T18:33:03.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.819+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12319678900346053487', time=2024-09-12T20:14:14.895271+0000, chain.objs.size()=1 2024-09-12T18:33:03.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.819+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LtaiCnikUyZuO0rG7_tpOjN0E_7QDPE_0 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10026140610237425478', time=2024-09-12T20:14:18.682773+0000, chain.objs.size()=1 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.268__shadow_.m0oiDDX7reZ9FHvv5ElsWgD6ehBPAg4_0 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11985181968448309964', time=2024-09-12T20:14:23.337729+0000, chain.objs.size()=1 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.276__shadow_.ZxkL7CaD6SWselhc302pJlGCx3sPiqZ_0 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7217138449941268971', time=2024-09-12T20:14:34.491150+0000, chain.objs.size()=1 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.ZDZXaniKwDRtCkB3jxA83qcPg4Dhz7H_0 2024-09-12T18:33:03.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17596725819544929382', time=2024-09-12T20:14:36.403029+0000, chain.objs.size()=1 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.47T9JTXbCCQh6IGRH7QbwPs9q6ZTmu5_0 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11906057632082735074', time=2024-09-12T20:14:37.750699+0000, chain.objs.size()=1 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295__shadow_.uC-vGogOe-th4kbtwPWcnDM85R1F-5J_0 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7893312303259260874', time=2024-09-12T20:14:40.387316+0000, chain.objs.size()=1 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.299__shadow_.usKYvRfF_fAyiOxhUjGvx47fQt74z57_0 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11792194918214728105', time=2024-09-12T20:15:32.336413+0000, chain.objs.size()=1 2024-09-12T18:33:03.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.820+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.y3J8Md2X0t6JnMT3K8M12wrN1i9oaGt_0 2024-09-12T18:33:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6522967683825846672', time=2024-09-12T20:15:33.769280+0000, chain.objs.size()=1 2024-09-12T18:33:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7VhEalKGY0LD_emcySjLh7J1i2IYPnR_0 2024-09-12T18:33:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17502320728955063362', time=2024-09-12T20:15:33.868469+0000, chain.objs.size()=1 2024-09-12T18:33:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._beFFVh5JUHAAnDeohOMUNuuYAtuSy7_0 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14444847519887990747', time=2024-09-12T20:15:34.703087+0000, chain.objs.size()=1 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VJcTlk2z2lqHlkL8MgGBHzz9mjkhbeU_0 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18102633123735962999', time=2024-09-12T20:15:35.244284+0000, chain.objs.size()=1 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.u8boWBCNLV-IcfpLQXCEE5SB3UAZI9__0 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11331944727797528836', time=2024-09-12T20:15:35.749623+0000, chain.objs.size()=1 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3L_1-rvJj6boy9P03E9EQm7YZMQC_iG_0 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12097596579810749137', time=2024-09-12T20:15:35.754112+0000, chain.objs.size()=1 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4O6JrOE4cSfWrZG6lfhuEUk0Kp9LaVi_0 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2377074202295062447', time=2024-09-12T20:15:35.799044+0000, chain.objs.size()=1 2024-09-12T18:33:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0at3RC5DOLUSsUR3iIrbtIRh6FvVA2H_0 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14364815733583445306', time=2024-09-12T20:15:35.960360+0000, chain.objs.size()=1 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._MkbSEOb-2sBQCsS13XPtxGt6PrmtNm_0 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8848525729680764709', time=2024-09-12T20:15:36.804601+0000, chain.objs.size()=1 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.khWwlUSNjIT_jczwIKNxNtDHJOnq5Zt_0 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1649489907541742771', time=2024-09-12T20:15:36.807436+0000, chain.objs.size()=1 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2vqOWp-rmAN2vUqEeZsvYm1Ud78r1qA_0 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10500861096797921877', time=2024-09-12T20:15:37.077639+0000, chain.objs.size()=1 2024-09-12T18:33:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.828+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wLcCQOFYVszRdRhxi0Ao_rkj3Z9o2Ag_0 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11665781030573383716', time=2024-09-12T20:15:37.194649+0000, chain.objs.size()=1 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gj-zYiaRdI9c4WAJmFsYoQRHyvZMBO7_0 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14374767592135824349', time=2024-09-12T20:15:37.424947+0000, chain.objs.size()=1 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PK0s7qnhJY2EDRPUV21HQ64Oh9Fahf1_0 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5400172006533786303', time=2024-09-12T20:15:38.361487+0000, chain.objs.size()=1 2024-09-12T18:33:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.00WqIP4c-93q_Gd4aakIe-qqkw99p9__0 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9990399648525938142', time=2024-09-12T20:15:38.363237+0000, chain.objs.size()=1 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nwthVCONlmVbEb6dnjLPvJ3cW7BAFgE_0 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7575580720566574106', time=2024-09-12T20:15:38.411260+0000, chain.objs.size()=1 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.56mDCgaoy3dDmjDbR6qrdIKGgW0jriH_0 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17692128316720241670', time=2024-09-12T20:15:38.608265+0000, chain.objs.size()=1 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.z_mqTArtd-4lqNXKCWlqmcF_ZgqI2Y1_0 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.174340883624162361', time=2024-09-12T20:15:38.649681+0000, chain.objs.size()=1 2024-09-12T18:33:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.831+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.X211puBQi0Fz0OgKchl-LjX6-qKsz_J_0 2024-09-12T18:33:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.833+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18408880494632947638', time=2024-09-12T20:15:38.746443+0000, chain.objs.size()=1 2024-09-12T18:33:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.833+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bz4KZOngT-FtsSOlIcsgOSibq-EiMYl_0 2024-09-12T18:33:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.834+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6781720932553858614', time=2024-09-12T20:15:38.988439+0000, chain.objs.size()=1 2024-09-12T18:33:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.834+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ulD_1gJhhOl6lfrtj5Xx0-h2cvxcqIi_0 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.834+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6996052838053780470', time=2024-09-12T20:15:39.078341+0000, chain.objs.size()=1 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.834+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.H34owAvO8cMAhBVtMuGLBiML3vnoQuy_0 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4862223042091825252', time=2024-09-12T20:15:39.460113+0000, chain.objs.size()=1 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PXlRishSsUyEusmWctiNxg5eDWgF207_0 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5473007158039815684', time=2024-09-12T20:15:39.724204+0000, chain.objs.size()=1 2024-09-12T18:33:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uDF6kITAsKFkty5KiP6iaE0ScPlYgaT_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10225886658299673368', time=2024-09-12T20:15:40.127119+0000, chain.objs.size()=1 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oPvLOBAOJmpmwHs-D83tL0wp5Qnxw1y_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15892643108973877349', time=2024-09-12T20:15:40.251867+0000, chain.objs.size()=1 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1AYPLa0YMPyWQa7dUe8spgIY-U29nhz_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14044147849898698595', time=2024-09-12T20:15:40.752559+0000, chain.objs.size()=1 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.OV5Gp8AuqhzQVxNWEYMzOi_iHCzmpvW_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4813971743475597938', time=2024-09-12T20:15:40.779584+0000, chain.objs.size()=1 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dJ50wR2jKS1rPOrr5oWcc092PSgl7iQ_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13318429853299162122', time=2024-09-12T20:15:41.410995+0000, chain.objs.size()=1 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TL7wbN7krCsyQJ7zDZlweZuxCi0sxlr_0 2024-09-12T18:33:03.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15559988653007408707', time=2024-09-12T20:15:41.414888+0000, chain.objs.size()=1 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nvpMZa-5mt9D2_536cOEulBoLeUf_Qm_0 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6478192509833101688', time=2024-09-12T20:15:41.455110+0000, chain.objs.size()=1 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oy0RLWC-xFOMf4d74xKzhzqa2W6OByG_0 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6783607698534476167', time=2024-09-12T20:15:41.520899+0000, chain.objs.size()=1 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nPHZYJyZRB7v_2-HhbrEw5BwTYVERKO_0 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5502028910811013367', time=2024-09-12T20:15:41.625022+0000, chain.objs.size()=1 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.M32KnqxL75C7DZGinWr7YgaMLwWWwBc_0 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.840+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16095584218947802576', time=2024-09-12T20:15:41.698658+0000, chain.objs.size()=1 2024-09-12T18:33:03.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.840+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.K1imzh_-OmJcYknQsk3F3VWS23ZZVMN_0 2024-09-12T18:33:03.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.840+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10882804283079523921', time=2024-09-12T20:15:41.801844+0000, chain.objs.size()=1 2024-09-12T18:33:03.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.840+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tdutWJGqO2KIMRUQGVRqdX7POpg_GIN_0 2024-09-12T18:33:03.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13375384543899329275', time=2024-09-12T20:15:42.057807+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.anZwB95-J4pMZev_mcJUAwJp_OcKCrt_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4263825064507342383', time=2024-09-12T20:15:42.366882+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.r9-HtDwoTkGxbUj78hWumrDyKLjZWOi_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14488319833273322490', time=2024-09-12T20:15:42.495284+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mAbDtzYwWPLNsEcDBL_R-ZOWzHxcI5G_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1200130761377587530', time=2024-09-12T20:15:42.664062+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1d3cSX2egSvwmJWiVMqa_XlKy2HbSbB_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18129638770869276651', time=2024-09-12T20:15:42.774039+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vdF4ZzX-8gPr4ZdH9bhehOl-G5OvF2S_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13131232410599709864', time=2024-09-12T20:15:42.881270+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GFv_pqeOMt0D_z676WuAVvGGH7BEGwY_0 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17525540642029551156', time=2024-09-12T20:15:42.888827+0000, chain.objs.size()=1 2024-09-12T18:33:03.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.844+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iUX9_-5xIoBlsM8q6rq7yQzpsao2hS__0 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15603849251654680086', time=2024-09-12T20:15:42.897416+0000, chain.objs.size()=1 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.k0az_teWXvqbHd7k2r58g91it5Vq0zx_0 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10840990542276657145', time=2024-09-12T20:16:20.585230+0000, chain.objs.size()=1 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sSAwpHP5eqljrojmfliJe5IrLd4mI-6_0 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16418295792913785715', time=2024-09-12T20:16:20.722730+0000, chain.objs.size()=1 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bwmE5sWqeXPcQT5_-BF0s1uGyDA_0nY_0 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3470319573266880090', time=2024-09-12T20:16:20.723688+0000, chain.objs.size()=1 2024-09-12T18:33:03.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Ds45jQxTo0oCvAOzifuc7I0C_RW2Mb3_0 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8253482497846676964', time=2024-09-12T20:16:22.416351+0000, chain.objs.size()=1 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yhH3Ngw4UjSf23I2Fj5BO90d5jNxpHM_0 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16589871138339392528', time=2024-09-12T20:16:22.575830+0000, chain.objs.size()=1 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VBf4eFHrCoa8R1EwsH0FQQliOnH-x-R_0 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12096070920326338052', time=2024-09-12T20:16:23.443178+0000, chain.objs.size()=1 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YwaNs2vx7jK979W_mTG20aLngN5Pn80_0 2024-09-12T18:33:03.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9955047440231472390', time=2024-09-12T20:16:23.482434+0000, chain.objs.size()=1 2024-09-12T18:33:03.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.849+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kUsM8eKvoyKVMmlia5ySQLMIRIkpHnX_0 2024-09-12T18:33:03.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5304511418458997957', time=2024-09-12T20:16:23.666975+0000, chain.objs.size()=1 2024-09-12T18:33:03.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2UxbKN8f_b4jWYNV0iog2Z9lY90GpBX_0 2024-09-12T18:33:03.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5775129908568971994', time=2024-09-12T20:16:24.111353+0000, chain.objs.size()=1 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9LaumnFi5y3So9aU9SIBiOQ3vwm9Hwc_0 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6571027826984234291', time=2024-09-12T20:16:25.123243+0000, chain.objs.size()=1 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NTLSWh_jcHeWFRZdkUHc5H2c6fWopod_0 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14988223563722591851', time=2024-09-12T20:16:25.525738+0000, chain.objs.size()=1 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JGQ0yAR8sC_1chESa8eFoZO-yLS7YLQ_0 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1401812166913203004', time=2024-09-12T20:16:25.547416+0000, chain.objs.size()=1 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3EK5ySRrktRViTRKvajab6d7Ke9P4Uj_0 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8040041343322203131', time=2024-09-12T20:16:25.553287+0000, chain.objs.size()=1 2024-09-12T18:33:03.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.852+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BFwxUUFXjcJl26ffC6i7Tf3BKgFkWZ2_0 2024-09-12T18:33:03.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.859+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/49626 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12331049434205276061', time=2024-09-12T20:16:25.930488+0000, chain.objs.size()=1 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tMbQsZspDGSnCzQIdAEZKnJoJnW7AWv_0 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15861120480254969550', time=2024-09-12T20:16:26.048442+0000, chain.objs.size()=1 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YgTwFaD_HLMba6rnAVf-VkSqpD8S4P8_0 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11703063532535148878', time=2024-09-12T20:16:26.171106+0000, chain.objs.size()=1 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BPqNGJjI6pNNV3Uep0Uuey3Q-tcHVmR_0 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4323280622465201034', time=2024-09-12T20:16:26.198254+0000, chain.objs.size()=1 2024-09-12T18:33:03.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oMwhqEJgu6abi-YPU0qI7NWNEKakcQT_0 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15370914928424567248', time=2024-09-12T20:16:26.272080+0000, chain.objs.size()=1 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Px1yMvE4jIXqiNb0orVC8CvMP0kwqGD_0 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4413352422215737974', time=2024-09-12T20:16:26.752574+0000, chain.objs.size()=1 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DActrrCE8U0UXdoIpvJOsmaXqK3dRl__0 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1577012108701128014', time=2024-09-12T20:16:27.301478+0000, chain.objs.size()=1 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2uayEFzz3KeBonJubwLPjq7Gh2IUw_Y_0 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13054153377288228411', time=2024-09-12T20:16:27.437954+0000, chain.objs.size()=1 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XdlbyIL8rKiojd-SfGJ3_JZNBp5Vul4_0 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17678742514748294929', time=2024-09-12T20:16:27.504496+0000, chain.objs.size()=1 2024-09-12T18:33:03.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ssA-_Wj72G2IE2OekRrrzW76iIeaHLj_0 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12289661046669651348', time=2024-09-12T20:16:27.669058+0000, chain.objs.size()=1 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sH1VMEuHzbmgRQqHLyFJ07SqQTm1jvC_0 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7094373902162445439', time=2024-09-12T20:16:27.686898+0000, chain.objs.size()=1 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JGB8y9643pNS1qRhoQ-G-Qm7HqARTE7_0 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7070233714276264972', time=2024-09-12T20:16:27.939503+0000, chain.objs.size()=1 2024-09-12T18:33:03.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8xXGP6WGXfvdewik7bYxcbH67JyAmYJ_0 2024-09-12T18:33:03.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.866+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14538529596467791668', time=2024-09-12T20:16:27.940302+0000, chain.objs.size()=1 2024-09-12T18:33:03.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.866+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tG6GeAJrLxVUhrl1Ybv3e8pIUDHcz_4_0 2024-09-12T18:33:03.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16641280838887064016', time=2024-09-12T20:16:27.996499+0000, chain.objs.size()=1 2024-09-12T18:33:03.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Xu22PVc7Qv8ZZjyVsaS-5BXBFQNOoxj_0 2024-09-12T18:33:03.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4675517452158659461', time=2024-09-12T20:16:28.211687+0000, chain.objs.size()=1 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZnVNaqdqZ574uzejPzvB53xGmgcjOqX_0 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4932199374422122124', time=2024-09-12T20:16:28.257536+0000, chain.objs.size()=1 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.h4mRXgAloYeeB6j4PBdqKfoRK_nmfba_0 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14509775256895502904', time=2024-09-12T20:16:29.744150+0000, chain.objs.size()=1 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6VWWHJAYF6ZyZjQnt4mAtLimM8qRnpU_0 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6946316182094143522', time=2024-09-12T20:16:30.254583+0000, chain.objs.size()=1 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.s3w8USjU2lKiaZDai-P19gR81VMDInS_0 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9319309620275645613', time=2024-09-12T20:16:30.382883+0000, chain.objs.size()=1 2024-09-12T18:33:03.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.867+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MFvMMwcZ2b0yGjfL6YQPVYM2AKsfym8_0 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3124831450579950531', time=2024-09-12T20:16:30.554552+0000, chain.objs.size()=1 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lCFFE-Rp76KbA_zoLpS8QK_Qu13Ut8l_0 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.108988257209489183', time=2024-09-12T20:16:30.576379+0000, chain.objs.size()=1 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F7PTL1NA9UzkNC4UOBhFwq8fquMUCue_0 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4806094864286038727', time=2024-09-12T20:16:30.972332+0000, chain.objs.size()=1 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-YmyMaZI9BImgP7gmzqem19lHb3vln4_0 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12782268659361919424', time=2024-09-12T20:16:31.999023+0000, chain.objs.size()=1 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.868+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.326__shadow_.M24VsRQECs_0wV3W-EsmsPY2878Oi84_0 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.869+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11869871890814907837', time=2024-09-12T20:16:40.404756+0000, chain.objs.size()=1 2024-09-12T18:33:03.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.869+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.342__shadow_.24QHOvcIWAssD0hN57TGIc34fgF8VkO_0 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17399411051235693978', time=2024-09-12T20:17:27.767180+0000, chain.objs.size()=1 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.433__shadow_.tgoYiZrx9Aq5quIvz6vxggF8WIoX9rI_0 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4300357356513305654', time=2024-09-12T20:17:57.945271+0000, chain.objs.size()=1 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484__shadow_.f7bVDvTa1TBSSIS1swFa3sUXwS5uiRB_0 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3181740547598000041', time=2024-09-12T20:18:11.350737+0000, chain.objs.size()=1 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2365725480597924188', time=2024-09-12T20:18:24.746668+0000, chain.objs.size()=1 2024-09-12T18:33:03.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.514__shadow_.fGBDZsm5fEBxj-ssHX1OC_pGhmpQrML_0 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7647155138981576747', time=2024-09-12T20:18:31.774792+0000, chain.objs.size()=1 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.873+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.518__multipart_mymultipart.2~-inSWG31a6saTmtdZz_PYpVsSYU3enj.1 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2121352519826722787', time=2024-09-12T20:21:35.329308+0000, chain.objs.size()=1 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:sFm-Qu9X.Qmlmkk8T2dgGH41ruByXyC_.sP1NXK_M22vhTqbvSxku-26xX9mM8Ok_0 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10979387299908942493', time=2024-09-12T20:21:48.045683+0000, chain.objs.size()=1 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:QMhCzDzhzLEZoJrlVw7kj8L3cfxWbZs_.xMnjFgsNLwYRHVgzFavJ0rz-N9B-3gV_0 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2597732038534781095', time=2024-09-12T20:22:38.285520+0000, chain.objs.size()=1 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.586__shadow:4wftK04wJ1EPh6dv0YpaziEQp3F2Sqn_.yJ7k-BBHRnbRkNyJ0PuCRq3BdGpQNfd_0 2024-09-12T18:33:03.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~F2RV4UB0yybNxXWon9uAkEmQ5cR2yq-', time=2024-09-12T20:28:22.650488+0000, chain.objs.size()=1 2024-09-12T18:33:03.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.874+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.742__multipart_mymultipart2.2~F2RV4UB0yybNxXWon9uAkEmQ5cR2yq-.1 2024-09-12T18:33:03.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.878+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.880+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:33:03.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.882+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.882+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48644' 2024-09-12T18:33:03.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17470369115545630671', time=2024-09-12T20:14:04.015038+0000, chain.objs.size()=1 2024-09-12T18:33:03.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gTJ4PF8T5-Kg_thH-PhidDu0X1iWe1T_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7944637183981523415', time=2024-09-12T20:14:04.200277+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KNXpVdRy5UC_ar0s273i72ZB84w_dSf_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12283967234835745977', time=2024-09-12T20:14:04.618847+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YMxx-KVMeZvC-3agFfomSkLsPQ7nQ98_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16521161124748800649', time=2024-09-12T20:14:04.741713+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FVYfHzfMAnzfTvGpeXpSYVXLiYBlffB_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12501933587282547135', time=2024-09-12T20:14:04.833233+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JJiXZxhk2Gh1Lw07S_-SbR4G2U5wfHh_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16244508796901512438', time=2024-09-12T20:14:05.158367+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.f1ICsXF2PNJosDc-azgaG-6zNRbHzRa_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3551377942098026257', time=2024-09-12T20:14:05.172075+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SN6FDapv0Xl6N-ebAa3_jhvlGu-dnos_0 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8351047755613342718', time=2024-09-12T20:14:05.778572+0000, chain.objs.size()=1 2024-09-12T18:33:03.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hds9hE1_pFSwu7sVka13IYc7NIQJagy_0 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8282205657859871815', time=2024-09-12T20:14:05.820007+0000, chain.objs.size()=1 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.d-zdMZiXD_EUYe0Lbfb5nri3wnzd5wn_0 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9001508490780771633', time=2024-09-12T20:14:06.002705+0000, chain.objs.size()=1 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HeOHiSyv0rclNJrQ-NoBzgELV2Ya7fG_0 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6269412956017245187', time=2024-09-12T20:14:06.003264+0000, chain.objs.size()=1 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.eOSq02Bzy7NUEmgW7re9JDuERj0tmn6_0 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14347708064216161733', time=2024-09-12T20:14:06.170624+0000, chain.objs.size()=1 2024-09-12T18:33:03.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.883+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lsH8GVWANZZX5iLSqvbX7vf2pPOlpsM_0 2024-09-12T18:33:03.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13525879790799461455', time=2024-09-12T20:14:06.379001+0000, chain.objs.size()=1 2024-09-12T18:33:03.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FJO77C9XPiS68ECd1MQ7HO-BSYLBY1O_0 2024-09-12T18:33:03.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17145174970925815594', time=2024-09-12T20:14:06.461109+0000, chain.objs.size()=1 2024-09-12T18:33:03.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gGoP2ywK01-6fIsEbIahroztfB0AE2X_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3552844498074986682', time=2024-09-12T20:14:07.331412+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pTmyNMLiToBbOXyb_ghALj0AUX7XZhQ_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5003555329763524722', time=2024-09-12T20:14:07.331954+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uw8EOOF379TMWsIHpo-zSnvCF-sr5Fb_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9506437988623010320', time=2024-09-12T20:14:07.585913+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zaYB1-jPeIEygMeMSN4vMha-QQr7lSW_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14894177189460911304', time=2024-09-12T20:14:07.939406+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F4d_pjxEtr8Fcm4CmnaIE9U863m-nWq_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17034682342403905915', time=2024-09-12T20:14:08.938391+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kgSTlylDkRN-w0fqtVG3Y6Htyc1SGkl_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14563667278986953782', time=2024-09-12T20:14:08.962272+0000, chain.objs.size()=1 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jnjB9EHNdgWk93py1ruSrm1uJWJAOr1_0 2024-09-12T18:33:03.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5832579580843585635', time=2024-09-12T20:14:09.004691+0000, chain.objs.size()=1 2024-09-12T18:33:03.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NrkXnwuh96NNa4HGW-I4bELU1EwemtL_0 2024-09-12T18:33:03.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8126065023113548961', time=2024-09-12T20:14:09.023951+0000, chain.objs.size()=1 2024-09-12T18:33:03.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ErxANDCqdtD-l_vOvZI3CWZRN-gipVa_0 2024-09-12T18:33:03.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4628283819647168823', time=2024-09-12T20:14:09.462062+0000, chain.objs.size()=1 2024-09-12T18:33:03.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.887+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xL8pn5tSjtRO5X-OBssy0QdMBWVl7S2_0 2024-09-12T18:33:03.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.891+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14794564120359639815', time=2024-09-12T20:14:10.080808+0000, chain.objs.size()=1 2024-09-12T18:33:03.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.891+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IWvGPkA4W7wfMLdg2tyDEWGHtFNdmCQ_0 2024-09-12T18:33:03.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16884978539615790485', time=2024-09-12T20:14:10.451032+0000, chain.objs.size()=1 2024-09-12T18:33:03.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZV1A_v4UvHFW4H2k_uWyRd0cUyQDyFG_0 2024-09-12T18:33:03.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1187110332985230562', time=2024-09-12T20:14:10.751744+0000, chain.objs.size()=1 2024-09-12T18:33:03.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._iCjRJrJsIGUuc6k9xEbAQkxknK3VN7_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2195016430412606634', time=2024-09-12T20:14:11.138442+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9geS76iBKFnf2qAUDgSTbz8hm0vxkT6_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13507425129690438685', time=2024-09-12T20:14:11.492109+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.n1tGWDlXgr1_gmgp-uAPtjPrGGfMURH_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3741413953043922428', time=2024-09-12T20:14:11.813610+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tMDunuHNIBWy2age1_kDYOUP90LAARs_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17769176954310328167', time=2024-09-12T20:14:11.847682+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8hx5F6EgL88Zv0xqVz9xrcDtMp1UNnl_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10499560916271073980', time=2024-09-12T20:14:11.864493+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3h3VyP6g9EMF-GvkwB7JKZ9dUqWNmlH_0 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13410112390059556648', time=2024-09-12T20:14:12.033333+0000, chain.objs.size()=1 2024-09-12T18:33:03.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.j5enBviTOehSk-HtkpN0jCpOAUUDmO-_0 2024-09-12T18:33:03.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3290241017259560286', time=2024-09-12T20:14:12.226452+0000, chain.objs.size()=1 2024-09-12T18:33:03.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.T-_kQXYPuOYWYaE6edtQERkGHB8rKko_0 2024-09-12T18:33:03.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1325673820405203183', time=2024-09-12T20:14:12.335636+0000, chain.objs.size()=1 2024-09-12T18:33:03.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.892+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6lOfUxKxhEwsOFF3ywTEl_zULId8ok0_0 2024-09-12T18:33:03.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.895+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2508302345714742479', time=2024-09-12T20:14:12.547207+0000, chain.objs.size()=1 2024-09-12T18:33:03.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.895+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1-o9wWwPhg_ERIe-nFLO-zUmHjQg_n4_0 2024-09-12T18:33:03.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.896+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10842450509722210960', time=2024-09-12T20:14:13.399341+0000, chain.objs.size()=1 2024-09-12T18:33:03.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.896+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jU_uwgwWEAo2fyYX2jSJALRgyMnCxwt_0 2024-09-12T18:33:03.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1524631325628563132', time=2024-09-12T20:14:13.596122+0000, chain.objs.size()=1 2024-09-12T18:33:03.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qG2O7xuQ5lTabz-hwERub0WKViPcU9X_0 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9234323294873172757', time=2024-09-12T20:14:13.923522+0000, chain.objs.size()=1 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qr6stC9XxLkADEFsvahnN7DWfIY70Um_0 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2868036273437597554', time=2024-09-12T20:14:14.332721+0000, chain.objs.size()=1 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OBqpYrxGFG1LC2kFQD1E3a_4skvqey7_0 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4001019815286837566', time=2024-09-12T20:14:14.508831+0000, chain.objs.size()=1 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Zlpu1e82aH2qDlmnYaZVD21eBZxBlp__0 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13794538982372666847', time=2024-09-12T20:14:14.790484+0000, chain.objs.size()=1 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4uSmFWGHgTctViNAZOvfyG4xDQD0Ott_0 2024-09-12T18:33:03.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12670531455542391377', time=2024-09-12T20:14:15.040131+0000, chain.objs.size()=1 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WZ-VYFeZ7ejh72arHV3eKDlZ1KqAR88_0 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13893365593858007065', time=2024-09-12T20:14:15.203677+0000, chain.objs.size()=1 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.99P_IPsN5Gb49BqWhskrOcWaK5brZJN_0 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17480896822049531176', time=2024-09-12T20:14:15.219279+0000, chain.objs.size()=1 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mH_HAol2RBM-d8NtRGSeo23TJP9i-rA_0 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15640672542857044381', time=2024-09-12T20:14:17.511610+0000, chain.objs.size()=1 2024-09-12T18:33:03.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.898+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.266__shadow_.Q76DjVU2Enb7pUzykc6TD1US-GWwMQo_0 2024-09-12T18:33:03.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.899+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12522479853702896863', time=2024-09-12T20:14:26.436120+0000, chain.objs.size()=1 2024-09-12T18:33:03.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.899+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.281__shadow_.WQ2zg7omGThLYHvas6Qvi2BOI5miiyt_0 2024-09-12T18:33:03.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.901+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9434716885189565514', time=2024-09-12T20:14:27.656606+0000, chain.objs.size()=1 2024-09-12T18:33:03.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.901+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.283__shadow_.LVhmQqpu6vD9lhzQcgHqxltTUBYn1yr_0 2024-09-12T18:33:03.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15538808700005853674', time=2024-09-12T20:14:29.626553+0000, chain.objs.size()=1 2024-09-12T18:33:03.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.286__shadow_.1OZIGGTNRA-ouyL5zqQ_BoZaY5K9HiX_0 2024-09-12T18:33:03.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8190035924114189732', time=2024-09-12T20:14:34.607434+0000, chain.objs.size()=1 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.CLU0yOLzQSgJ8vGuhV-hN0q26-hvciP_0 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2198861119801351895', time=2024-09-12T20:14:36.406719+0000, chain.objs.size()=1 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.My4GFnEAWyQVMgst7OTGOyUfk2pPQgF_0 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13300084160658142284', time=2024-09-12T20:14:42.784750+0000, chain.objs.size()=1 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.904+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.303__shadow_.vXjqBjYDTphMmAtOvcJfWn0hkZYCsvY_0 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4352124051093799309', time=2024-09-12T20:14:44.882220+0000, chain.objs.size()=1 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.306__shadow_.1l0OpIoHXoXt-rnSuO6YI7om6yDs8hS_0 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12548576270619347621', time=2024-09-12T20:14:53.095054+0000, chain.objs.size()=1 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319__shadow:.Mq7S2XrTcXUMRBaqYdFJh.3wEnv7EK_.5GCpPSr2n2DaR7XejN_wbQ-C4ihk5Fb_0 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3964600483952202548', time=2024-09-12T20:15:32.319388+0000, chain.objs.size()=1 2024-09-12T18:33:03.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9W6jV0aFryXAebzRW24EFG9_phgmzW5_0 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14116874327144287105', time=2024-09-12T20:15:32.553818+0000, chain.objs.size()=1 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9z7WQA5bHarPnDBNfpvs-t4g2yT-Qeo_0 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17128876346584244753', time=2024-09-12T20:15:33.026793+0000, chain.objs.size()=1 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7-UMR0LMsnEoGztcDnelB-FbiYI6ny0_0 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8115786452432235504', time=2024-09-12T20:15:33.829895+0000, chain.objs.size()=1 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.phHyDt08CQYHV7ij3XYEWdqzL7YG_9l_0 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18295594610124152346', time=2024-09-12T20:15:34.135637+0000, chain.objs.size()=1 2024-09-12T18:33:03.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.906+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VMHUwBkO2-2Oye86LxBk8J7C3k0qZEJ_0 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7329726897170394394', time=2024-09-12T20:15:34.597442+0000, chain.objs.size()=1 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fv2ZUYZsPrKboj42p2XyL4Do-Ga9Lis_0 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7127202436644392027', time=2024-09-12T20:15:34.753850+0000, chain.objs.size()=1 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lm0euBVI9Y-7dbdSS7M-4EzQo6OrTPs_0 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9109566324091427265', time=2024-09-12T20:15:35.331430+0000, chain.objs.size()=1 2024-09-12T18:33:03.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.907+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Gcw-S3M5kYnGKwhrY8qOYSwnOsyTETJ_0 2024-09-12T18:33:03.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7660946182879040012', time=2024-09-12T20:15:35.518117+0000, chain.objs.size()=1 2024-09-12T18:33:03.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5zBoiXoA_6Bv4zAK1JaYhwbJwoh8uSd_0 2024-09-12T18:33:03.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17142150235865084305', time=2024-09-12T20:15:35.544398+0000, chain.objs.size()=1 2024-09-12T18:33:03.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xKleC0rp8S4R4hgsJ4wkfMNFElO_xVJ_0 2024-09-12T18:33:03.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13391348452377777371', time=2024-09-12T20:15:35.572028+0000, chain.objs.size()=1 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fXZ1n6NKHg60yo__9AG3Hseugb1zYbr_0 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10711265348524097723', time=2024-09-12T20:15:35.603527+0000, chain.objs.size()=1 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Aqi-IAXDbUNiMtwGgxqOu1sS1zWB23I_0 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17701591150764447653', time=2024-09-12T20:15:36.113799+0000, chain.objs.size()=1 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ld1aBL1AzpxyjK9VlPC32gSJ-YNB-9G_0 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12765590240975200109', time=2024-09-12T20:15:36.721319+0000, chain.objs.size()=1 2024-09-12T18:33:03.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7GSY97AKvWmv0StStbZS27TV3awJPU-_0 2024-09-12T18:33:03.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3418482513686543437', time=2024-09-12T20:15:36.722098+0000, chain.objs.size()=1 2024-09-12T18:33:03.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HwsKYwXBaP7kESDLSAQIrkejMYycnJL_0 2024-09-12T18:33:03.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.92636561689206547', time=2024-09-12T20:15:36.926011+0000, chain.objs.size()=1 2024-09-12T18:33:03.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.912+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uQxf2IGm1lcJguFLxLeGyE2v-EeB_gM_0 2024-09-12T18:33:03.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.914+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4654972001788481873', time=2024-09-12T20:15:36.972843+0000, chain.objs.size()=1 2024-09-12T18:33:03.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.914+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uAOnWca5kdWI9hunHRnfVuDXAgx4psg_0 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9413132319480126686', time=2024-09-12T20:15:37.000038+0000, chain.objs.size()=1 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TvLCAQhBppC6EyCcCzBSFl_HCOUi3Om_0 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1782214259624638252', time=2024-09-12T20:15:37.237539+0000, chain.objs.size()=1 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3cDxQqgZ0YczT9uYoEAuHbQQvF4s00J_0 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3609395035532383788', time=2024-09-12T20:15:37.651603+0000, chain.objs.size()=1 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9-xH-z8HTB8pg-4C85r-SHqqP0NziRF_0 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2028020490115761772', time=2024-09-12T20:15:38.140862+0000, chain.objs.size()=1 2024-09-12T18:33:03.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.915+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lxJzxnDIy0mc-zqLk8qaU2jmJLtiDq9_0 2024-09-12T18:33:03.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8275498438414628067', time=2024-09-12T20:15:38.875184+0000, chain.objs.size()=1 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.axhPpYNKuhqYUai2cjGeTqUZtwbFymy_0 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12409114889637420299', time=2024-09-12T20:15:38.911658+0000, chain.objs.size()=1 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Ss5aLcu9o397Q7NJS2gK6KunbaRGNDp_0 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6230434834942700355', time=2024-09-12T20:15:39.604103+0000, chain.objs.size()=1 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Li-OQlYvszfk28IP9Xr1bNXVuh-VPQn_0 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17083621850490356557', time=2024-09-12T20:15:39.654920+0000, chain.objs.size()=1 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JFYwPyqhjmYV-00GKEcX0ZPS-Ohijs4_0 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16349868686737887956', time=2024-09-12T20:15:40.447050+0000, chain.objs.size()=1 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EFdJzS3BiCdCNJ_WMJK09LN1zaxWiYL_0 2024-09-12T18:33:03.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13438431852200077488', time=2024-09-12T20:15:40.787783+0000, chain.objs.size()=1 2024-09-12T18:33:03.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0KcB3bV0PiT4acgzgPR9kKrlZa4JIjl_0 2024-09-12T18:33:03.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5100557272391329528', time=2024-09-12T20:15:41.350650+0000, chain.objs.size()=1 2024-09-12T18:33:03.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.917+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BCGiDGNrqzNKis5sHZQc5qnm6Yo59zE_0 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6392708591395631496', time=2024-09-12T20:15:42.704104+0000, chain.objs.size()=1 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.X4FTb8RnABhJQGYmQorJyrYzB9eTe5E_0 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13265369729933244802', time=2024-09-12T20:15:42.704912+0000, chain.objs.size()=1 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DhylqoKRqQgHoPrCtYDQMKPf2mjAYr5_0 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8248873646191686671', time=2024-09-12T20:15:42.878297+0000, chain.objs.size()=1 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lxzerwPY-Yk3US3wxofG0xe2sY8-vZn_0 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9631390860838579830', time=2024-09-12T20:16:20.096323+0000, chain.objs.size()=1 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.920+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y9B5ib_0Q-sJ_GyT-qEa72rSvD7oArl_0 2024-09-12T18:33:03.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.922+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9871424262216629844', time=2024-09-12T20:16:20.124989+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.922+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pouTiZodJLjuBc6-dJ_9LLECWurFzEX_0 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17373005516661503429', time=2024-09-12T20:16:20.255011+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IFyjXGpxderNkA3bqPeOva238PSv1xZ_0 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17886650071710142650', time=2024-09-12T20:16:20.971684+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0lUmsKn1gwaHc6OyUL9tn1nyS-8YMlY_0 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9531492702462153973', time=2024-09-12T20:16:21.671722+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pFHehpmd67Qj_MbqAisdbb-OJttlFoi_0 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4068184633581397419', time=2024-09-12T20:16:22.571596+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4XqEdWhO_CNfaF9kc_EPSqNdPHsEkmF_0 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2700465623364488126', time=2024-09-12T20:16:23.225386+0000, chain.objs.size()=1 2024-09-12T18:33:03.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.923+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mCPrGmk2CQ5O_9mCAuqGZp6PHgdOUtS_0 2024-09-12T18:33:03.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.925+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13026906026831412350', time=2024-09-12T20:16:23.483020+0000, chain.objs.size()=1 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.925+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4SXvW2JNyDcp3PmnCm759OYqKGqPWVq_0 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.220485443493353620', time=2024-09-12T20:16:23.524043+0000, chain.objs.size()=1 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.b5oS5Zs0RA0ivbndvbJr0yKHW5GiF1Y_0 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6390581891631901612', time=2024-09-12T20:16:23.524856+0000, chain.objs.size()=1 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8XHkZyOGyQej5PHlXq8mbWnKMiAnN0l_0 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16931661306048546216', time=2024-09-12T20:16:23.634274+0000, chain.objs.size()=1 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._bLRZCCaO_2qxzwBdlgAY4Yb2sK-5vI_0 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.189146406735690050', time=2024-09-12T20:16:23.661256+0000, chain.objs.size()=1 2024-09-12T18:33:03.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.926+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vBCvt0pwXqRhXWIA2qrFn3NpGe8cSoR_0 2024-09-12T18:33:03.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.928+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8948560116895943880', time=2024-09-12T20:16:24.115288+0000, chain.objs.size()=1 2024-09-12T18:33:03.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.928+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DfKxrQYHnJEm5lDQVQ5pXo3ch7my1TE_0 2024-09-12T18:33:03.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.928+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16212104228401498469', time=2024-09-12T20:16:24.682245+0000, chain.objs.size()=1 2024-09-12T18:33:03.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.928+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kQLR6OIntGI5rj5OgNCKGOchSz29qlD_0 2024-09-12T18:33:03.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.931+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7152073406049776094', time=2024-09-12T20:16:24.800343+0000, chain.objs.size()=1 2024-09-12T18:33:03.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.931+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RopI_DpuHwnZCXWiwoOOVQlUKF0GhZ0_0 2024-09-12T18:33:03.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.931+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5263488009362896471', time=2024-09-12T20:16:24.829408+0000, chain.objs.size()=1 2024-09-12T18:33:03.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.931+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5HtQUSHpSlaoOdYq7Tl56diH0wnGkho_0 2024-09-12T18:33:03.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.936+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/48644 2024-09-12T18:33:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T18:33:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14523226055116176949', time=2024-09-12T20:16:25.420704+0000, chain.objs.size()=1 2024-09-12T18:33:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.D29FrcwRVjr3kT4m2tvrTskJK6xXllz_0 2024-09-12T18:33:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2782910525863214579', time=2024-09-12T20:16:25.421446+0000, chain.objs.size()=1 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Pld4vN_VXnn2cd8FIiUuJncFoIywAua_0 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15143898154363072392', time=2024-09-12T20:16:25.424465+0000, chain.objs.size()=1 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.P82V3r4XpSPZMRpPDaHDHoAFuZUoU1a_0 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3345919209967875226', time=2024-09-12T20:16:25.561995+0000, chain.objs.size()=1 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PVZmg09mqP7cwwVtuYWCbsZjgQ1Ftp1_0 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10000752752505490676', time=2024-09-12T20:16:26.077344+0000, chain.objs.size()=1 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Vr-lsTpu-Ve5QEorSDu07YUsCVFUgJ3_0 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15287300583079087891', time=2024-09-12T20:16:26.715538+0000, chain.objs.size()=1 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fzQd8ESSg4lQaxUeti_1Mg3AdsNQDxG_0 2024-09-12T18:33:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14968818837675609198', time=2024-09-12T20:16:27.286025+0000, chain.objs.size()=1 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DJ-Uxp1wK9g5atxh7qYq0g8G86Y5_Bo_0 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.307542128985171905', time=2024-09-12T20:16:29.328382+0000, chain.objs.size()=1 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LE7osU7ch1vLi2m6QLcZRznNLw7RdAS_0 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1788162814404796648', time=2024-09-12T20:16:29.658303+0000, chain.objs.size()=1 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.r2PxEs3pr47IN3BLfqIxOktB816tusY_0 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13184831444909340240', time=2024-09-12T20:16:29.692589+0000, chain.objs.size()=1 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zKRsB9UPyb61n7busV-C5_8yKb02Wra_0 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10219264073994782803', time=2024-09-12T20:16:29.803764+0000, chain.objs.size()=1 2024-09-12T18:33:03.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IsnplJ6xlkr9BsVxAPqO9sbrvKCenUK_0 2024-09-12T18:33:03.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6314586731864106019', time=2024-09-12T20:16:30.215408+0000, chain.objs.size()=1 2024-09-12T18:33:03.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AyO3iUY6KMx9PcWe5J1cD_7TI3OAzku_0 2024-09-12T18:33:03.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.944+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.630673412587223429', time=2024-09-12T20:16:30.255145+0000, chain.objs.size()=1 2024-09-12T18:33:03.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.944+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.r2-BTrTHdDfmrwyTm7QWbjqDFsbDC73_0 2024-09-12T18:33:03.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.946+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4758452936103387399', time=2024-09-12T20:16:30.255813+0000, chain.objs.size()=1 2024-09-12T18:33:03.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.946+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.klQiB017XiA1GVChM2GdkklM5L2qOXR_0 2024-09-12T18:33:03.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.946+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17594356046352391269', time=2024-09-12T20:16:30.877648+0000, chain.objs.size()=1 2024-09-12T18:33:03.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.946+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EojVkZlynp2RuHbvA9vBLEpHiqMA5zC_0 2024-09-12T18:33:03.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11283765591639023681', time=2024-09-12T20:16:30.912050+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GwYkIBEx5LaxYwz19LyRXoY4Ey68yOj_0 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7681780661040202770', time=2024-09-12T20:16:31.030120+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6ylGs8wcxVjzb4zKGY9p31j8sYcxWiW_0 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3770620487491615302', time=2024-09-12T20:16:35.527764+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.333__shadow_.PWmCddlaerqtv5et_JsIufwrjGqE8xy_0 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4440494051225236039', time=2024-09-12T20:16:37.380946+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.336__shadow_.Y8a9pptmkGLqCR25OOvj03q6dCu6qCc_0 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5901692641614231072', time=2024-09-12T20:16:45.238187+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.353__shadow_.JJjfVMDyAIxGQRTsRv4g85-v9F2Cg5v_0 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4744190606051476048', time=2024-09-12T20:16:57.737916+0000, chain.objs.size()=1 2024-09-12T18:33:03.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.377__shadow_.zcT6_7q_koK-pCglUU3-mlWEIM4-CNI_0 2024-09-12T18:33:03.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13474061687205623433', time=2024-09-12T20:16:59.031477+0000, chain.objs.size()=1 2024-09-12T18:33:03.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.379__shadow_.h3JtcFIyabAu1fYAqhaxXdJB-K_LUof_0 2024-09-12T18:33:03.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17539869205290433933', time=2024-09-12T20:17:42.242298+0000, chain.objs.size()=1 2024-09-12T18:33:03.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457__shadow_.-2SWAods_a22EH0QBFx6_SaypfnRbGi_0 2024-09-12T18:33:03.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8185642301397117264', time=2024-09-12T20:17:55.160992+0000, chain.objs.size()=1 2024-09-12T18:33:03.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.481__shadow_.n3wCbbNf4t_DBviLMqukXZwgERSo49m_0 2024-09-12T18:33:03.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.950+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2824134008986537069', time=2024-09-12T20:18:03.372065+0000, chain.objs.size()=1 2024-09-12T18:33:03.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.950+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.490__shadow_.8J3L8WRtRRGhyaOH2YIGG3uBgUPffYw_0 2024-09-12T18:33:03.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2824134008986537069', time=2024-09-12T20:18:03.568626+0000, chain.objs.size()=1 2024-09-12T18:33:03.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.490__shadow_.8J3L8WRtRRGhyaOH2YIGG3uBgUPffYw_0 2024-09-12T18:33:03.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12970753386847982508', time=2024-09-12T20:18:11.344770+0000, chain.objs.size()=1 2024-09-12T18:33:03.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:03.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10155966646316256874', time=2024-09-12T20:18:11.860771+0000, chain.objs.size()=1 2024-09-12T18:33:03.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:03.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13386906549555520557', time=2024-09-12T20:18:20.449511+0000, chain.objs.size()=6 2024-09-12T18:33:03.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:03.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:03.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:03.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:03.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.953+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:03.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.953+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:03.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.953+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2362294000361376081', time=2024-09-12T20:18:51.611542+0000, chain.objs.size()=3 2024-09-12T18:33:03.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.953+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~lU_9l6m5WY9J6A0vlMzW_uM9z2dN4ax.1 2024-09-12T18:33:03.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.955+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~lU_9l6m5WY9J6A0vlMzW_uM9z2dN4ax.2 2024-09-12T18:33:03.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.955+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~lU_9l6m5WY9J6A0vlMzW_uM9z2dN4ax.3 2024-09-12T18:33:03.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.955+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17136329283414342716', time=2024-09-12T20:20:37.242271+0000, chain.objs.size()=4 2024-09-12T18:33:03.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.955+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535__multipart_mymultipart.2~aJRPtiAVg810Zp9sjwhi9FuWP_Z4nUZ.1 2024-09-12T18:33:03.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.955+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535__multipart_mymultipart.2~aJRPtiAVg810Zp9sjwhi9FuWP_Z4nUZ.2 2024-09-12T18:33:03.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535__multipart_mymultipart.uhm_oHUxlmP2Hr4N_uQdjLnsdM5SBwPv.3 2024-09-12T18:33:03.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535__multipart_mymultipart.2~aJRPtiAVg810Zp9sjwhi9FuWP_Z4nUZ.4 2024-09-12T18:33:03.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7567186459125359970', time=2024-09-12T20:21:05.039938+0000, chain.objs.size()=1 2024-09-12T18:33:03.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.554__shadow_.ocbCMaNhqcSrWct3b5y7uRxniaINGmR_0 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16385472367335400008', time=2024-09-12T20:21:36.697884+0000, chain.objs.size()=1 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:SqB3xAYAk63SmdcoFynBxdOZrFjjqcO_.12o7NGaXANfsTokOh_dZI0EMaJqZewv_0 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2418036983158374837', time=2024-09-12T20:21:52.192909+0000, chain.objs.size()=1 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:1bdqLVEy-G2TC-d7kYvSCEmzSkrGRo1_.o3SPdF7sLbmr3r7eRQOn5GZM6i7Xsup_0 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1541740279201117599', time=2024-09-12T20:21:53.391732+0000, chain.objs.size()=1 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:XBb2diKcwZm1t1XLSTrKOUFAV8XEsHW_.Y5GKaXY5qN8qPf5Cl55fo6i7vDdnvPW_0 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14581647357528316305', time=2024-09-12T20:22:10.714174+0000, chain.objs.size()=1 2024-09-12T18:33:03.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.957+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:EW2hnHCtkCSi-brjdbMJnGb3fTkjMBP_.SDSafNwbqoxi13XZ6JXGc1DAkqr0cSG_0 2024-09-12T18:33:03.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.959+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8472727680370822293', time=2024-09-12T20:22:15.306237+0000, chain.objs.size()=1 2024-09-12T18:33:03.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.959+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:Gqx3MQMoo8UIfBmfzRWRnhHWcGCv29T_.P9IWq2IVtPprvqOQuc6GmAwjzpFceH8_0 2024-09-12T18:33:03.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11644198814229440470', time=2024-09-12T20:22:35.412160+0000, chain.objs.size()=1 2024-09-12T18:33:03.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.583__shadow:smNZKI2ltI9KeW6UPbBKtXSUZQ4y0-n_.2d_V2bx9cQceWwrnV01l03WV7BdJsLd_0 2024-09-12T18:33:03.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9966616622177615176', time=2024-09-12T20:28:25.917151+0000, chain.objs.size()=6 2024-09-12T18:33:03.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__multipart_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.1 2024-09-12T18:33:03.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__shadow_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.1_1 2024-09-12T18:33:03.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.961+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__multipart_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.2 2024-09-12T18:33:03.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.961+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__shadow_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.2_1 2024-09-12T18:33:03.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.961+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__multipart_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.3 2024-09-12T18:33:03.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.961+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743__shadow_mymultipart3.2~AFr8CQ8lZ9ZCMR6__HbMCcLacYwF-JT.3_1 2024-09-12T18:33:03.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.967+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:03.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.969+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:33:03.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.973+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:03.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.973+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55900' 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8077262774666085879', time=2024-09-12T20:10:48.540648+0000, chain.objs.size()=1 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.151__shadow_.oHXfuGoXhYGaP3NQQVdCnZQJ66Y2sQs_0 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_6cvjN_0M-EIDPIeUhHOr6mG8_c79V8H', time=2024-09-12T20:11:07.291424+0000, chain.objs.size()=1 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.eV4W8e4AL5eHvyzm86RRSdtPkSZXq42_0 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_N5mnSegTabl__Ns64_GNfBZyXY79LhS', time=2024-09-12T20:11:17.133527+0000, chain.objs.size()=1 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.165__shadow_.Ka7TGKQ9133TMb5PvZwOHesDeomH-dP_0 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17405679392455825863', time=2024-09-12T20:13:11.183766+0000, chain.objs.size()=1 2024-09-12T18:33:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.235__shadow_.NGGrRJ6QqgSN4J5L_aBPURzGRV_-KST_0 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6503954623206516677', time=2024-09-12T20:13:13.593926+0000, chain.objs.size()=1 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.238__shadow_.rLH-m2VU8D4kdNvAhPGAprDX6plq097_0 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3308662954756663436', time=2024-09-12T20:13:25.537959+0000, chain.objs.size()=1 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.257__shadow_.PhrQJoRj1q50fs8scvkjVL89YbYHg0m_0 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13011071932607864457', time=2024-09-12T20:14:04.027021+0000, chain.objs.size()=1 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UQSwNniCplRYUwFBfzWlhN8iS5XhIDc_0 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2305184928101126405', time=2024-09-12T20:14:04.028043+0000, chain.objs.size()=1 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gYAOMBGn-CQBy_5fC570y3rOeqK3MV6_0 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6244801161999049137', time=2024-09-12T20:14:04.132858+0000, chain.objs.size()=1 2024-09-12T18:33:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NVDgw7JpQotTGQeowjrgdlvet6srx2n_0 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14130139600653309221', time=2024-09-12T20:14:04.166879+0000, chain.objs.size()=1 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xBIkTnco79d__g_NA-iFiNPlGijGn16_0 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10296091703723232452', time=2024-09-12T20:14:04.755946+0000, chain.objs.size()=1 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hOYcHvOapRTNcpDL9z2LIVKtJGvOowk_0 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8738375195833551089', time=2024-09-12T20:14:05.691084+0000, chain.objs.size()=1 2024-09-12T18:33:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.78s1oFFCo1kXbTb_PugoNrQ_l7pPDK4_0 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2346511074631105013', time=2024-09-12T20:14:05.691708+0000, chain.objs.size()=1 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.r48Yw48xu9tUSuLvWi4UkLS2kSnayDE_0 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12460753676943416015', time=2024-09-12T20:14:05.977304+0000, chain.objs.size()=1 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6hIu-OkoU1WplqOWmyJmRpRA28InPie_0 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13086258683010081406', time=2024-09-12T20:14:06.211538+0000, chain.objs.size()=1 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RItn5G4ZA-TeG57dj0rFkEx1LfKDph5_0 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9342392890043809470', time=2024-09-12T20:14:06.451091+0000, chain.objs.size()=1 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.q0FKcV04TepOUTe2ISY3w_TTwViJ-hU_0 2024-09-12T18:33:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6415328812821101781', time=2024-09-12T20:14:07.773829+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uuR5UfMmP6TCYn0vS4cby2Caw57jFG5_0 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2896009238527510491', time=2024-09-12T20:14:08.659758+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.X7RhzPPS0OfzSiQF9495oLF1ykLMm1-_0 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2198053090543353432', time=2024-09-12T20:14:09.370620+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.djzW7HMVM00vNGkwuqfoN7J8SAZnaU3_0 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11225281970911238718', time=2024-09-12T20:14:09.457585+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mhhN0KwrI1Qft0VZYevmGDgZdxwDRsz_0 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.119569002679561076', time=2024-09-12T20:14:09.527319+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.12xSImDgO0fAtDcvA9ua0hl8cr1dgcA_0 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10277917340815870213', time=2024-09-12T20:14:09.597417+0000, chain.objs.size()=1 2024-09-12T18:33:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-c0IuxqC3OBjOMMhC648acnWpTHn6H7_0 2024-09-12T18:33:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7081034387415245854', time=2024-09-12T20:14:10.255443+0000, chain.objs.size()=1 2024-09-12T18:33:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.978+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.65K9sVJUSe2kTRHnRY0mO7PQGgn0CYv_0 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4466618357730069908', time=2024-09-12T20:14:10.256171+0000, chain.objs.size()=1 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cTYXSwfLuKy0Px1V3zpcC2SDxR1r4g6_0 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14495759335340586485', time=2024-09-12T20:14:10.776863+0000, chain.objs.size()=1 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zcNWkeT0hL2ulTGR5CS3S7J4-fhikAF_0 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6350633748897670362', time=2024-09-12T20:14:11.007785+0000, chain.objs.size()=1 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.AgrXgI1zw-muQJm_lXeycdjGGutCr_U_0 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1468641522014482468', time=2024-09-12T20:14:11.103304+0000, chain.objs.size()=1 2024-09-12T18:33:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PV3DrbCEA1jo-xA-x6wLBXsUfYgFrLA_0 2024-09-12T18:33:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10877079448454057706', time=2024-09-12T20:14:11.599134+0000, chain.objs.size()=1 2024-09-12T18:33:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.982+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SU84eZvxahw0fg3LZEON0joLmVrgyHY_0 2024-09-12T18:33:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12904485820012741909', time=2024-09-12T20:14:11.949488+0000, chain.objs.size()=1 2024-09-12T18:33:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G8FJGstOKofcSy1ex_WyScPKak1qj_e_0 2024-09-12T18:33:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4436669011465635728', time=2024-09-12T20:14:12.129177+0000, chain.objs.size()=1 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gsgIq8buptmqwgFozylV7nz1n0s3WUn_0 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6417288275987054290', time=2024-09-12T20:14:12.893897+0000, chain.objs.size()=1 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4MwdB39nWKdcGmpsiQtUAtb5doleXha_0 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5896959552763033823', time=2024-09-12T20:14:13.028943+0000, chain.objs.size()=1 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3ei2bXGjdwSkvYF0tb6AS-Ku7xJRTQn_0 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15212072772468209582', time=2024-09-12T20:14:13.302555+0000, chain.objs.size()=1 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.crhyuf4SHaFF6mRrYskKGCJljhVVPaT_0 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3412920867620517498', time=2024-09-12T20:14:14.348457+0000, chain.objs.size()=1 2024-09-12T18:33:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Sf37UEdvMcvQVrbrykQIwDYBbE_Tbmj_0 2024-09-12T18:33:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.986+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2084455655258821906', time=2024-09-12T20:14:14.349240+0000, chain.objs.size()=1 2024-09-12T18:33:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.986+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8tT6Zj_SCEDMCAvIM2Yk0Hx6fBtzwMU_0 2024-09-12T18:33:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.987+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10072247543751179724', time=2024-09-12T20:14:14.546206+0000, chain.objs.size()=1 2024-09-12T18:33:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.987+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.J8RelkQWZ7y-S5kKoJPvRLnStqmUz7u_0 2024-09-12T18:33:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.987+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14567670627856667136', time=2024-09-12T20:14:14.641440+0000, chain.objs.size()=1 2024-09-12T18:33:03.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.987+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.15Bm1siDjg2CYUXPSTeSdr0XVUu4K18_0 2024-09-12T18:33:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.989+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15649180271779710484', time=2024-09-12T20:14:22.125217+0000, chain.objs.size()=1 2024-09-12T18:33:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.989+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.274__shadow_.IgCqwcz3APvseIUItdFezakfvqeS4Oh_0 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15903310040079646297', time=2024-09-12T20:14:34.496205+0000, chain.objs.size()=1 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.v0NARlVSQ5FEZXQ3Y0ZD6GGDHIu5s-1_0 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10046330007179979313', time=2024-09-12T20:14:34.614383+0000, chain.objs.size()=1 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.BmGKTy6Diwy3LOcxQYn69VsfPDkHOyh_0 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.802467833124059390', time=2024-09-12T20:14:36.404517+0000, chain.objs.size()=1 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.4Cdo-5MU-PEnjkCk-naQB2Uq15rjvAJ_0 2024-09-12T18:33:03.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18036903447781737087', time=2024-09-12T20:14:37.750381+0000, chain.objs.size()=1 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295__shadow_.HglYVZXWLLn9oQAv-7BtR_T5FejlC_w_0 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.592752372840729635', time=2024-09-12T20:15:32.188977+0000, chain.objs.size()=1 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KDbvFQVKxrb3vcJ6K_7p5h6ek4kYGIF_0 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10351817961786703244', time=2024-09-12T20:15:32.866460+0000, chain.objs.size()=1 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J6EiqqUjzTd6UbamfeVSOJ1JSsTNF-b_0 2024-09-12T18:33:03.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15362323567244259513', time=2024-09-12T20:15:32.867255+0000, chain.objs.size()=1 2024-09-12T18:33:03.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.AyUj674O6wR6Asvhh0OecWHxRM3FbTI_0 2024-09-12T18:33:03.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.992+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8315440840880148448', time=2024-09-12T20:15:33.134025+0000, chain.objs.size()=1 2024-09-12T18:33:03.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.992+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fA7uzE6ZQIon05W1e0qvntSox1VWB0H_0 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16236236680991047230', time=2024-09-12T20:15:33.708915+0000, chain.objs.size()=1 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Oaidzd7D1lQ3n_Nawn6HwCIamN8kIrY_0 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15275990533570124062', time=2024-09-12T20:15:33.744105+0000, chain.objs.size()=1 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aO0fnzoeaK6fJ2GgR_4aSXqND_2XHpu_0 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11519423209586264298', time=2024-09-12T20:15:34.259807+0000, chain.objs.size()=1 2024-09-12T18:33:03.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6MtBGIg1xr5g3OmaVxbZYt-WQszrSaf_0 2024-09-12T18:33:03.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4765201969529968316', time=2024-09-12T20:15:34.297902+0000, chain.objs.size()=1 2024-09-12T18:33:03.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.993+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.kUHJKMx0RY59CVXNsH_X6Jn3eumBMD3_0 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8639315299226501029', time=2024-09-12T20:15:34.474005+0000, chain.objs.size()=1 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.udumlFXtmIhQa6P5_cAIacc4pE2qvI__0 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5581172441535637171', time=2024-09-12T20:15:34.629784+0000, chain.objs.size()=1 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.G6ytOB7XzJPHejlrqoix8aQeNajpzJl_0 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3723121464726625665', time=2024-09-12T20:15:34.692961+0000, chain.objs.size()=1 2024-09-12T18:33:03.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rcq-sx-jGGFJcCYz8DzWmEhbYcR69I5_0 2024-09-12T18:33:04.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7835817230677570360', time=2024-09-12T20:15:34.736397+0000, chain.objs.size()=1 2024-09-12T18:33:04.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1bFIOX3QqItXfEb3RQAbUcPEXMAUXAb_0 2024-09-12T18:33:04.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17301133248523654694', time=2024-09-12T20:15:36.114573+0000, chain.objs.size()=1 2024-09-12T18:33:04.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KUVntzpF5hkA4CwB2TGOGADGB3kfwkU_0 2024-09-12T18:33:04.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15869438937077710045', time=2024-09-12T20:15:36.230880+0000, chain.objs.size()=1 2024-09-12T18:33:04.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wOOL9yqRDJChrqE0adeOIw57VEO_VOK_0 2024-09-12T18:33:04.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12156645899402914684', time=2024-09-12T20:15:36.231664+0000, chain.objs.size()=1 2024-09-12T18:33:04.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Y3T5PTjK4o7cA5f6rh040m40nlB4rB-_0 2024-09-12T18:33:04.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18154412129936553703', time=2024-09-12T20:15:36.890992+0000, chain.objs.size()=1 2024-09-12T18:33:04.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:03.998+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._cpWvR160mrkOecTcFTAeX5iz5Ab3R0_0 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12546179718096160598', time=2024-09-12T20:15:36.947003+0000, chain.objs.size()=1 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BBAV5HmPeN_CeWwZniyNOdt7X5W_mF0_0 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8895520399079347772', time=2024-09-12T20:15:36.971879+0000, chain.objs.size()=1 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2KPKfrPFwuDSCba7p6MA4Shsv9kM_qe_0 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6006746441768522335', time=2024-09-12T20:15:37.138244+0000, chain.objs.size()=1 2024-09-12T18:33:04.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.um_JI9XGc-6scHauE8HAPqPMsYsHnb-_0 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2268208234498886155', time=2024-09-12T20:15:37.200005+0000, chain.objs.size()=1 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ulvG8CPcMcgteMzWOqPZ4qQSjhG15gO_0 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10253129404515501391', time=2024-09-12T20:15:38.743897+0000, chain.objs.size()=1 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.heOT-ojTlUZKMYIVlAUG5KWAGYPo3WC_0 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15054412869198806965', time=2024-09-12T20:15:39.414939+0000, chain.objs.size()=1 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oedShDfB_bXflXPc-_lvWfMk29k7w5L_0 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17508819434696305816', time=2024-09-12T20:15:39.603924+0000, chain.objs.size()=1 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Jpps2g2XgdQ0E_jp0hDRCUYSVgYUtDz_0 2024-09-12T18:33:04.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2246185885789583300', time=2024-09-12T20:15:39.815558+0000, chain.objs.size()=1 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5RUB0Hpu6-dJUFKyg3kZ_cpJsv0m_T1_0 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17428562998369372045', time=2024-09-12T20:15:40.474411+0000, chain.objs.size()=1 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qy_XC6OEndAMa3eMYKW4Pu2TvRqfXEN_0 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3286736006607484653', time=2024-09-12T20:15:40.914825+0000, chain.objs.size()=1 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1juG2_4OpACRq_XS6yZwe-BJmbBKLiN_0 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18298157851632501229', time=2024-09-12T20:15:41.075984+0000, chain.objs.size()=1 2024-09-12T18:33:04.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cChQfvyjhL4n0V8RgvUZ_RnEDdZ4CbR_0 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7228130422420619899', time=2024-09-12T20:15:41.785350+0000, chain.objs.size()=1 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tAI3eTSgVMaXDgXhz78m5czCDPDqIEv_0 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14393411426559751889', time=2024-09-12T20:15:42.071321+0000, chain.objs.size()=1 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qouNelFxm2qKGD1FtvUrGiq7LTbQLlu_0 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2830795080794546300', time=2024-09-12T20:15:42.220039+0000, chain.objs.size()=1 2024-09-12T18:33:04.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.006+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fa3d8T6qlncvktjRnskxFXmuqpyTKU2_0 2024-09-12T18:33:04.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.011+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.417096164516541627', time=2024-09-12T20:15:42.642763+0000, chain.objs.size()=1 2024-09-12T18:33:04.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.011+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FQub3ICGVFAIsNdTtMPAqybCT8r885j_0 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16460694405465060653', time=2024-09-12T20:15:42.756567+0000, chain.objs.size()=1 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UuhNKYh58XbnxkVITCNZDo-F68gjLPZ_0 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15924205621071198264', time=2024-09-12T20:16:20.117009+0000, chain.objs.size()=1 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.t84ZrmPGdB2xqVvhB8fWEhq2MVFFfsY_0 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11645268855722725363', time=2024-09-12T20:16:20.255237+0000, chain.objs.size()=1 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.U8qX6vZBl4s_wsgb5ZN_HMJiSkdAf56_0 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9947310822886517227', time=2024-09-12T20:16:20.705212+0000, chain.objs.size()=1 2024-09-12T18:33:04.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1_BUJY9xUn8ztqcIIMsZ2AUDu67xlOp_0 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6403342826807003519', time=2024-09-12T20:16:21.771584+0000, chain.objs.size()=1 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9msgVh-SgaxltBabdfvKA5xBk6zX-t-_0 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8244615157088119681', time=2024-09-12T20:16:21.852997+0000, chain.objs.size()=1 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wpwIKEz0bKhuH1ZJtq5GjOmN7u7HSeZ_0 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9207966819946830992', time=2024-09-12T20:16:21.863749+0000, chain.objs.size()=1 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UXfp5-vAERjJGeCWsJfArq2Lo2PhzMP_0 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14246606124460722696', time=2024-09-12T20:16:23.106303+0000, chain.objs.size()=1 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cLoNInZ2WCS7SaoT8w81q289lB6m1Ks_0 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9257967876162291719', time=2024-09-12T20:16:24.866367+0000, chain.objs.size()=1 2024-09-12T18:33:04.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Hh0BAR_cG-RAapsNkKg7I83k2Hj7dPV_0 2024-09-12T18:33:04.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13798010427592645284', time=2024-09-12T20:16:25.128487+0000, chain.objs.size()=1 2024-09-12T18:33:04.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HgO-iAf0knmYPQJKjfeFms2LrZjTMOF_0 2024-09-12T18:33:04.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9284107560917869521', time=2024-09-12T20:16:25.219196+0000, chain.objs.size()=1 2024-09-12T18:33:04.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KLQ5Gg46PBp_rhy3snmRDqVS5KjZALX_0 2024-09-12T18:33:04.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.018+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4572030835557538490', time=2024-09-12T20:16:25.220074+0000, chain.objs.size()=1 2024-09-12T18:33:04.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.018+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cD1uwmId5kqNAJrxNyNLMXh6cY_quaL_0 2024-09-12T18:33:04.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.018+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8152888998151023366', time=2024-09-12T20:16:25.389208+0000, chain.objs.size()=1 2024-09-12T18:33:04.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.018+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ur-8jVaRB6-NYHUiQ-sMNp-_Yz2mBlD_0 2024-09-12T18:33:04.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17335640142657256997', time=2024-09-12T20:16:25.544569+0000, chain.objs.size()=1 2024-09-12T18:33:04.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vrjg91e5U0U6s4Q_hnKLcEuYyhmhQa3_0 2024-09-12T18:33:04.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.303989280613005244', time=2024-09-12T20:16:26.025628+0000, chain.objs.size()=1 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1JcKvjF5TBuwSav7zgHoTm0_2ZHG6kc_0 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10386655427107554002', time=2024-09-12T20:16:26.038574+0000, chain.objs.size()=1 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tBXHOFEfiJBps4Ru0LJ0tUbWe-Fl8hC_0 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12508139945197120887', time=2024-09-12T20:16:26.591304+0000, chain.objs.size()=1 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kkbWPi2vGe8Visp0HPW_YSXw5M7Lrpz_0 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.852284172088021709', time=2024-09-12T20:16:26.592096+0000, chain.objs.size()=1 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-vg873ltk1jPWxSyGWzEAyMyPNvrZCo_0 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11520593000328107394', time=2024-09-12T20:16:26.950943+0000, chain.objs.size()=1 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CapvxVu-LgfhtM7c9wFQZ3KxENIsEMf_0 2024-09-12T18:33:04.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6053046555833026649', time=2024-09-12T20:16:27.891675+0000, chain.objs.size()=1 2024-09-12T18:33:04.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NfVNTaN-g5EfneeFnRsg-k1SouWRQz3_0 2024-09-12T18:33:04.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1946989748877943450', time=2024-09-12T20:16:27.956388+0000, chain.objs.size()=1 2024-09-12T18:33:04.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.019+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kuSeeC0xhvSW326Y_GvEcioW4I672EY_0 2024-09-12T18:33:04.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5811966632386669804', time=2024-09-12T20:16:28.156079+0000, chain.objs.size()=1 2024-09-12T18:33:04.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YrBQCpaipLI0e9pb3rv1YvIztwxp5hd_0 2024-09-12T18:33:04.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.025+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7420757774918292458', time=2024-09-12T20:16:28.298776+0000, chain.objs.size()=1 2024-09-12T18:33:04.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.025+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ELLonKj5roB3oqKc2fM8VrnH7e6Zlat_0 2024-09-12T18:33:04.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.025+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15860747564653788841', time=2024-09-12T20:16:28.837762+0000, chain.objs.size()=1 2024-09-12T18:33:04.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.025+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2vycSaWiGOaQrAsH8FBWx8C8krCrn9D_0 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11098282721891366077', time=2024-09-12T20:16:28.942799+0000, chain.objs.size()=1 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RAEvKXdDpZ__rSLhJynNfVYuCTRT2TG_0 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17855515442635614238', time=2024-09-12T20:16:28.943733+0000, chain.objs.size()=1 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CKrx0GIYP0dJpuZBdfy6iI4VhvxYy7y_0 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3319890606820746108', time=2024-09-12T20:16:29.121171+0000, chain.objs.size()=1 2024-09-12T18:33:04.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.026+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cHaC4Fz4KqZA_n_D4ff8owROOa2WSjP_0 2024-09-12T18:33:04.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.029+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/55900 2024-09-12T18:33:04.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17302786950575092257', time=2024-09-12T20:16:29.759742+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PK-p6eAyQeAfVjkAxcJhPt9r94eJbAP_0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1343441012931658910', time=2024-09-12T20:16:29.921607+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QRR1uH-K9z41-JJldamih9kAFx33Dcn_0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14016352987758855213', time=2024-09-12T20:16:30.684938+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.H9az0pcJGF18xX5bgqjYItxDgEcTPc__0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12384482711544924373', time=2024-09-12T20:16:31.038060+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rf3Z_kBiN25g4PJDH0SgDTkTYZmXwIe_0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12909924641937858966', time=2024-09-12T20:16:34.102386+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.330__shadow_.zlUx7I_rpBLOWvWYL5QjI2S7uq2fUji_0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3829026143215454100', time=2024-09-12T20:17:01.403038+0000, chain.objs.size()=1 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.383__shadow_.8rlPsNKkNQYkQ4lepFZTXPqXz6x0ig7_0 2024-09-12T18:33:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.880847974682601242', time=2024-09-12T20:17:41.428814+0000, chain.objs.size()=1 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.456__shadow_.86KAF4O1dlfxzIYHOa8LwMLnhLQzu3J_0 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12034811137715273356', time=2024-09-12T20:17:44.678853+0000, chain.objs.size()=1 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.460__shadow_.fjWgPZKfGYU7AYnXdwV3CFenFIRIoES_0 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2615590884233070409', time=2024-09-12T20:17:48.890555+0000, chain.objs.size()=1 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.465__shadow_.c_PcCgEf8R-xx3Ew2klrZ2a0uBdFrz3_0 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10455158370114465809', time=2024-09-12T20:18:20.963637+0000, chain.objs.size()=6 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.032+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14280022157084148271', time=2024-09-12T20:21:18.122245+0000, chain.objs.size()=1 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.559__shadow_.x47iSRNq1exjZkCDaGoVZjyiJxRcWeV_0 2024-09-12T18:33:04.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10906796939832083741', time=2024-09-12T20:21:33.087279+0000, chain.objs.size()=1 2024-09-12T18:33:04.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:p.o1zbLaUD2swtTibiDvx7yH1sFvj2K_.Tdo0LGHQQtftmzTCoboVTtpXB0svStX_0 2024-09-12T18:33:04.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5101437985949660229', time=2024-09-12T20:21:48.603068+0000, chain.objs.size()=1 2024-09-12T18:33:04.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:EV.unPaWlLzlWgy1hiXY1LSjPe8YSpy_.rG0x7uVxqLr2dfgDCqPaVR4IIjv74Uj_0 2024-09-12T18:33:04.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7784271861788780597', time=2024-09-12T20:21:50.729215+0000, chain.objs.size()=1 2024-09-12T18:33:04.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.036+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:PsA0Vyld.CWDIK4vFd.n3wrGwzgJUA8_.iiG8KsKbVbnH-rICHjhj4RVfpn16PfG_0 2024-09-12T18:33:04.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11414749274344636458', time=2024-09-12T20:21:59.965684+0000, chain.objs.size()=1 2024-09-12T18:33:04.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:uEoDV5FnG-EGLGz7.8icM3WcYMygeoS_.gDXwpjBKrjyx_l2IsGbKY0VWsfN5lrr_0 2024-09-12T18:33:04.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2412809528965361111', time=2024-09-12T20:22:39.620776+0000, chain.objs.size()=1 2024-09-12T18:33:04.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:6JWwDvXdPZV5r.zOylSDLm5zjkom3ms_.IN9eAgOIlqviNFPZ1zrHREsx6FnXAGM_0 2024-09-12T18:33:04.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11599242586620986703', time=2024-09-12T20:22:44.021285+0000, chain.objs.size()=1 2024-09-12T18:33:04.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.596__shadow_.g7NPQY5QsmHFBf2KJXNLZasC2xo-QMJ_0 2024-09-12T18:33:04.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17168551284310811731', time=2024-09-12T20:26:50.396815+0000, chain.objs.size()=1 2024-09-12T18:33:04.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.038+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.650__shadow_.RLoOeGM_SadUgAJGa0i-_HIkLM_KORu_0 2024-09-12T18:33:04.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.043+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.046+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:33:04.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.047+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.047+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48414' 2024-09-12T18:33:04.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_tmmAasN5jEMJ-ME504XLb_tasuuQ_P8', time=2024-09-12T20:11:14.243470+0000, chain.objs.size()=3 2024-09-12T18:33:04.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.6zJ2wHOr_sf5YeaePrNyQctBMPJYC88_0 2024-09-12T18:33:04.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.6zJ2wHOr_sf5YeaePrNyQctBMPJYC88_1 2024-09-12T18:33:04.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.6zJ2wHOr_sf5YeaePrNyQctBMPJYC88_2 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6980759039911721012', time=2024-09-12T20:11:16.925284+0000, chain.objs.size()=2 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.164__multipart_foo.2~1Y3iUO5DbuW3N7TqlbF3DpDFlstZrHJ.1 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.164__multipart_foo.2~1Y3iUO5DbuW3N7TqlbF3DpDFlstZrHJ.2 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5658961298909401397', time=2024-09-12T20:11:20.070346+0000, chain.objs.size()=1 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.171__shadow_.StbYxeDBQ9UtYaq5rBkyh3HXhWE97Z1_0 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17959617322411537420', time=2024-09-12T20:13:11.189341+0000, chain.objs.size()=1 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.235__shadow_.kVSscYBOgQSZXcYYhzN6EagBjoPNrQF_0 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9795241400171739786', time=2024-09-12T20:13:22.543291+0000, chain.objs.size()=1 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.252__shadow_.yqAhhK0z8MW1tvE1PaCpu-Ki73nq6U0_0 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11849924190753355052', time=2024-09-12T20:14:03.996624+0000, chain.objs.size()=1 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SfxhGBZY8Ce4Z_Cck0wgQ-B2eb4DmHy_0 2024-09-12T18:33:04.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7426535695754956833', time=2024-09-12T20:14:04.791223+0000, chain.objs.size()=1 2024-09-12T18:33:04.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.I880Ub0VYcKfuUotMAUZ2mzQv1BXICu_0 2024-09-12T18:33:04.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2591381875399872651', time=2024-09-12T20:14:05.180634+0000, chain.objs.size()=1 2024-09-12T18:33:04.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.n3tmhCoiq4SL07WneX7HZKBTwu8RPfJ_0 2024-09-12T18:33:04.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7663505992681681807', time=2024-09-12T20:14:05.676881+0000, chain.objs.size()=1 2024-09-12T18:33:04.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.048+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WUkATRGhjZRUgYfA6q6PxvfZShRIgJO_0 2024-09-12T18:33:04.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15125378073947766689', time=2024-09-12T20:14:05.820026+0000, chain.objs.size()=1 2024-09-12T18:33:04.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.br4nTc0yq3-DtWDrUykoQC0Cl_ychtf_0 2024-09-12T18:33:04.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8464572113604959107', time=2024-09-12T20:14:05.912430+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8Di3A-6enRuaOUQOwkXwSf8AA3v1gdY_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12305972629028972397', time=2024-09-12T20:14:06.170598+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1MJGs3rerrAmxNDVDB-RpNz4TELboK5_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7071000601720568055', time=2024-09-12T20:14:06.603317+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9zwfEpcJA9qA3QDq2w67KJGMHOaIXEa_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16711109098913609279', time=2024-09-12T20:14:06.678428+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KG4aG4epXioc457G7o8G6jTKl7Z3_3D_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3024809499539894683', time=2024-09-12T20:14:08.047326+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uguQzoAwnMxUcbnNP_Gpl6eGCozzHkM_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11327708029381075243', time=2024-09-12T20:14:08.070937+0000, chain.objs.size()=1 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JO8SqCtK-Wv-tTph6jBn11WTYsvGZCo_0 2024-09-12T18:33:04.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13542065916182301438', time=2024-09-12T20:14:08.123686+0000, chain.objs.size()=1 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5XS2eeZEP4IFQ-0XnJF5uHDGnonbtmo_0 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17303260899630102063', time=2024-09-12T20:14:08.188794+0000, chain.objs.size()=1 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OyDqQw-tAPkHBEJSGbjkdhTNFOpAfEZ_0 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14558780394743297679', time=2024-09-12T20:14:08.206409+0000, chain.objs.size()=1 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ok3mAEQDUasxd_YjS8MrYNo6uwjr5gk_0 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10372101442871603462', time=2024-09-12T20:14:08.712866+0000, chain.objs.size()=1 2024-09-12T18:33:04.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.053+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HShBZOImgQjI1uc3uYVi6Gf912Jfwy5_0 2024-09-12T18:33:04.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.056+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7460442552491951888', time=2024-09-12T20:14:08.882334+0000, chain.objs.size()=1 2024-09-12T18:33:04.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.056+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VN9g2AjlGxIDuId3dYXmo5lQ_atPwoD_0 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9496678636306255909', time=2024-09-12T20:14:09.171123+0000, chain.objs.size()=1 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FGf8SIynZ8vakP3Uh5GCK5Ih648T6vO_0 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6919172102786628584', time=2024-09-12T20:14:09.468551+0000, chain.objs.size()=1 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CEYd8zxaeqVJ19bki-p0d6EEXpCRacU_0 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5863817231957362622', time=2024-09-12T20:14:10.188822+0000, chain.objs.size()=1 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bmKtZ114EQGTAF2yzhFs8ks4j16frkm_0 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16266749477686887703', time=2024-09-12T20:14:10.296133+0000, chain.objs.size()=1 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.y5zObAvgQ4OLuopjZpSnnxsB3QBX5pg_0 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11963512655928494397', time=2024-09-12T20:14:10.625555+0000, chain.objs.size()=1 2024-09-12T18:33:04.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0ZGCpL-ocCMs2zVhqSylRZ2RZvbaYIh_0 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1642070059398624632', time=2024-09-12T20:14:11.040987+0000, chain.objs.size()=1 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jIKCCz2ahJqop8R56VHLbuC3d_H-UhR_0 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1566455284238585282', time=2024-09-12T20:14:11.492164+0000, chain.objs.size()=1 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FPmrbeSW004jFwZSKRjGpa0vbSjFJVB_0 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4077217628229898216', time=2024-09-12T20:14:11.708242+0000, chain.objs.size()=1 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.058+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MUNogmmliTe2wNlxStyTYz7VGqKdsxZ_0 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.059+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295523769401761474', time=2024-09-12T20:14:12.427643+0000, chain.objs.size()=1 2024-09-12T18:33:04.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.059+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.T7KhpLd3vBTsYmW7U__JL7gkhmlOX2b_0 2024-09-12T18:33:04.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.059+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13439536184980595885', time=2024-09-12T20:14:12.458650+0000, chain.objs.size()=1 2024-09-12T18:33:04.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.059+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4TfPMXuXVE5dHEzDVrby8RxVMHSqAiR_0 2024-09-12T18:33:04.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.061+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12181024109796804312', time=2024-09-12T20:14:12.856077+0000, chain.objs.size()=1 2024-09-12T18:33:04.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.061+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6LHG23X4rL_PIA8xV3LtE2bfwNAKlCa_0 2024-09-12T18:33:04.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.063+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14995849307766659077', time=2024-09-12T20:14:13.803623+0000, chain.objs.size()=1 2024-09-12T18:33:04.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.063+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qQauqRuwNgxw9my75PVMQ1ybfYdoN19_0 2024-09-12T18:33:04.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.063+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.814032720069296176', time=2024-09-12T20:14:13.819064+0000, chain.objs.size()=1 2024-09-12T18:33:04.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.063+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.guxU5V0Am7rv43nEZywTmdTBrvFgGxt_0 2024-09-12T18:33:04.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9354541579282245630', time=2024-09-12T20:14:14.606604+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XMJGQW3ZnlchWXeaZuzX9zx04gNv5W__0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14689310387913174252', time=2024-09-12T20:14:14.898106+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Qh_zOsHmVp79hHOI21nrLHUML2jW9dR_0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16682124358312702245', time=2024-09-12T20:14:14.926638+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G_u5cF-WQpQ0uKnJgxmf_Xhyr3w8xYi_0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11614300883420852016', time=2024-09-12T20:14:15.186078+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MyHVEwsdEwehMBHinjGpVw_XtHmyecj_0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.657148399473547645', time=2024-09-12T20:14:15.238335+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XC5OZWySKWuD-mT62niU-bE0tNQNrOG_0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12984138304049742613', time=2024-09-12T20:14:22.131677+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.274__shadow_.aXEaJkJAMotMuNNleAI1fAN_n_6R4DA_0 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3225506787222867053', time=2024-09-12T20:14:25.183346+0000, chain.objs.size()=1 2024-09-12T18:33:04.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.279__shadow_.P16a92DWnzI1hSrEnbt-LD4BtKpqAYz_0 2024-09-12T18:33:04.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1786975412011755305', time=2024-09-12T20:14:26.447737+0000, chain.objs.size()=1 2024-09-12T18:33:04.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.281__shadow_.a_NbZ9AROFyZ8oti8Pb5WBoJveeAXlR_0 2024-09-12T18:33:04.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.067+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4718554729197206564', time=2024-09-12T20:14:29.620515+0000, chain.objs.size()=1 2024-09-12T18:33:04.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.067+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.286__shadow_.LgCdOK5KxCCyOt6alOapGJq8WmfJj1x_0 2024-09-12T18:33:04.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.069+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13317299907280740794', time=2024-09-12T20:14:34.498780+0000, chain.objs.size()=1 2024-09-12T18:33:04.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.069+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.UCF58VQ-kSuJ5PrIPhZer3yFQau5kkG_0 2024-09-12T18:33:04.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.069+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5400560098520685169', time=2024-09-12T20:14:36.406756+0000, chain.objs.size()=1 2024-09-12T18:33:04.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.069+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.CTlhTFzqFCKfr3SKnxDgNdc3eFgTsOp_0 2024-09-12T18:33:04.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5215413284676432982', time=2024-09-12T20:14:41.602320+0000, chain.objs.size()=1 2024-09-12T18:33:04.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.301__shadow_.HyWC2jgcjf-aNBqp3F9s5tY6Ur73Aqe_0 2024-09-12T18:33:04.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12848439781951798987', time=2024-09-12T20:14:44.875795+0000, chain.objs.size()=1 2024-09-12T18:33:04.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.306__shadow_.IknMPotA70a4OSuPG3SsptkP_n--rme_0 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10404028853950914037', time=2024-09-12T20:14:54.189275+0000, chain.objs.size()=1 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.321__shadow_.06Ao4mo8P0bCdBxo3GzyHZEZWBBJbUc_0 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13653393031167773734', time=2024-09-12T20:15:32.192235+0000, chain.objs.size()=1 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YMUer5nGEwhumVrVetBrtfwHQgT4os3_0 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5738541921138743362', time=2024-09-12T20:15:32.236411+0000, chain.objs.size()=1 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eRSYJ3Uspxa2zzl9Prg-oauy_d3CgSm_0 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16253413622280460030', time=2024-09-12T20:15:32.336724+0000, chain.objs.size()=1 2024-09-12T18:33:04.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HcC-5jahaks_27GDcen9Ptu10vNz9A1_0 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9329199609339973726', time=2024-09-12T20:15:32.589143+0000, chain.objs.size()=1 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.A_i1pEmpVwZRHP3049hFhyrBrUN20Ep_0 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6642720899094266088', time=2024-09-12T20:15:32.956327+0000, chain.objs.size()=1 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wlmZ51iVmytHwn7m4NucjHX45HCbWFs_0 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11921197344919791329', time=2024-09-12T20:15:34.135689+0000, chain.objs.size()=1 2024-09-12T18:33:04.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.072+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7NsvviucdCoCfXwwsINUnyLVMTLUeK__0 2024-09-12T18:33:04.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.075+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6273308225484159957', time=2024-09-12T20:15:34.246681+0000, chain.objs.size()=1 2024-09-12T18:33:04.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.075+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.19ZB-eNNNSgUiXWCOmhWMrDbWKNuXYb_0 2024-09-12T18:33:04.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.075+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3464896322867547736', time=2024-09-12T20:15:34.247335+0000, chain.objs.size()=1 2024-09-12T18:33:04.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.075+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wyx2L51xPiDkUEc_G12T9DGQT4Zga7C_0 2024-09-12T18:33:04.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10555855905469564992', time=2024-09-12T20:15:34.303775+0000, chain.objs.size()=1 2024-09-12T18:33:04.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xmOH_SmG95UtCa95dV89SPPF5QPktwN_0 2024-09-12T18:33:04.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14489431315082848924', time=2024-09-12T20:15:34.481002+0000, chain.objs.size()=1 2024-09-12T18:33:04.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6gpLxhSZQjP8QBAhaDdppaCfkKMXQLI_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4665639542784379473', time=2024-09-12T20:15:34.597343+0000, chain.objs.size()=1 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.OfcTN77p_RoMQ7ruXqaqCvikanC8NkT_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14117586633717076740', time=2024-09-12T20:15:36.026590+0000, chain.objs.size()=1 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ssYA3LfkduUfuif_dCfuzoKMsH-Eb_0_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6887429658068835352', time=2024-09-12T20:15:36.973575+0000, chain.objs.size()=1 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dbjW-0rQxHsAV8aPR7geDLtKu2hxOAz_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16245440270928050700', time=2024-09-12T20:15:37.157489+0000, chain.objs.size()=1 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xbeEcYtnnRrBFz71qrZq2nwD2Snu6fl_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9874650916007471264', time=2024-09-12T20:15:37.456940+0000, chain.objs.size()=1 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hRlys5pgnhsDEDwTP6aN1VNLP6Z3ORF_0 2024-09-12T18:33:04.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13001103725134519919', time=2024-09-12T20:15:37.547740+0000, chain.objs.size()=1 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8EvzyX6xjpzQmzcsl_Mp9i7UVTmEAvf_0 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8798489166692847693', time=2024-09-12T20:15:38.108097+0000, chain.objs.size()=1 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xrH8PRUpWmeEwA7aIYgKd6NY-2nqQcX_0 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16681212937645394097', time=2024-09-12T20:15:38.256715+0000, chain.objs.size()=1 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xJ5u_ZhI1USxFaDwUZDfb9yO8qQm3Cd_0 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11146470984926796482', time=2024-09-12T20:15:38.875717+0000, chain.objs.size()=1 2024-09-12T18:33:04.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Ansd2Xyq2qVqf6FCyyyxKYEttmY29ig_0 2024-09-12T18:33:04.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44499643242123725', time=2024-09-12T20:15:39.029597+0000, chain.objs.size()=1 2024-09-12T18:33:04.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fOCAO0g75BL2BE-26O-pbbcFNVfT-p4_0 2024-09-12T18:33:04.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.084+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2065666656246772925', time=2024-09-12T20:15:39.546301+0000, chain.objs.size()=1 2024-09-12T18:33:04.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.084+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BNuR5PgtJy5zqzdWfrte_1CCqACbTp8_0 2024-09-12T18:33:04.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.084+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6441820586718467098', time=2024-09-12T20:15:39.579013+0000, chain.objs.size()=1 2024-09-12T18:33:04.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.084+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.c8hrJehkaDRz3qne4-5AX0vQevsghAr_0 2024-09-12T18:33:04.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8377645837225649700', time=2024-09-12T20:15:39.945218+0000, chain.objs.size()=1 2024-09-12T18:33:04.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.t4mqDmbISZlBXtNcwFLvngrZVXNVO_D_0 2024-09-12T18:33:04.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12483227084500400149', time=2024-09-12T20:15:40.006261+0000, chain.objs.size()=1 2024-09-12T18:33:04.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oeTQbWGlcKxkCRH1qbOPeTpQitlX7Bm_0 2024-09-12T18:33:04.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2424569647324297386', time=2024-09-12T20:15:40.255473+0000, chain.objs.size()=1 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iclfK0MKp24e-zPlH3l1mzs7RErJHn5_0 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3711698074438753402', time=2024-09-12T20:15:40.790322+0000, chain.objs.size()=1 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mjotIWxqx6vlul6l4y7doXjh1kH2Ky9_0 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12378298726290069975', time=2024-09-12T20:15:40.897974+0000, chain.objs.size()=1 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pHxtnZtAIrE4Vbh-jeFUYEFnCPW1QP-_0 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12577683944883686640', time=2024-09-12T20:15:41.035140+0000, chain.objs.size()=1 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.O-MKnznst5Eska04eqjI74ib1WZpE42_0 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18047122848383069035', time=2024-09-12T20:15:41.149296+0000, chain.objs.size()=1 2024-09-12T18:33:04.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.roc0mqTVmqO28DGs3xAzy68GBTeLYzS_0 2024-09-12T18:33:04.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7946157279292277583', time=2024-09-12T20:15:41.215351+0000, chain.objs.size()=1 2024-09-12T18:33:04.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VK35eW00Wd3FlAECa_ZAFNeoPv2zzEV_0 2024-09-12T18:33:04.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3430224496404154127', time=2024-09-12T20:15:41.319985+0000, chain.objs.size()=1 2024-09-12T18:33:04.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ire1EFB_TNLlF3PnLvuTFWZ6XZ0Wirr_0 2024-09-12T18:33:04.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13253181054236390588', time=2024-09-12T20:15:42.137770+0000, chain.objs.size()=1 2024-09-12T18:33:04.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Oblihn2cVg4wTfGGHk-bUHq7eHAID5k_0 2024-09-12T18:33:04.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.089+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5662145159458715886', time=2024-09-12T20:15:42.229283+0000, chain.objs.size()=1 2024-09-12T18:33:04.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.089+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Sqg5qF12KpCtNJZrJ6s2paXE6lONhb1_0 2024-09-12T18:33:04.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.091+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.976707240909299336', time=2024-09-12T20:15:42.437381+0000, chain.objs.size()=1 2024-09-12T18:33:04.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.091+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WGiw1tnqM2hamf4-n20FnbtDPr6jFuR_0 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1141221426602484400', time=2024-09-12T20:15:42.438356+0000, chain.objs.size()=1 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mc3dhAQTTq4uWLpNS2zZbxoJzr-hd0F_0 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13096628720030689039', time=2024-09-12T20:15:42.544916+0000, chain.objs.size()=1 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Gv_KM1HQz-fOuJtL07HKQcv5IgT3wGe_0 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13272660895554218275', time=2024-09-12T20:15:42.897155+0000, chain.objs.size()=1 2024-09-12T18:33:04.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4Iw7yLklGHcrAN1p_2Dc6d3WMDSnueQ_0 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3626494662510470876', time=2024-09-12T20:16:20.953002+0000, chain.objs.size()=1 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YEriEyFx23ioq_Ja8QtBCfuLCSC--Vu_0 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2678805536506618647', time=2024-09-12T20:16:20.985539+0000, chain.objs.size()=1 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QOl5UVPrMmwwuDKSAzrNyaqb4b6mXLd_0 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14234718466049882751', time=2024-09-12T20:16:21.851609+0000, chain.objs.size()=1 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XNphN8Diniv9w7wtAtAwOggzwabuPAn_0 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15615132521832995005', time=2024-09-12T20:16:21.925002+0000, chain.objs.size()=1 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZoOISy1qMnPDNPzvSnfBriOPKHpYI_3_0 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1553831582932431887', time=2024-09-12T20:16:22.242729+0000, chain.objs.size()=1 2024-09-12T18:33:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KwnKyvevXpw9cTB8-zJac58ngQ83BX9_0 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9633783386798417478', time=2024-09-12T20:16:22.253905+0000, chain.objs.size()=1 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._cBQU5lIlZDbNfbPIjb9_fx_HiY04fb_0 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4300441779051113990', time=2024-09-12T20:16:22.350820+0000, chain.objs.size()=1 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.o7qpA-jWw5waT5oAHgioWNg7T4ivqTp_0 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13273099651371787511', time=2024-09-12T20:16:22.656489+0000, chain.objs.size()=1 2024-09-12T18:33:04.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oOIARODPRf_fRfHI3xmrTzwZRKN-R6v_0 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9474177414323404519', time=2024-09-12T20:16:23.968381+0000, chain.objs.size()=1 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2qACI9czOiOAqMNbW6sM7qGDy17_aMx_0 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8025728151869562928', time=2024-09-12T20:16:24.105493+0000, chain.objs.size()=1 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Fj7zQC1G3sFQZn0LEBKjtL1HGqaXoNH_0 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14749527582676745207', time=2024-09-12T20:16:24.829388+0000, chain.objs.size()=1 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Q8SgMu-CIJYdvU_ox9JEkOJsxS163Bs_0 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12908858852495471013', time=2024-09-12T20:16:25.338900+0000, chain.objs.size()=1 2024-09-12T18:33:04.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HKfMHhG6V2bb8rITNR6vDV6pqPDnl2W_0 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17685434431105310599', time=2024-09-12T20:16:25.437845+0000, chain.objs.size()=1 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0DfvOOJk3--_pN5h6tk0Xe4pjhOy4BB_0 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6518510750647919311', time=2024-09-12T20:16:25.928180+0000, chain.objs.size()=1 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4EQTvK0rPN1FAkZimWQ-SIBRyNDM2H6_0 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10632541832380606630', time=2024-09-12T20:16:26.355809+0000, chain.objs.size()=1 2024-09-12T18:33:04.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Fv6YaXdK8Igh-kdHBpKKKeyNxz2Gq--_0 2024-09-12T18:33:04.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/48414 2024-09-12T18:33:04.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:33:04.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1258657025021884520', time=2024-09-12T20:16:26.385666+0000, chain.objs.size()=1 2024-09-12T18:33:04.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZvawpLM89yVmNPCpGhSH_SHXWNZPaiF_0 2024-09-12T18:33:04.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8258967823894103736', time=2024-09-12T20:16:27.286022+0000, chain.objs.size()=1 2024-09-12T18:33:04.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FAvSAVqkN0Jfdec2okPmMLQA-iKbAFx_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16422576736282089273', time=2024-09-12T20:16:27.407686+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mGaZEUH63LOsfxUZEYotiSs1FJUj52U_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12939749390226010086', time=2024-09-12T20:16:27.561259+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0_w7cW9rXtr32JxhKeAvaF0CsE7BU7p_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2234247181292958739', time=2024-09-12T20:16:27.654433+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9BrqxgzVrM7zBZwxvTOPfm3HS2G2AhT_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4722919921155781765', time=2024-09-12T20:16:27.781112+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xjmbkPkCz0SWYTQUnpngl__Q4ekKDQ8_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5069914023632971117', time=2024-09-12T20:16:28.177404+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gzeLOyttLMHnfqG2DiDJaIwayDI11wE_0 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10671546827275820304', time=2024-09-12T20:16:28.655472+0000, chain.objs.size()=1 2024-09-12T18:33:04.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nYNJAoypSoTgwcd22347yx2mdxsrQr7_0 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7671490433726430429', time=2024-09-12T20:16:28.810125+0000, chain.objs.size()=1 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mCHGWLszBA2yfHrS-cfDh0WYs8yGAd1_0 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14736473797159851790', time=2024-09-12T20:16:28.816358+0000, chain.objs.size()=1 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QOdfDMJg19a6XcxWFvwFskodUOiWNdT_0 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8093579457338965997', time=2024-09-12T20:16:28.939299+0000, chain.objs.size()=1 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZMcCnz45f7hd8rHs5r6-LIegm9Meu6q_0 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4916444737715318425', time=2024-09-12T20:16:29.243278+0000, chain.objs.size()=1 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2b8saYk4S_vFGPgL9mwjP6xLR-Q5lHg_0 2024-09-12T18:33:04.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.110+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5306586365609327800', time=2024-09-12T20:16:29.259918+0000, chain.objs.size()=1 2024-09-12T18:33:04.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.110+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ONjoKcZw2q3cGRTn3QYziTKAAHKq1Bs_0 2024-09-12T18:33:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14800535369924602321', time=2024-09-12T20:16:31.007937+0000, chain.objs.size()=1 2024-09-12T18:33:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mBZddreXvBR9mXtC98mU_Bm3JubgGAx_0 2024-09-12T18:33:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.112+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11999589027145750797', time=2024-09-12T20:17:43.871260+0000, chain.objs.size()=1 2024-09-12T18:33:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.112+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.459__shadow_.He7KzsZfEb1P_fO3i-6ZxSPq_hdywkw_0 2024-09-12T18:33:04.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.112+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14545156763538648935', time=2024-09-12T20:17:55.163114+0000, chain.objs.size()=1 2024-09-12T18:33:04.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.112+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.481__shadow_.mRfLdzW3HFj-GfHb0Jbf85qaAK5hsjV_0 2024-09-12T18:33:04.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9149470284151321687', time=2024-09-12T20:18:01.148419+0000, chain.objs.size()=1 2024-09-12T18:33:04.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.486__shadow_.sYEdO6JxhG_Yh_6suJ6yqwa2PeZ-tUW_0 2024-09-12T18:33:04.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5593095600276465659', time=2024-09-12T20:18:06.428147+0000, chain.objs.size()=1 2024-09-12T18:33:04.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.496__shadow_.9IGfIcpiVPM6y_RJvvNfTt6eV29nL3V_0 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8351541921237617066', time=2024-09-12T20:21:02.419706+0000, chain.objs.size()=1 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.553__shadow_.4wBwncFmsk7E8SojryoBCUaH6lCPjZD_0 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11263167405100221772', time=2024-09-12T20:21:27.965943+0000, chain.objs.size()=1 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.566__shadow_.B2dWEdQJnxXbwdUnUzdbVNIvuqbsNve_0 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11745286488139353422', time=2024-09-12T20:21:29.930201+0000, chain.objs.size()=1 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:OI4x0MvLlC94kATF4U89Ny6Hu04Lzib_.qQiJ47XnJSrJnhtZRAp-c4pjqZQGBMX_0 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7996591615199135589', time=2024-09-12T20:21:49.681249+0000, chain.objs.size()=1 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.575__shadow:lLyws-HgJQycY.4EB2.QLkQGp20may7_.T0gqIIEeAQKNyMAekmzwlvOwBeMqPjI_0 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2497255884706397582', time=2024-09-12T20:22:12.110694+0000, chain.objs.size()=1 2024-09-12T18:33:04.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.114+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:tVL9rjWnovBiUr-Pme6G-qRbTcZmbHv_.eHRoOmu_s-mrSNeAMq02upKDhe_nQCM_0 2024-09-12T18:33:04.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.117+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11424100584395300439', time=2024-09-12T20:22:39.667763+0000, chain.objs.size()=1 2024-09-12T18:33:04.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.117+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:OXi3To34w0e7iG.ZJBhlGN8uoQh6S0a_.BwJu9IJIn7zCVlohE3QGwFXe8BL6Xl0_0 2024-09-12T18:33:04.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.117+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2593844903799582289', time=2024-09-12T20:26:51.506010+0000, chain.objs.size()=1 2024-09-12T18:33:04.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.117+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.652__shadow_.1xhbnV6dDNatsngrGIt-PM_FRlLHVfI_0 2024-09-12T18:33:04.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.122+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.126+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:33:04.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.127+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.128+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58480' 2024-09-12T18:33:04.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9695774642423831640', time=2024-09-12T20:11:01.426494+0000, chain.objs.size()=5 2024-09-12T18:33:04.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-FROZEN.2~K_Y7SjjsnwM6cqBh1yAyCtQ07ZTKpFs.1 2024-09-12T18:33:04.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__shadow_mymultipart-FROZEN.2~K_Y7SjjsnwM6cqBh1yAyCtQ07ZTKpFs.1_1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-FROZEN.2~K_Y7SjjsnwM6cqBh1yAyCtQ07ZTKpFs.2 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__shadow_mymultipart-FROZEN.2~K_Y7SjjsnwM6cqBh1yAyCtQ07ZTKpFs.2_1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-FROZEN.2~K_Y7SjjsnwM6cqBh1yAyCtQ07ZTKpFs.3 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6208144776679409261', time=2024-09-12T20:11:35.632555+0000, chain.objs.size()=1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.188__shadow_.XaIjXJc9BGQ_Tx79CC9FAVmD2Lxl6qt_0 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11086333337875005553', time=2024-09-12T20:11:45.778575+0000, chain.objs.size()=1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.200__shadow_.6IggvWpPpg9JsGn-wmXWEuER1c7cV9D_0 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2381354162108141725', time=2024-09-12T20:13:18.869148+0000, chain.objs.size()=1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.246__shadow_.z-V8ND5bYyssIJiogTdF3q9CCENyr_a_0 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13110373427310877923', time=2024-09-12T20:13:21.906468+0000, chain.objs.size()=1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.251__shadow_.Bg4peGU4B_CN-0Fm5y7iSWH4-p9sHBc_0 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5557705224456448738', time=2024-09-12T20:14:04.003940+0000, chain.objs.size()=1 2024-09-12T18:33:04.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WZVMOwOCLK37VtNccENvRGkfxVNkICc_0 2024-09-12T18:33:04.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3130492485114441763', time=2024-09-12T20:14:04.012013+0000, chain.objs.size()=1 2024-09-12T18:33:04.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wL4GNxV-eBgxb8HXjPmrb477Kuss380_0 2024-09-12T18:33:04.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6546483279795240289', time=2024-09-12T20:14:04.034397+0000, chain.objs.size()=1 2024-09-12T18:33:04.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.129+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aGyoLDSzkk2HLB2pYWvhHk5gc6JACYS_0 2024-09-12T18:33:04.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.132+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16951390229501432820', time=2024-09-12T20:14:04.160848+0000, chain.objs.size()=1 2024-09-12T18:33:04.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.132+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._LEiYjKGCXwziN4OVDh3PZi8lTQRoU8_0 2024-09-12T18:33:04.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.133+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2825577084193527586', time=2024-09-12T20:14:04.200590+0000, chain.objs.size()=1 2024-09-12T18:33:04.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.133+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.U5leKY-p4jaWe10QBnmeyhK_bHryG5G_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13375383328414072877', time=2024-09-12T20:14:04.777857+0000, chain.objs.size()=1 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zJ7RWFrg8fRe-t2sdJ8RckLKVS6KIIn_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2536847913882975589', time=2024-09-12T20:14:05.654826+0000, chain.objs.size()=1 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8qkQGL8R9AjQV3WFN_HYqWy5KrG360U_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3493400867334627187', time=2024-09-12T20:14:05.686568+0000, chain.objs.size()=1 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XYlVhuhjrQBdMIzGLcLdmffdIWUFvAQ_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12684227216992255485', time=2024-09-12T20:14:05.799459+0000, chain.objs.size()=1 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0I9OMSGCVupnYcEOqM66YOcigkK1DWG_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17460945095424629016', time=2024-09-12T20:14:06.242319+0000, chain.objs.size()=1 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.b_7zkuIrUByT-Km-Yio2d50pqOsxCP7_0 2024-09-12T18:33:04.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14916049586803582981', time=2024-09-12T20:14:06.478158+0000, chain.objs.size()=1 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FuT2s-TF47YHjkMIgzL3qKACuUqXcKQ_0 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7227379331989632278', time=2024-09-12T20:14:07.113445+0000, chain.objs.size()=1 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Wlgbroy4Y82BM8yTkgEJtuVlTg_EItU_0 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11955260112337174637', time=2024-09-12T20:14:07.367085+0000, chain.objs.size()=1 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DKXAxCY-uN_5nX9Gu7Jo2J3YChTXfHP_0 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3459801483270024925', time=2024-09-12T20:14:08.187371+0000, chain.objs.size()=1 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.134+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nnXy5QqrMyOT8Gh9hzcEj2Zlyx4xdcV_0 2024-09-12T18:33:04.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.136+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12808092685173394403', time=2024-09-12T20:14:08.197767+0000, chain.objs.size()=1 2024-09-12T18:33:04.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.136+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DR8dbJVer6kZ1jbPgQXm1grwhBeavFd_0 2024-09-12T18:33:04.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.137+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15280138583167877815', time=2024-09-12T20:14:09.263449+0000, chain.objs.size()=1 2024-09-12T18:33:04.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.137+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CmdwAFEmv_2kzAb9SMEwt636GHV_4CF_0 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3231588697486172649', time=2024-09-12T20:14:09.528652+0000, chain.objs.size()=1 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pKWM3rGzTIwuayM8RWGz4HWhjU3tlp8_0 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5865974207182495706', time=2024-09-12T20:14:10.105861+0000, chain.objs.size()=1 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.C5vYW2glsvMRH2m9FmKtXfl_I5mvdgJ_0 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6347798988169529618', time=2024-09-12T20:14:10.254055+0000, chain.objs.size()=1 2024-09-12T18:33:04.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.138+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZHagS-D-kyS9Vkk7cj8TLIqFpzGY5CL_0 2024-09-12T18:33:04.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.139+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8498730043209933010', time=2024-09-12T20:14:10.254773+0000, chain.objs.size()=1 2024-09-12T18:33:04.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.139+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QZ5pG025_XOSIsMWiHkjzxNHnumia_A_0 2024-09-12T18:33:04.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.139+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15250917729187164337', time=2024-09-12T20:14:10.255483+0000, chain.objs.size()=1 2024-09-12T18:33:04.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.139+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.r-86PlxwhHalzBx_l1mrB1TfEINe5DR_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18250741954315046316', time=2024-09-12T20:14:10.336868+0000, chain.objs.size()=1 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5L8C4ck0pTff__EkMmCSDqsyCNsHkgU_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11529278147148198545', time=2024-09-12T20:14:10.550850+0000, chain.objs.size()=1 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qc8aHifxjj0VodGlFd7kBftp1373eOV_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6953473320064328006', time=2024-09-12T20:14:11.026375+0000, chain.objs.size()=1 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JJ6EaLmre4naP7a6NN6Ui29wcI65dKd_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11285348610860551202', time=2024-09-12T20:14:11.724276+0000, chain.objs.size()=1 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zGZhunR73L_S6MSfLd_YyusD0ev-far_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15399012785698325306', time=2024-09-12T20:14:12.302829+0000, chain.objs.size()=1 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HLHrjFbDcO00JU7mGQrh69vOf9x9AQv_0 2024-09-12T18:33:04.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2767116199053038534', time=2024-09-12T20:14:12.885035+0000, chain.objs.size()=1 2024-09-12T18:33:04.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OkXbDHlTgnKToJ0b6qtql5SRl7Ge1ZA_0 2024-09-12T18:33:04.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.141+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11949251298694288255', time=2024-09-12T20:14:13.659517+0000, chain.objs.size()=1 2024-09-12T18:33:04.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.141+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.J7fEaGA3msu2_xBosact1VW3J5nQGcO_0 2024-09-12T18:33:04.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3163269576223053542', time=2024-09-12T20:14:13.934895+0000, chain.objs.size()=1 2024-09-12T18:33:04.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EUyEG4yviJKguatenCTjueu8jgFzKzF_0 2024-09-12T18:33:04.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15317742361934930848', time=2024-09-12T20:14:14.540983+0000, chain.objs.size()=1 2024-09-12T18:33:04.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kyJNZfa0IvolhYbOnVmRm5PnhdjJ--7_0 2024-09-12T18:33:04.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9761287989919924597', time=2024-09-12T20:14:14.618235+0000, chain.objs.size()=1 2024-09-12T18:33:04.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iZIAnUfHkeuolIAMaciPbivGZCabhuf_0 2024-09-12T18:33:04.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.144+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7448601082520838261', time=2024-09-12T20:14:14.637450+0000, chain.objs.size()=1 2024-09-12T18:33:04.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.144+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EDMjo8tqVSCrkFCc_okZ3mv8bQIrT5o_0 2024-09-12T18:33:04.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.144+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8240144454137287684', time=2024-09-12T20:14:16.384077+0000, chain.objs.size()=1 2024-09-12T18:33:04.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.144+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.264__shadow_.ZzlxDLO8a-0KVsKq7ZFxxlVF5_wXmI__0 2024-09-12T18:33:04.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.146+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6575712262065168372', time=2024-09-12T20:14:20.386874+0000, chain.objs.size()=1 2024-09-12T18:33:04.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.146+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.271__shadow_.ws3S42ovZx6it16lhSD-g6yjGJbCOPP_0 2024-09-12T18:33:04.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.146+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17487781251084672837', time=2024-09-12T20:14:36.409052+0000, chain.objs.size()=1 2024-09-12T18:33:04.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.146+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.HkoRoz53h0sreTj1Rf_5P50XBUlqrks_0 2024-09-12T18:33:04.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3267515229006821427', time=2024-09-12T20:14:37.742520+0000, chain.objs.size()=1 2024-09-12T18:33:04.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295__shadow_.OQ7DfrJd3hcMSvocSXmQ8_YNf0D-mp9_0 2024-09-12T18:33:04.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14780725582342158002', time=2024-09-12T20:15:32.153766+0000, chain.objs.size()=1 2024-09-12T18:33:04.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yVuhw4hF3vUH83tsY_xBkCqnhpVpUlY_0 2024-09-12T18:33:04.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11736231569658727948', time=2024-09-12T20:15:32.287442+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rUJ-3aT2UGa8P7YsEg2AAZcuYpgRPWh_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8248689032020226814', time=2024-09-12T20:15:32.471168+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ozH_BDyV4V3_c045WzRXFCFHT65GeTp_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7077519682946125379', time=2024-09-12T20:15:32.673349+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QRzCstomPYquxzv8kovmGw6P99J5iO9_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16748414566245218823', time=2024-09-12T20:15:32.756598+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DYVBCsoZqO6INkwWr34q8cJePNxV6pJ_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.493768066102124722', time=2024-09-12T20:15:33.062304+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KuyL0X4ajwQELO6AhzSigueFiDUEe2p_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3794498452687464945', time=2024-09-12T20:15:33.222612+0000, chain.objs.size()=1 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bXQy39BPqAG70SGRjw5aIw8E6YByBb9_0 2024-09-12T18:33:04.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4914800821823445183', time=2024-09-12T20:15:33.750110+0000, chain.objs.size()=1 2024-09-12T18:33:04.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EioUKPH6cunx40dsFoz8ZyWap3slONj_0 2024-09-12T18:33:04.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16731077694154569754', time=2024-09-12T20:15:33.905774+0000, chain.objs.size()=1 2024-09-12T18:33:04.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.u8wJaKIbDJ9FH-6xUIlpEXvF2lEumAq_0 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1092793399436460645', time=2024-09-12T20:15:34.008208+0000, chain.objs.size()=1 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CfL8SlI7tFmi-BlF1sAv8-2M19duptt_0 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18157275306390705349', time=2024-09-12T20:15:34.009477+0000, chain.objs.size()=1 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1pRmQKEg4XNVishjM0Nsep10YoknV9b_0 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4233928991286645774', time=2024-09-12T20:15:34.110771+0000, chain.objs.size()=1 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7B8IVvJhuhRl8jLRVc3KkJNZVHl2WZL_0 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4623959533277222366', time=2024-09-12T20:15:34.423254+0000, chain.objs.size()=1 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.27Q5I0aqVqYJuqfV5RsNJnKwE4nVsjy_0 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8336834843841872609', time=2024-09-12T20:15:35.296053+0000, chain.objs.size()=1 2024-09-12T18:33:04.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Pnn_9OFi4f2VHsk0BOVGNKpjF4U1GnF_0 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10422768237112513712', time=2024-09-12T20:15:35.379695+0000, chain.objs.size()=1 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IDEwuDAZq3gn-N8xbJCG65_egaQgKUf_0 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16857663373242169137', time=2024-09-12T20:15:35.394166+0000, chain.objs.size()=1 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Wah7SnKuaxOQ7X1zVN9kgjlm41Hwn8I_0 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8456953456312386781', time=2024-09-12T20:15:35.396017+0000, chain.objs.size()=1 2024-09-12T18:33:04.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.152+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.geNazFMLRtwW18eNX9D1my7TBLLAvw6_0 2024-09-12T18:33:04.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.155+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.818053433627689294', time=2024-09-12T20:15:35.491461+0000, chain.objs.size()=1 2024-09-12T18:33:04.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.155+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FZpSOq7Yl1C7_20RjrALsY-uTtNHiwf_0 2024-09-12T18:33:04.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.155+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12089414798506872986', time=2024-09-12T20:15:35.545553+0000, chain.objs.size()=1 2024-09-12T18:33:04.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.155+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.d-fTKJAFQGZh_vh-VpqZQJUklIYZCth_0 2024-09-12T18:33:04.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.156+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5879728011274603498', time=2024-09-12T20:15:35.596855+0000, chain.objs.size()=1 2024-09-12T18:33:04.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.156+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QzZY1-p_wry9t0xkA1RRL00pXjjTGzB_0 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.593855470808487557', time=2024-09-12T20:15:35.781395+0000, chain.objs.size()=1 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J4KvJkLPEgyI-PpQ_Gg_2LZUHe8bny5_0 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12477951545624743300', time=2024-09-12T20:15:35.843992+0000, chain.objs.size()=1 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5dGm5mSk5ev9oCwYaKaiccCNjvoGOFm_0 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5880318990514299992', time=2024-09-12T20:15:35.921415+0000, chain.objs.size()=1 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wCHSJ6jfeU2dm0tIVDNA0VeKtplLU00_0 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15247931823082123741', time=2024-09-12T20:15:36.226581+0000, chain.objs.size()=1 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZEfa3vd4fLgJmva8FJ_hY0z7ihAxKTU_0 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9726801286585581400', time=2024-09-12T20:15:36.631136+0000, chain.objs.size()=1 2024-09-12T18:33:04.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.s5p9LWSwyDgNKatvu2oJqDmUCiNjuCv_0 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4754310566644331831', time=2024-09-12T20:15:37.204576+0000, chain.objs.size()=1 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZFJcBgE55PLDKEbO42TQnto6is8Rl29_0 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9657632171758111757', time=2024-09-12T20:15:37.663815+0000, chain.objs.size()=1 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8pFZQAKbxxInMWSj2Lga4wO8FNlmR3O_0 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7712074421279822249', time=2024-09-12T20:15:38.027650+0000, chain.objs.size()=1 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HIK54kxyKGGmTs3uDV8k2pa0GJzgAWf_0 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.159+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2320362213606091542', time=2024-09-12T20:15:38.562983+0000, chain.objs.size()=1 2024-09-12T18:33:04.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.159+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4JcgLf95piGfvRUtODO1y-e-hseJzKC_0 2024-09-12T18:33:04.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.161+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8109304119234429916', time=2024-09-12T20:15:38.690951+0000, chain.objs.size()=1 2024-09-12T18:33:04.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.161+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Wcu3MhiYP4bfb81MRXEuJkoC20_MnmH_0 2024-09-12T18:33:04.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.161+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16380441615593896076', time=2024-09-12T20:15:39.459744+0000, chain.objs.size()=1 2024-09-12T18:33:04.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.161+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZN8DhEY4_jRQFq_KjUDKbTPXdno01fF_0 2024-09-12T18:33:04.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11706286144730120946', time=2024-09-12T20:15:39.891102+0000, chain.objs.size()=1 2024-09-12T18:33:04.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.juNKtp1xFGReMrSMehkU7qMnZ7xUGnA_0 2024-09-12T18:33:04.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15691279632290343519', time=2024-09-12T20:15:40.127077+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mJ7QpSKYLeAJaVJLhyE5XGGpR-GNC8P_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13626896238561849756', time=2024-09-12T20:15:40.917572+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wcGvj5Nz_OE55InBXSDrkEwddNGWBCm_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2667893399504108447', time=2024-09-12T20:15:41.331504+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3jTpzfOvGcJfmroI8xyfKPZo2izpkjR_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9341575779006395270', time=2024-09-12T20:15:41.528928+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6_f1yR5gPaYu-PYc2ZgOJmuk47BJ9Oz_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5876507795690120172', time=2024-09-12T20:15:41.759746+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pE2PXEySifduTQZyB7_vsvO3V32TJnR_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15087866036400065816', time=2024-09-12T20:15:41.787730+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Jy6QLaNZ3Ug2PYmuyf-XR8q6tnr6nxe_0 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16708278983228948374', time=2024-09-12T20:15:42.059356+0000, chain.objs.size()=1 2024-09-12T18:33:04.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2MkVr9M5JTVrvXj9Ey97mdLuw4iQpq3_0 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11347340751256152000', time=2024-09-12T20:15:42.474050+0000, chain.objs.size()=1 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JB48MQ1GYoS8diE0Y8P2M-C_WIM2NNo_0 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.165+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6116296863056612852', time=2024-09-12T20:15:42.791643+0000, chain.objs.size()=1 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.165+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BUYZ1xklZIHu3do0lq6qMiCAaVQ1vRe_0 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.165+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17454096641317076011', time=2024-09-12T20:16:20.129960+0000, chain.objs.size()=1 2024-09-12T18:33:04.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.165+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CCDoQadUCwHmKqEf-96kkzCUFWcAHz1_0 2024-09-12T18:33:04.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7002298349196613318', time=2024-09-12T20:16:20.372698+0000, chain.objs.size()=1 2024-09-12T18:33:04.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y4Q9qK0OdCUJJtilPUK9ReFiCAE-cWH_0 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13946622769717991212', time=2024-09-12T20:16:20.797434+0000, chain.objs.size()=1 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ic7x5RCi6RFFUnJvV60mDf0BTwp3Vq5_0 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8433487547060991031', time=2024-09-12T20:16:22.415017+0000, chain.objs.size()=1 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lSX1M0jPsnP8gMm2xOj7JzeTq2xDC6w_0 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6506541227372293747', time=2024-09-12T20:16:22.472825+0000, chain.objs.size()=1 2024-09-12T18:33:04.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5Zz8_ekRt8YcknzD60LfmjA82E0ugHn_0 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17650733583320778342', time=2024-09-12T20:16:22.529692+0000, chain.objs.size()=1 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vkEhxyc3EKCIJOmpTr2HHmuWJoBNQJD_0 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14158322507535024697', time=2024-09-12T20:16:24.047053+0000, chain.objs.size()=1 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F-Dcx_NSjZ_1hgdTTdG3Cyvxkisnqpw_0 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11060698820388522818', time=2024-09-12T20:16:24.106468+0000, chain.objs.size()=1 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HJ8IbkNpkTUcxbPLnURcxofhewFHHec_0 2024-09-12T18:33:04.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2429631273679814099', time=2024-09-12T20:16:24.109662+0000, chain.objs.size()=1 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hWc75bDF0WPgpRHI9I7hUhlaslXJaYW_0 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10323153510140892507', time=2024-09-12T20:16:24.545220+0000, chain.objs.size()=1 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LN6rK67dhYzwDUBn9NyUF3CnaoaHmT8_0 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14085720617528216982', time=2024-09-12T20:16:24.752964+0000, chain.objs.size()=1 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FFA2j-pAwlMpYVBuR671BvDYRT9O9o4_0 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7501381895535320236', time=2024-09-12T20:16:26.137708+0000, chain.objs.size()=1 2024-09-12T18:33:04.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LJrtL2gFvaELOxlL2TI4MxNOplpmGD5_0 2024-09-12T18:33:04.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.173+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6019312349542484594', time=2024-09-12T20:16:26.615800+0000, chain.objs.size()=1 2024-09-12T18:33:04.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.173+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2hM8URqt29RynhCQyPg4tIbKov1mo70_0 2024-09-12T18:33:04.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9894642158788209077', time=2024-09-12T20:16:26.684443+0000, chain.objs.size()=1 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Jkdmi4HM6-dvlu3amuMqJ57_EkX05Ut_0 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6835045415373040687', time=2024-09-12T20:16:26.685554+0000, chain.objs.size()=1 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.saojiAQu4KWuWSTPICsv6I55aE72k1M_0 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5167402798171020082', time=2024-09-12T20:16:27.782798+0000, chain.objs.size()=1 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kla6eIbmDhs8whjtkmdkib9Ql_bLuK-_0 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5943549557913705413', time=2024-09-12T20:16:27.830255+0000, chain.objs.size()=1 2024-09-12T18:33:04.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.174+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7nea-nOpiO2OOEDahVXBoOAEI0sBd71_0 2024-09-12T18:33:04.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.177+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14129392811665728959', time=2024-09-12T20:16:27.920823+0000, chain.objs.size()=1 2024-09-12T18:33:04.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.177+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.10TrxhsTe5tl22LcUdkBVce_cN4AMvH_0 2024-09-12T18:33:04.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.182+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/58480 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2374095546151551179', time=2024-09-12T20:16:28.031863+0000, chain.objs.size()=1 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rI51Gxl2CTDXpVruuQnDr01VJCgUkhW_0 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1558410998798712909', time=2024-09-12T20:16:28.916944+0000, chain.objs.size()=1 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZKTLNpWvBBpRht9-qQOp9nOuPMtmmln_0 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11723566690031388278', time=2024-09-12T20:16:29.055065+0000, chain.objs.size()=1 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uq6taxDtyvf-0RVzmltzxv2aYTlFXNq_0 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1980311454691471453', time=2024-09-12T20:16:29.872148+0000, chain.objs.size()=1 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Nhk8kBhc6tpBTGxaQVcOcAfBVZ3LD8G_0 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12711606539941910208', time=2024-09-12T20:16:30.266290+0000, chain.objs.size()=1 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UsPDzA5ynvmkRzhtRG-3nEoYQhK9nJY_0 2024-09-12T18:33:04.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8737383355569262191', time=2024-09-12T20:16:30.283206+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GwYk191OjB1RMQUnjpKOLbRmixT_l5i_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9699838387596301972', time=2024-09-12T20:16:30.750085+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.A1GssI9h7qtuNw-A8fxLPfiGcQEOtUP_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17161947593714906660', time=2024-09-12T20:16:30.951430+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ahTb-yTroHMir6tAJXzOwpKpa89uqrH_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10323733693895811770', time=2024-09-12T20:17:00.870078+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.382__shadow_.ERiFc8ssRg16GoU39V__uKu0lh5uuce_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11448541121694854292', time=2024-09-12T20:17:15.212318+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.407__shadow_.RXXfhRA2R0C5aM4I6BRraUTwCc7dqmD_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12167645888501456661', time=2024-09-12T20:17:44.682375+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.460__shadow_.udzr2SzZkzy579pcRS9dwBoeg-7WSCT_0 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3985654741604743038', time=2024-09-12T20:17:58.315430+0000, chain.objs.size()=1 2024-09-12T18:33:04.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.185+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.485__shadow_.WMpzzxJvQ8glIm2mhnSDBLto-8ztggS_0 2024-09-12T18:33:04.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.189+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10413457278595361601', time=2024-09-12T20:18:22.052692+0000, chain.objs.size()=1 2024-09-12T18:33:04.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.189+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.511__multipart_mymultipart.2~Ga5DCZcfCSy1tZ2vSg2Gnva2ARcuxAb.1 2024-09-12T18:33:04.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.190+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5203344252672316757', time=2024-09-12T20:21:11.078339+0000, chain.objs.size()=1 2024-09-12T18:33:04.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.190+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.557__shadow_.2Xak1Ges_yOZGsDPu8O-S6BYjhO4NKH_0 2024-09-12T18:33:04.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.190+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14217269294718028147', time=2024-09-12T20:21:26.335025+0000, chain.objs.size()=2 2024-09-12T18:33:04.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.190+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.563__shadow_.ZdThU9_IUr24rUkWUaJ17jo4trqCWQA_0 2024-09-12T18:33:04.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.190+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.563__shadow_.ZdThU9_IUr24rUkWUaJ17jo4trqCWQA_1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17705558114533985828', time=2024-09-12T20:21:30.743163+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:y-E3DW6XhiiHcmYRepTxJxJNGXCGJIz_.xu12Zji0PAvtiOJZIGXYsHIpl2pWBGD_0 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7839509484041643516', time=2024-09-12T20:22:05.165530+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:FpxDjFlJvEPRJEUKSSy0p5sgv-4evx0_.wmCK-qil3WcmkAHJ4MySCP9kLDT--wn_0 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17500310713628430427', time=2024-09-12T20:22:15.752678+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:npdnyUSYk-arxMkt7oVuZUspbVv-xid_.IL0EoW7R2HTGxx4FvoCinZ72BZqVlqD_0 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9580332519282558643', time=2024-09-12T20:22:16.126795+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:xO0H1QAkvcmmWxoRuMk9CWoOUsxPSa3_.mhFWWbkgV7bkNc_BbOA-OC9h6ni8i1x_0 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12395889044236715263', time=2024-09-12T20:23:52.801074+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.616__shadow_.X4AQYpTbDXUB1C9b-ItQmnIkxVVK_So_0 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.774998688820457489', time=2024-09-12T20:25:55.523662+0000, chain.objs.size()=1 2024-09-12T18:33:04.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.620__shadow_.Xj7zAgkZFyMjfSY_SEdmon_-PYvqgLL_0 2024-09-12T18:33:04.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY', time=2024-09-12T20:26:27.791627+0000, chain.objs.size()=12 2024-09-12T18:33:04.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.191+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.1 2024-09-12T18:33:04.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.192+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.1_1 2024-09-12T18:33:04.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.194+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.2 2024-09-12T18:33:04.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.194+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.2_1 2024-09-12T18:33:04.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.195+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.3 2024-09-12T18:33:04.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.195+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.3_1 2024-09-12T18:33:04.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.4 2024-09-12T18:33:04.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.4_1 2024-09-12T18:33:04.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.5 2024-09-12T18:33:04.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.5_1 2024-09-12T18:33:04.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__multipart_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.6 2024-09-12T18:33:04.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.197+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.625__shadow_multipart_enc.2~HmFTwLUNrx9ng-6nE5u8nJtsf6VXusY.6_1 2024-09-12T18:33:04.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.198+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7050909695591306965', time=2024-09-12T20:26:38.056073+0000, chain.objs.size()=1 2024-09-12T18:33:04.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.198+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.642__shadow_.r0PezP1L3m_Zkj4KWwXhXEjUEzFMwWS_0 2024-09-12T18:33:04.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.200+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8368860784389467277', time=2024-09-12T20:27:14.434240+0000, chain.objs.size()=1 2024-09-12T18:33:04.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.200+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.665__shadow_.nZ2OxeYMUWV6yp5ch8aD2hNmiMslKod_0 2024-09-12T18:33:04.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.200+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5738746988104517591', time=2024-09-12T20:28:19.593780+0000, chain.objs.size()=1 2024-09-12T18:33:04.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.200+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.739__shadow_.vvFeTHBLLmJunOAKwz9Xre0hCEFWTjM_0 2024-09-12T18:33:04.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.205+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.208+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:33:04.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.209+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.210+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/60970' 2024-09-12T18:33:04.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5227773433989475146', time=2024-09-12T20:13:11.183545+0000, chain.objs.size()=1 2024-09-12T18:33:04.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.235__shadow_.3xkx3J5cDYc04FwCRNca0yKTdYOUcGa_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4943358901329317471', time=2024-09-12T20:13:20.701970+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.249__shadow_.K5KvwuU6dWdoGlYG8qJjHdO3DROnzFH_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13510209063377874631', time=2024-09-12T20:14:04.705697+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YzoYd5Y61DC8mSWrktWH45qrUVDILlD_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9680328599384657200', time=2024-09-12T20:14:05.649742+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6HSKqaJ0FEGjmrYcqc15Xs-D1rf7gjY_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2916284977873277644', time=2024-09-12T20:14:05.903016+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.C8la21PDnOyf8gSWAYulMuX4K_EDSQI_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4552510488086166317', time=2024-09-12T20:14:06.292423+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NkWYUrCl6Da7VE9bZAXAHB0G4YL2lZc_0 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8632304391004662674', time=2024-09-12T20:14:06.299733+0000, chain.objs.size()=1 2024-09-12T18:33:04.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qOYOWWVHpSsbyhSjCR3tNcSSTrWLRMk_0 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13786756075655430463', time=2024-09-12T20:14:06.661938+0000, chain.objs.size()=1 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.e7lUN4m3QreZPljsk5cReYE7HZo1bcg_0 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1390009959692888382', time=2024-09-12T20:14:07.519520+0000, chain.objs.size()=1 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nK8pycpyBdTRd5ACQvfw49ARVaiLpEr_0 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.218851975191184223', time=2024-09-12T20:14:07.920856+0000, chain.objs.size()=1 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TkIEO2BX7L9GVRNtjE1eWqRmD6Yh3Rj_0 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8559931304286153003', time=2024-09-12T20:14:08.178455+0000, chain.objs.size()=1 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lAQRLpWmnKtq8EenQMegFnvgpZiF9qF_0 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12574278863870207262', time=2024-09-12T20:14:08.603872+0000, chain.objs.size()=1 2024-09-12T18:33:04.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mUWSzPUhVg1I7Wl5Mb0KdTI9hJ7l1J2_0 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2261442308833741940', time=2024-09-12T20:14:08.879837+0000, chain.objs.size()=1 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mYjt7wd9-TqEcTL_ER1W6okM8KKxd3w_0 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4675233254096193088', time=2024-09-12T20:14:10.066994+0000, chain.objs.size()=1 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3rLlqNm0tCsyPLlcti3A1EuSuOELpZl_0 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8762714566534264565', time=2024-09-12T20:14:10.294432+0000, chain.objs.size()=1 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F7AVs1nFPqcl1UdeAjgw0FbZCGSACwa_0 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14673785883797432198', time=2024-09-12T20:14:10.295165+0000, chain.objs.size()=1 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pEYZTLDygayxjeMDYn3CDL3HYjeklCh_0 2024-09-12T18:33:04.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7992001715235643021', time=2024-09-12T20:14:11.008395+0000, chain.objs.size()=1 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Fk2hkkDgcQB08Re5r08Eb1U3RCOy3Ri_0 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11827661143750761792', time=2024-09-12T20:14:11.515475+0000, chain.objs.size()=1 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZJxE0jdJk-ing1nBPjRJRu6CAeuOGJs_0 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4284388854531388591', time=2024-09-12T20:14:11.601090+0000, chain.objs.size()=1 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.215+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OzWSG05EtShpO2YsKPtN6GIIMaUKuXl_0 2024-09-12T18:33:04.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14478519257537872291', time=2024-09-12T20:14:12.125920+0000, chain.objs.size()=1 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.n5SVSG5PJU7dlGZk2SlwLAlwPXVsIRf_0 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3054315663988325994', time=2024-09-12T20:14:12.363693+0000, chain.objs.size()=1 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9pe5-ROq3yEoB4RRa_xutk9Sj4RzyaY_0 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18117120806042927617', time=2024-09-12T20:14:12.364713+0000, chain.objs.size()=1 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Y77mLb_m-MVjn63Ku9MvdKfHSOOEAWL_0 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12722601510331893524', time=2024-09-12T20:14:12.541272+0000, chain.objs.size()=1 2024-09-12T18:33:04.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.exLZTY1mSKInmlsJfNfjZ6UN6CJ1ZTp_0 2024-09-12T18:33:04.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.219+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17580987583299085244', time=2024-09-12T20:14:13.908713+0000, chain.objs.size()=1 2024-09-12T18:33:04.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.219+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MCoXYH1iaHjS2FGZ76pd7CsIICwe41p_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4194327495928054137', time=2024-09-12T20:14:14.239784+0000, chain.objs.size()=1 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4OQ0eNUlAEHTvnA1ZuoToy5WIKPjQXO_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13527193124766583977', time=2024-09-12T20:14:16.946752+0000, chain.objs.size()=1 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.265__shadow_.8EKnLo2MqnzXsmxIuNMKMLHaHa62uIq_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14411517879060288909', time=2024-09-12T20:14:19.237917+0000, chain.objs.size()=1 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.269__shadow_.avyHfEnGQwQtgkV1xeCIl903BrrbbNJ_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16749570058929029039', time=2024-09-12T20:14:19.822140+0000, chain.objs.size()=1 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.270__shadow_.erb_Ewmw3KvN_UkJ-4fn6jvhWv3rig3_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8369811706180124713', time=2024-09-12T20:14:30.865389+0000, chain.objs.size()=1 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.288__shadow_.8eS0nYCpSnJOonnDrV17hvxWU2GemD7_0 2024-09-12T18:33:04.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7527550977424599155', time=2024-09-12T20:14:34.501487+0000, chain.objs.size()=1 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.wLq-wRebTcVrb_Wj5kWj0XS6tOp_Syv_0 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12475939303340140604', time=2024-09-12T20:14:34.618238+0000, chain.objs.size()=1 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.Wkf-ZDGxTJcbN056IIi-1IsNaIfpC4a_0 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2382119851247208840', time=2024-09-12T20:14:40.986310+0000, chain.objs.size()=1 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.300__shadow_.gRUbqLp9h5PdpQpj3l5cOs8nc8ufTx8_0 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3624271348848844169', time=2024-09-12T20:14:53.103060+0000, chain.objs.size()=1 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319__shadow:cPlprxwmg15w.TYxSshM73KPxMtfciv_.h79P-c-MJiGM--XF7s-h_LuPGa7hwuc_0 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13835331382697538671', time=2024-09-12T20:15:32.160334+0000, chain.objs.size()=1 2024-09-12T18:33:04.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hTtS1Fl_xQThOfWfJ9N_TcI8DEeithB_0 2024-09-12T18:33:04.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.222+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9041002164436602240', time=2024-09-12T20:15:32.460971+0000, chain.objs.size()=1 2024-09-12T18:33:04.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.222+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.G0FbV4abXNIKXRjuKXcgpPolyZJKOZK_0 2024-09-12T18:33:04.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6707291719378989192', time=2024-09-12T20:15:32.882355+0000, chain.objs.size()=1 2024-09-12T18:33:04.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VZ29e2XmI0Br2TyiKMRhXjEvUDye-1j_0 2024-09-12T18:33:04.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2006195833855677544', time=2024-09-12T20:15:33.100253+0000, chain.objs.size()=1 2024-09-12T18:33:04.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YgfAgCru1Md9aLAprmKGAmxDSbW9pb7_0 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13239689094874533892', time=2024-09-12T20:15:33.734986+0000, chain.objs.size()=1 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.224+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LqZXvL4RByPWulU5SCs2Y5kpL-6Cy_z_0 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10665174834798807115', time=2024-09-12T20:15:34.317942+0000, chain.objs.size()=1 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.AJ0-5TX9Y0OTwI53-TCTpDxf-xLEyAT_0 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8600783119506057977', time=2024-09-12T20:15:34.395919+0000, chain.objs.size()=1 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jnyYuH31UkMbthK4M0xMVrZ76DujXgX_0 2024-09-12T18:33:04.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17730588540143022857', time=2024-09-12T20:15:35.511018+0000, chain.objs.size()=1 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.o8a98p0_Mm4gu4nvJRznBve9y8HPtiw_0 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15444345888898795114', time=2024-09-12T20:15:35.645920+0000, chain.objs.size()=1 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jpFVstYpw4t8d7w-6Kr2ksgJ-RX8nEl_0 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8060125897145124247', time=2024-09-12T20:15:35.646550+0000, chain.objs.size()=1 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.URart9TSl4GAItLoBSahn7SqKDpGYTF_0 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3093093805525669754', time=2024-09-12T20:15:35.962355+0000, chain.objs.size()=1 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.225+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.o9Gv_-H5lwSSXugPmn3N04Wcajmxkh1_0 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.226+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14038333445176821397', time=2024-09-12T20:15:36.223707+0000, chain.objs.size()=1 2024-09-12T18:33:04.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.226+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8xc5j9GVYHEHYNECWAIQvo-0FoTA_SV_0 2024-09-12T18:33:04.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.228+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16799176187663632194', time=2024-09-12T20:15:36.766025+0000, chain.objs.size()=1 2024-09-12T18:33:04.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.228+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JZ9PtuWFl89nu9c3uQm-bZOkYIMk5bh_0 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3674220134903245263', time=2024-09-12T20:15:36.766828+0000, chain.objs.size()=1 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YXDcqvTQk5BW-mZldb874U8RJRW2efg_0 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2339793244386122992', time=2024-09-12T20:15:37.091562+0000, chain.objs.size()=1 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CzVvjrNXuDw9VohTRCmP8gDMT2d-NRR_0 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17088052446722728326', time=2024-09-12T20:15:37.174383+0000, chain.objs.size()=1 2024-09-12T18:33:04.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YOdbW3R2vpQhDU5jnc50fPKL0A0aycM_0 2024-09-12T18:33:04.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2918279524754130814', time=2024-09-12T20:15:37.382045+0000, chain.objs.size()=1 2024-09-12T18:33:04.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.229+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WMVmWRCdMsUzptEpcufYaBMBPG5F1q7_0 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7887928783765826279', time=2024-09-12T20:15:38.072955+0000, chain.objs.size()=1 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Elde_YQb4V9hB4SIc5baHxFHXn4X10b_0 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.410078311278238270', time=2024-09-12T20:15:38.462917+0000, chain.objs.size()=1 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.kzsnOAPAvigQqCZUA9_KkvIHcK9yKw5_0 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17774519061405043916', time=2024-09-12T20:15:38.566013+0000, chain.objs.size()=1 2024-09-12T18:33:04.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hB-EFI5NbT5E3HyIrYvunwq812RMJBu_0 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2326486562773349324', time=2024-09-12T20:15:39.546029+0000, chain.objs.size()=1 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pbN2zCGKIYQPx2kOADE1ezbsu4eVBiJ_0 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11185108381431951075', time=2024-09-12T20:15:39.578362+0000, chain.objs.size()=1 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zZAQM1XJwPRO2ps28LC7Dk27wRemSJY_0 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1120569395784807616', time=2024-09-12T20:15:39.735281+0000, chain.objs.size()=1 2024-09-12T18:33:04.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WgKlhr65elkhGnxYvEShSG4TyqvGtY2_0 2024-09-12T18:33:04.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1880179734165760510', time=2024-09-12T20:15:39.985377+0000, chain.objs.size()=1 2024-09-12T18:33:04.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.OWjHTFnpcVX24Y2D5FUg26B8c3CUdix_0 2024-09-12T18:33:04.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12377530241105429860', time=2024-09-12T20:15:40.297117+0000, chain.objs.size()=1 2024-09-12T18:33:04.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rFvBDCXaPiEZQs-x2KW7Erun__QT_xe_0 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17956222358272692125', time=2024-09-12T20:15:40.323373+0000, chain.objs.size()=1 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3xH9kw7URTmb7IPR4U7rdO8coHI05nY_0 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4004709261867818651', time=2024-09-12T20:15:40.450912+0000, chain.objs.size()=1 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NqjLxrpYyBmAfYz7MVuCeM4nBDatmSK_0 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.344005700976639176', time=2024-09-12T20:15:40.940423+0000, chain.objs.size()=1 2024-09-12T18:33:04.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.V07OKp2CW7HJDYUEtc5xKO_e8NxnMb__0 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.237+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14849728390439529613', time=2024-09-12T20:15:41.246202+0000, chain.objs.size()=1 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.237+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HUoblZV8viIsDKKsydAY0FXt08jcA8w_0 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17740127382818245516', time=2024-09-12T20:15:42.072358+0000, chain.objs.size()=1 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IoYMve9sKY4iFdlXlhXXOkL3NLUPhvA_0 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7556932627649248267', time=2024-09-12T20:15:42.073125+0000, chain.objs.size()=1 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DO_uBPMgwVQ92Q6LPhoxcue17NZ68Yh_0 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1706192719961278007', time=2024-09-12T20:15:42.180736+0000, chain.objs.size()=1 2024-09-12T18:33:04.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7x9AdO1uRmgpb6LFMsLhWEu9lvrJSbA_0 2024-09-12T18:33:04.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3613825088447140948', time=2024-09-12T20:15:42.347210+0000, chain.objs.size()=1 2024-09-12T18:33:04.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vdd20vbOILG2EIhI0kDhCTCAHCn3703_0 2024-09-12T18:33:04.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17703682481195716627', time=2024-09-12T20:16:20.536999+0000, chain.objs.size()=1 2024-09-12T18:33:04.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tH8LJaQuosouyvA8Re6LM5s_6qwiRzu_0 2024-09-12T18:33:04.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13583165295254428252', time=2024-09-12T20:16:20.681160+0000, chain.objs.size()=1 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MwxAjp_W4gfp9mRSL2-IuCymdQ7R6PE_0 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18378963702327863679', time=2024-09-12T20:16:20.795673+0000, chain.objs.size()=1 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.asjiL7kiucrwScqjNrb-RiucH2ez4Z2_0 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11435224205094921626', time=2024-09-12T20:16:20.955010+0000, chain.objs.size()=1 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MFUq-jZBVuBdGKq3X6uhe6GkhjnME95_0 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8306031952047321825', time=2024-09-12T20:16:21.153461+0000, chain.objs.size()=1 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5voC4fSDo2R9xs1JkF8QtnchLxEyC1h_0 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1097514140160053144', time=2024-09-12T20:16:21.645571+0000, chain.objs.size()=1 2024-09-12T18:33:04.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zSa3zT9ct42L04ZjtrCwtYzV3K_WGsy_0 2024-09-12T18:33:04.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.242+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7308490598051953547', time=2024-09-12T20:16:22.423193+0000, chain.objs.size()=1 2024-09-12T18:33:04.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.242+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BHjqyPoTJvFs5bwvz43v9_YoN7099UA_0 2024-09-12T18:33:04.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3365253431427485436', time=2024-09-12T20:16:23.286870+0000, chain.objs.size()=1 2024-09-12T18:33:04.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rxL34e1WXV8wdlKs4jDsPXVhc3p-sCn_0 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14875883283793332367', time=2024-09-12T20:16:23.636201+0000, chain.objs.size()=1 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.j6TG4iS7fTewGXxS4TStr22cdzYIz3w_0 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14847776956777770871', time=2024-09-12T20:16:23.675201+0000, chain.objs.size()=1 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.v_DlOUleELjwwcLbne5eXVQfwfXsOJS_0 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6759916548698050706', time=2024-09-12T20:16:23.992850+0000, chain.objs.size()=1 2024-09-12T18:33:04.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.243+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Cw4GVeJ4kAjYU9tvCoxDzCRaaR2nKAx_0 2024-09-12T18:33:04.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.244+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.777329072559669870', time=2024-09-12T20:16:24.056051+0000, chain.objs.size()=1 2024-09-12T18:33:04.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.244+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.csI4VGFLXRjIzN-w_suTWK3Xp3k1IJf_0 2024-09-12T18:33:04.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.244+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6636181693641980507', time=2024-09-12T20:16:24.682438+0000, chain.objs.size()=1 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wPLXOM9it0iFm9S7eNR6XYk2iL7Cmr4_0 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1309422030901011819', time=2024-09-12T20:16:25.025487+0000, chain.objs.size()=1 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GazmgDDK7NC3fz18lO9uIT2LDIdsvZ8_0 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12692748000570175375', time=2024-09-12T20:16:25.026214+0000, chain.objs.size()=1 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7BklX8MQVSZB3Et3MG2dNph3cTSAfWF_0 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16402857392828723502', time=2024-09-12T20:16:25.250741+0000, chain.objs.size()=1 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LInHS25g5am0_8ND0BspuV16KhUAH2o_0 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9861905515850646359', time=2024-09-12T20:16:25.348781+0000, chain.objs.size()=1 2024-09-12T18:33:04.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.X2jLhD8_j9l0jK3AwUS5jtOBWjB7yZe_0 2024-09-12T18:33:04.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17272144391164396065', time=2024-09-12T20:16:25.462360+0000, chain.objs.size()=1 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pchrI6OfexEtFDhUxHMz9GqG8uDlpI8_0 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6132704973413795798', time=2024-09-12T20:16:25.929666+0000, chain.objs.size()=1 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eu4kakXOsAFuo9sNipwEdJ0785FB-na_0 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6098778991037766325', time=2024-09-12T20:16:26.412966+0000, chain.objs.size()=1 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.S290-XF9DahjS91TBa8Egi36p86ARgn_0 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1918215106836372024', time=2024-09-12T20:16:26.413676+0000, chain.objs.size()=1 2024-09-12T18:33:04.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.248+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dmsbdVrLaB1D85wznxOGPQ8Acjo-7ZJ_0 2024-09-12T18:33:04.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.278393817569760767', time=2024-09-12T20:16:26.546027+0000, chain.objs.size()=1 2024-09-12T18:33:04.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EFoIcYXTNJ_USkvo3MopO-I1L6H2SXB_0 2024-09-12T18:33:04.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15735392106970763168', time=2024-09-12T20:16:27.440699+0000, chain.objs.size()=1 2024-09-12T18:33:04.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JJn0UWIsMriRiQIGGpNPzLCywFiabCq_0 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11078055404385829974', time=2024-09-12T20:16:28.118827+0000, chain.objs.size()=1 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cge6A67etfgE3MxWdJ_WCvAyZNK29uN_0 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14426430102879341162', time=2024-09-12T20:16:28.247452+0000, chain.objs.size()=1 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vIt_n8RN10VTULIs-iqa0lF2Gmh9TuZ_0 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3379754404614753671', time=2024-09-12T20:16:28.634053+0000, chain.objs.size()=1 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.a72pfv5NgPym3Xdjb55nrYEP3fx8iQK_0 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5973311725891155660', time=2024-09-12T20:16:28.776111+0000, chain.objs.size()=1 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2xFpXQ7-NvzQbbe7tgMHPUKLkurhi1L_0 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6460421359463311082', time=2024-09-12T20:16:28.776994+0000, chain.objs.size()=1 2024-09-12T18:33:04.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NWHMdzw-ouwGV5-2MszjtizR_wBYXFa_0 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.251+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11283030250976375168', time=2024-09-12T20:16:28.802193+0000, chain.objs.size()=1 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.251+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kWPVeKW0P-cZSfWURESxSGaKJOeIvcN_0 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.251+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17254966253717230944', time=2024-09-12T20:16:28.933993+0000, chain.objs.size()=1 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.251+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BMijm-iRUjk6p2_okq1UcAsTjuZwTvS_0 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.252+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2616163083581305418', time=2024-09-12T20:16:29.061148+0000, chain.objs.size()=1 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.252+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9dIVYBilvPHjAG_TpEfoaG_ICrT9D1F_0 2024-09-12T18:33:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.252+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11540553430772328757', time=2024-09-12T20:16:29.061956+0000, chain.objs.size()=1 2024-09-12T18:33:04.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.252+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.G_DWlOBj7Wp23GsMXbA1UHLgU4cPr3v_0 2024-09-12T18:33:04.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.255+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2410356505770262000', time=2024-09-12T20:16:29.284871+0000, chain.objs.size()=1 2024-09-12T18:33:04.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.255+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1-u7L0Qqko5eU8OtEFRo3Ynvt2M6wNz_0 2024-09-12T18:33:04.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.255+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6555815676809414699', time=2024-09-12T20:16:29.649602+0000, chain.objs.size()=1 2024-09-12T18:33:04.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.255+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rGNiIKOji-5hqVB6npDA1M7IHP1AjCi_0 2024-09-12T18:33:04.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.259+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/60970 2024-09-12T18:33:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:33:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11160615954078951383', time=2024-09-12T20:16:29.650285+0000, chain.objs.size()=1 2024-09-12T18:33:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eEa17SlUb4Y4UeE2dhYo-5zzvKjtHNm_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17230346430194841127', time=2024-09-12T20:16:30.213183+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.h2XEdW-x1sHxLbvqK3c5qLox6I4L6lB_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6365814861248442745', time=2024-09-12T20:16:30.251989+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8pnbnPlfSa1aEuP3A01Tqzqr_9cAcJ6_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4886921683175841075', time=2024-09-12T20:16:30.722429+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HMrSJ_1iN0_c_HC8M2BI_b6GcforUUy_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10034648004150020913', time=2024-09-12T20:16:30.864943+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5YXcJS7IHUATi4JUyZUKLojomsAgH19_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16991494239966043263', time=2024-09-12T20:16:34.593497+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.331__shadow_.5qHJUMukcV1yobOQbCsfu_NUGwTMRPj_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2699950886833374491', time=2024-09-12T20:17:31.801611+0000, chain.objs.size()=1 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.440__shadow_.pRwHLHK5eP4jGT8-fB7rs2IOXSJFpAq_0 2024-09-12T18:33:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.750011578295574276', time=2024-09-12T20:17:42.246329+0000, chain.objs.size()=1 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.457__shadow_.GlPlcmazXumKUogHhXJS5rxRlH847IK_0 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5537512752293263013', time=2024-09-12T20:18:25.643529+0000, chain.objs.size()=1 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.515__shadow_.h_jXdvQ4_aJs-uPEn8RZkkRnLXZOeGn_0 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17608510110168964625', time=2024-09-12T20:18:32.247086+0000, chain.objs.size()=1 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.517__shadow_.Kd4a-7F2XoxDjskAmRUA9NksOb8uZ5y_0 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3509239428359134126', time=2024-09-12T20:19:29.477851+0000, chain.objs.size()=6 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.1 2024-09-12T18:33:04.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.2 2024-09-12T18:33:04.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.265+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.45dpsvx3UYOpFsv6zQoPhl6nSPSDLRXo.3 2024-09-12T18:33:04.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.266+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.4 2024-09-12T18:33:04.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.266+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.5 2024-09-12T18:33:04.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.266+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.6 2024-09-12T18:33:04.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12975760593394519748', time=2024-09-12T20:20:12.562589+0000, chain.objs.size()=1 2024-09-12T18:33:04.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.528__shadow_.eyPnu5YhD0Yn9K5aFZucmz4TGAG5jJ8_0 2024-09-12T18:33:04.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4885920780459640517', time=2024-09-12T20:22:05.542003+0000, chain.objs.size()=1 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:80sa4MyOsgBcLCRbJgoWkZ5wN9pPMAh_.thS80_LMhn1s2pxaAJDlrwkdTmiOBPM_0 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14565382713086413283', time=2024-09-12T20:22:39.755728+0000, chain.objs.size()=1 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:c3jnRYm3.48zWkrsdsCsVG6wLvSE819_.jONqAiPOZPgO95xjuMEYL7_ANnRvvVb_0 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12589673298178495206', time=2024-09-12T20:22:46.610516+0000, chain.objs.size()=1 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.602__shadow_.0TjPa5xy69rRJ7ioSuJ6wCx6c_hpZzK_0 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1148111241568762185', time=2024-09-12T20:26:14.855545+0000, chain.objs.size()=12 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.1 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.267+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.1_1 2024-09-12T18:33:04.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.268+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.2 2024-09-12T18:33:04.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.2_1 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.3 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.3_1 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.4 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.4_1 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.5 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.5_1 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__multipart_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.6 2024-09-12T18:33:04.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.623__shadow_multipart_enc.2~sCjCoXgHszw3ZtATZ2ClPBGHbc7gQ1C.6_1 2024-09-12T18:33:04.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.283+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:33:04.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.284+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.285+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49057' 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_HUfUb_Kv_sXzb6v4bR9kROS0AoT4XRd', time=2024-09-12T20:11:05.721058+0000, chain.objs.size()=3 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.uIXV69Y0ByAqqelMK56Ym3Apye-EQH6_0 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.uIXV69Y0ByAqqelMK56Ym3Apye-EQH6_1 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.uIXV69Y0ByAqqelMK56Ym3Apye-EQH6_2 2024-09-12T18:33:04.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10815792654582295176', time=2024-09-12T20:11:07.153691+0000, chain.objs.size()=3 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-STANDARD.2~kHz1yLM1mc9F-fwoWXmZjuYk6S6LwQz.1 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-STANDARD.2~kHz1yLM1mc9F-fwoWXmZjuYk6S6LwQz.2 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-STANDARD.2~kHz1yLM1mc9F-fwoWXmZjuYk6S6LwQz.3 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_1EUYO9wI3v_tNv3uh3_pU0bvcB7Jnid', time=2024-09-12T20:11:09.416269+0000, chain.objs.size()=3 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.LA1AnCk6yOFDj8s7YT7alBiVtVzL9yt_0 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.LA1AnCk6yOFDj8s7YT7alBiVtVzL9yt_1 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.LA1AnCk6yOFDj8s7YT7alBiVtVzL9yt_2 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~sDSb_htRIwREKmCjoNhfI9rCX_OHgDS', time=2024-09-12T20:11:48.081232+0000, chain.objs.size()=1 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.202__multipart_mymultipart.2~sDSb_htRIwREKmCjoNhfI9rCX_OHgDS.1 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13977368351167935979', time=2024-09-12T20:11:48.709941+0000, chain.objs.size()=1 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.203__shadow_.rlXq0wpo47Ddc-cjIFZDvnnx8cmKvqZ_0 2024-09-12T18:33:04.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17049225928442663029', time=2024-09-12T20:11:49.410736+0000, chain.objs.size()=1 2024-09-12T18:33:04.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.204__shadow_.NISSzmrEjN9JTB0EQTrl_ATCaedDrOz_0 2024-09-12T18:33:04.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.290+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5238011571532259519', time=2024-09-12T20:13:10.583353+0000, chain.objs.size()=1 2024-09-12T18:33:04.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.290+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.234__shadow_.A_aGCEYqQ4T7-Y5bhMC5exhV0gkzmzz_0 2024-09-12T18:33:04.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.290+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11443769452998018898', time=2024-09-12T20:13:12.693066+0000, chain.objs.size()=1 2024-09-12T18:33:04.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.290+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.237__shadow_.66pVDD6flWtV-EQ26PCXPOK_PHThxte_0 2024-09-12T18:33:04.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.290+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7352578099449605259', time=2024-09-12T20:13:13.592164+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.238__shadow_.Kpw5sCtElu8qg5WyMaxV9MRPQ_xfsZ6_0 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13352861322921837353', time=2024-09-12T20:13:16.737054+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.243__shadow_.U--SGpefd2NQsRZK74G14T7RAdI-d-5_0 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12843460140721076455', time=2024-09-12T20:13:23.154482+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.253__shadow_.oWL8AMH8y4gEbiQ0I6hN_NaNq8MXNby_0 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15778249532993855168', time=2024-09-12T20:13:24.373249+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.255__shadow_.XqLs8eeSFHewBqyyHRigKzBKyzK5HSC_0 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12677822752160892483', time=2024-09-12T20:13:27.297202+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.260__shadow_.wQpN-YcUOxYvngxJMQrzec6q9qBhJE0_0 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8669221272424285968', time=2024-09-12T20:13:27.918142+0000, chain.objs.size()=1 2024-09-12T18:33:04.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.261__shadow_.gSHHC02nPx7cGJFuYg7UHcRjQ4pnCrT_0 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17887084150271742058', time=2024-09-12T20:14:04.258877+0000, chain.objs.size()=1 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GE9hQnvBIg6nXCgGLtBaDMSENbgQfjU_0 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11089835494498979149', time=2024-09-12T20:14:05.182650+0000, chain.objs.size()=1 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EfRK3YT8IhqlRkhgRgbDYt4Yid6hDKo_0 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7742553289615988969', time=2024-09-12T20:14:05.695152+0000, chain.objs.size()=1 2024-09-12T18:33:04.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.291+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9yS8HoUBoUORE7RBIkU1K5hxldMAbTO_0 2024-09-12T18:33:04.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.294+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18112875455347148887', time=2024-09-12T20:14:05.938136+0000, chain.objs.size()=1 2024-09-12T18:33:04.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.294+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LgJw-oE4AYBtoyjaCB9zl1RLZ7hbkwo_0 2024-09-12T18:33:04.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.294+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1777678311315026403', time=2024-09-12T20:14:06.555089+0000, chain.objs.size()=1 2024-09-12T18:33:04.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.294+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.65ERKfKAC0GY-DqQwK7PpBbtHXO6BU3_0 2024-09-12T18:33:04.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.663601981935288469', time=2024-09-12T20:14:06.693549+0000, chain.objs.size()=1 2024-09-12T18:33:04.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.x_TTvnO7qOk9Y-cMim6SAr1Itm7wHFO_0 2024-09-12T18:33:04.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5933690443463390081', time=2024-09-12T20:14:07.306077+0000, chain.objs.size()=1 2024-09-12T18:33:04.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1Hh1TVMRuc_oLZQgfW5lopcafPwOHNF_0 2024-09-12T18:33:04.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8468388035077635980', time=2024-09-12T20:14:07.452086+0000, chain.objs.size()=1 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CQ7lbq0KweiCUIJ1SjCRqC1REcm8KLi_0 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15476164372312628170', time=2024-09-12T20:14:07.754411+0000, chain.objs.size()=1 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KIG2mobQtM8sg9y_XmfEj1t09QABaPD_0 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18146788997253037325', time=2024-09-12T20:14:07.762971+0000, chain.objs.size()=1 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PUaMqJaUHIhg2U06d0IjNupwojpsUQS_0 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16528448072678867624', time=2024-09-12T20:14:08.168168+0000, chain.objs.size()=1 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8TKzoABNzGgcJsnppBpfUL35KlhX4l5_0 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.634619268574809067', time=2024-09-12T20:14:08.979372+0000, chain.objs.size()=1 2024-09-12T18:33:04.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.295+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._MMPN1P_TiWutPq34ttPyZWpcLxhGa2_0 2024-09-12T18:33:04.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12950788818170371408', time=2024-09-12T20:14:09.208224+0000, chain.objs.size()=1 2024-09-12T18:33:04.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OHljOO4iW5UsrOJPaVGuJpZJaOpiuSd_0 2024-09-12T18:33:04.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8723301164297866645', time=2024-09-12T20:14:09.638302+0000, chain.objs.size()=1 2024-09-12T18:33:04.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MD8Fl1ghM-pZnAF0E6X0vWg37I6Oaeh_0 2024-09-12T18:33:04.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.298+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5530235474557719091', time=2024-09-12T20:14:10.450387+0000, chain.objs.size()=1 2024-09-12T18:33:04.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.298+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.OsVq5DNbejfKw3izoIsoClUiPkX9wuv_0 2024-09-12T18:33:04.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.298+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16757186671801170109', time=2024-09-12T20:14:10.590028+0000, chain.objs.size()=1 2024-09-12T18:33:04.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.298+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.byiisEqLC9sm_XNVA4Cn-0D3n8dYNGJ_0 2024-09-12T18:33:04.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.300+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18016219880919907998', time=2024-09-12T20:14:10.850556+0000, chain.objs.size()=1 2024-09-12T18:33:04.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.300+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.N5vnIe8CtEgqh0r3veAKcA-wQIDqbB4_0 2024-09-12T18:33:04.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.302+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17335927508282891545', time=2024-09-12T20:14:10.950113+0000, chain.objs.size()=1 2024-09-12T18:33:04.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.302+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.m20PqO4mrBZdDq4MGaQF83wQYg_YJWW_0 2024-09-12T18:33:04.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4107695624680881018', time=2024-09-12T20:14:12.175794+0000, chain.objs.size()=1 2024-09-12T18:33:04.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WsbGc6py_McJTDPADNm0X3YZ6eWBI2I_0 2024-09-12T18:33:04.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14540619490221274391', time=2024-09-12T20:14:12.460442+0000, chain.objs.size()=1 2024-09-12T18:33:04.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.k-H70xVX1IbXK4lQEfhNFXglXRNxBIG_0 2024-09-12T18:33:04.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8592856600843527671', time=2024-09-12T20:14:12.461251+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lzdluYuZO7gmX3cqho74O-oLtXTuuJX_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3281187713699275468', time=2024-09-12T20:14:12.904066+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oOM0daW1mbNnCzxPicZe_apZDFf0mDt_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17284980140960296392', time=2024-09-12T20:14:12.999205+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.faJ2nr_kCKGoiyVYEGn5i9jVek8g8ex_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18276966963558639520', time=2024-09-12T20:14:13.074800+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uM7GZBTvhBkaPWMeqsDCGu5CWVMSeMe_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8472378097362063429', time=2024-09-12T20:14:14.503592+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.K_hX3SG6GU1KfmmArjaud2NFIKnGXAk_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14086640490757308138', time=2024-09-12T20:14:14.732083+0000, chain.objs.size()=1 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2YeXFVZzhNVvwrj0qtE3FP3vxsZGtaZ_0 2024-09-12T18:33:04.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7029226619741088121', time=2024-09-12T20:14:14.861699+0000, chain.objs.size()=1 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.303+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BHavI4p2jwFrOCmPGt2E39ImMC98_Az_0 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.304+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18199206247030794600', time=2024-09-12T20:14:19.245836+0000, chain.objs.size()=1 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.304+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.269__shadow_.7-ExrwyoIBM-y3XWwGlzHns3H6xMCtv_0 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.306+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4431083425064542939', time=2024-09-12T20:14:23.966503+0000, chain.objs.size()=1 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.306+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.277__shadow_.Taq9jiJLycMJZ0zEamjjkbr0c1q8xzF_0 2024-09-12T18:33:04.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16727739980230300986', time=2024-09-12T20:14:27.044754+0000, chain.objs.size()=1 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.282__shadow_.CWx3fucy6TQce7G6-SjTohiKxtH0pqA_0 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2775756922678775733', time=2024-09-12T20:14:28.933708+0000, chain.objs.size()=1 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.285__shadow_.-OYSBVDPZFrD5LfdsAOGbXfVNS0WCHa_0 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2141494336749223148', time=2024-09-12T20:14:28.942936+0000, chain.objs.size()=1 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.285__shadow_.Bab0XGmzsvVZY5ExenQzlcVJJ8uzwvQ_0 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16616451951900556937', time=2024-09-12T20:14:34.525427+0000, chain.objs.size()=1 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.aHi5LXJK93PJDr2_Jc7OuVSciGWax8t_0 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8998982757515334848', time=2024-09-12T20:14:34.615839+0000, chain.objs.size()=1 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.308+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.sSKCVXobq5nLuMJOkjeAMsLGl5r1XIT_0 2024-09-12T18:33:04.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12310944328803019735', time=2024-09-12T20:14:40.991644+0000, chain.objs.size()=1 2024-09-12T18:33:04.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.300__shadow_.RxmSJ9M69VT6qOWL8QRwEUX9hs-cPfw_0 2024-09-12T18:33:04.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9696870067372470993', time=2024-09-12T20:14:54.949306+0000, chain.objs.size()=1 2024-09-12T18:33:04.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.322__shadow_.9qo_KTcnkSCTAPHgN3kFICDBTjmM_yl_0 2024-09-12T18:33:04.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5751969249326966570', time=2024-09-12T20:15:32.425451+0000, chain.objs.size()=1 2024-09-12T18:33:04.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oaH3qqa4poSkzXPONkAvTGK6IilsomV_0 2024-09-12T18:33:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16945841955920727712', time=2024-09-12T20:15:32.709640+0000, chain.objs.size()=1 2024-09-12T18:33:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MN955fzklb8rEJZFNKMtBKYl0uILgkZ_0 2024-09-12T18:33:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7783577035869661576', time=2024-09-12T20:15:32.754170+0000, chain.objs.size()=1 2024-09-12T18:33:04.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.309+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gFxwMpmhcSfDcs-LnXJVFQUABqbM4Ub_0 2024-09-12T18:33:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.313+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12608320555718144828', time=2024-09-12T20:15:34.016621+0000, chain.objs.size()=1 2024-09-12T18:33:04.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.313+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n7G3ElukgLakuBTifA6v9NvPd0euIlw_0 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6282777106889641588', time=2024-09-12T20:15:35.694666+0000, chain.objs.size()=1 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7cNw192c-PfVFLZNdPprA6uW8-aVcVu_0 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14982060808657232617', time=2024-09-12T20:15:35.785960+0000, chain.objs.size()=1 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eq3yP2YmxWlI9QbUfXTm6cT6wOrNm-J_0 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5498057091542950959', time=2024-09-12T20:15:35.786736+0000, chain.objs.size()=1 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eJYuTURyCREzplhzCqSpXCw3Nxc8hXZ_0 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10141173316712301319', time=2024-09-12T20:15:35.853558+0000, chain.objs.size()=1 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nIDtkBlBDTm3fPBZ8pjrKjsm6vpAU0a_0 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2354853486821398723', time=2024-09-12T20:15:36.118722+0000, chain.objs.size()=1 2024-09-12T18:33:04.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0BGSNTGHdlZSYnFzdhDyuEMNiEiNUWa_0 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6280998832631909595', time=2024-09-12T20:15:37.312447+0000, chain.objs.size()=1 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6sKKjvUr9lHIgDxWK70AqpkHm7-LgE3_0 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11681573407453131631', time=2024-09-12T20:15:37.421048+0000, chain.objs.size()=1 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zKulV4OVK6AjG40M-vFJ2SZvOyfQNoF_0 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10631392006950491881', time=2024-09-12T20:15:37.609691+0000, chain.objs.size()=1 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9f6dchhb6nt2oLo9rR5HtI7OKCWnLMg_0 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11076971219454561623', time=2024-09-12T20:15:37.671967+0000, chain.objs.size()=1 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.314+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ULUqdNnvyTaN8vuiM8UBX_gRNoM1RZE_0 2024-09-12T18:33:04.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15499272581003569522', time=2024-09-12T20:15:37.681653+0000, chain.objs.size()=1 2024-09-12T18:33:04.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PkuEytzD2ArLXMNLH6pBWtafUWyxdgt_0 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.317+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17502510887972676059', time=2024-09-12T20:15:38.041761+0000, chain.objs.size()=1 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.317+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vZFPzxohwrvZvrI_B3bIyVP6YYLtiH6_0 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.317+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6943422715146102311', time=2024-09-12T20:15:38.335195+0000, chain.objs.size()=1 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.318+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.j2r2fb4PqvoJIig-YtXQhK7rNnznM-I_0 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.318+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3622839376219195662', time=2024-09-12T20:15:38.690748+0000, chain.objs.size()=1 2024-09-12T18:33:04.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.318+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yYr2R0x0R_nI1ydx2qee2MT09ZYShmT_0 2024-09-12T18:33:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.319+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10720791460816651804', time=2024-09-12T20:15:38.739873+0000, chain.objs.size()=1 2024-09-12T18:33:04.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.319+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qj-Jf56XpSClIV_aUV6B4uGTLHxByb0_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.319+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14517687331469986332', time=2024-09-12T20:15:38.740490+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TcUe9RHZUbQ391_tsyl42dKsMxYMkys_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14135817514541377839', time=2024-09-12T20:15:38.951392+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.T-rVcwG-CODDsZ00qjaZqqx7bm2VvR6_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14997558677324839306', time=2024-09-12T20:15:38.967594+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.RZZOv7I4h8Uok4ngynxISLI2wg64Ij-_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3925475179639110455', time=2024-09-12T20:15:39.621759+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0un6fX2mtBAkov-yTSkMQwNEoodHbZp_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3335280241465521597', time=2024-09-12T20:15:39.818523+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nBbEWvkQ2KXFetxWn1EY0GiMD1o4uTG_0 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1969876582484670491', time=2024-09-12T20:15:40.090138+0000, chain.objs.size()=1 2024-09-12T18:33:04.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.O1orEfPBjyT8bJW4Tjg6E9_n7F0uLrm_0 2024-09-12T18:33:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9054320543484326593', time=2024-09-12T20:15:40.788284+0000, chain.objs.size()=1 2024-09-12T18:33:04.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.attaQf8-iaoY86DVr87IDbaGxzOzDMw_0 2024-09-12T18:33:04.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.322+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6635051889358589077', time=2024-09-12T20:15:41.754765+0000, chain.objs.size()=1 2024-09-12T18:33:04.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.322+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lIob1_81Zu5TeRqj1geb2eixPmWHWpn_0 2024-09-12T18:33:04.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11002782133337845302', time=2024-09-12T20:15:42.252265+0000, chain.objs.size()=1 2024-09-12T18:33:04.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Z3KUXjCcu8sbxsa7b58rqVh2TRfRDIV_0 2024-09-12T18:33:04.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4114027516881935338', time=2024-09-12T20:15:42.516127+0000, chain.objs.size()=1 2024-09-12T18:33:04.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XK1RFNF_H4-5S7lesi5Q0nTEWKXcMq2_0 2024-09-12T18:33:04.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.325+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4325884692252179159', time=2024-09-12T20:16:20.639085+0000, chain.objs.size()=1 2024-09-12T18:33:04.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.325+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AhkXZFqamIoeT73hBqgP8KwbjyudyAc_0 2024-09-12T18:33:04.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.325+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9587893252045412200', time=2024-09-12T20:16:21.049611+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.325+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vHK_GeexoG8nQiSTg5x5lmP1qJuoWFR_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466791092394876332', time=2024-09-12T20:16:21.083794+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sqZm3sZcVxeZiNgNNQeOZnsfO7h1prr_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8797269779428059368', time=2024-09-12T20:16:21.152897+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PSXTXqT_eKuozaE2ajhCRKCNAMuunE9_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17221023072010073394', time=2024-09-12T20:16:21.662104+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FO8YFjF57Ahvgti9BfWdxBajerdQfo9_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.641473619718606010', time=2024-09-12T20:16:21.672019+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zmV6qxsLWi2LWbbTCilY-1XT7RTBX3K_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9334797140138586101', time=2024-09-12T20:16:22.008231+0000, chain.objs.size()=1 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dOSGK93P6Kf_IWI0rXmUVaIvk86jZb4_0 2024-09-12T18:33:04.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15296985954005236452', time=2024-09-12T20:16:22.075865+0000, chain.objs.size()=1 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.c3p07YwaUqKxRSP5Vzq5tYo4BhZhLgs_0 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6559805436296261469', time=2024-09-12T20:16:22.407246+0000, chain.objs.size()=1 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0nmqHsNFSVEZmL-SBCX9mWByCtwlpXy_0 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12993638171739260581', time=2024-09-12T20:16:23.093191+0000, chain.objs.size()=1 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.326+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wahmkUyXJ2CTMQ_motq9MIUFj06YskV_0 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.272249395715768794', time=2024-09-12T20:16:23.116774+0000, chain.objs.size()=1 2024-09-12T18:33:04.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DUbsh75XTJwPz8sPy9yBEdJUIp0s9it_0 2024-09-12T18:33:04.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.330+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11747866334121221707', time=2024-09-12T20:16:23.249753+0000, chain.objs.size()=1 2024-09-12T18:33:04.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.330+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xLDJgzGL7tmvVl9qfaXtCNedKYPQT0v_0 2024-09-12T18:33:04.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.330+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18046678309346763064', time=2024-09-12T20:16:23.494016+0000, chain.objs.size()=1 2024-09-12T18:33:04.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.330+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y8QKApSIu0xKY_csZMGBHHBxQSS6ry7_0 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13936889468729232144', time=2024-09-12T20:16:23.680038+0000, chain.objs.size()=1 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7e_SfL63uEGDjR2G13k53HeVr_LmnRd_0 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10420901275381073725', time=2024-09-12T20:16:25.128358+0000, chain.objs.size()=1 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sH1kCDTPyEar9LVusKvR2YaCG0Ta6O3_0 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5469607346992431162', time=2024-09-12T20:16:25.926529+0000, chain.objs.size()=1 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CHMNGvmOW1SK26kxdlDUwztV7yLIG9g_0 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16817283039599253472', time=2024-09-12T20:16:26.172000+0000, chain.objs.size()=1 2024-09-12T18:33:04.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NN_P-4FxkP6ENKwUKKC5Sq2-Q4eUfnJ_0 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16754206750779892024', time=2024-09-12T20:16:26.676118+0000, chain.objs.size()=1 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aQJthjr61zgNPVLyuJLmmF7avMeOlns_0 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7470167488966446521', time=2024-09-12T20:16:26.752142+0000, chain.objs.size()=1 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XNNqR37Xn3_qoukRTDKopHOHoDFoHQ7_0 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2251938111783327530', time=2024-09-12T20:16:27.604611+0000, chain.objs.size()=1 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6cAUXa3G2PhBmDRVxCbwJT7iaH4158G_0 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2200615163811472689', time=2024-09-12T20:16:27.754177+0000, chain.objs.size()=1 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1QL6l2QyWKg_rttiPwHOVRI5oYrkzze_0 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295836043885150369', time=2024-09-12T20:16:28.122026+0000, chain.objs.size()=1 2024-09-12T18:33:04.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8zpSKFW65QHz3cSa-F4zJkOUJiFlozM_0 2024-09-12T18:33:04.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.339+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/49057 2024-09-12T18:33:04.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:33:04.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17587758708062826172', time=2024-09-12T20:16:28.207638+0000, chain.objs.size()=1 2024-09-12T18:33:04.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-EbE-tBzTHSxdQjPK30_O-KQzLZoTUF_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18398174530558928156', time=2024-09-12T20:16:29.832123+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MTEGooEwcdQ5_Y7GjfZxv0Bj0Xp437A_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3079088842665564994', time=2024-09-12T20:16:29.928773+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QneB2n0JqcqP0q1YwQjPIjFlK1LZJcJ_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.756519327161241119', time=2024-09-12T20:16:30.538128+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oI6DTBSFCk3XG1oaz6qLWn0WfHPoC9z_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3312526419741869276', time=2024-09-12T20:17:04.983324+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.390__shadow_.F95qP15frEmGZYW4wIUZcOvDG8m4fm4_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6322969759730450512', time=2024-09-12T20:17:57.237274+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.-WD8NsH2azlPdIl6eyiz3tiMOqgZsML_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1712634287157967490', time=2024-09-12T20:17:57.250049+0000, chain.objs.size()=1 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.qoaunHQiY9GOcWbA6n3YSBk_CGnHPPa_0 2024-09-12T18:33:04.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13089761926269267414', time=2024-09-12T20:18:01.778193+0000, chain.objs.size()=1 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.487__shadow_.Wel9i5nMV9dFGLKys0ZScDpjzWPkzWZ_0 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15293353886488859074', time=2024-09-12T20:18:01.781080+0000, chain.objs.size()=1 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.487__shadow_.Wel9i5nMV9dFGLKys0ZScDpjzWPkzWZ_0 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1001691851743655257', time=2024-09-12T20:18:52.288949+0000, chain.objs.size()=1 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.520__shadow:WqRLofNpLMTaf0-yx3lPshNs6XvZEXL_.dk_AZYmDKo2wQnRkQqAb1xwNOfknaXg_0 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO', time=2024-09-12T20:18:57.524696+0000, chain.objs.size()=2 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.1 2024-09-12T18:33:04.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.341+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__shadow_mymultipart.2~_QT4LjElTmzDGdsG6N1O5dy6h1uhiVO.1_1 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.345+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9638889500773335345', time=2024-09-12T20:19:48.960502+0000, chain.objs.size()=2 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.345+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~gZTz4Qr29n00JhE6l83S4baHLWPZCZV.1 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.345+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~gZTz4Qr29n00JhE6l83S4baHLWPZCZV.2 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.345+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9374881769411608219', time=2024-09-12T20:19:57.428407+0000, chain.objs.size()=1 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.345+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~cjaeUVrS_2Dgh5K5_WoQ82jKCVeCdC_.1 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2616484377566596913', time=2024-09-12T20:21:01.301893+0000, chain.objs.size()=3 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.552__shadow_.i0_c3kcls9vjQECxTEO8d05l6uYHDiO_0 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.552__shadow_.i0_c3kcls9vjQECxTEO8d05l6uYHDiO_1 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.552__shadow_.i0_c3kcls9vjQECxTEO8d05l6uYHDiO_2 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2544996604352388269', time=2024-09-12T20:21:32.533618+0000, chain.objs.size()=1 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:MD.GVGB7Q.EXN6ZE5N2jt0mVTZv30Pi_.MDCw2Jp7-A9ojeXHXJY3MUwZTGufVSU_0 2024-09-12T18:33:04.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15682168685522899275', time=2024-09-12T20:21:47.673380+0000, chain.objs.size()=1 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:GUXZpWnqbAREVMVgFIydzcwvDegM0eJ_.Q-wbcqaSbosVd0THo7-0sQNenLG2jX2_0 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4668802757264338820', time=2024-09-12T20:21:54.358974+0000, chain.objs.size()=1 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:VDOCVVAw5iHjwTEbZckjiPTrjy9WXXX_.NL84J8Koskh8PWeh4n3KwkbIemU94VC_0 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10860993415919848406', time=2024-09-12T20:21:57.137662+0000, chain.objs.size()=1 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:Wwn5HJKUMLpUswJ1EtjZ26OgP2REgAG_.b3_Vhq_RxyJOCF0ALiP-ZKeluB_vls3_0 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2871020315512244946', time=2024-09-12T20:22:13.569651+0000, chain.objs.size()=1 2024-09-12T18:33:04.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.346+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:Nh5BQ-vZdOZGaZGkQE7uWvEw6KTl1B2_.ZK229oKMUlmX1wjlQEMmEPSZDQcQymn_0 2024-09-12T18:33:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14415461052819825556', time=2024-09-12T20:22:33.629988+0000, chain.objs.size()=1 2024-09-12T18:33:04.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:6qkXM.SgrWj36dkPfIZYG8RDbPIOm2p_.GlfyLQiGbnvyGClyHNx-Ahlfqliwlpv_0 2024-09-12T18:33:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.349+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2992276894915389207', time=2024-09-12T20:22:39.774203+0000, chain.objs.size()=1 2024-09-12T18:33:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.349+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:r-LMUkvsrdy1hyCwJH0mCFjn.r3pttS_.JlSMyCAlSV06nIHTgmSlWYnBJxdvMG3_0 2024-09-12T18:33:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.349+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8250978258913274256', time=2024-09-12T20:23:52.294545+0000, chain.objs.size()=12 2024-09-12T18:33:04.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.349+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.1 2024-09-12T18:33:04.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.350+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.1_1 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.2 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.2_1 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.3 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.3_1 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.4 2024-09-12T18:33:04.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.4_1 2024-09-12T18:33:04.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.5 2024-09-12T18:33:04.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.5_1 2024-09-12T18:33:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.355+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__multipart_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.6 2024-09-12T18:33:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.355+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615__shadow_multipart_enc.2~LZVYP0ovWYYySPVoVdRa3URm1KPZgyl.6_1 2024-09-12T18:33:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.355+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1730062412985382694', time=2024-09-12T20:27:14.441714+0000, chain.objs.size()=1 2024-09-12T18:33:04.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.355+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.665__shadow_.IQVAJ_quSylnsqiWG_oeRxHU6i9Bsjs_0 2024-09-12T18:33:04.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.361+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.363+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:33:04.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.364+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46997' 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12284243553719050293', time=2024-09-12T20:13:08.662789+0000, chain.objs.size()=1 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.231__shadow_.Y6wiNxJbPavcq0ELx_kLKTPaW_5fjvk_0 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3108541237997637285', time=2024-09-12T20:13:10.585328+0000, chain.objs.size()=1 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.234__shadow_.kUZUgPxNOj_Ow16q-E2GeIWMQVkUfGk_0 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16748607983021035527', time=2024-09-12T20:13:15.228753+0000, chain.objs.size()=1 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.241__shadow_.4ywN2EkpmeafA4YDnV5kkalw-qbMKYO_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3293168378207234390', time=2024-09-12T20:13:18.872593+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.246__shadow_.CLLBEIaUFhNX0wyClj73_rnVWM3IUa2_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9455403546599530570', time=2024-09-12T20:13:19.493028+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.247__shadow_.aU4oFYqmB5waXcYbFHUY9yqUvb6aMa0_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7876088864290039718', time=2024-09-12T20:13:23.760909+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.254__shadow_.iSiJi7HPBc7LZSt-5OXaRJOvwtHZOin_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18074960666974473776', time=2024-09-12T20:13:24.368521+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.255__shadow_.YfA6Ax5tKC9LEf6Qcyp5NHsybo-Xn6N_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14956717591017197520', time=2024-09-12T20:14:04.028029+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2UqNh7J3qV_clG6mAVi9TJW0xNkT8wd_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5560604356510684963', time=2024-09-12T20:14:04.029421+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5IgXEevLqsPfJz-YdbeWf81DNe2kuKK_0 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2823356407662457163', time=2024-09-12T20:14:04.453371+0000, chain.objs.size()=1 2024-09-12T18:33:04.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2FDY5VVvVO6KNZL80F9r-BiuaY-hq7S_0 2024-09-12T18:33:04.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16372469909226833744', time=2024-09-12T20:14:04.650816+0000, chain.objs.size()=1 2024-09-12T18:33:04.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.59ZT0l-cwtbORtLnhYlyOB3FSRrNUWx_0 2024-09-12T18:33:04.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7014938962068834088', time=2024-09-12T20:14:04.882648+0000, chain.objs.size()=1 2024-09-12T18:33:04.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.365+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.W278yXhd_oIiwRF_YzYKK3mWW1l-Gb4_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4566658057861352995', time=2024-09-12T20:14:05.089428+0000, chain.objs.size()=1 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3mlvAvbx4i2WOxV3ENoVACyGpjE4XKM_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18046205655234543223', time=2024-09-12T20:14:06.298002+0000, chain.objs.size()=1 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qW0lpCIThnBC5P2wxY72OQTSUJGAuT5_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9335197621055581518', time=2024-09-12T20:14:06.298761+0000, chain.objs.size()=1 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4MJtxE6JbZnwXNHTlJ-Te69hE8Lo2IG_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14711331383697191717', time=2024-09-12T20:14:06.451215+0000, chain.objs.size()=1 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9A1IOzdbZDZajIivg-TcV_RbU6KQebW_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12758349640399909780', time=2024-09-12T20:14:07.451299+0000, chain.objs.size()=1 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IprUFl3jWiZ1BRO7TyzHUnvlBAKemLh_0 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8606717311803186709', time=2024-09-12T20:14:07.773920+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Aw8geFUOJnhCSnsCzESn0T7Nlj6Pdn4_0 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3234271816764825704', time=2024-09-12T20:14:07.824180+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wzUjaXT4EDMAkVe_bpRF04bWRaSrCtq_0 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8354772109814204124', time=2024-09-12T20:14:07.945203+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0DFWmRiXnam2HmsrunAYFx43Gq8Bixg_0 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4759724322944161472', time=2024-09-12T20:14:08.659835+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dm3k4BWnmZcu02g4CVlLZmzu9KNCAqX_0 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2337566320776234792', time=2024-09-12T20:14:09.434019+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dV9zf_iVOJH8wdGWxqkh-2M9b_nXCC__0 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15210601925785360869', time=2024-09-12T20:14:10.479503+0000, chain.objs.size()=1 2024-09-12T18:33:04.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fMDzrXY2SxWu6hevxNtwBod_pIIwbTq_0 2024-09-12T18:33:04.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14966122290076640340', time=2024-09-12T20:14:10.585384+0000, chain.objs.size()=1 2024-09-12T18:33:04.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.crQ6E2dNDFgMLQ84kV_ivg1hP8S6aQd_0 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12947469843335055518', time=2024-09-12T20:14:10.677185+0000, chain.objs.size()=1 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZedV0sxdzJAdFQC8rZXF_6OSxKEtRve_0 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12438396670353485840', time=2024-09-12T20:14:11.478004+0000, chain.objs.size()=1 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wEKbCcKn2NqWdNJkVxCH3o91N_QzNXC_0 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4152583609019922545', time=2024-09-12T20:14:11.599242+0000, chain.objs.size()=1 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cLbYMIRvtQ22EYJj532xRiHBZgEjHjS_0 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.998608831373129095', time=2024-09-12T20:14:11.883460+0000, chain.objs.size()=1 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aqCK0s2_71rqIaWfzEdGq-nt5Z47msF_0 2024-09-12T18:33:04.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13652019393240430519', time=2024-09-12T20:14:11.949383+0000, chain.objs.size()=1 2024-09-12T18:33:04.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jPEGw-R3PEmTpGERo_HKS3cyrfineNt_0 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11615575038389710006', time=2024-09-12T20:14:11.988244+0000, chain.objs.size()=1 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WpKRFomgD29VFkeFUFA5XcWLUBpvuTZ_0 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9580821715590784749', time=2024-09-12T20:14:13.255710+0000, chain.objs.size()=1 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6VHNqTx3oNfuIo6NnLjx6m6dwP7RaFd_0 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4733186049219470540', time=2024-09-12T20:14:13.778094+0000, chain.objs.size()=1 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.AsBXSWBuITMFum1fwfx1WuozZmTiaRn_0 2024-09-12T18:33:04.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6196249690064485583', time=2024-09-12T20:14:14.857573+0000, chain.objs.size()=1 2024-09-12T18:33:04.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qIKVTuU8SaV1dpJXK2RZsAS-dG5A0i-_0 2024-09-12T18:33:04.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2882482489658315195', time=2024-09-12T20:14:14.936394+0000, chain.objs.size()=1 2024-09-12T18:33:04.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0W2aahzbUHcaMQna0mwQQlf4k5OP5Z2_0 2024-09-12T18:33:04.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3102178713850121373', time=2024-09-12T20:14:28.263428+0000, chain.objs.size()=1 2024-09-12T18:33:04.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.284__shadow_.3znr0qYqClYX6BrEDqBLwzgLUVph-3a_0 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10492077560097059272', time=2024-09-12T20:14:36.404394+0000, chain.objs.size()=1 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.RAnUI_jmKgAKqBrdAkbzHsgrzvB3sjR_0 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3933222038413725975', time=2024-09-12T20:14:37.144092+0000, chain.objs.size()=1 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.294__shadow_.uPa_8_7lGurYYVlMBCjCT2kam6lY7DA_0 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13580795751844455416', time=2024-09-12T20:14:42.195467+0000, chain.objs.size()=1 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.302__shadow_.dzFkA3QO6Us42UNJu0-cH9oQgNhV5CT_0 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16223758840063178854', time=2024-09-12T20:14:44.011906+0000, chain.objs.size()=1 2024-09-12T18:33:04.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.383+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.305__shadow_.3b1oLEfRpV8TuCzhwyJGIraipSFSYP1_0 2024-09-12T18:33:04.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15302366945890654672', time=2024-09-12T20:15:32.816236+0000, chain.objs.size()=1 2024-09-12T18:33:04.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zWI1eYxCGTgZIo2-DFO2sHMbfX3h1iT_0 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4037360335502331131', time=2024-09-12T20:15:32.866514+0000, chain.objs.size()=1 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pCWDQq7G4GRUo3_4x-x0UNE9fen-NC-_0 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16801285219941152053', time=2024-09-12T20:15:33.992431+0000, chain.objs.size()=1 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0-vxOyusfqG_nq_2vIOYSd0ht6NfWNy_0 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.764955838526367577', time=2024-09-12T20:15:34.152716+0000, chain.objs.size()=1 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DdVjQcmohXukqMg6Yt8dt8WpCx1h7Yy_0 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18410294314441266936', time=2024-09-12T20:15:34.229665+0000, chain.objs.size()=1 2024-09-12T18:33:04.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.A6oatyXhmdA4QNqpI-zXdyur71swV2B_0 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16623955350696299494', time=2024-09-12T20:15:34.473995+0000, chain.objs.size()=1 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KnuXH7A_IgNt69AjDqP7VulihE9OMZB_0 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12849397032426274608', time=2024-09-12T20:15:35.254136+0000, chain.objs.size()=1 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CxDzwBb-_lZGy_ykZx0NsA9vata0DDa_0 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8808322030097625553', time=2024-09-12T20:15:36.212223+0000, chain.objs.size()=1 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wXGOtkhfTTVEmJoTJnuolqLLpSherar_0 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4672026703057092201', time=2024-09-12T20:15:36.212990+0000, chain.objs.size()=1 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QF7FCyeeUDhMEIqElFwoK0ZFMP7Ls4i_0 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12822996737753206185', time=2024-09-12T20:15:36.785144+0000, chain.objs.size()=1 2024-09-12T18:33:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rgOqEfyPF1GCFKGsY9UsV72c7eoEgz__0 2024-09-12T18:33:04.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4107010642903838549', time=2024-09-12T20:15:36.808910+0000, chain.objs.size()=1 2024-09-12T18:33:04.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.388+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3EQ-G04VyDV_O35NT-FsNII6xykYmOS_0 2024-09-12T18:33:04.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10882961233150148232', time=2024-09-12T20:15:37.048358+0000, chain.objs.size()=1 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1MLjDPejxqFdeiYWRqoIeyFJuhmM1q0_0 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735877318728178486', time=2024-09-12T20:15:37.238629+0000, chain.objs.size()=1 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lWvXUWg0t5YIY4MeHOhEWX95n0QvOWp_0 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5263282087691941948', time=2024-09-12T20:15:37.417203+0000, chain.objs.size()=1 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uF-2NmQr0uqs_RQuMZEzEz47MZCImwa_0 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17157022284245645028', time=2024-09-12T20:15:37.418002+0000, chain.objs.size()=1 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ai8cmdMGUiGUNO9nIIanBh3--iae9T__0 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525806977552472316', time=2024-09-12T20:15:38.409705+0000, chain.objs.size()=1 2024-09-12T18:33:04.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oULJqNPOlkJzdirg5V6Q6qbR4C8uepm_0 2024-09-12T18:33:04.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.391+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9932275789959059263', time=2024-09-12T20:15:38.817831+0000, chain.objs.size()=1 2024-09-12T18:33:04.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.391+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lD8x5E4Fiwa6YHRG6eYgha-egeuZgTv_0 2024-09-12T18:33:04.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.392+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3030116404807184856', time=2024-09-12T20:15:39.003243+0000, chain.objs.size()=1 2024-09-12T18:33:04.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.392+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lSEfTPwNWjvXDFhOWRr7HWnsPBj3643_0 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1019040468514281783', time=2024-09-12T20:15:39.062144+0000, chain.objs.size()=1 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Szghz46SYs34IUrTa9s8kxU0hsdVLXV_0 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12947051336299240813', time=2024-09-12T20:15:40.009476+0000, chain.objs.size()=1 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-ulA9Lp2K8py8ZxgoY5-D47UTo25JeL_0 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8794399539844917805', time=2024-09-12T20:15:40.986975+0000, chain.objs.size()=1 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Hz8LQGj_DVToflhrVztrgVygm91vkgK_0 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16995156789103850523', time=2024-09-12T20:15:41.250212+0000, chain.objs.size()=1 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.393+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.htXupTcT7BmxEaJhY_SZFX_5TDpLv3x_0 2024-09-12T18:33:04.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15734715650770535915', time=2024-09-12T20:15:41.658310+0000, chain.objs.size()=1 2024-09-12T18:33:04.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.j3cB70KrVYUU4WygFZC6g4cNtyRznx2_0 2024-09-12T18:33:04.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18324060265505511614', time=2024-09-12T20:15:41.785368+0000, chain.objs.size()=1 2024-09-12T18:33:04.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gy1_ROJQytvqXrgVs9qzvr-vEyXjz83_0 2024-09-12T18:33:04.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7847654528055287002', time=2024-09-12T20:15:41.802256+0000, chain.objs.size()=1 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uU1Oa8NcWqSeje-1UR3qm3pZ6eAhYhu_0 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10494038537250831146', time=2024-09-12T20:15:42.473641+0000, chain.objs.size()=1 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3Mvh0OxNK31OPkJznXfR6JCivIv2y9J_0 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5775680924972738611', time=2024-09-12T20:15:42.852298+0000, chain.objs.size()=1 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.z1hP-ADBf3EwO5A24G4TKS46DBHuXnh_0 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13643786696848297385', time=2024-09-12T20:15:42.881566+0000, chain.objs.size()=1 2024-09-12T18:33:04.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.396+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BIEg8Mbh0Wzb9ytgKQc0P1hN7WbU6K3_0 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.398+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3432169734527105964', time=2024-09-12T20:16:20.223857+0000, chain.objs.size()=1 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.398+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0-wQVrTmIckeigVNMZzW0-Xfq_GdptI_0 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.398+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4412619317101044228', time=2024-09-12T20:16:20.224677+0000, chain.objs.size()=1 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.398+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XhUnkoldzBO2SCnJOA2M2ViDHRS-0xz_0 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14558160913877588969', time=2024-09-12T20:16:20.408309+0000, chain.objs.size()=1 2024-09-12T18:33:04.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0Qs67sMwdv8R7pxFBCvme65f7ffFBgF_0 2024-09-12T18:33:04.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16184034054556080034', time=2024-09-12T20:16:20.539662+0000, chain.objs.size()=1 2024-09-12T18:33:04.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zP1gyaTF_1L9YNEKsPEqENpY-FL8JrZ_0 2024-09-12T18:33:04.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1641656614021377648', time=2024-09-12T20:16:21.746579+0000, chain.objs.size()=1 2024-09-12T18:33:04.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QuK1i3OmQGSuo4Vpu1fwC_ffH4Ob-t0_0 2024-09-12T18:33:04.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.401+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7198923226542787501', time=2024-09-12T20:16:22.424925+0000, chain.objs.size()=1 2024-09-12T18:33:04.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.401+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JT47mRdWVb19XYUcsd5U9ULFC3cKV3j_0 2024-09-12T18:33:04.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7513740472878030804', time=2024-09-12T20:16:22.425916+0000, chain.objs.size()=1 2024-09-12T18:33:04.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FOVfZbCRJfMOK46gZqQgyPc5YxoxgVi_0 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7917356362582663702', time=2024-09-12T20:16:22.659117+0000, chain.objs.size()=1 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oLHWTT-AW6kUJvwvWlhYIoMmo8n4VMY_0 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6223242596077611586', time=2024-09-12T20:16:23.186826+0000, chain.objs.size()=1 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LxIibVX1hwo2HmD2LDnnMP1zDeicNKu_0 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3365496343793742884', time=2024-09-12T20:16:23.226779+0000, chain.objs.size()=1 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NCu0i_eui1kO-EI3Oao-PyuzLF0uWJF_0 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17408388213019900422', time=2024-09-12T20:16:23.451492+0000, chain.objs.size()=1 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._h5EBJDbSTNcAAidF0NqnCzk-C97Qr3_0 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5930829689389766225', time=2024-09-12T20:16:23.975573+0000, chain.objs.size()=1 2024-09-12T18:33:04.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.K7UmC1ZygRV7vu_6G3e-2PYH79q1ALI_0 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6989748524053543576', time=2024-09-12T20:16:24.695207+0000, chain.objs.size()=1 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6wvh3WuUaq_VoyW4g4W89poAitvGpAh_0 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12783593394408946923', time=2024-09-12T20:16:24.893513+0000, chain.objs.size()=1 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-w3XrMFMUoR8wT07sIvOKZDRVS4RkYW_0 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2758452196522407621', time=2024-09-12T20:16:25.532805+0000, chain.objs.size()=1 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.403+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8uLhujD5Zn5I4N7w4dFCNwIfl0q8vph_0 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.404+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8649670061076403279', time=2024-09-12T20:16:25.930574+0000, chain.objs.size()=1 2024-09-12T18:33:04.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.404+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.c00Q46qWB9AkMTZBM7NH9NodHBpphSL_0 2024-09-12T18:33:04.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.407+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3309032653402165551', time=2024-09-12T20:16:26.216953+0000, chain.objs.size()=1 2024-09-12T18:33:04.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.407+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.q8lp_f10r7bwUxVaFOZ-wsWk4zeTx99_0 2024-09-12T18:33:04.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6896092616914262913', time=2024-09-12T20:16:27.450190+0000, chain.objs.size()=1 2024-09-12T18:33:04.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yYmgUNpwrG8Y0xaZdtVcLRuOKrmwr_w_0 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4461072633232402511', time=2024-09-12T20:16:27.641355+0000, chain.objs.size()=1 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RhhkACT3utxsZ2KyMOLghQU1c1d0wsP_0 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7893271895890737226', time=2024-09-12T20:16:27.669980+0000, chain.objs.size()=1 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.G2UwTQ17DHvbyWIT-R1_leS-Ljp2MeY_0 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113610423367288076', time=2024-09-12T20:16:27.863427+0000, chain.objs.size()=1 2024-09-12T18:33:04.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.iLJWQpaSwnMZlEXDPx2fXb88fmtR5JW_0 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16714988721692223491', time=2024-09-12T20:16:27.996109+0000, chain.objs.size()=1 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3-0y4mN8UzlwaalXM7YX3LCFPzgO9hW_0 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4321889810976735178', time=2024-09-12T20:16:29.073091+0000, chain.objs.size()=1 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fE6S0OfSSXth6A562c3Vnl0N02ubkuM_0 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3100937084923141327', time=2024-09-12T20:16:29.202262+0000, chain.objs.size()=1 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.408+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VLASZdjoSONO9ZRxFqY_7hMoGwHKER5_0 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15008744040810001502', time=2024-09-12T20:16:29.310794+0000, chain.objs.size()=1 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YBnG2pXh5utUVuwwoZkZB2o9mO3-WJw_0 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18366672103376798534', time=2024-09-12T20:16:29.759673+0000, chain.objs.size()=1 2024-09-12T18:33:04.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mTTsPWJui_VZwxpFNr6YR-0AlRZXq2P_0 2024-09-12T18:33:04.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14478242122604395835', time=2024-09-12T20:16:29.760734+0000, chain.objs.size()=1 2024-09-12T18:33:04.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.409+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MWrib5nvKj5lSOuyQmAmtLhCC8lj0ef_0 2024-09-12T18:33:04.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.411+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8153572826720322574', time=2024-09-12T20:16:29.799380+0000, chain.objs.size()=1 2024-09-12T18:33:04.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.411+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.etaVW7fk9Xpnx_iAZNB2JzY_oKbB-_n_0 2024-09-12T18:33:04.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.412+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.710674380112767867', time=2024-09-12T20:16:30.591183+0000, chain.objs.size()=1 2024-09-12T18:33:04.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.412+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bq-dbjOfxrfH_14WD9wdSsYRT3Z6_IX_0 2024-09-12T18:33:04.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.412+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3714138345776145793', time=2024-09-12T20:16:30.649775+0000, chain.objs.size()=1 2024-09-12T18:33:04.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.412+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YKvwgg3uO5_62Drn5k8V2XOHwqdzttT_0 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13471582844612577903', time=2024-09-12T20:16:30.741211+0000, chain.objs.size()=1 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.b49ID_ibC4U8h5CcUWUsOzQryiEDNp4_0 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14024813402951540820', time=2024-09-12T20:16:39.200337+0000, chain.objs.size()=1 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.340__shadow_.xI4upSns4xB-k8jrJrNZxVj-kc4DGSS_0 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15860830827541352557', time=2024-09-12T20:17:40.588376+0000, chain.objs.size()=1 2024-09-12T18:33:04.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.414+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.455__shadow_.5gJZPkXJoy94P1N_ZTu8fjcwy46HTg8_0 2024-09-12T18:33:04.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.417+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/46997 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16586822447911108024', time=2024-09-12T20:17:40.589249+0000, chain.objs.size()=1 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.455__shadow_.WImX79bKkM2WG37nnyd2WLStZJq_NAb_0 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.539462574301363965', time=2024-09-12T20:17:43.060393+0000, chain.objs.size()=1 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.458__shadow_.CHa4uDHFUftPvhuKXtox6_26Yr7lYcO_0 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16297782186389916735', time=2024-09-12T20:18:52.269046+0000, chain.objs.size()=1 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.520__shadow:NuhxYYvTK9OIbyTeHq4ROyD2A105Z4-_.uqp9Chfd_nQrR59QW3zmYzJFbUwS_dL_0 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~8YVL8Sb_31XYhT6ATG3BFeBwXBAlnf5', time=2024-09-12T20:20:14.670252+0000, chain.objs.size()=4 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.529__multipart_mymultipart.2~8YVL8Sb_31XYhT6ATG3BFeBwXBAlnf5.1 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.529__shadow_mymultipart.2~8YVL8Sb_31XYhT6ATG3BFeBwXBAlnf5.1_1 2024-09-12T18:33:04.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.529__multipart_mymultipart.2~8YVL8Sb_31XYhT6ATG3BFeBwXBAlnf5.2 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.529__shadow_mymultipart.2~8YVL8Sb_31XYhT6ATG3BFeBwXBAlnf5.2_1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8851610923321766113', time=2024-09-12T20:20:57.182229+0000, chain.objs.size()=1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.550__shadow_._oFrqRP8nRkxDgJeafuVS2bHR5uGjlR_0 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8023851977361179571', time=2024-09-12T20:21:08.563128+0000, chain.objs.size()=1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.555__shadow_.IelzoJgnDGQ2ZXZu-wkhGB45MaYDmBQ_0 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17241460112262382636', time=2024-09-12T20:21:32.842243+0000, chain.objs.size()=1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:0KPxupy0b36DFCrVzWf0J8DrTvunLYR_.FsIFcD6cmXPWfgjDtZAkGxY4Ibmn_nD_0 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.953646910740974425', time=2024-09-12T20:21:41.114238+0000, chain.objs.size()=1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.570__shadow:xqCpb7jByIJADEYMuUwahqQpUMpVdRw_.ChbOGMiQ5fddGvkwt-jY0FoZo4z90XR_0 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18037508261219351807', time=2024-09-12T20:21:41.387733+0000, chain.objs.size()=1 2024-09-12T18:33:04.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.420+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.570__shadow:6vDfxfgajvKvycO4jTzOB0rk.OwukDF_.rknikvkfi8Pa3JIHdRIPuxGElvKWP_t_0 2024-09-12T18:33:04.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.423+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14060248575631007321', time=2024-09-12T20:21:53.892318+0000, chain.objs.size()=1 2024-09-12T18:33:04.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.423+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:gSAke11iNy8d3HkrpxSFI05xlmHvTOv_.8Tm5dFeomRNx2WhYzplr_7zZ7rpyQUh_0 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7196381399908939128', time=2024-09-12T20:22:31.538040+0000, chain.objs.size()=1 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:9Ylk4vLvmKEQLecSQ29XCza1pycsQbA_.5Au3anFxGakE5HafT86qYKkkQgSW1Xy_0 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12589558918009350714', time=2024-09-12T20:22:39.732304+0000, chain.objs.size()=1 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:VBpl1f9a.bl-ZzF1mKtNUTRUthVTUn1_.QI6pmxQAEjff--M8hWqrNW4y0lJrK79_0 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16316568206818837405', time=2024-09-12T20:22:44.025128+0000, chain.objs.size()=1 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.596__shadow_.XD1-9bdaN3lgjYp7T6A1q0beKpiTBnz_0 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7373035850196266427', time=2024-09-12T20:26:28.207398+0000, chain.objs.size()=1 2024-09-12T18:33:04.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.626__shadow_.wbzwhEO68nWOf-Z3hpRd6itJxKbvf1D_0 2024-09-12T18:33:04.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17077343781093155776', time=2024-09-12T20:27:12.661540+0000, chain.objs.size()=1 2024-09-12T18:33:04.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.663__shadow_.9lLfjzLmZ1HSjg2cCQZr98KV1FEVYMU_0 2024-09-12T18:33:04.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16559018836854435926', time=2024-09-12T20:27:13.577226+0000, chain.objs.size()=1 2024-09-12T18:33:04.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.664__shadow_.gCeIKYaeJ1qtoes4bfj-iIcjS1DAsLf_0 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14886023222582902409', time=2024-09-12T20:27:27.454145+0000, chain.objs.size()=1 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.691__shadow_.T8qZoOqEw81yZYAHzvX-xtxs1UqO18t_0 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17404914480711939540', time=2024-09-12T20:27:34.670229+0000, chain.objs.size()=1 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.703__shadow:vsJU-w58SBMFtsIGxI3uPrsu7H.jvgt_.C6m75uas7dtnoCCBI0_FC0ZYFW8cGu1_0 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3085934011097424909', time=2024-09-12T20:28:22.528773+0000, chain.objs.size()=1 2024-09-12T18:33:04.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.428+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.742__multipart_mymultipart3.2~zQD6WIoBfMATGdLEegEjqq3TbiIIc9j.1 2024-09-12T18:33:04.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.434+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:33:04.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.436+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.437+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46882' 2024-09-12T18:33:04.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_unw6y_nD8znBOkx4HQMayLE7DmGNwxb', time=2024-09-12T20:11:05.695662+0000, chain.objs.size()=3 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.dEtY6aHQMcMm3Vi18gUkDDRDNG9u4Ib_0 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.dEtY6aHQMcMm3Vi18gUkDDRDNG9u4Ib_1 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.dEtY6aHQMcMm3Vi18gUkDDRDNG9u4Ib_2 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10201577537290357656', time=2024-09-12T20:11:14.000428+0000, chain.objs.size()=3 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.162__shadow_.-SvL2vfRmmw2ytfhXHC-UdCjKnh8NUg_0 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.162__shadow_.-SvL2vfRmmw2ytfhXHC-UdCjKnh8NUg_1 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.162__shadow_.-SvL2vfRmmw2ytfhXHC-UdCjKnh8NUg_2 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11491842582091645808', time=2024-09-12T20:13:12.678189+0000, chain.objs.size()=1 2024-09-12T18:33:04.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.237__shadow_.rBlbAJeyWn_6K65yAsEyc3fw-0X0-fh_0 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9588024614648122210', time=2024-09-12T20:13:12.699335+0000, chain.objs.size()=1 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.237__shadow_.dqRK5YoqEyoUPIDXwrdMcEiM3O8fTBd_0 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9712172921523940752', time=2024-09-12T20:13:13.594961+0000, chain.objs.size()=1 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.238__shadow_.87IGWNx-q0CVeEmZfr7q9GJ9fjfV3ax_0 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4139879026404207811', time=2024-09-12T20:13:19.486297+0000, chain.objs.size()=1 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.247__shadow_.vo3Z_nsLsVzEWsUpBixk_0yRYNgQ_h1_0 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3807541451309599749', time=2024-09-12T20:13:20.095147+0000, chain.objs.size()=1 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.248__shadow_.qs2R-9mWqWptCtNgRR3w21iA8wCWTEF_0 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6217577560749759609', time=2024-09-12T20:13:21.898625+0000, chain.objs.size()=1 2024-09-12T18:33:04.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.438+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.251__shadow_.-zGGrmRr1qhwuYJdPeHo0joOsf_AYcu_0 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11666502930030696902', time=2024-09-12T20:14:04.073047+0000, chain.objs.size()=1 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JRufBpNrLMTzD-oA1A_FKvDBrox_iK9_0 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8466531009830792024', time=2024-09-12T20:14:04.217458+0000, chain.objs.size()=1 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F4ineUkE55YA2tjtr2F0iLfmHbD_CgN_0 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11778455414328136840', time=2024-09-12T20:14:04.309555+0000, chain.objs.size()=1 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.e9m5S31QFGJulZYGBtBR5y7OpCNj1YW_0 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12656118961521304001', time=2024-09-12T20:14:04.854294+0000, chain.objs.size()=1 2024-09-12T18:33:04.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.441+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WB2MsHD6d-2H5ztPbPfrvZpdHDowWz6_0 2024-09-12T18:33:04.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8450338738301655555', time=2024-09-12T20:14:05.003763+0000, chain.objs.size()=1 2024-09-12T18:33:04.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wfY0O2Qxvlvm2wwIgylnudb5PlVE7Rr_0 2024-09-12T18:33:04.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14517278397991207907', time=2024-09-12T20:14:05.980502+0000, chain.objs.size()=1 2024-09-12T18:33:04.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Qscvl3yFZiQvgh_0Ydk6qxPIbZvBsci_0 2024-09-12T18:33:04.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4947813820151819918', time=2024-09-12T20:14:06.000929+0000, chain.objs.size()=1 2024-09-12T18:33:04.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.98ad5oQ2fYi0Gb_bI6GFWleLCioWZkE_0 2024-09-12T18:33:04.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5677885311274947294', time=2024-09-12T20:14:06.700929+0000, chain.objs.size()=1 2024-09-12T18:33:04.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9vMscXPFuhv62DPmbt1IjtIsbpprh1d_0 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15408941305215781145', time=2024-09-12T20:14:07.280534+0000, chain.objs.size()=1 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lE3PvxjkVgX44Xa62z16WVSTb2f6QMd_0 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16759206376649830174', time=2024-09-12T20:14:07.632679+0000, chain.objs.size()=1 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2X-hbKycx1zJr-4SP2xaTpcenGrb5fz_0 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5043144023871899220', time=2024-09-12T20:14:09.170932+0000, chain.objs.size()=1 2024-09-12T18:33:04.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.444+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LFmAX9YujM-pwoG5RW65ge69oBxJ8jd_0 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16169607286099481567', time=2024-09-12T20:14:09.637147+0000, chain.objs.size()=1 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wImsHcpNDT4Ektkoo9EUdSxJAv9yZ2n_0 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4433602986413677802', time=2024-09-12T20:14:10.060489+0000, chain.objs.size()=1 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GLdU3CKWVUmBQRi6H7reBs_h6I0SUOH_0 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9833863856516226052', time=2024-09-12T20:14:10.699818+0000, chain.objs.size()=1 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WFO6jh9VXrHwQtfIvvJqgiqPW-j3I-D_0 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13536984199960030104', time=2024-09-12T20:14:11.022050+0000, chain.objs.size()=1 2024-09-12T18:33:04.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.447+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UTZ7wOrzvEvNp6bfvpTTahvbrCGVu4s_0 2024-09-12T18:33:04.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8943534564253036661', time=2024-09-12T20:14:11.543507+0000, chain.objs.size()=1 2024-09-12T18:33:04.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._UZDBps7QqmXAIRWHnkj8WOwxe3wU0s_0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14285885726681396451', time=2024-09-12T20:14:11.775034+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.eZgDElVIXsWREEVlUy--SiJtx-htvX__0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13202778716086282282', time=2024-09-12T20:14:13.135940+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xm3eEarT6Vt_IHbXomGbO-nEtnK_vJ-_0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18203292420697996064', time=2024-09-12T20:14:13.168865+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CPCcSRFh27n16fdsh3Zg12VA1IQQkZj_0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16266373048774949080', time=2024-09-12T20:14:13.459718+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xL0uhuUqAaHfUm4cyDo0M4Gyw2FLi3b_0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6943391902809602667', time=2024-09-12T20:14:13.920926+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Rkzd1QosdTUeEfCqft3a6BsFhcRMfXv_0 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5116799655843536752', time=2024-09-12T20:14:14.336200+0000, chain.objs.size()=1 2024-09-12T18:33:04.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.449+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Gdklfz-4RmQtaQimN1ZS8XMSWstus4Q_0 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7847976326703184952', time=2024-09-12T20:14:14.502507+0000, chain.objs.size()=1 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EgDjZRXbObeB4OQhVFW5xeb0OJ8wTBp_0 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18061530396710629958', time=2024-09-12T20:14:14.903109+0000, chain.objs.size()=1 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ce9QN_0V1_Mlhau9vXPTveVcrwBw20Z_0 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6860441562456740875', time=2024-09-12T20:14:15.818827+0000, chain.objs.size()=1 2024-09-12T18:33:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.263__shadow_.G7b3MjunzekaFrG5ItMkPEbqcEw_Q0g_0 2024-09-12T18:33:04.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4471846670923264834', time=2024-09-12T20:14:36.412370+0000, chain.objs.size()=1 2024-09-12T18:33:04.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.455+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.Dsc7NLphkgf_ci80Yan6oKy57vgpuHE_0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7920869465016446239', time=2024-09-12T20:14:36.496663+0000, chain.objs.size()=1 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.WM8ttDgpNCj6fbgtOMpKXh2Gk-ht9i__0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16202356925709785841', time=2024-09-12T20:14:38.974829+0000, chain.objs.size()=1 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.297__shadow_.Sn8oZZQ_ZLfMW5ZLdMcHbAt8wafmsd3_0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17379035824636423888', time=2024-09-12T20:14:39.717962+0000, chain.objs.size()=1 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.298__shadow_.aaj0ZPd9W8rlKsfttcNCF2v-NmXVXQr_0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16324035942074556991', time=2024-09-12T20:15:32.153466+0000, chain.objs.size()=1 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.V47UVSu-D3-xDIHLVAYyjD3kGvWD-O2_0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11050837405965222323', time=2024-09-12T20:15:32.597971+0000, chain.objs.size()=1 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Q4e9TBZrD2wnPsAM56zsc9OUEAV-ucB_0 2024-09-12T18:33:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7900103326762199300', time=2024-09-12T20:15:32.666227+0000, chain.objs.size()=1 2024-09-12T18:33:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rGqdoL1aRqSGmvYvrqgUBRD4J_30Isl_0 2024-09-12T18:33:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3757644473703627280', time=2024-09-12T20:15:33.085216+0000, chain.objs.size()=1 2024-09-12T18:33:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.456+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SF1kd7bB4fsauJ9-qCCqxuMnNyHs9Le_0 2024-09-12T18:33:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.458+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.214278082696068317', time=2024-09-12T20:15:33.193436+0000, chain.objs.size()=1 2024-09-12T18:33:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.458+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rKI40zVqXj3fedwcvmxqmIM5WCU-nfZ_0 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2074951894150999455', time=2024-09-12T20:15:33.899534+0000, chain.objs.size()=1 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6_UYNX5RXhdA50uhhCNI6PB0tgnHdJN_0 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4654975006141615620', time=2024-09-12T20:15:34.515490+0000, chain.objs.size()=1 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qve4uhxhlDXt5mhaERdJgQKqlPXEINm_0 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17446452731566676858', time=2024-09-12T20:15:34.548677+0000, chain.objs.size()=1 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qhw7ppXDuNDjAT8VeH2l-fKWJhED20l_0 2024-09-12T18:33:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12703410436957496194', time=2024-09-12T20:15:34.709321+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LfRMn_s66LugKgYdrA1gblMK9DlRWnc_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9552024507614453199', time=2024-09-12T20:15:34.740336+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.55_CT6xdtISv1NiXRoHwWRax9VI4eTP_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1494928918293735775', time=2024-09-12T20:15:35.244049+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HkFneI3OQIDNlmxEbbhLhsbP1KMB_X2_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7905985081393266678', time=2024-09-12T20:15:35.442663+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.W70HCuCwm3yj_HzK8WaHtwIZWIzMBBF_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10496944633649036450', time=2024-09-12T20:15:35.658991+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.v1XrA29sZtJ4ippT3zaAzWwwblDbVSb_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11795475680426983313', time=2024-09-12T20:15:35.697224+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.URsRraNbaIlt5mzbvKrhokkdG7euEDi_0 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17977111756610439905', time=2024-09-12T20:15:35.737099+0000, chain.objs.size()=1 2024-09-12T18:33:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.461+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6SCIGeeBZv6mhC0HL-gULKUnAwrlRSA_0 2024-09-12T18:33:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.464+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.769944129888931599', time=2024-09-12T20:15:35.883642+0000, chain.objs.size()=1 2024-09-12T18:33:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.464+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ymGBGsTBoLer0Aoj9amaoeBah7io-98_0 2024-09-12T18:33:04.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.466+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7516798807730849731', time=2024-09-12T20:15:35.884521+0000, chain.objs.size()=1 2024-09-12T18:33:04.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.466+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3qEoiXV4ccN4mY8bbCgmnMDFEqvEyir_0 2024-09-12T18:33:04.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.466+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15258195451455285224', time=2024-09-12T20:15:36.010369+0000, chain.objs.size()=1 2024-09-12T18:33:04.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.466+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gR3zBYbGoZXZqM78jBtaFAj8uG1aFyx_0 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10224827676433721425', time=2024-09-12T20:15:36.202705+0000, chain.objs.size()=1 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bh3oI6nSUVzZPjFQ2ciut9Sj5RixO_w_0 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12702391995605112791', time=2024-09-12T20:15:37.399908+0000, chain.objs.size()=1 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._22gnVybvbNk0USRQ61t3SWiAYFeHhG_0 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1216304680367852661', time=2024-09-12T20:15:37.493645+0000, chain.objs.size()=1 2024-09-12T18:33:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xyLdBGXJKi_yKRQpE_-3PE37cvvQA9P_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9942558466661255662', time=2024-09-12T20:15:38.069893+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gI3aB-A_cKxIf8dhGij7718150k-P4m_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6833866259381738864', time=2024-09-12T20:15:38.173763+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uAW1ZITG3OTfu1KLGViYxlfKck9BqPi_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11707412487242782140', time=2024-09-12T20:15:38.317636+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yBCVNxwi1QyhoQHwKOr3tIQ4irObnsC_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.718395756647008089', time=2024-09-12T20:15:38.486744+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jwttFwUcXS07_9fGqWv0fYLiQIYsNvJ_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10310709189547578202', time=2024-09-12T20:15:38.789852+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.INeKz5IzkKSpqcLv02JdHhNn9_REj3M_0 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11440846133646180534', time=2024-09-12T20:15:39.417891+0000, chain.objs.size()=1 2024-09-12T18:33:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.468+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cPPbaSKwEr8ofJ68xrF3zugq6xMy7aX_0 2024-09-12T18:33:04.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7202733089916669655', time=2024-09-12T20:15:39.642242+0000, chain.objs.size()=1 2024-09-12T18:33:04.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FVoWYpDYfhe6N4rogi4bXCJ57y_6pMk_0 2024-09-12T18:33:04.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5549283273144393620', time=2024-09-12T20:15:39.726877+0000, chain.objs.size()=1 2024-09-12T18:33:04.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gqOg3cbWwN68Ec-hqYP9jTIWuWYdhdh_0 2024-09-12T18:33:04.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13064841828496020066', time=2024-09-12T20:15:39.892471+0000, chain.objs.size()=1 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5QvtUXc0JyZCbthrxKW6n9_7_NQcRwu_0 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17870220194288368096', time=2024-09-12T20:15:40.052246+0000, chain.objs.size()=1 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GjxnM5Wy5tmtEcBYr4WAUopc2BsbQ6I_0 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7704988503014661057', time=2024-09-12T20:15:40.328751+0000, chain.objs.size()=1 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vWfau7dS0akEvQIMeAsm1BB3kBFyoPR_0 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17388604562665469566', time=2024-09-12T20:15:40.454575+0000, chain.objs.size()=1 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-6iE7aIkYl8Fbvvv4pbtJMavHAPCQyZ_0 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18334962908408519101', time=2024-09-12T20:15:41.071588+0000, chain.objs.size()=1 2024-09-12T18:33:04.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dixv7dloUIxt4fRYSl_xXXk_2GDUwGE_0 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12561904689231706555', time=2024-09-12T20:15:41.102846+0000, chain.objs.size()=1 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pNNqXuND5Jlc7anGl-EChfrTw1kx85w_0 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7960159549186814281', time=2024-09-12T20:15:41.508547+0000, chain.objs.size()=1 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vDDNPlxhE7lri_07CSPwM1jmr70gVnv_0 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16171142525583413485', time=2024-09-12T20:15:41.694653+0000, chain.objs.size()=1 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6m7ivt3hrZyBUBNb-FooFnMWjCdEslH_0 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7189950817177066740', time=2024-09-12T20:15:41.801600+0000, chain.objs.size()=1 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vbTH4wRr2cMOrcUYEgOAYxuLzJKb7Bo_0 2024-09-12T18:33:04.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12462816950281266544', time=2024-09-12T20:15:42.577864+0000, chain.objs.size()=1 2024-09-12T18:33:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LSm3ZKw0H0QBJZG1lMdRjKHVoMmU8Od_0 2024-09-12T18:33:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4360719825387537959', time=2024-09-12T20:16:20.114392+0000, chain.objs.size()=1 2024-09-12T18:33:04.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.476+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mi_dGIUtwBE7vw3yS1tTibSOcd164qv_0 2024-09-12T18:33:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.481+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10664341471477964611', time=2024-09-12T20:16:20.312684+0000, chain.objs.size()=1 2024-09-12T18:33:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.481+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Ln36na2zaRG2omZNVWJ49FDWlwyuYMA_0 2024-09-12T18:33:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7202979013078562209', time=2024-09-12T20:16:20.803688+0000, chain.objs.size()=1 2024-09-12T18:33:04.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HQ2EmxdCRYeSq60Ji177Fz0Rr-MBmSt_0 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4819145499419784399', time=2024-09-12T20:16:20.828660+0000, chain.objs.size()=1 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9q639JkKz1lybYWyqivY2I-3OXEhDxl_0 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10079389634185690037', time=2024-09-12T20:16:20.951973+0000, chain.objs.size()=1 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6bAX80dwIRDsHZuGypNn9gLiakVJt-d_0 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9605055650461757284', time=2024-09-12T20:16:21.673522+0000, chain.objs.size()=1 2024-09-12T18:33:04.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UEGz73383uWtGY57XZqiNRLkMsC8y1h_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10163710268807706529', time=2024-09-12T20:16:21.823173+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.azOoblKSFfxqTELASIKz_eWmcRiyUdY_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6550521624332335731', time=2024-09-12T20:16:21.985093+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y30VsFdu6HyecNhaaT2TPd7_A2vifwM_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9019913166669233569', time=2024-09-12T20:16:22.109881+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ON1DahS4_ug10vUGL3aLI8euQgaFPLh_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16024807212548558766', time=2024-09-12T20:16:22.190683+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Ld8KE6pB51-tgsbrxiwBpZMlzknKuqL_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5957807805567255611', time=2024-09-12T20:16:22.426144+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vRY-3O0d-x45mmwbKs8jfnE3TAXaK7j_0 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11361922113975377837', time=2024-09-12T20:16:22.613459+0000, chain.objs.size()=1 2024-09-12T18:33:04.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.482+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vVHkkC1S5kgboboqJKMMNifN4rI0EkD_0 2024-09-12T18:33:04.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.486+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15654902252377074662', time=2024-09-12T20:16:22.646703+0000, chain.objs.size()=1 2024-09-12T18:33:04.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.486+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-g9xDV5dt-cQHkECf3iDBmZTB0jK2U3_0 2024-09-12T18:33:04.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.488+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7143766485599485921', time=2024-09-12T20:16:22.662543+0000, chain.objs.size()=1 2024-09-12T18:33:04.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.488+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.R84Qd1famrCop9SiVTYWLKXG7Y4sVA3_0 2024-09-12T18:33:04.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4088392801825394121', time=2024-09-12T20:16:23.227085+0000, chain.objs.size()=1 2024-09-12T18:33:04.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BxJ-1Pf3o_CcAfdPvR_sc3PhJjm-Lt3_0 2024-09-12T18:33:04.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2055514193234560987', time=2024-09-12T20:16:23.309382+0000, chain.objs.size()=1 2024-09-12T18:33:04.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NtZ95ZyvuNCTww8wYnyygZMFKDXyszy_0 2024-09-12T18:33:04.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13298392911708784469', time=2024-09-12T20:16:23.758938+0000, chain.objs.size()=1 2024-09-12T18:33:04.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.489+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lTxh9wBG995vcfcN_7Wboc6YWFARWoW_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10071816362167708219', time=2024-09-12T20:16:23.828674+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mmOhJsrrAHkNc6c8ZW9oOOZYVSIk8SU_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2930753375626157516', time=2024-09-12T20:16:23.829435+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y7lGmFAK3SjLJSMGUZqsgLhFdlfd3oe_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15442402944306327081', time=2024-09-12T20:16:23.897800+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.owxinRwygi6vgoVBaZWWHQTYhqLIs4m_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.318006778433254165', time=2024-09-12T20:16:24.523199+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GHmxZ7Mmt8d7RU1_iXqSbCoYjhokE_B_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3731482180063280294', time=2024-09-12T20:16:24.656890+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.J2MRYvIGsFTqI86bOI43PrnRaHp2yT9_0 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15031238992091530132', time=2024-09-12T20:16:26.360136+0000, chain.objs.size()=1 2024-09-12T18:33:04.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aF6tmTVJ0fNaLo3kgmJlpd3KCWfVZQ1_0 2024-09-12T18:33:04.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18186608603495137907', time=2024-09-12T20:16:26.477413+0000, chain.objs.size()=1 2024-09-12T18:33:04.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.490+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Qqkc40CA95TgPCnOVE5-0REzpgYLwGS_0 2024-09-12T18:33:04.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.496+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/46882 2024-09-12T18:33:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16851111540487203110', time=2024-09-12T20:16:26.829909+0000, chain.objs.size()=1 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.w5E4DkguggoQd3lqv8Ro4uP9XqEu5GA_0 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9379353612685180759', time=2024-09-12T20:16:27.288469+0000, chain.objs.size()=1 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vffZKp5bDUgQtKd75ozL2lCkBVX08-t_0 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2831692033751302587', time=2024-09-12T20:16:27.446044+0000, chain.objs.size()=1 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.n3X-uvdCa53sjHOWRxQ0Ew7l-2ZpRE1_0 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10258849276267420723', time=2024-09-12T20:16:27.756353+0000, chain.objs.size()=1 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tYpvHdLX1DRkhAEcPnhbpDYyxyAkaOU_0 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5871395945741492342', time=2024-09-12T20:16:27.865612+0000, chain.objs.size()=1 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.REkpFZ2cl3AH6ON0riwSEkyItXA8i4E_0 2024-09-12T18:33:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1093945451824545155', time=2024-09-12T20:16:27.893527+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5sy5ObmernbXnwTHhYiyDrptwRTRGa1_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14383374142586852959', time=2024-09-12T20:16:28.098628+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.O7HLlUnnb6T548rLWHNcifUIkAtFGvf_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11605417133611350166', time=2024-09-12T20:16:28.827739+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GnWCXk1sLW83UZl6avr0W1dJrTHRTrX_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1353525449572004361', time=2024-09-12T20:16:28.882656+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.z-nIjchuV4micJe0164yhlnneiBZfdn_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4470102898407827545', time=2024-09-12T20:16:29.216373+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yPdTESF0dZ3x_NoJB7nj-NIVw0GKU_J_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9678923799078240502', time=2024-09-12T20:16:30.558794+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LgR3jWej1atUjVgGiLSuWfB31w9d7nV_0 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6325671055452937759', time=2024-09-12T20:16:30.585802+0000, chain.objs.size()=1 2024-09-12T18:33:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-P4LBElgECGDVV75FWxpN3FmxXbb_hv_0 2024-09-12T18:33:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.501+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1212870170008165371', time=2024-09-12T20:16:30.586560+0000, chain.objs.size()=1 2024-09-12T18:33:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.501+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uZFja0fCZwZv_PaO2g1J711AVRgB9tR_0 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14547098703100904964', time=2024-09-12T20:16:30.693397+0000, chain.objs.size()=1 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3BtHnGTyICvLWYp4Bl_xL1GvcZxH8Fs_0 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13752112993485600259', time=2024-09-12T20:16:30.740200+0000, chain.objs.size()=1 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5kzL51LS_F6ZzqE9FBXhnSif_CJHv-e_0 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2066474073467142283', time=2024-09-12T20:16:40.866091+0000, chain.objs.size()=1 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.343__shadow_.zeSxKhOnh3JcbwGHbph7MnmPCJVui2j_0 2024-09-12T18:33:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9263710221506451696', time=2024-09-12T20:17:00.006934+0000, chain.objs.size()=1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.381__shadow_.ADuLU8RUvmx8QJQr2tH6EthfjdbJ52N_0 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11019697461827055930', time=2024-09-12T20:18:02.415034+0000, chain.objs.size()=1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.488__shadow_.7z-sAIOHrJ1Gu97ScVUMFMj8qk1J38F_0 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3279600317871824733', time=2024-09-12T20:18:07.878849+0000, chain.objs.size()=1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.498__shadow_.1txvxufwv7H0X_m8dYczKe6JXFM929G_0 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7629791655065314102', time=2024-09-12T20:18:24.167576+0000, chain.objs.size()=1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.513__multipart_mymultipart.2~p80sbP-4oMMQJTdbqhACH9_aIgcyicj.1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7514737282458351138', time=2024-09-12T20:18:39.945399+0000, chain.objs.size()=6 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.1 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.2 2024-09-12T18:33:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.502+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.3 2024-09-12T18:33:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.506+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.4 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.5 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.519__multipart_mymultipart.2~VOgaov-rsNrHQVeTr7w6KJ-FCEbSkJA.6 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18176459344553601845', time=2024-09-12T20:20:12.974356+0000, chain.objs.size()=4 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.528__multipart_mymultipart.2~j8Vh3JDb4zvkC0CGG3WIZj7YMJ0yRzS.1 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.508+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.528__shadow_mymultipart.2~j8Vh3JDb4zvkC0CGG3WIZj7YMJ0yRzS.1_1 2024-09-12T18:33:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.508+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.528__multipart_mymultipart.2~j8Vh3JDb4zvkC0CGG3WIZj7YMJ0yRzS.2 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.508+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.528__shadow_mymultipart.2~j8Vh3JDb4zvkC0CGG3WIZj7YMJ0yRzS.2_1 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10806186470587850537', time=2024-09-12T20:21:08.291053+0000, chain.objs.size()=3 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.555__shadow_.ekztutdDKYxB24lEtqsgWSWWTS747iw_0 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.555__shadow_.ekztutdDKYxB24lEtqsgWSWWTS747iw_1 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.555__shadow_.ekztutdDKYxB24lEtqsgWSWWTS747iw_2 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5488912147695818466', time=2024-09-12T20:21:30.370322+0000, chain.objs.size()=1 2024-09-12T18:33:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.509+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:sbL-GTqQ78zLfJN6cLEeHexYSuuy.Zb_.isSVMwhXlmZo0FBnfOMHpZErEOquOX6_0 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10042679453979685705', time=2024-09-12T20:21:42.982429+0000, chain.objs.size()=1 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.572__shadow_.z1Q_36c1rmAFtXcuFkkGEh8cwZ2Vp5J_0 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3154787099758214266', time=2024-09-12T20:22:08.820601+0000, chain.objs.size()=1 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:p7at.Otj0EkZq4dB5BrC5iDfc7bUbV2_.M6KwSOcYOYV29NSDn4nccieeYHpr3o6_0 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10609930336249493690', time=2024-09-12T20:22:14.203309+0000, chain.objs.size()=1 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:YNo2OBl5R4X87z7Y6JVb78AQuRUzjyN_.IfvaH2vPPBC0PRYsjWHw9Phxtr0eOhv_0 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9813882137900014100', time=2024-09-12T20:22:16.439260+0000, chain.objs.size()=1 2024-09-12T18:33:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.512+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:AhcFMQk-mGt19O4iHV8fkBQfAJqQOtC_.yEW2JM9-Y69pN1HKkwnTx4SJHJuBvu7_0 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13841641381131474656', time=2024-09-12T20:26:50.977268+0000, chain.objs.size()=1 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.651__shadow_.iM7H54YytwSmpXOuyW6eVqfO6xTcDcJ_0 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12495489677162863429', time=2024-09-12T20:26:55.451451+0000, chain.objs.size()=1 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.655__shadow_.pL5TFjKTM5-y_1f_GNHHAxpzjB5FQWi_0 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16431956365421226965', time=2024-09-12T20:27:21.926145+0000, chain.objs.size()=1 2024-09-12T18:33:04.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.513+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.679__shadow_.GQ_djOD8H74dEZZ9P-cycKVenFXRXy9_0 2024-09-12T18:33:04.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.515+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13483032962691105010', time=2024-09-12T20:27:28.551226+0000, chain.objs.size()=1 2024-09-12T18:33:04.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.515+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.693__shadow:i22-4VJxruvsLG3796wLwlE9S1Q4tqe_.fM4omgs87mWfuhcoHdo3T1rqzot_vyz_0 2024-09-12T18:33:04.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.518+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.521+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:33:04.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.522+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.523+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44344' 2024-09-12T18:33:04.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13709921713513060659', time=2024-09-12T20:13:08.017862+0000, chain.objs.size()=1 2024-09-12T18:33:04.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.230__shadow_.7S4NBmsKev5vZefxRdqd6uJH7EOmaKH_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1400344101243440926', time=2024-09-12T20:13:22.550679+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.252__shadow_.GA5nlJEpGVZCLP2jv9u8XFUt9RsFz3-_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6274150408589362932', time=2024-09-12T20:14:04.388180+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LsUc2zpuV-irApl67c3hQemCqixKYp9_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1505423596240652334', time=2024-09-12T20:14:04.483746+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SKBpHYpiGfTDHliR01jPfQKOhj8vNBG_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1492419748699292979', time=2024-09-12T20:14:04.546065+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._Lu9Jzpdq_M7A-3mlJNEPzLt5m0Z4Ke_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11191996849915444829', time=2024-09-12T20:14:04.739106+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.y7pE5FdbYxEQKp7k8V0KaiX7jGXS0_v_0 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3697855056735309825', time=2024-09-12T20:14:05.049706+0000, chain.objs.size()=1 2024-09-12T18:33:04.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kbjzJyG-C5FnpP59AbETFQScfSMQF94_0 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14237704084389862645', time=2024-09-12T20:14:06.693498+0000, chain.objs.size()=1 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.odNhjPxAcAPh3HJjpyXkk25KFg9S-t0_0 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13005674246053924615', time=2024-09-12T20:14:07.166080+0000, chain.objs.size()=1 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.g2isJHgJOYw8HB1GLu5tQ-oJ_qssb_A_0 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3542860650355842945', time=2024-09-12T20:14:07.266856+0000, chain.objs.size()=1 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.67hdzolXVTZ_f-3DxYzMh4B03oP0k1X_0 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3078099341029269413', time=2024-09-12T20:14:07.319611+0000, chain.objs.size()=1 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wQYrOcMwI8bZYnvv8ba1GTndAoeWCP5_0 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3679889059354417623', time=2024-09-12T20:14:07.409508+0000, chain.objs.size()=1 2024-09-12T18:33:04.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.524+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Zl5stw0KA_LAxgsoBmUGxVS3qLbUVxc_0 2024-09-12T18:33:04.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6679563461965712411', time=2024-09-12T20:14:07.426161+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JYPw19zwd_zY4Km-CnrDUce9GxUYUOW_0 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13378833856979655900', time=2024-09-12T20:14:07.633906+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VkkQVXoBn3HTAiKfma5PHHzFakj5cEL_0 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17999233143745651020', time=2024-09-12T20:14:07.634768+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EPjYl31hGJFbVt2EhUj1MZzHhx46LfM_0 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5886462452435589474', time=2024-09-12T20:14:08.786166+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gZ9uRDuEORIz5Xsqs9Gg1lMW7VrgGxA_0 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15060673460089820779', time=2024-09-12T20:14:09.135567+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QBuyvbNOdHXd350Ydo2jvlMUoD4pKgc_0 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9789133541660443785', time=2024-09-12T20:14:09.365577+0000, chain.objs.size()=1 2024-09-12T18:33:04.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.528+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ogn3TFn8cUiG0JnXVNojRUU8DRCrYaA_0 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4440533803606121522', time=2024-09-12T20:14:09.602713+0000, chain.objs.size()=1 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GCAGtEU7ijuIrAP3PAv9F5F6zJavC0H_0 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12245561399009454274', time=2024-09-12T20:14:09.606643+0000, chain.objs.size()=1 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.M1L2ERa4jkMJ7Leqy4eJqVm4pq2jzjq_0 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6402165459683579045', time=2024-09-12T20:14:10.067958+0000, chain.objs.size()=1 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hzFnwH7chG6-q-Xpvow16UxfJ3pZH9d_0 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5848682080411285345', time=2024-09-12T20:14:10.205273+0000, chain.objs.size()=1 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5OocGGrbRTMFevGHMm05fvMxJ1XAwei_0 2024-09-12T18:33:04.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.719821563802856033', time=2024-09-12T20:14:10.205840+0000, chain.objs.size()=1 2024-09-12T18:33:04.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.T9KLGdJA1G16r9K5f3YLCiVBVqTCo8c_0 2024-09-12T18:33:04.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10373344317348863054', time=2024-09-12T20:14:11.000166+0000, chain.objs.size()=1 2024-09-12T18:33:04.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9eq8MjICRr2Pb9PtaYmc8AHn6OVSAKd_0 2024-09-12T18:33:04.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17012592364610337184', time=2024-09-12T20:14:11.137613+0000, chain.objs.size()=1 2024-09-12T18:33:04.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Wh5g4KrqeqPIOTe1C5tCxYIf-kfM7B2_0 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2587650739392580671', time=2024-09-12T20:14:11.850956+0000, chain.objs.size()=1 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5TAc4j9RxTJrJZbq_xfMyUshtCc-zqw_0 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.532+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12933950645077436164', time=2024-09-12T20:14:12.343611+0000, chain.objs.size()=1 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.532+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.35FBsO_1FnfJ7lFvI3pUwDEo-dWQXPp_0 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.533+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6766098828837528616', time=2024-09-12T20:14:13.040981+0000, chain.objs.size()=1 2024-09-12T18:33:04.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.533+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xfQoOxijAnIuuPq2cmxJxkkBoliFLai_0 2024-09-12T18:33:04.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.533+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2800291887720748449', time=2024-09-12T20:14:13.325098+0000, chain.objs.size()=1 2024-09-12T18:33:04.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.533+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IW8F9CjYSraSC5DursKzCBvZz102q34_0 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17266410481202015472', time=2024-09-12T20:14:13.412104+0000, chain.objs.size()=1 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.R29h1zJkMdn3SXdv8IqfPHHTPXG37Vl_0 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1520839086790881943', time=2024-09-12T20:14:13.693553+0000, chain.objs.size()=1 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SRPQIjZOQgVMgc1Gvv9FxRg_LOQtlse_0 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16354376492054046434', time=2024-09-12T20:14:13.769216+0000, chain.objs.size()=1 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EjC_8dFZd6-zTAkmN4ZvoK6CHpM4I3L_0 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13893121901949085178', time=2024-09-12T20:14:14.862109+0000, chain.objs.size()=1 2024-09-12T18:33:04.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uZuwPgfA7-h5wiC0sq7F_w9PNKCD_vB_0 2024-09-12T18:33:04.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7685233652788805384', time=2024-09-12T20:14:18.674844+0000, chain.objs.size()=1 2024-09-12T18:33:04.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.268__shadow_.4dXrGA7Xfd2cqErTzgab4PVIWGOQLkz_0 2024-09-12T18:33:04.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15126139300580892470', time=2024-09-12T20:14:22.742373+0000, chain.objs.size()=1 2024-09-12T18:33:04.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.275__shadow_.0zIh04RQZ5QOYNKkEry2ZfdAx7g_KCz_0 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17923041438293878702', time=2024-09-12T20:14:27.652910+0000, chain.objs.size()=1 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.283__shadow_.R5jhs06hI-tjnyjTrqvFE1LVqfWvqyg_0 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7700184233113431864', time=2024-09-12T20:14:30.262794+0000, chain.objs.size()=1 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.287__shadow_.VRDr466ezWQU1UDofRKxL58vNz7Wse1_0 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7844835158462892909', time=2024-09-12T20:14:34.501952+0000, chain.objs.size()=1 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.40NmjOp-Uu3qwTj1yJcPnGfomZoDL8x_0 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4372935149417513450', time=2024-09-12T20:14:34.601051+0000, chain.objs.size()=1 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.0C3GVcgcRjg6CPb_awmyOmw9-LkKCGW_0 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12401018263168990151', time=2024-09-12T20:14:48.527013+0000, chain.objs.size()=1 2024-09-12T18:33:04.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.313__shadow_.ZIJp9YCtgwRTNkqL3hGLWt19XS4D6JM_0 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15346815053416890497', time=2024-09-12T20:15:32.336564+0000, chain.objs.size()=1 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TBLZLgPeAPKUsR412_Kn0zljU252AVz_0 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3366847628388870822', time=2024-09-12T20:15:32.462304+0000, chain.objs.size()=1 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SzkhDiGpVrxFu5PIZlfBuxL8jxcW8Lu_0 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15742594756918048081', time=2024-09-12T20:15:32.526247+0000, chain.objs.size()=1 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9t63vIS5enzpsAecMbAwBI_BTtKD5wm_0 2024-09-12T18:33:04.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13371903505794827287', time=2024-09-12T20:15:32.573163+0000, chain.objs.size()=1 2024-09-12T18:33:04.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.loOIrcL5bu3OOecfBGIR5mQ28pdt38-_0 2024-09-12T18:33:04.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1496055305903906482', time=2024-09-12T20:15:32.754173+0000, chain.objs.size()=1 2024-09-12T18:33:04.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.539+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.w3g3474VR5bquo9uVzMT3JWGqA_MH6o_0 2024-09-12T18:33:04.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.541+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14174955877804724625', time=2024-09-12T20:15:32.818288+0000, chain.objs.size()=1 2024-09-12T18:33:04.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.541+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IVrOn2IViHY1RVJw-KyagtSvCCpyXgy_0 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18424245093717442053', time=2024-09-12T20:15:32.912612+0000, chain.objs.size()=1 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3afo0jEc0fZkBhTTQ678CdS4SXqykXw_0 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.317492252357201730', time=2024-09-12T20:15:32.961094+0000, chain.objs.size()=1 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4VfJWlR4Tpaoyo0BtC63hPfmtlAt59z_0 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1992331472145231600', time=2024-09-12T20:15:33.709158+0000, chain.objs.size()=1 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oUTIPbPKHsatW58De3F41Q25V8UUH8E_0 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5220309063866965411', time=2024-09-12T20:15:34.151977+0000, chain.objs.size()=1 2024-09-12T18:33:04.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zb6JPB7S5n8DJ1H6wnPcgIc3a_17LzQ_0 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2139354086257618028', time=2024-09-12T20:15:34.250113+0000, chain.objs.size()=1 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yYWBpgl7BrVcql49Q1haX_NucL0frkU_0 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15297892671646569336', time=2024-09-12T20:15:35.694641+0000, chain.objs.size()=1 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ng4LOW9UZ00qdaVCMGLPw4r8xly0rsn_0 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17262943438357948879', time=2024-09-12T20:15:36.639734+0000, chain.objs.size()=1 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.545+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aS07SAcCY6Qede3MdTnzq0PtxO3eSan_0 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.85356664003126771', time=2024-09-12T20:15:36.640978+0000, chain.objs.size()=1 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZqHZzArlxOFN405L1LvK3eoP0AN8XrF_0 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14584619710757998018', time=2024-09-12T20:15:36.642667+0000, chain.objs.size()=1 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3_FFf7Vlm5rHaIjrLqD9pZ9cxdVRLYS_0 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11669322969643249137', time=2024-09-12T20:15:37.001019+0000, chain.objs.size()=1 2024-09-12T18:33:04.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.546+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2r-Mqg3wdL8csH-z8GPaCk7PET1l1fz_0 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.84739959855486984', time=2024-09-12T20:15:37.346731+0000, chain.objs.size()=1 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hB7jtqxVnkE86tTvajQwVUktnFnVAc4_0 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12755846960551819144', time=2024-09-12T20:15:37.638734+0000, chain.objs.size()=1 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qltHR5eHQ97xPPFh3wAJu0FUAIG99y0_0 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11154406559598737089', time=2024-09-12T20:15:38.188373+0000, chain.objs.size()=1 2024-09-12T18:33:04.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ANi60Ttw_cu2TxmEiXnJ1Gb6qCsTRSX_0 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14795042626410610887', time=2024-09-12T20:15:38.610828+0000, chain.objs.size()=1 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5kTK0r_VFtorxyx_lQWl2LY6RRygIb8_0 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6059110723447606365', time=2024-09-12T20:15:38.771228+0000, chain.objs.size()=1 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lOn5JnnWkouvk4pOiWeZ1APja057Wyo_0 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16874185715590948512', time=2024-09-12T20:15:38.818655+0000, chain.objs.size()=1 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HiTHS_ilLu3GY8r8l6d9JLVMpF874KI_0 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2806229576148631471', time=2024-09-12T20:15:38.850388+0000, chain.objs.size()=1 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ie-rLbY0V7M6Od8EJfCl5zZBxAsYg08_0 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17574080319891626834', time=2024-09-12T20:15:40.361873+0000, chain.objs.size()=1 2024-09-12T18:33:04.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.B_nhhR4GCp5bEM-2cIvWkc_OR8rTJxp_0 2024-09-12T18:33:04.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2662121568978728780', time=2024-09-12T20:15:40.984038+0000, chain.objs.size()=1 2024-09-12T18:33:04.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rRMKTLtxQJY7eLXtIIBr3vbcUHBZMH7_0 2024-09-12T18:33:04.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.552+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12084329354223815244', time=2024-09-12T20:15:41.072733+0000, chain.objs.size()=1 2024-09-12T18:33:04.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.552+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gNWbPDeu49saRTgA1mUNBu3Atg1Ko-u_0 2024-09-12T18:33:04.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.552+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10937810735498623202', time=2024-09-12T20:15:41.249420+0000, chain.objs.size()=1 2024-09-12T18:33:04.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.552+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YLQbYd-urDIKNkiq_PdHCK45pKCeOtW_0 2024-09-12T18:33:04.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.554+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.811079060831057828', time=2024-09-12T20:15:41.390038+0000, chain.objs.size()=1 2024-09-12T18:33:04.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.554+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MCXYUr0l-bjoWci2gfi5gDJLvGXU0PE_0 2024-09-12T18:33:04.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.554+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18410540699315756885', time=2024-09-12T20:15:41.612449+0000, chain.objs.size()=1 2024-09-12T18:33:04.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.554+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-bIeHIQXPEHwA3D5FuP4FTtY9UJN1dB_0 2024-09-12T18:33:04.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.555+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11376029113172023245', time=2024-09-12T20:15:41.754614+0000, chain.objs.size()=1 2024-09-12T18:33:04.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.555+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Km7TJTqt6Z8ljYOJfC6xZWYorBeHMh5_0 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2879798298776936093', time=2024-09-12T20:15:42.080886+0000, chain.objs.size()=1 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.G0PTZSurDvCONmJQXWZi8XX6d5K17Ed_0 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.340019063955451068', time=2024-09-12T20:15:42.388098+0000, chain.objs.size()=1 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fMfOoqv4C0khl9tP7YnwdOJZRlyhn0g_0 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11658774329304932788', time=2024-09-12T20:15:42.625229+0000, chain.objs.size()=1 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JjVnlCH3xnmWLJubWpUhw4M09s_fCzP_0 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8513464735314002594', time=2024-09-12T20:16:20.529583+0000, chain.objs.size()=1 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dM5atKxz4bGeNsrNxLNpCCqI8z1_ULx_0 2024-09-12T18:33:04.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16590350243542989987', time=2024-09-12T20:16:20.760577+0000, chain.objs.size()=1 2024-09-12T18:33:04.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eernLybHhLX66ucmXSQyZb6F61tdjL4_0 2024-09-12T18:33:04.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18036619911149410238', time=2024-09-12T20:16:21.039976+0000, chain.objs.size()=1 2024-09-12T18:33:04.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1qmBB5nLrgIjZnj_w5N22LW-XmQHxOF_0 2024-09-12T18:33:04.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7425302774942313702', time=2024-09-12T20:16:21.155410+0000, chain.objs.size()=1 2024-09-12T18:33:04.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gdGmhil6h7GhCvqhbvxJeedmUXK7c5O_0 2024-09-12T18:33:04.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.559+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14154931099656912764', time=2024-09-12T20:16:21.155898+0000, chain.objs.size()=1 2024-09-12T18:33:04.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.559+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kAz3jW6k3RziFPgdZEbxrFF6fNhEoFt_0 2024-09-12T18:33:04.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.559+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2672748036880962302', time=2024-09-12T20:16:22.106089+0000, chain.objs.size()=1 2024-09-12T18:33:04.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.559+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5cxTvJjbK4raBVBcaTIKoefaJ-RSWL5_0 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3513766932696947973', time=2024-09-12T20:16:22.408685+0000, chain.objs.size()=1 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pb4VeeeyWVJlCdfC3w57m5xmGDnxBlW_0 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16847779025661531055', time=2024-09-12T20:16:22.539123+0000, chain.objs.size()=1 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ecepPdm5jBah7ppk9ni5FioOroTcg75_0 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5788390300809464441', time=2024-09-12T20:16:23.190866+0000, chain.objs.size()=1 2024-09-12T18:33:04.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sYNLV6Em2z2s_5dasRXuNU0AQYbv4yf_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10912761927285708493', time=2024-09-12T20:16:23.251442+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5KRIe5qgqeS1rKBb6_P8CycZB0lBm96_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12974822457821559474', time=2024-09-12T20:16:23.563336+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ilbLIo-gw4XVeah-cLg9PxybGO6zfip_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10924417312047551958', time=2024-09-12T20:16:23.585748+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uQkL6Ni6FLGkNGO7EoxG8mx4CIgjcPz_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2588378765668703072', time=2024-09-12T20:16:23.937112+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mnUsTl19AebG4bpUwvPlNBjvci_MTXP_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5313244980676818799', time=2024-09-12T20:16:24.652659+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6awxKb1mq2CCs7XiI_1AqgsGEDzdDxF_0 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3926363366499017596', time=2024-09-12T20:16:24.823903+0000, chain.objs.size()=1 2024-09-12T18:33:04.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.560+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._a92CtuTRAsfC44E4U1NbaCE1C3wj3U_0 2024-09-12T18:33:04.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.564+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3282765211697121520', time=2024-09-12T20:16:24.868779+0000, chain.objs.size()=1 2024-09-12T18:33:04.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.564+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bXpidzOj3h2jaEsFv6wkmpmMOmRWn-E_0 2024-09-12T18:33:04.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.564+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6993457330351125262', time=2024-09-12T20:16:25.083894+0000, chain.objs.size()=1 2024-09-12T18:33:04.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.564+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fnHUJvhsBL5Er5KnkDn_z-7-hfIBgxp_0 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16991323582400027453', time=2024-09-12T20:16:25.249014+0000, chain.objs.size()=1 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hywuc_thtN8ayTFIRZZFFyfquRvILi7_0 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2287307326133863783', time=2024-09-12T20:16:25.511635+0000, chain.objs.size()=1 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.chP0xYXQmPV6E4qTxs9wObxsvzWPkBn_0 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7410511719541337874', time=2024-09-12T20:16:25.959162+0000, chain.objs.size()=1 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.isFtHeWGPKfZyHKy6rl2dJYMrCkocFz_0 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7026536699328500415', time=2024-09-12T20:16:26.219729+0000, chain.objs.size()=1 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9q7OAKbKfRJXuJXJ5wwK2YIveh5ZTCD_0 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18377663120218447877', time=2024-09-12T20:16:26.854412+0000, chain.objs.size()=1 2024-09-12T18:33:04.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lg1ND3chQRoaOKZ1qUUfmYfUqyrUqDl_0 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2989116087783437673', time=2024-09-12T20:16:26.902365+0000, chain.objs.size()=1 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zAvXtiV25I40GaxZH5emXn7Aqv23ueR_0 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14222972385901407737', time=2024-09-12T20:16:26.926659+0000, chain.objs.size()=1 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EyuVR-RspPY_hfpIsBwC0cO5WgH-Stg_0 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3533729100469052619', time=2024-09-12T20:16:27.437690+0000, chain.objs.size()=1 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.I5S91DoCxPGcMlAxU81_Wd1E_H6vLWJ_0 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11878475707497842972', time=2024-09-12T20:16:27.697132+0000, chain.objs.size()=1 2024-09-12T18:33:04.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.567+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PWicWIP_GYPIZLoxfUp4PS-0TQlOK76_0 2024-09-12T18:33:04.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.569+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5506283147863683417', time=2024-09-12T20:16:28.022933+0000, chain.objs.size()=1 2024-09-12T18:33:04.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.569+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tyojGKZSzS2cMztqDIsbEAENVAAj_Xh_0 2024-09-12T18:33:04.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.574+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/44344 2024-09-12T18:33:04.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6688912502108397571', time=2024-09-12T20:16:28.636500+0000, chain.objs.size()=1 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7OVeQFyT1iyb42g3hPsavHmN4vk_Sr5_0 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.44629541249524789', time=2024-09-12T20:16:28.678112+0000, chain.objs.size()=1 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Et-XXI_MQDVX5MY7Qd27W1RCgh5nOJO_0 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15620984660285315060', time=2024-09-12T20:16:28.682945+0000, chain.objs.size()=1 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zbEkAheNidNHWacYs3uXB7X8XRO0BIb_0 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6097275448660520687', time=2024-09-12T20:16:28.933111+0000, chain.objs.size()=1 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.579+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7HoRBbmqnu4-vz3f52oTh3bVeVt1mE1_0 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15727985311335398363', time=2024-09-12T20:16:29.136532+0000, chain.objs.size()=1 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PoBUW-nbaasjeGgYNkbg01kNYNjuYsy_0 2024-09-12T18:33:04.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5766827104877033416', time=2024-09-12T20:16:29.742425+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Njs8QH7M0alwtHKcMM529ad_1Ctadtf_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14214381312486160704', time=2024-09-12T20:16:30.409038+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QrXghPuRAP-pG99L7D7a-CySxC42l7k_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3949229214731301115', time=2024-09-12T20:16:30.750780+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ajEb3eDMl2kP-SdRtDKFeuo5ojOiEWx_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3111092713351020987', time=2024-09-12T20:16:30.783289+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9_a2OEGWdQOsru_AdZC0Y-rP4OJfRvt_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16465375758882861485', time=2024-09-12T20:16:30.806956+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ErRPSgyabT17N2h4534v1y4tz-EvNee_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12489009457105503593', time=2024-09-12T20:16:30.919325+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RszaYFPJrIICEETbMAjufbRREVVvc8c_0 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3034337475862841968', time=2024-09-12T20:16:33.003041+0000, chain.objs.size()=1 2024-09-12T18:33:04.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.580+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.328__shadow_.juVjzrUJPDy6zOTpAu8e5XU9lEZJOGa_0 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6711324564167441307', time=2024-09-12T20:16:56.572980+0000, chain.objs.size()=1 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.375__shadow_.EfEDq8DYPmhM69-q1xTYIGjJb9LFwUk_0 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6899386165344215283', time=2024-09-12T20:16:57.541643+0000, chain.objs.size()=1 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.377__shadow_.D60LDufPl7X43IbdhN6EWpO_sZNcZVX_0 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11780442633937461180', time=2024-09-12T20:17:30.154628+0000, chain.objs.size()=1 2024-09-12T18:33:04.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.437__shadow_.aqBvgfsMOpecWMH2uJCYDUvAU98VTM0_0 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1257487053890003372', time=2024-09-12T20:17:46.363665+0000, chain.objs.size()=1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.462__shadow_.AprljAGJvUvRaa0gFCtHVdekxv9j1Ub_0 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7235733993522509900', time=2024-09-12T20:17:49.740829+0000, chain.objs.size()=1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.583+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466__shadow_.i_-RPn_sV9arX93lsv4XkRimSn-7jWk_0 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14402081573089195641', time=2024-09-12T20:17:57.240104+0000, chain.objs.size()=1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.izYmLQ0FlAdc6MX8Rl7au4IwN_UNzHY_0 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~NppAdwovW6kD5mAOSJxGh8IcWRthdc_', time=2024-09-12T20:20:20.229203+0000, chain.objs.size()=1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.534__multipart_mymultipart.2~NppAdwovW6kD5mAOSJxGh8IcWRthdc_.1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12308705005525515913', time=2024-09-12T20:21:46.171706+0000, chain.objs.size()=1 2024-09-12T18:33:04.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:bpULd28fu0FYHWFHasIlg8pmsYPlcHH_.Mlgd2kYU3-EMiQkbfx1Zsfp164fcMk2_0 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9134287930545287470', time=2024-09-12T20:22:39.580975+0000, chain.objs.size()=1 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:zmDiBtS3ur4WqqQePgH70LoYoXbQppZ_.MGRnQCXBoyJh2zmZs9YukEoNMv5-y6x_0 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2182392106331321869', time=2024-09-12T20:22:50.097982+0000, chain.objs.size()=1 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.608__shadow_.yUOO0h_0uA4P3eW-XYjPtH1yQmGg7nx_0 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15741003899319883916', time=2024-09-12T20:24:53.513466+0000, chain.objs.size()=1 2024-09-12T18:33:04.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.617__shadow_.Fk7ZVW_7_kZlL2A4P7eaDxitGBppqxh_0 2024-09-12T18:33:04.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6277062133586255549', time=2024-09-12T20:26:45.558818+0000, chain.objs.size()=1 2024-09-12T18:33:04.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.647__shadow_.8sArqyZb360hwRXxRYTbjr1J9bnaJLg_0 2024-09-12T18:33:04.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11997800713323417835', time=2024-09-12T20:27:39.624019+0000, chain.objs.size()=1 2024-09-12T18:33:04.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.711__multipart_file1.2~Xdhj6-pPZtK-0AkoXUd5ExlYb6hlVpv.1 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9135873548242363121', time=2024-09-12T20:27:40.030379+0000, chain.objs.size()=1 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.712__shadow:aE8hY4X4HGzJwBJk8RoPdXM7Piz1Yfv_.e7Da3kEHN8IVSj0Q0XKuzXMVZ666erl_0 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9457979982350679491', time=2024-09-12T20:28:17.659853+0000, chain.objs.size()=10 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.1 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.2 2024-09-12T18:33:04.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.3 2024-09-12T18:33:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.4 2024-09-12T18:33:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.5 2024-09-12T18:33:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.6 2024-09-12T18:33:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.7 2024-09-12T18:33:04.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.591+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.8 2024-09-12T18:33:04.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.593+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.9 2024-09-12T18:33:04.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.593+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.735__multipart_foo.2~AQ4NATzLn0tMfEdqEdjHUqXhH1QTW6w.10 2024-09-12T18:33:04.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.595+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11826225763037877568', time=2024-09-12T20:32:43.970590+0000, chain.objs.size()=1 2024-09-12T18:33:04.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.595+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.782__shadow_.1zmc96LZ-NrcfbsbZNiHUBtr4Bn0lzT_0 2024-09-12T18:33:04.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.598+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.601+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:33:04.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.602+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.602+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53785' 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10841225493858735322', time=2024-09-12T20:10:57.505471+0000, chain.objs.size()=1 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.HbdeRAHPfH7EOBkh2pgOpKSgHNfXjHF_0 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_NhRaWCLx0KWLsqYpYLgWHJDy5jbR0GP', time=2024-09-12T20:11:05.414797+0000, chain.objs.size()=3 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.ZTeCkNJ4xEvPwvWfF5dqqQYGwuYE6wC_0 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.ZTeCkNJ4xEvPwvWfF5dqqQYGwuYE6wC_1 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.ZTeCkNJ4xEvPwvWfF5dqqQYGwuYE6wC_2 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.859112038108714997', time=2024-09-12T20:13:09.938416+0000, chain.objs.size()=1 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.233__shadow_.JyWYQ-kjd7q5YGo_D-lOLVfxFHvIove_0 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8077947017702955710', time=2024-09-12T20:13:15.235540+0000, chain.objs.size()=1 2024-09-12T18:33:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.241__shadow_.w-q1Eaukl0I8CT94QnVdlqKnTvsX0Dp_0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7255826937629700887', time=2024-09-12T20:13:27.910418+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.261__shadow_.nCipDBbohsrfNLPjLaQQWMIeOnXYlkN_0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4332399540754343620', time=2024-09-12T20:14:04.028745+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.glfjXrvP3QmCsqpn85yxx7PCyOTt7qD_0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7423479673760125787', time=2024-09-12T20:14:04.790405+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sRY9BGbti4xBTiyRdRhEFEPIPjMbaOz_0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18293515088797857613', time=2024-09-12T20:14:05.089390+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lLTE3NXdUHK6pgIlyG3yt9oaT51MVKh_0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9795867888331426635', time=2024-09-12T20:14:06.337301+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vOLp_S4fX6cfsMNNPcM3E6TCS4LXax__0 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1311929162517524718', time=2024-09-12T20:14:06.486012+0000, chain.objs.size()=1 2024-09-12T18:33:04.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9XlkpE4R1Rlkdb0ZYZF_kLdwahXHHUy_0 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.605+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13700319188859387932', time=2024-09-12T20:14:06.550751+0000, chain.objs.size()=1 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.605+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9T0Bm8CMPyHWJ_ErM2OaYifpaOFgt9g_0 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.606+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16817081281931677316', time=2024-09-12T20:14:07.903817+0000, chain.objs.size()=1 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.606+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PMGut12coEWwS81MTEN6kUQX8biM4t1_0 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.606+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17854752607524649160', time=2024-09-12T20:14:07.904604+0000, chain.objs.size()=1 2024-09-12T18:33:04.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.606+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9f44UQp3Zm2meQ0-ByLWcHRMFL7UCd1_0 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3868457019663038081', time=2024-09-12T20:14:08.741837+0000, chain.objs.size()=1 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JYa_N_z5K0CWkVYIC7Cj1Z6NZSggXwD_0 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9442028898744919905', time=2024-09-12T20:14:08.897719+0000, chain.objs.size()=1 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0NJoT0ugSNgEJPgoILtBLep9rORKjps_0 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7391591995734196618', time=2024-09-12T20:14:08.898452+0000, chain.objs.size()=1 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HN3w0rynJDH987ldKqyv1WuoMnlZlww_0 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5827488694794379991', time=2024-09-12T20:14:09.051830+0000, chain.objs.size()=1 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TYIYEUnfXu5zpbwW1vpzcyuy1_2g2TZ_0 2024-09-12T18:33:04.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15583638012485018788', time=2024-09-12T20:14:09.272422+0000, chain.objs.size()=1 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SzTWi9y8wCySogKSGyWrfs7IFhDzBRU_0 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1568841438564578879', time=2024-09-12T20:14:10.055714+0000, chain.objs.size()=1 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IIbRO0MX8cmeCgE4sTgUaJa8LgfJbTQ_0 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1968704137432267487', time=2024-09-12T20:14:10.341823+0000, chain.objs.size()=1 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hAcHvkaJUmrKXaVBn2wsCrLn_NLcxhl_0 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6466513929918865370', time=2024-09-12T20:14:10.394011+0000, chain.objs.size()=1 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Myj_SIaeL9ThLXrKVswFz3wfDjJ3JSx_0 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11140131930811731407', time=2024-09-12T20:14:11.949658+0000, chain.objs.size()=1 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MbQtHlDWdDKn1dWT4c59l6bptT65Eqg_0 2024-09-12T18:33:04.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.610+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14376159666354573375', time=2024-09-12T20:14:12.027057+0000, chain.objs.size()=1 2024-09-12T18:33:04.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.610+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Yqvg81lccbeExMGuMm4tOUumq0d6yJD_0 2024-09-12T18:33:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.612+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13814589700178450495', time=2024-09-12T20:14:12.265189+0000, chain.objs.size()=1 2024-09-12T18:33:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.612+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.msfnx1X0QppTKa82NxgkQYCMmO9UbmW_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6551783100458519209', time=2024-09-12T20:14:12.426864+0000, chain.objs.size()=1 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FKrRNmVs3IKUTeIQYhsZ6_lPrq_oFr2_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4661920522974660125', time=2024-09-12T20:14:12.494855+0000, chain.objs.size()=1 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gdOKxWTONpfUslXS_BEIg-X_u_o6NxI_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18383209168988683677', time=2024-09-12T20:14:12.845616+0000, chain.objs.size()=1 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZgbLDxPSaaY4I-f8vP473knKaQv5RQD_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18058240831894017903', time=2024-09-12T20:14:13.165347+0000, chain.objs.size()=1 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pj2Y_w0e3KAUrmFxeja14e1zpClvaNh_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12779940534793166793', time=2024-09-12T20:14:13.303222+0000, chain.objs.size()=1 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nukvVKBwHlRxLRwF4WX78i9ncmi-zaL_0 2024-09-12T18:33:04.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12975291519165538252', time=2024-09-12T20:14:13.848972+0000, chain.objs.size()=1 2024-09-12T18:33:04.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.613+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LS3x6pVJIIz3o1CVFAgR319BJUgC1x6_0 2024-09-12T18:33:04.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.614+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15366684689689459473', time=2024-09-12T20:14:13.919474+0000, chain.objs.size()=1 2024-09-12T18:33:04.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.614+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.K_8eB_wshyYE6v__av_mmPcL-KtIE4e_0 2024-09-12T18:33:04.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1052956750630765055', time=2024-09-12T20:14:14.743339+0000, chain.objs.size()=1 2024-09-12T18:33:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kdvUBNvDp7kaK7jFwmK8Mq2PksaF2_C_0 2024-09-12T18:33:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1143134847358724589', time=2024-09-12T20:14:14.744051+0000, chain.objs.size()=1 2024-09-12T18:33:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WqVQFoHdxQdqCIBH2GPl-EbKWKyQOQH_0 2024-09-12T18:33:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17001641834594728250', time=2024-09-12T20:14:14.856856+0000, chain.objs.size()=1 2024-09-12T18:33:04.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VOmfF1uSkw--yN6mkXUoy9TCuO6Hx02_0 2024-09-12T18:33:04.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.618+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17431469631642673793', time=2024-09-12T20:14:18.107433+0000, chain.objs.size()=1 2024-09-12T18:33:04.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.618+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.267__shadow_.2m6XjbFbNBdQFYJugPRvmDbmWpKgXKs_0 2024-09-12T18:33:04.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.619+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11157415942178729881', time=2024-09-12T20:14:20.384340+0000, chain.objs.size()=1 2024-09-12T18:33:04.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.619+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.271__shadow_.aSxKa0gT8hk-VCF8NWcZsCphjXWXMuy_0 2024-09-12T18:33:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13854965586347944804', time=2024-09-12T20:14:21.523435+0000, chain.objs.size()=1 2024-09-12T18:33:04.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.273__shadow_.kuM9q8B1C_moaIFMEtXK8sWlSjbAm9e_0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7920659710057183111', time=2024-09-12T20:14:23.351281+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.276__shadow_.aunNL4EhDrsW7Ojk_ap8E6XgcT-yOH__0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18247278001724148396', time=2024-09-12T20:14:23.948424+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.277__shadow_.nbxn2NoP4OKffZql3QK-hJzUlxYrSh__0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11368535485503325032', time=2024-09-12T20:14:28.263428+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.284__shadow_.CVHBlqcZxOvnyDcvA0GcHcC_elCINvD_0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16429120430010321624', time=2024-09-12T20:14:31.467700+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.289__shadow_.1-_rWC84861-2tUbJ4zPtuxNtvsuqth_0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2920421377281073872', time=2024-09-12T20:14:32.717330+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.291__shadow_.QTmq3fSbGjvu6OFLHcaYqhp5m0n3S5M_0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10404339395401437361', time=2024-09-12T20:14:34.473325+0000, chain.objs.size()=1 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.jXorVyo7DsEgFlzt7wGyK7CK2z3JCUF_0 2024-09-12T18:33:04.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.621+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17476419408159766748', time=2024-09-12T20:14:34.586432+0000, chain.objs.size()=1 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.3UKgTijqwdNh_j8RYxqid8tmSN60tVL_0 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4760650181257015139', time=2024-09-12T20:14:36.505695+0000, chain.objs.size()=1 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.x61ELs6zTUkkHZhvVQXeOrle_RMTkmm_0 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6298751954735397266', time=2024-09-12T20:14:38.356363+0000, chain.objs.size()=1 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.296__shadow_.rWpGhUmrRJd9sBLPd2GBx0kDno6yVsm_0 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1148712058508033872', time=2024-09-12T20:14:54.952971+0000, chain.objs.size()=1 2024-09-12T18:33:04.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.322__shadow_.4fzIyrz4oeIA1row-OaYf1hWmO_JvAs_0 2024-09-12T18:33:04.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1955437330607921929', time=2024-09-12T20:15:32.379693+0000, chain.objs.size()=1 2024-09-12T18:33:04.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nXgsXZKFtHIlVe0VvJSJXUJKHpvqM8R_0 2024-09-12T18:33:04.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3677380776677645110', time=2024-09-12T20:15:32.908861+0000, chain.objs.size()=1 2024-09-12T18:33:04.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0prV7XIpJx6FWQr0csHW3tNPQZ_adM5_0 2024-09-12T18:33:04.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1794896937735732386', time=2024-09-12T20:15:33.180555+0000, chain.objs.size()=1 2024-09-12T18:33:04.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LThtuC8sWemGqg3knSargFqCdxXLZHF_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7168585887076475293', time=2024-09-12T20:15:34.123889+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._MfI13qhqwdRtRTFw5O3wQJwIs6oavW_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15416845120503522335', time=2024-09-12T20:15:34.544513+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NMzTWPKTkyaN7jvkkgCxsLTmq0vv4Jw_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10503577311206056115', time=2024-09-12T20:15:35.254082+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qW2RaHcz7d7KCxXlWOBJ5aY--9gk79F_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1578454410807955451', time=2024-09-12T20:15:35.302528+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FCL-7steMJA5YeXLwB-FjKeOcae9LVY_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1120110953830585729', time=2024-09-12T20:15:35.374767+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MkI4vg9reXV0aLc0RsFk30hZEgpjVh3_0 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10403861522863116730', time=2024-09-12T20:15:35.407943+0000, chain.objs.size()=1 2024-09-12T18:33:04.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-27b4bEbpqMReohd643mBCHG-055aSU_0 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16618321711825087183', time=2024-09-12T20:15:35.969959+0000, chain.objs.size()=1 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.k_-Jj7GwXgrCJ-t5VX5T3e5rQ7rbnEW_0 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7598700145652364671', time=2024-09-12T20:15:36.014051+0000, chain.objs.size()=1 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8LBoxOWWQkKqy76ap5teR7ucmWnRkDr_0 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12406932137964349856', time=2024-09-12T20:15:36.185380+0000, chain.objs.size()=1 2024-09-12T18:33:04.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jSwjxpjA92nbEDKRas-1j_Hu652HVmP_0 2024-09-12T18:33:04.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11760361142450169236', time=2024-09-12T20:15:36.808910+0000, chain.objs.size()=1 2024-09-12T18:33:04.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dAH24R7sjt51Id4mhFVb_0mJ2kPOx5a_0 2024-09-12T18:33:04.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.631+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8272428758316915941', time=2024-09-12T20:15:36.847512+0000, chain.objs.size()=1 2024-09-12T18:33:04.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.631+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.A6mVZhCd4EjWb05c_sqqigDsgYa3LQd_0 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4076504900747002987', time=2024-09-12T20:15:37.085431+0000, chain.objs.size()=1 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MM3rkSxUaYU9tzzM7bFh8wF_eMIFwG2_0 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13581219165918788420', time=2024-09-12T20:15:37.308718+0000, chain.objs.size()=1 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.loOyNhYouAxgIdsCVWDzFbW0l9LHSeK_0 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4589663339003065704', time=2024-09-12T20:15:37.617602+0000, chain.objs.size()=1 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.sX65IZBs0R78F3aWCu2d4s2l1OZ-cEQ_0 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13619572164643934511', time=2024-09-12T20:15:38.365003+0000, chain.objs.size()=1 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0LblYJcO3XJn1hvxChJeaw1jjxL-IzY_0 2024-09-12T18:33:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1659755430010303800', time=2024-09-12T20:15:38.459052+0000, chain.objs.size()=1 2024-09-12T18:33:04.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HQXo7WO3AYkfQ35yWMxdbNXrN7fF6Fj_0 2024-09-12T18:33:04.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6451310425580869556', time=2024-09-12T20:15:39.664721+0000, chain.objs.size()=1 2024-09-12T18:33:04.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.632+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.q4aTfXLIrww7HtqTRYTTIr4uaoJ4ZON_0 2024-09-12T18:33:04.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.634+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10374978404131146109', time=2024-09-12T20:15:39.904312+0000, chain.objs.size()=1 2024-09-12T18:33:04.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.634+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GQjIvoN-fY20PWjQQvRyvZfo9V6nNz-_0 2024-09-12T18:33:04.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6001703580271947130', time=2024-09-12T20:15:39.943758+0000, chain.objs.size()=1 2024-09-12T18:33:04.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HXUjL40wMe_rVbXSidq0WCW4TKuy6Qt_0 2024-09-12T18:33:04.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17020140332630481303', time=2024-09-12T20:15:40.100468+0000, chain.objs.size()=1 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qnMvq_0kg_ZKp8FvjyUSySI0Ww59rDV_0 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.603123560921596882', time=2024-09-12T20:15:40.246759+0000, chain.objs.size()=1 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.luSW0r0gjmptW31OWDCOz8VWkdPZ_v__0 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10114128183488175162', time=2024-09-12T20:15:40.945793+0000, chain.objs.size()=1 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cHxE8eQYQZuwOaU8ak9z2MnWSLLWcK1_0 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1097001123776802362', time=2024-09-12T20:15:40.946601+0000, chain.objs.size()=1 2024-09-12T18:33:04.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.636+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1o5TXjHLGjMGr4ZpLtMufgmwW0j6KcM_0 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7608653928365166408', time=2024-09-12T20:15:41.561293+0000, chain.objs.size()=1 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.O_2mmyXSBLwsMQ-TAvecv-jzMddYC-3_0 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16093038170328080411', time=2024-09-12T20:15:41.613526+0000, chain.objs.size()=1 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YbWj_w-2ydQaM_WVvK2IaAiVZcKGA2d_0 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3260156314041556710', time=2024-09-12T20:15:41.715098+0000, chain.objs.size()=1 2024-09-12T18:33:04.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GjPNEDqv4WcImMzDy-e_fgUf_t7mLiA_0 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15113024882536192245', time=2024-09-12T20:15:42.263550+0000, chain.objs.size()=1 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Nz9Pso3NQpRa4pBWWcVEUcbFI0qzIMH_0 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12702256533424021198', time=2024-09-12T20:15:42.799011+0000, chain.objs.size()=1 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zWBEuAZ3rego_eSF8APR52rUiE_2UtZ_0 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4778783999355824738', time=2024-09-12T20:16:20.408147+0000, chain.objs.size()=1 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3v0R9BXK-N4LEovM7rACrwyAizg7-W5_0 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.639+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7315722838407980347', time=2024-09-12T20:16:20.481260+0000, chain.objs.size()=1 2024-09-12T18:33:04.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.639+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jiNF7SBXzLrP2LmsG5rnH4sBmtO6Ojy_0 2024-09-12T18:33:04.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12776635310403251462', time=2024-09-12T20:16:20.751810+0000, chain.objs.size()=1 2024-09-12T18:33:04.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PBnbXSBMsK2YVPm00Vx0GSG74if_DDY_0 2024-09-12T18:33:04.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7585408971140378922', time=2024-09-12T20:16:20.835763+0000, chain.objs.size()=1 2024-09-12T18:33:04.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uXAgcAeBgfJyMinIt-H422tU78bwhTL_0 2024-09-12T18:33:04.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14590097226346277229', time=2024-09-12T20:16:21.713919+0000, chain.objs.size()=1 2024-09-12T18:33:04.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.641+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ELZHJ_VEIJXQD60TxNStvr7Hiwu59_F_0 2024-09-12T18:33:04.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.642+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14963616487762891042', time=2024-09-12T20:16:22.094222+0000, chain.objs.size()=1 2024-09-12T18:33:04.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.642+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3bXRk6mRWgzr8IMRu2I0QCF_VNxdWQ6_0 2024-09-12T18:33:04.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.642+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7342442593100970209', time=2024-09-12T20:16:22.659108+0000, chain.objs.size()=1 2024-09-12T18:33:04.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.642+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kQreDzLTP-Wq-n3usMCvs3Js6eDeon1_0 2024-09-12T18:33:04.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.485064663380665812', time=2024-09-12T20:16:23.549262+0000, chain.objs.size()=1 2024-09-12T18:33:04.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kGmeirMzDjkXnnlw1yKCmNcarHlbt6z_0 2024-09-12T18:33:04.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5096320793019922141', time=2024-09-12T20:16:23.575213+0000, chain.objs.size()=1 2024-09-12T18:33:04.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qICE41Sp0GMyiHgKkmwbUHcoe1Dh8-s_0 2024-09-12T18:33:04.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6874751094568609166', time=2024-09-12T20:16:23.757547+0000, chain.objs.size()=1 2024-09-12T18:33:04.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.A09QNLzsz4cRiWYP6-Yn6cH10NPYos8_0 2024-09-12T18:33:04.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.535997378307686952', time=2024-09-12T20:16:23.758259+0000, chain.objs.size()=1 2024-09-12T18:33:04.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RXEV_N8i71udhyF34VuE0iyncyLIp-2_0 2024-09-12T18:33:04.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7568783580982345536', time=2024-09-12T20:16:25.294053+0000, chain.objs.size()=1 2024-09-12T18:33:04.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.643+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Pk0yDdmPOH5SCrKUcLmRHf_tBfcC81A_0 2024-09-12T18:33:04.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.645+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6486618852783599997', time=2024-09-12T20:16:26.238788+0000, chain.objs.size()=1 2024-09-12T18:33:04.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.645+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QbB5GdZgsy6_pScDBpXVFKctkMD5AsX_0 2024-09-12T18:33:04.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1677833370147326339', time=2024-09-12T20:16:26.675348+0000, chain.objs.size()=1 2024-09-12T18:33:04.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PnfpMdNdWq-Wl21DRQPwoZsF5pjuDfB_0 2024-09-12T18:33:04.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14013427340516542603', time=2024-09-12T20:16:26.780106+0000, chain.objs.size()=1 2024-09-12T18:33:04.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Io3NFiHo1lIg8LkGte0P9cdKzIlRZUq_0 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5966409418914742774', time=2024-09-12T20:16:26.803328+0000, chain.objs.size()=1 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.u4kGdYYB9AKrUsUE8NA3MwZRXL9IUEt_0 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10257735730709958956', time=2024-09-12T20:16:27.300483+0000, chain.objs.size()=1 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zULfMvafdyvMbe0J_G-M7PgDsci4_bZ_0 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13119400681690667851', time=2024-09-12T20:16:27.515021+0000, chain.objs.size()=1 2024-09-12T18:33:04.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.647+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eprruqsq0UMbx-Yv8pL7jbGBjc0Yyou_0 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10717539210967911077', time=2024-09-12T20:16:28.339278+0000, chain.objs.size()=1 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._O2sNNOmzQCYIGmuks75cQS_EeYbgQ4_0 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5448717188439523020', time=2024-09-12T20:16:28.643284+0000, chain.objs.size()=1 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tSSnvutPBCXxSaQX7MCxFsKY5WXhvaU_0 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15880962987154332583', time=2024-09-12T20:16:28.692029+0000, chain.objs.size()=1 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-1VGahyfl-f9UlOEHHSRIkddEw2ZBZQ_0 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7158833793311235216', time=2024-09-12T20:16:28.785242+0000, chain.objs.size()=1 2024-09-12T18:33:04.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.650+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4J2zPAr4SZmx54SZSjId5KmCu2zpRnG_0 2024-09-12T18:33:04.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.658+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/53785 2024-09-12T18:33:04.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:33:04.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10098901765320329032', time=2024-09-12T20:16:29.237049+0000, chain.objs.size()=1 2024-09-12T18:33:04.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yngXLyOWZhqH89CnFXG3UYWTbs073xJ_0 2024-09-12T18:33:04.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7872234519739257769', time=2024-09-12T20:16:29.649869+0000, chain.objs.size()=1 2024-09-12T18:33:04.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FbKXi_W4ygg3p7voqNsThcVvy-I0oQe_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1547783921006350735', time=2024-09-12T20:16:29.909334+0000, chain.objs.size()=1 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uwcsURT0Wy9qbOEJnE7PjV0Yk3IzOPg_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1004707230144912825', time=2024-09-12T20:16:30.351799+0000, chain.objs.size()=1 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qepfzf5pNLS5JA2p0EkGlm1vlhA3SzJ_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7561213974747636989', time=2024-09-12T20:16:30.489657+0000, chain.objs.size()=1 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TDvjs7tOVr7sG6EveeZzVtemaU_ojEA_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9574241157869759394', time=2024-09-12T20:16:30.786882+0000, chain.objs.size()=1 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.39M-f66Ov3lsPOnX4Vdu7xgWPGLNGhW_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9494282826818225624', time=2024-09-12T20:16:30.976345+0000, chain.objs.size()=1 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vXQcLk2sIotDlNA5R0ScQwBfo4FC0nr_0 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18113622944419860021', time=2024-09-12T20:17:47.189070+0000, chain.objs.size()=1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.463__shadow_.f8W1uuGASkcVH8USr9OPo-dVf2HxfzZ_0 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~8vk6Y7u9DvCNoxmtP4gixHzez-QaLnn', time=2024-09-12T20:20:19.695152+0000, chain.objs.size()=1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.533__multipart_mymultipart.2~8vk6Y7u9DvCNoxmtP4gixHzez-QaLnn.1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6795269257360105201', time=2024-09-12T20:21:09.238609+0000, chain.objs.size()=1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.556__shadow_.s9vJnTLqbOgSxcJL5Fs2-UfJdRM0486_0 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5502652970147704679', time=2024-09-12T20:21:19.055957+0000, chain.objs.size()=1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.560__shadow_.g99GjUkJsIesSXxMtsDCgKw-U4Yei6V_0 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4191934381553109173', time=2024-09-12T20:21:37.130542+0000, chain.objs.size()=1 2024-09-12T18:33:04.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:yzCN17KN9-abP74exGrEGKrZT5v38ev_.5oxe8akttDpETglhAbNKk3Rr1NssfEP_0 2024-09-12T18:33:04.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.663+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10852998284617844750', time=2024-09-12T20:21:41.339379+0000, chain.objs.size()=1 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.663+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.570__shadow:FnPMYqs60ZSG.OOqBolw90DejEXSrsN_.mYX77l1h0uve_BbzBcmjiKcDoPHxnh-_0 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.663+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11663059118846547669', time=2024-09-12T20:22:09.395649+0000, chain.objs.size()=1 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.663+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:P--CGMI42UkYYFrXCkMmQoBtWSRB1wX_.oTKKq-bBVQdeuPZWCCeX3D994l3ThlM_0 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8475610738384151007', time=2024-09-12T20:22:29.513716+0000, chain.objs.size()=4 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~-O3QX5bsoYdp2mT2R9wYq5r28QKcfas.1 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~-O3QX5bsoYdp2mT2R9wYq5r28QKcfas.2 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~-O3QX5bsoYdp2mT2R9wYq5r28QKcfas.3 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~-O3QX5bsoYdp2mT2R9wYq5r28QKcfas.4 2024-09-12T18:33:04.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17120409229042645333', time=2024-09-12T20:22:33.962119+0000, chain.objs.size()=1 2024-09-12T18:33:04.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.664+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:6qkXM.SgrWj36dkPfIZYG8RDbPIOm2p_.GlfyLQiGbnvyGClyHNx-Ahlfqliwlpv_0 2024-09-12T18:33:04.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5551935625184039738', time=2024-09-12T20:22:38.249001+0000, chain.objs.size()=1 2024-09-12T18:33:04.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.586__shadow:2yH.CBrMHMZpTPbTJ3hbVgLqJjxSLTI_.wUFWbKWsvLuCl0JBU8UgvnUb9TTKmOA_0 2024-09-12T18:33:04.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15714292835561227345', time=2024-09-12T20:22:49.565563+0000, chain.objs.size()=1 2024-09-12T18:33:04.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.607__shadow_._Vqy6qwdhz0kWUPDD8UcOPlI4VS2BB9_0 2024-09-12T18:33:04.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9468149923869078396', time=2024-09-12T20:28:03.304981+0000, chain.objs.size()=1 2024-09-12T18:33:04.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.665+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.719__shadow_.vu1PmPvcolqu0lLJJgUBiZ9U6GKtDTp_0 2024-09-12T18:33:04.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.672+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:33:04.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.673+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47879' 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10758426339685265183', time=2024-09-12T20:11:17.950776+0000, chain.objs.size()=1 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.166__shadow_.YaUKhGAKQbZ5AIWL0YFqpHQSCelNMIJ_0 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.26787233452224028', time=2024-09-12T20:13:08.657833+0000, chain.objs.size()=1 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.231__shadow_.eaXkdQQ-93uj29p2vpNk_UEtMBcp0Af_0 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5316937605558487130', time=2024-09-12T20:13:12.682407+0000, chain.objs.size()=1 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.237__shadow_.50AZgfOtq_p2iD89i34-QMoP01u2F2S_0 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13770657164561004522', time=2024-09-12T20:13:14.612323+0000, chain.objs.size()=1 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.240__shadow_.oAWs9lF27IrN6OQsXHFgVF8VulDkv7o_0 2024-09-12T18:33:04.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2553778053682810558', time=2024-09-12T20:13:21.309625+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.250__shadow_.rssJ4JIQahiuhvNJbE4f0hsxNJ_Ppxm_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6479073934214082332', time=2024-09-12T20:14:04.015043+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3bkziftoP55nL4nhKYJV4wBuLgRj_Dk_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6015559414258094211', time=2024-09-12T20:14:04.274476+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.piZsnE72bl46P-IwM26CI71QEosp3OG_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5852039710254755235', time=2024-09-12T20:14:04.650301+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.L0s4UlWhkJ3U-wRDaKsBLPqbQB6ukQy_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14426963851231965206', time=2024-09-12T20:14:05.629257+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9GzVAarb8spR1ZGcaf2k-oDtFvBj63D_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6052280359883869432', time=2024-09-12T20:14:05.995136+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.J0052gVv4GeeMbhd5KdFrwE1rK_NNdL_0 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12238190155244088884', time=2024-09-12T20:14:06.218941+0000, chain.objs.size()=1 2024-09-12T18:33:04.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3LqiwhbqQQuFlX5OLmqjUvpHA2Oh1_Z_0 2024-09-12T18:33:04.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15024964743097635238', time=2024-09-12T20:14:07.331274+0000, chain.objs.size()=1 2024-09-12T18:33:04.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.674+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2ipLRIStv2iIpkWfqkKiCWGfNcvry1Z_0 2024-09-12T18:33:04.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14926765781569743749', time=2024-09-12T20:14:07.419885+0000, chain.objs.size()=1 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uEH5bLCc-dupL-2Jw8-AJQBEgQ517jz_0 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14293596842458472239', time=2024-09-12T20:14:07.916621+0000, chain.objs.size()=1 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.f0ZoQcxBhIW5z2Qsej11bbAjMpz_nVC_0 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6263761430614743033', time=2024-09-12T20:14:07.969838+0000, chain.objs.size()=1 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vlERF8823lNYjAdr4vx7of7-n-DYGBx_0 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6413342095726900249', time=2024-09-12T20:14:08.607242+0000, chain.objs.size()=1 2024-09-12T18:33:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.678+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4vnyWfhgYUn_Y034J0hPskmgh88aWfk_0 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4144900326996218090', time=2024-09-12T20:14:08.728720+0000, chain.objs.size()=1 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZZfEmVatewBHZ18UhSOvJiB-2O584eT_0 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17120302816100181471', time=2024-09-12T20:14:08.962354+0000, chain.objs.size()=1 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cbC-W-rTVLU7-kMLZZ1JhiE8kw43JZI_0 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2501247527551141633', time=2024-09-12T20:14:09.130282+0000, chain.objs.size()=1 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vOb68cCxQ2SOhOztZDsUaB4thnQO3XD_0 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4774448777913588411', time=2024-09-12T20:14:09.268389+0000, chain.objs.size()=1 2024-09-12T18:33:04.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.679+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-RoyyjlOaKK80phHqkc9WipRE4fnWNB_0 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1969186863321628704', time=2024-09-12T20:14:09.369099+0000, chain.objs.size()=1 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HueXxrdJ8wmqkCm8khO-4e47ic0zmKs_0 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3196391706229465637', time=2024-09-12T20:14:09.428416+0000, chain.objs.size()=1 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MdppDZJhGXEW2WSr2iCDQb22789iHG1_0 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3334035309682828031', time=2024-09-12T20:14:10.209425+0000, chain.objs.size()=1 2024-09-12T18:33:04.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lh1usqfveivktY5KuCluVjM-ZRP1i1j_0 2024-09-12T18:33:04.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.681+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3516058354335458381', time=2024-09-12T20:14:10.478922+0000, chain.objs.size()=1 2024-09-12T18:33:04.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.682+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BdPZrTET21m5LqjpBkqEgvRRNsnzyXI_0 2024-09-12T18:33:04.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.682+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2415996234952759019', time=2024-09-12T20:14:10.718464+0000, chain.objs.size()=1 2024-09-12T18:33:04.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.682+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.AnII87yv-gbw2_FqmnsafvEJxDk9PeX_0 2024-09-12T18:33:04.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.682+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10703223438219726368', time=2024-09-12T20:14:12.159260+0000, chain.objs.size()=1 2024-09-12T18:33:04.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.682+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pl03-VcqCaxsGgp_x98260cVaWTFbcK_0 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9196512748319986718', time=2024-09-12T20:14:12.493806+0000, chain.objs.size()=1 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WN9VIB1zgYS68gwV29E4mqpym3kLuBE_0 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6884255800576647743', time=2024-09-12T20:14:13.533049+0000, chain.objs.size()=1 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rIAm5sY1qfA0lbW3ghHoftKFlCkK6lv_0 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6846695588151284721', time=2024-09-12T20:14:13.533654+0000, chain.objs.size()=1 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oBiTLjtBhhSEUece6BU-McpMCr6qFfl_0 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10941284119911510698', time=2024-09-12T20:14:13.617057+0000, chain.objs.size()=1 2024-09-12T18:33:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uF1pO96zP5ErWBLG6jqRYVuic3M4s4N_0 2024-09-12T18:33:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9576526787699548061', time=2024-09-12T20:14:13.889075+0000, chain.objs.size()=1 2024-09-12T18:33:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.A3Mxd7Vi-ZcL5_GWWwU-h0rdLNxi_k-_0 2024-09-12T18:33:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7635622786668202911', time=2024-09-12T20:14:13.890001+0000, chain.objs.size()=1 2024-09-12T18:33:04.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UB2lLJ3r1bMhYXTMKECg0h9tMUd_uoL_0 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10545988145182425882', time=2024-09-12T20:14:14.219512+0000, chain.objs.size()=1 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lN8aLceWe9xUU30ff8EnzyH4L43Xcq0_0 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10106914860463638839', time=2024-09-12T20:14:14.220263+0000, chain.objs.size()=1 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aN9YmNhvldHl4HyX4xrg99Mzv74iOiJ_0 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.883923601209067725', time=2024-09-12T20:14:14.638906+0000, chain.objs.size()=1 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.686+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Yt-QVS4b06WYc0C1VUWTwzizakvTiy9_0 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7592627179728445820', time=2024-09-12T20:14:15.151714+0000, chain.objs.size()=1 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VH5BuHUPL5gneZV43QhyXKqanahrxxu_0 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8391599234304877024', time=2024-09-12T20:14:15.219318+0000, chain.objs.size()=1 2024-09-12T18:33:04.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CE1yVU-vRivDn8GDI4SnG8coj-wfmx0_0 2024-09-12T18:33:04.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2112990808049857966', time=2024-09-12T20:14:19.830756+0000, chain.objs.size()=1 2024-09-12T18:33:04.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.270__shadow_.4KJyLiq1hC6WD525nd2JPlU8N70aF89_0 2024-09-12T18:33:04.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3032072863620003618', time=2024-09-12T20:14:34.460310+0000, chain.objs.size()=1 2024-09-12T18:33:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.wJuxnOk-a1WhaCIfOiNuo_8VqVi4F2T_0 2024-09-12T18:33:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13126735265475800078', time=2024-09-12T20:14:34.583943+0000, chain.objs.size()=1 2024-09-12T18:33:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.HMo-WCQAwqPrxByPGcmv7HAUbVZckno_0 2024-09-12T18:33:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3887417286131231524', time=2024-09-12T20:14:36.406794+0000, chain.objs.size()=1 2024-09-12T18:33:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.690+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.65h3wk8SG0efpLr_f-PXebTMfMR6GIG_0 2024-09-12T18:33:04.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5654265187868504355', time=2024-09-12T20:14:38.974436+0000, chain.objs.size()=1 2024-09-12T18:33:04.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.297__shadow_.PZoJd2Zx7_-HdhP3YOriMKy05iGmWid_0 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8559586604693407455', time=2024-09-12T20:14:39.711144+0000, chain.objs.size()=1 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.298__shadow_.cv1YYHF-p4LfXCvySNIfh04U2fdJFXq_0 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17719669133851479252', time=2024-09-12T20:14:42.200719+0000, chain.objs.size()=1 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.302__shadow_.R-7AsU5LdSHNvuzosWz5ohc1AL7fsv7_0 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9234866487932789095', time=2024-09-12T20:15:32.626228+0000, chain.objs.size()=1 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iI4A8HlJSMFjpZtXI1N6q__J_Wd4gvu_0 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6877602242872706753', time=2024-09-12T20:15:32.849397+0000, chain.objs.size()=1 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IN_DPCE59zrORWF5K7V-T3nXF7JL6-i_0 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5501845278047277337', time=2024-09-12T20:15:33.116744+0000, chain.objs.size()=1 2024-09-12T18:33:04.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3Yuus6Ao9Lx_suQ98mzmzpq-poVFmoN_0 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4418191994876897228', time=2024-09-12T20:15:33.734555+0000, chain.objs.size()=1 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.izHFTaQEqFrYRPa9WGwq8B25FOtxDsS_0 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6749779240596535589', time=2024-09-12T20:15:33.996544+0000, chain.objs.size()=1 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SnmOGu8KcrC7-bXhwn65DAaY0gZLntm_0 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17807608884414624273', time=2024-09-12T20:15:33.997270+0000, chain.objs.size()=1 2024-09-12T18:33:04.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.d4aNcwHhT2UqPlD1OnaLEmFSIGH_T4I_0 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11512577049009195097', time=2024-09-12T20:15:34.632331+0000, chain.objs.size()=1 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8MJQHPVB3t47MYnop5GmaS3_-Y9hJ_G_0 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4151400495185285843', time=2024-09-12T20:15:34.667913+0000, chain.objs.size()=1 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.693+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J9ks-p1_59xoLd9_UMng2DLlRDhrabQ_0 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.695+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16919417596357566165', time=2024-09-12T20:15:35.190601+0000, chain.objs.size()=1 2024-09-12T18:33:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.695+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n4oCm-BL_Mil0L7iWp7fBIPfreZ-cfa_0 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13505876936483774271', time=2024-09-12T20:15:35.654346+0000, chain.objs.size()=1 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Z3R4fKwvo6tjxJ6hxFzfgYAD__qsiLI_0 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17811785253100851737', time=2024-09-12T20:15:35.800982+0000, chain.objs.size()=1 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PTqJSOVu6ts1kEuFVhU_74ehaJjElBe_0 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15088185940952564220', time=2024-09-12T20:15:35.996909+0000, chain.objs.size()=1 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.geb_Wxm4KKtbFMUcuKRSPDBIuxeFPxE_0 2024-09-12T18:33:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7578802686363926627', time=2024-09-12T20:15:36.972877+0000, chain.objs.size()=1 2024-09-12T18:33:04.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qa2kCASTvD6Z7beOEpn5N2fbFY7i_Nk_0 2024-09-12T18:33:04.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17002975513981142494', time=2024-09-12T20:15:37.309919+0000, chain.objs.size()=1 2024-09-12T18:33:04.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Pxsv4qAETqcq-TROZUry1UyI-GSExUI_0 2024-09-12T18:33:04.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13263202231955892018', time=2024-09-12T20:15:38.073228+0000, chain.objs.size()=1 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.o26eFUXBAm5bLmIHzXrcTwvRKmPF7m7_0 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6983048515914821002', time=2024-09-12T20:15:38.174007+0000, chain.objs.size()=1 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iI9o1TTUy6rKAJJ8eJTnhlfd1F0ACYC_0 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.547140152563865252', time=2024-09-12T20:15:39.001023+0000, chain.objs.size()=1 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1Ak5VXgIMxnJ8kgiyuvGpoOHbTW0XKV_0 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4346054149653010083', time=2024-09-12T20:15:39.417708+0000, chain.objs.size()=1 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.U-e2nYvFloe7JuD2bf_b_hjVkuhJng3_0 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13832671510111289340', time=2024-09-12T20:15:39.435406+0000, chain.objs.size()=1 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gUggtuEIFotpPA7U4tMUuZyvBuAlYwI_0 2024-09-12T18:33:04.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6475360948880635914', time=2024-09-12T20:15:39.654964+0000, chain.objs.size()=1 2024-09-12T18:33:04.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.u3j3APGElwUelFKZAECWTDjPeIi7pQt_0 2024-09-12T18:33:04.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1488590506281306147', time=2024-09-12T20:15:40.053340+0000, chain.objs.size()=1 2024-09-12T18:33:04.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GqQq7i5aC2RhY4WaC5N31ebt3tMtvhW_0 2024-09-12T18:33:04.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.702+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8684783982720587345', time=2024-09-12T20:15:40.897982+0000, chain.objs.size()=1 2024-09-12T18:33:04.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.702+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8Itit9iaelWN_T0TVu9_ohNBVYMUxAC_0 2024-09-12T18:33:04.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.702+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11970775573328492302', time=2024-09-12T20:15:41.066355+0000, chain.objs.size()=1 2024-09-12T18:33:04.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.702+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qppGicxoXWDn8lbvXdffImJBcVG-CFZ_0 2024-09-12T18:33:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6148621971892348562', time=2024-09-12T20:15:41.756293+0000, chain.objs.size()=1 2024-09-12T18:33:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qMmYetePv5UyrioRu7l_4ZFPzVbWxoS_0 2024-09-12T18:33:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5573912062481157906', time=2024-09-12T20:15:42.237635+0000, chain.objs.size()=1 2024-09-12T18:33:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4DHwxikDWMKHM5SR4VuwouznghSHtCl_0 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14201130912565276066', time=2024-09-12T20:15:42.287339+0000, chain.objs.size()=1 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0LBlOGO2z3iu3WHI_A8-mjUSS9czOX5_0 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4111247083620254588', time=2024-09-12T20:15:42.436605+0000, chain.objs.size()=1 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MR7RRZms9RJ7qHtd9dry6_jjPlvA1yi_0 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11503194952392036908', time=2024-09-12T20:15:42.472289+0000, chain.objs.size()=1 2024-09-12T18:33:04.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.704+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SbtlDvDkFy-bJ-YnEMpNQsVk8LfBBUM_0 2024-09-12T18:33:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10062546738739275452', time=2024-09-12T20:15:42.639626+0000, chain.objs.size()=1 2024-09-12T18:33:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.amKqrkhswwTSDuUxyV0S6UMFdKqqBwi_0 2024-09-12T18:33:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.997730018352699299', time=2024-09-12T20:15:42.859756+0000, chain.objs.size()=1 2024-09-12T18:33:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nPbkgrLHD6XjqDLcOX24aw6PQvUqqsY_0 2024-09-12T18:33:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.41597474622246958', time=2024-09-12T20:16:20.125038+0000, chain.objs.size()=1 2024-09-12T18:33:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.02b-93SzIrp2Hz46JwEgyWd7YKSBnaM_0 2024-09-12T18:33:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1734148195807484906', time=2024-09-12T20:16:20.255055+0000, chain.objs.size()=1 2024-09-12T18:33:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mkyy3PnVrJ7YKj7hP-LjDJh9A7I62i__0 2024-09-12T18:33:04.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14230346803672442661', time=2024-09-12T20:16:20.398037+0000, chain.objs.size()=1 2024-09-12T18:33:04.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZnVutlMV5hJh1UQhm8hBgLAdcuVt81c_0 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17278628397265037734', time=2024-09-12T20:16:20.721222+0000, chain.objs.size()=1 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.E5A3Cwk8waLZMVNd8Y4YxBNBZXBJQn-_0 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5978677741108397852', time=2024-09-12T20:16:21.096077+0000, chain.objs.size()=1 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F7RMlQaBi826-hbmg7uHgsUCMmz8hJV_0 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13477822389999152317', time=2024-09-12T20:16:21.650167+0000, chain.objs.size()=1 2024-09-12T18:33:04.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pmeDPlXyorTkzaXG_ah9u5oWfb7um9z_0 2024-09-12T18:33:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5273177170627344577', time=2024-09-12T20:16:22.242589+0000, chain.objs.size()=1 2024-09-12T18:33:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.euvhUH4rfrEryB05Ip86gWfe9PbJaOx_0 2024-09-12T18:33:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13668045854112090405', time=2024-09-12T20:16:22.330491+0000, chain.objs.size()=1 2024-09-12T18:33:04.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JvEfEV4S7Vm_jfAnSr42hH76pRjAGh1_0 2024-09-12T18:33:04.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8659879731353182684', time=2024-09-12T20:16:22.543130+0000, chain.objs.size()=1 2024-09-12T18:33:04.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.710+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DefpB5WMEzSfUqAXoYWLPKJaQSiFw0r_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5439281612618583772', time=2024-09-12T20:16:22.562470+0000, chain.objs.size()=1 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8xT8m6KmdoA8vX_r-ZIxmdFTMWoWqQP_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9508235195244735961', time=2024-09-12T20:16:23.547930+0000, chain.objs.size()=1 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JwtJ4van6d2VHZTPJYBVDe0chz-wXK0_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5298336033943474630', time=2024-09-12T20:16:23.743578+0000, chain.objs.size()=1 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0NdNGyV8lWmJDPBb1o5zWwiggJXZNjB_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4666941469229095659', time=2024-09-12T20:16:24.829845+0000, chain.objs.size()=1 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5H8fgLU1Trvo-ARBUoUJ3yxd1RlAbct_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17192839589598253320', time=2024-09-12T20:16:26.355802+0000, chain.objs.size()=1 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5QY-mV1LuSQQPmvJkKVyvDYyX8JVDgR_0 2024-09-12T18:33:04.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12407928679107113565', time=2024-09-12T20:16:26.826397+0000, chain.objs.size()=1 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.t4EKHoz2j8jGZMenA0Wo3PER_LZqv40_0 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1705353541209208779', time=2024-09-12T20:16:26.904909+0000, chain.objs.size()=1 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JuFF6XyMZBBG4ApKn33iXPWJtbMqugh_0 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7251383376937094357', time=2024-09-12T20:16:27.359457+0000, chain.objs.size()=1 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.m5gapCot9pLT_3I8WB3tgA3BaKjP2Bd_0 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6978397706395979995', time=2024-09-12T20:16:27.490020+0000, chain.objs.size()=1 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.O1gYrF6oeJ5RHpHbEYZW7zpp9fnMXqF_0 2024-09-12T18:33:04.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8291641650295915751', time=2024-09-12T20:16:27.629143+0000, chain.objs.size()=1 2024-09-12T18:33:04.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vvUb_zXHF5L_LdQcGpsz-TsrDF8BGn7_0 2024-09-12T18:33:04.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6367342706888331790', time=2024-09-12T20:16:27.630014+0000, chain.objs.size()=1 2024-09-12T18:33:04.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.715+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5ucF281oLkLv72Maz2w103V9S_QibIS_0 2024-09-12T18:33:04.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12161106734589165146', time=2024-09-12T20:16:27.826409+0000, chain.objs.size()=1 2024-09-12T18:33:04.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.h5GqAbcpNBnzcHUMhLxwGQtBXRfNEYX_0 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9026667729909480961', time=2024-09-12T20:16:28.700840+0000, chain.objs.size()=1 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BE3FLei0zecI3UT5JQ0V_JqQ8_vVo4s_0 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2697935421150608648', time=2024-09-12T20:16:28.911489+0000, chain.objs.size()=1 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F7BXrnIrovf9UpM1zUZo-M2fxi4QQQ__0 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17750093663983683713', time=2024-09-12T20:16:29.096134+0000, chain.objs.size()=1 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IGwC8eTptg1-_fV7S4pGqftiTl3vg3w_0 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2617756924057615606', time=2024-09-12T20:16:29.313710+0000, chain.objs.size()=1 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.s5-zk-VGf2zqXD3uwvlcxOXrjcIkotL_0 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12883204550087314789', time=2024-09-12T20:16:30.256508+0000, chain.objs.size()=1 2024-09-12T18:33:04.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.721+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vvZNf2RXI7bytODeN9Ax2MgPnYYeDL4_0 2024-09-12T18:33:04.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/47879 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8907173505343193798', time=2024-09-12T20:16:37.905886+0000, chain.objs.size()=1 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.337__shadow_.myGeZWSaBhvu9gYOxQ3dNQzHvhFTX55_0 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5307681565070419588', time=2024-09-12T20:17:04.986150+0000, chain.objs.size()=1 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.390__shadow_.YIywKDlb_8hEEbCMGCXHvfePgO41bM9_0 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.368920904596354137', time=2024-09-12T20:17:49.734277+0000, chain.objs.size()=1 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466__shadow_.k_quAxCEA_4GoHkx-cJpHwgTSCdlMcW_0 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17645628538801102875', time=2024-09-12T20:17:57.258059+0000, chain.objs.size()=1 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.A4qNNQO74EZlkr4UalhV52DMxSarDNB_0 2024-09-12T18:33:04.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10282840829204747701', time=2024-09-12T20:17:57.944728+0000, chain.objs.size()=1 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484__shadow_.u2onpi4K5SfzfIE-uDOkMHXz3AgyLN4_0 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13502880009406408879', time=2024-09-12T20:18:09.040817+0000, chain.objs.size()=1 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.500__shadow_.H32a70XjJuNS6vYqQiEZu7J8cQ3R2Iz_0 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8778056769336534643', time=2024-09-12T20:18:20.715012+0000, chain.objs.size()=6 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:04.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:04.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14506398812800564281', time=2024-09-12T20:18:20.958711+0000, chain.objs.size()=6 2024-09-12T18:33:04.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.1 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.2 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.3 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.4 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.731+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.5 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.507__multipart_srcmultipart.2~ZfXW3VFm9-IfuZZbdUYPteYfvIvX8En.6 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7001558361342967707', time=2024-09-12T20:21:09.742669+0000, chain.objs.size()=1 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.556__shadow_.AEh6Be1oILGZPOnBHGQ7PHG3s58Sr61_0 2024-09-12T18:33:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10414755247196726102', time=2024-09-12T20:21:18.355146+0000, chain.objs.size()=1 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.559__shadow_.zydMm-tNNoI4c8a-W80wLwuzezOAWhV_0 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8528496963605868940', time=2024-09-12T20:21:38.948162+0000, chain.objs.size()=1 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:gv.p53uA4PHQHoIeZpUo9HyPJcQhZBX_.S_tmt0JLry38jAKGvUmCUfL589NrBQV_0 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14483440959206356077', time=2024-09-12T20:21:41.435360+0000, chain.objs.size()=1 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.570__shadow:Jn5Y9zxCyNowsb.yXnh-RH4buiZeLXS_.G7i54uo8XHVC7aQe2SnMQsA6u4bKSSD_0 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13614697362237826986', time=2024-09-12T20:22:31.582342+0000, chain.objs.size()=1 2024-09-12T18:33:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.732+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:ZKAA8Q6B2fR1xBYlYSuCe1XWm9ipaAk_.ZQK1J5uKTcgLREc3Qt-D2STQk02t695_0 2024-09-12T18:33:04.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5850336237732818944', time=2024-09-12T20:22:37.333900+0000, chain.objs.size()=1 2024-09-12T18:33:04.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.585__shadow:4DIAs93HdW2kDh75McA9b-jNimxyOPQ_.rm49A49E4werEcRWoijE7gcifFxBzUu_0 2024-09-12T18:33:04.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7456417275495096145', time=2024-09-12T20:26:30.654486+0000, chain.objs.size()=1 2024-09-12T18:33:04.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.630__shadow_.pxwxqHEu82-3-mCtDcHRCEE6pYITEoc_0 2024-09-12T18:33:04.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5102651892793309304', time=2024-09-12T20:26:34.632789+0000, chain.objs.size()=1 2024-09-12T18:33:04.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.637__shadow_.cZlHxl6Poy672RY931Wllvw2PuSENMw_0 2024-09-12T18:33:04.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10387613137147143371', time=2024-09-12T20:27:32.718151+0000, chain.objs.size()=1 2024-09-12T18:33:04.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.738+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.700__shadow:O3AdEQ1T7VMpBa4NRb5ZwsYkjJ8eBmF_.qkRGZmwF-63LXxEQOxPNbvXN4vcngPt_0 2024-09-12T18:33:04.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.741+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.744+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:33:04.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.745+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50912' 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7705048682419855476', time=2024-09-12T20:11:01.453810+0000, chain.objs.size()=5 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-LUKEWARM.2~yyXrPdc_RnaTnVP_J_4MJzAZrlDQ6PD.1 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__shadow_mymultipart-LUKEWARM.2~yyXrPdc_RnaTnVP_J_4MJzAZrlDQ6PD.1_1 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-LUKEWARM.2~yyXrPdc_RnaTnVP_J_4MJzAZrlDQ6PD.2 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__shadow_mymultipart-LUKEWARM.2~yyXrPdc_RnaTnVP_J_4MJzAZrlDQ6PD.2_1 2024-09-12T18:33:04.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-LUKEWARM.2~yyXrPdc_RnaTnVP_J_4MJzAZrlDQ6PD.3 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2900912087289534196', time=2024-09-12T20:11:01.480906+0000, chain.objs.size()=3 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-STANDARD.2~rfMZZYAHqgRVCoKHy2dLuFT9_C4-8Yq.1 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-STANDARD.2~rfMZZYAHqgRVCoKHy2dLuFT9_C4-8Yq.2 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.159__multipart_mymultipart-STANDARD.2~rfMZZYAHqgRVCoKHy2dLuFT9_C4-8Yq.3 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3290293061933038741', time=2024-09-12T20:13:20.085336+0000, chain.objs.size()=1 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.248__shadow_.6934E-Wphdcw20VMkRp9HHURXffp9o-_0 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4716045752877804538', time=2024-09-12T20:13:26.094091+0000, chain.objs.size()=1 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.258__shadow_.CxXkLPTyJ9wpSCjHDRLhefBhcNy_V0r_0 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12398087990210701779', time=2024-09-12T20:13:26.689124+0000, chain.objs.size()=1 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.259__shadow_.ApKyT-xDkGY2bkQT9a8pIHHFZJn7gmJ_0 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15980172652590475316', time=2024-09-12T20:14:04.152343+0000, chain.objs.size()=1 2024-09-12T18:33:04.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.746+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BOfGszjQX-ZgLEUACjslC1-13c8XOQ6_0 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17628954664525342108', time=2024-09-12T20:14:04.509784+0000, chain.objs.size()=1 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YuAX5PH2TvUS0JQql1H8MekHGp7TFhp_0 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7295538264751460756', time=2024-09-12T20:14:05.010282+0000, chain.objs.size()=1 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.O-P4IMsM3l9OHG1YCqhe8P0r3WgG_XY_0 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.846756389956622321', time=2024-09-12T20:14:05.097962+0000, chain.objs.size()=1 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VdaJFxTiPxF3DpwkJo3FSUSrgWjcZcp_0 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5477599729493854978', time=2024-09-12T20:14:05.157283+0000, chain.objs.size()=1 2024-09-12T18:33:04.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KSHp4veUtWWLkHXUWFSg1WEwVIUO0-0_0 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17106059766307337154', time=2024-09-12T20:14:06.237977+0000, chain.objs.size()=1 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.749+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ifBveNo_dDybvdqyuVIibdt8Pv41kNG_0 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3465681629423253006', time=2024-09-12T20:14:06.610562+0000, chain.objs.size()=1 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ENtX6wWeViNByJrKb3ZWXqMo2IAY1y0_0 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12626553345670331838', time=2024-09-12T20:14:07.133077+0000, chain.objs.size()=1 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MprQGW-4BaYpx4ZjU_n7dg6qAeE-IZk_0 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15768494370450484560', time=2024-09-12T20:14:07.167897+0000, chain.objs.size()=1 2024-09-12T18:33:04.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3dXlK-Z2U3-JVtE0kpmUTMqgY8f9Tla_0 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11311999048533902324', time=2024-09-12T20:14:07.470685+0000, chain.objs.size()=1 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5vMPVtR5c751kQxdW2aq-BIvw_KqX-j_0 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16372036672485411912', time=2024-09-12T20:14:07.625659+0000, chain.objs.size()=1 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.750+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RK40Ol2hcOW-nCR0ARFxcjGvN0oAvxE_0 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.751+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12266843317480018200', time=2024-09-12T20:14:07.814720+0000, chain.objs.size()=1 2024-09-12T18:33:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.751+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ONpEeTe--aZk144bLUhjm2Dp3NE1D51_0 2024-09-12T18:33:04.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.753+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12031540099385069332', time=2024-09-12T20:14:08.662554+0000, chain.objs.size()=1 2024-09-12T18:33:04.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.753+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MWPE58kTBpvlqiyXM1Xnjzyi_ESV_Q9_0 2024-09-12T18:33:04.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.753+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3809948700532543165', time=2024-09-12T20:14:08.834008+0000, chain.objs.size()=1 2024-09-12T18:33:04.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.753+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.foOo-432bISOkq-I8Dyeaoa9VblD_ue_0 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.891152856539464855', time=2024-09-12T20:14:09.583038+0000, chain.objs.size()=1 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.13t6Zsc_mx2OkvtaiurA5objKoErjcU_0 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6659879487844807550', time=2024-09-12T20:14:10.401531+0000, chain.objs.size()=1 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9uNu6IJKZPYm1UmxD2t0NhnpmxEsNoh_0 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14191273357200289612', time=2024-09-12T20:14:10.550253+0000, chain.objs.size()=1 2024-09-12T18:33:04.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.insTIXLQXGHJaDI-_im9kulVpeT-yzd_0 2024-09-12T18:33:04.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12061388680633231040', time=2024-09-12T20:14:10.727460+0000, chain.objs.size()=1 2024-09-12T18:33:04.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.754+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.C05_48UOhU74FT150ZnAKd1Yxmy0YrG_0 2024-09-12T18:33:04.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4254003883505028843', time=2024-09-12T20:14:10.728966+0000, chain.objs.size()=1 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ccnnAXZs5dsvFl_ZUj-nkY7VDzlLP23_0 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4001810943716270919', time=2024-09-12T20:14:10.878713+0000, chain.objs.size()=1 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LTvEhxXErLuLCeXP_uFTA1Iyw7P9ZkY_0 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.86462510771464533', time=2024-09-12T20:14:11.067664+0000, chain.objs.size()=1 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sZZRc-InT3cfZmZVd6Rssj2GSjxnQNJ_0 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8959548958319634334', time=2024-09-12T20:14:11.478186+0000, chain.objs.size()=1 2024-09-12T18:33:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.755+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JZsSFSi93Pswe9Si-WoonOHp6YQYB6I_0 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9272523337878553923', time=2024-09-12T20:14:11.601091+0000, chain.objs.size()=1 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iAoX1ZyQESie1u4FFFDl6p90M3GWLMi_0 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12718797939134321854', time=2024-09-12T20:14:11.774228+0000, chain.objs.size()=1 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Detb9rp8PiZCvqcpfGri0BB-wsiPMQL_0 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5774658321764460488', time=2024-09-12T20:14:12.032208+0000, chain.objs.size()=1 2024-09-12T18:33:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2hY3CmRyW98mDaTXeoqE2gValZ9TUa1_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15652754290211342819', time=2024-09-12T20:14:13.029647+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0W_axo6f_x1eNx8mRinONt_wHQXxZzU_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5823926476877736891', time=2024-09-12T20:14:13.072172+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RvioIloy_trRlQtZmbwRanBPFrSSEJR_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10572996824586362364', time=2024-09-12T20:14:13.240991+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gqGatQXEtW9XYL7msLmEA17LEja6TOZ_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3662693991013681050', time=2024-09-12T20:14:13.403329+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Wlszby5pFO3X42vkPOpgVzTFxiFT2J2_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1270236890782780981', time=2024-09-12T20:14:13.821540+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6Z8hFxiC3CbknkKDK5wOkRa4qdvA24k_0 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10877648274079081052', time=2024-09-12T20:14:14.239769+0000, chain.objs.size()=1 2024-09-12T18:33:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.759+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.E0-_Bm6QYUowxN8kpSYp4uhNagV0PTO_0 2024-09-12T18:33:04.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.284647912271904256', time=2024-09-12T20:14:23.343732+0000, chain.objs.size()=1 2024-09-12T18:33:04.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.276__shadow_.IVWCtGf4R-MS7g5yGP6xBR3uJjIY8q2_0 2024-09-12T18:33:04.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.762+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8906616198910600344', time=2024-09-12T20:14:27.649849+0000, chain.objs.size()=1 2024-09-12T18:33:04.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.762+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.283__shadow_.BJOgVmQ0fXYiI6g9Y8w7zSh9BYn2zVH_0 2024-09-12T18:33:04.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10620286571284689892', time=2024-09-12T20:14:36.502476+0000, chain.objs.size()=1 2024-09-12T18:33:04.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.wgYw-kSiR9biywW7IVUkmmUuThpxlSX_0 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8531677270041933714', time=2024-09-12T20:14:37.749425+0000, chain.objs.size()=1 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.295__shadow_.7AwazzZ7oNJC-5Sptd8Cj9B2LhfYU9V_0 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4214372114832568071', time=2024-09-12T20:14:38.352301+0000, chain.objs.size()=1 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.296__shadow_.aXVJuKDQ3ciDLUx35FiYsesvfx2MvTa_0 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13809249936006728969', time=2024-09-12T20:14:40.993215+0000, chain.objs.size()=1 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.300__shadow_.80citb1TNHaRnF5WvvqiE9tDs6mDuJy_0 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14551813643425790716', time=2024-09-12T20:15:32.622791+0000, chain.objs.size()=1 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5MIkZBsRDJ6OFm4VlwQrf1qFuYsIwSI_0 2024-09-12T18:33:04.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5188968190996397720', time=2024-09-12T20:15:32.675137+0000, chain.objs.size()=1 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ICssVlLgPYiK6NcvT0dffwbhmon_Znu_0 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11028847967700344887', time=2024-09-12T20:15:33.139371+0000, chain.objs.size()=1 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GdQqX3FCMtBxvXphXnTl5sW_CeMWk4m_0 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2172406411761805358', time=2024-09-12T20:15:33.863368+0000, chain.objs.size()=1 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.69bWqE3XJjAk5vedAVTIXu66I2Ptu9p_0 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14689148195793944168', time=2024-09-12T20:15:34.671648+0000, chain.objs.size()=1 2024-09-12T18:33:04.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.764+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VuMyUTEjNKjfDsMj2ci8j7Gftef80zg_0 2024-09-12T18:33:04.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.572477531150151836', time=2024-09-12T20:15:34.732791+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aWDyQ4RIvM3hgtvU-z5qE2Xg38e0t4Y_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16890015113231022500', time=2024-09-12T20:15:35.248586+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.odu7tnZqtD82Nuor9vSzgD-mLfoG3ps_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16398493710562966760', time=2024-09-12T20:15:35.546955+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Uy4lmuCnRVernfaFMclJBY9vOVS7SXF_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3430958982361622346', time=2024-09-12T20:15:37.267100+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.B09IG6zb8t0RCuJSPSp7STUjNKzDz9N_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5331838378905107181', time=2024-09-12T20:15:38.436232+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n5tWX6Ji37YeomHKTNFNngMKtJ-0fJM_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4642820044054373053', time=2024-09-12T20:15:38.505311+0000, chain.objs.size()=1 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n0J00l8cmgjuZqAv2o3Vm_yxJUVefzO_0 2024-09-12T18:33:04.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15267914553171049056', time=2024-09-12T20:15:39.545952+0000, chain.objs.size()=1 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Spjio36VbUhWpKmKdQt233Diqbgu_L8_0 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9134598409718297657', time=2024-09-12T20:15:39.578355+0000, chain.objs.size()=1 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3DEiHxJtVfe8UZTj_j9WYJyXyp3xu2l_0 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8618901471306605070', time=2024-09-12T20:15:40.450942+0000, chain.objs.size()=1 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Eh8VgQPsr0Wy3Yr0imrT0ETn_DbbZET_0 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5072954459069531095', time=2024-09-12T20:15:40.451723+0000, chain.objs.size()=1 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZmxED5tA2erPOnzQKi9pBHETlnkyOik_0 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16103245577139382354', time=2024-09-12T20:15:41.191678+0000, chain.objs.size()=1 2024-09-12T18:33:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.769+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-SASX1GuuMUCfloVRv2Z8X2GevkY2jf_0 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3635006800251566988', time=2024-09-12T20:15:41.342550+0000, chain.objs.size()=1 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DPXidI0s9H4zBYy0pNxt51C3uTz2DbX_0 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17301674833105431735', time=2024-09-12T20:15:41.401573+0000, chain.objs.size()=1 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oC7hJpr8wdJjglE5NbpDPwYXbG9l9_m_0 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4990283083320514909', time=2024-09-12T20:15:41.429241+0000, chain.objs.size()=1 2024-09-12T18:33:04.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.773+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mI2tkIiM4CMOop-rdi9BHW2r-xTHoXK_0 2024-09-12T18:33:04.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.774+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15380719784128437082', time=2024-09-12T20:15:42.096765+0000, chain.objs.size()=1 2024-09-12T18:33:04.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.774+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fK7BndPctj6fLKPetuPAJHvWEVFO84S_0 2024-09-12T18:33:04.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.774+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6728625218662950531', time=2024-09-12T20:15:42.274102+0000, chain.objs.size()=1 2024-09-12T18:33:04.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.774+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J2-kLvBzYP3HqvZ2zaXs0c5fPq-s1P1_0 2024-09-12T18:33:04.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18171033491383737261', time=2024-09-12T20:15:42.387895+0000, chain.objs.size()=1 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.a5yShKR86v4zre6-2FZwx0gI6avP6Zd_0 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2080930533265003928', time=2024-09-12T20:15:42.753156+0000, chain.objs.size()=1 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Jhod0BtdYEdCyAgnTjFxGmgCb46cqbW_0 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.527237017431713123', time=2024-09-12T20:15:42.753897+0000, chain.objs.size()=1 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3AFVrR1WL6bpHZ6OwQJG144Xijqv0bn_0 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10980607913396506287', time=2024-09-12T20:15:42.831935+0000, chain.objs.size()=1 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mCXyBXlB9W918isfuTSilZO_rFs-9Kp_0 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7931992643330974108', time=2024-09-12T20:15:42.859460+0000, chain.objs.size()=1 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WAf4A-y8VxpzZa34gR0sKCf_c4EVg8M_0 2024-09-12T18:33:04.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4776599594107422291', time=2024-09-12T20:16:20.298160+0000, chain.objs.size()=1 2024-09-12T18:33:04.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.776+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xaJSznkU21ttLhk_sGxpecOAoL84RXz_0 2024-09-12T18:33:04.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.777+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10160344572952518365', time=2024-09-12T20:16:20.427517+0000, chain.objs.size()=1 2024-09-12T18:33:04.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.777+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HB0oCg7rtgTPhXKa9GSFi3lnYBVMynh_0 2024-09-12T18:33:04.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.778+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3203637941845944638', time=2024-09-12T20:16:22.132450+0000, chain.objs.size()=1 2024-09-12T18:33:04.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.778+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IyO8rFpAogRniwh8XAs0PS3RURS6MmA_0 2024-09-12T18:33:04.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.778+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8263120555042845029', time=2024-09-12T20:16:22.188503+0000, chain.objs.size()=1 2024-09-12T18:33:04.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.778+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pR5tFWWbvwiGDKTPk620xWb8b00emvF_0 2024-09-12T18:33:04.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1152475784982200580', time=2024-09-12T20:16:22.388216+0000, chain.objs.size()=1 2024-09-12T18:33:04.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.E0YfqFnCycyXTr2MXS5rNOsVMdVvhyA_0 2024-09-12T18:33:04.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4185568017674783297', time=2024-09-12T20:16:22.475635+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F3HyIpTh8W0wvJQfg6qKHrLPDkV3Mfz_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14331926615966202329', time=2024-09-12T20:16:22.632606+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CMQDO9H6xVNKH7J2HBv78O0oKDkk_3G_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7879302147743060760', time=2024-09-12T20:16:22.676872+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kEP5oJs-MSn3zAIoGGv9k6_66jq8kif_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5645544461260891094', time=2024-09-12T20:16:23.367799+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.779+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lZ0EPL_Jf2HO2AXRe4ffrDnGBk-CWsF_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14353322128620744949', time=2024-09-12T20:16:23.407885+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.D-x8JFQuvCvwMUvadYHI5MnpiaS8zhs_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1079951123386683651', time=2024-09-12T20:16:23.854700+0000, chain.objs.size()=1 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.e6e44yWc_I4EKX1TthU5j5xfu6U-hDG_0 2024-09-12T18:33:04.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2129282740780034065', time=2024-09-12T20:16:24.524347+0000, chain.objs.size()=1 2024-09-12T18:33:04.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.780+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rbeOtCLt0YToiCUMj4KDnR2Fjq2cYn-_0 2024-09-12T18:33:04.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14759014554626042910', time=2024-09-12T20:16:24.780657+0000, chain.objs.size()=1 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Khe-7pg4SybqnR4ScE2zzByIEBdUk5X_0 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16213343954643093963', time=2024-09-12T20:16:25.284438+0000, chain.objs.size()=1 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0OorHdTXmet7ARcwNbDDQATh5lmCVIg_0 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11033347479369770685', time=2024-09-12T20:16:25.929601+0000, chain.objs.size()=1 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TIFEPldbq0RhGgEKN9qkFKaujsEioeU_0 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10538199590538998108', time=2024-09-12T20:16:26.838535+0000, chain.objs.size()=1 2024-09-12T18:33:04.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.784+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QEQOHsrblGS7rJPpoAJw319nHPlIxIC_0 2024-09-12T18:33:04.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6110740179864133796', time=2024-09-12T20:16:26.932045+0000, chain.objs.size()=1 2024-09-12T18:33:04.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hIH31Q1WttKgl-zkjddA2-PKmhfL2hN_0 2024-09-12T18:33:04.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16286682742250378616', time=2024-09-12T20:16:28.025880+0000, chain.objs.size()=1 2024-09-12T18:33:04.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UJ4RaP5xdlP_0NvIJl2Iglsb_G7ZPdl_0 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2010264017911584227', time=2024-09-12T20:16:28.247483+0000, chain.objs.size()=1 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Z4OHKsYWE1WsGCV9vgEJfKw2tq67wIY_0 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16903841595180961171', time=2024-09-12T20:16:28.788776+0000, chain.objs.size()=1 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.N3-iI3x95UhBBum4p91_p7aPx40djLC_0 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18286299016972741450', time=2024-09-12T20:16:29.080256+0000, chain.objs.size()=1 2024-09-12T18:33:04.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.785+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rzYDjyI8PIlmNwAZv-ZqWrfRN0NysVC_0 2024-09-12T18:33:04.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.787+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15061185104220282094', time=2024-09-12T20:16:29.208341+0000, chain.objs.size()=1 2024-09-12T18:33:04.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.787+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Z8vlxq6g5RfFr1yP-NXZ1A3p7LyONF-_0 2024-09-12T18:33:04.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.787+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7809828014836232909', time=2024-09-12T20:16:29.267109+0000, chain.objs.size()=1 2024-09-12T18:33:04.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.787+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9dv2S4nfYNFLRCM0GQr5h7sHf3ATd51_0 2024-09-12T18:33:04.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17172941765234721460', time=2024-09-12T20:16:30.389580+0000, chain.objs.size()=1 2024-09-12T18:33:04.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZomFlZ75Q8rltRksoTB8_Te9RsxDPeK_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17139330423887596894', time=2024-09-12T20:16:30.453472+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8oizczWhGD_Ebzuyfj_xEA1a_O-7l2V_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10243314535017036024', time=2024-09-12T20:16:30.905873+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gWgaoj1U8VqC483XPu4RVPN9-U5qded_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3328784293114843989', time=2024-09-12T20:16:35.152461+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.332__shadow_.yFafoFr7d5GKrG-f0L-o02Tdd7Y_GuS_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8891058949707950946', time=2024-09-12T20:16:42.396259+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.791+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.346__shadow_.iQFc0HZ-RiQDMTHtDoH4wGfJ-CTpDIU_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.365749767987223673', time=2024-09-12T20:17:16.175324+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.409__shadow_.CfQCh0p8YZxRERW46XHe5JvRCs1Rhno_0 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6702315544213997802', time=2024-09-12T20:17:28.777285+0000, chain.objs.size()=1 2024-09-12T18:33:04.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.435__shadow_.TDHtf7aP1-qalCrt5JDZ1JR5hw-RPkL_0 2024-09-12T18:33:04.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8087112390721880786', time=2024-09-12T20:17:29.582895+0000, chain.objs.size()=1 2024-09-12T18:33:04.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.436__shadow_.8YzdU82UkzSMvRUYAfgjzx_EFT7ZZM__0 2024-09-12T18:33:04.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8506357584711862591', time=2024-09-12T20:17:43.870040+0000, chain.objs.size()=1 2024-09-12T18:33:04.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.792+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.459__shadow_.RkLKGiPYiyxgePSWD6rs2DfJihEyqJO_0 2024-09-12T18:33:04.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.798+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/50912 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14746703557303369010', time=2024-09-12T20:17:48.533898+0000, chain.objs.size()=1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.465__shadow_.ffLdPi9KgVYjFcT7xlLImjpdP3psQyE_0 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17637763591124060532', time=2024-09-12T20:18:11.351453+0000, chain.objs.size()=1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9516266950019465079', time=2024-09-12T20:18:32.481056+0000, chain.objs.size()=1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.518__multipart_mymultipart.2~ItZbZb_5TlbQIji2tfJwqiC18301WA1.1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9213247388268565573', time=2024-09-12T20:19:58.479574+0000, chain.objs.size()=3 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~1IA3itD7SYnAg3xHU2OiiiGSre2NP2w.1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__shadow_mymultipart.2~1IA3itD7SYnAg3xHU2OiiiGSre2NP2w.1_1 2024-09-12T18:33:04.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~1IA3itD7SYnAg3xHU2OiiiGSre2NP2w.2 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2500438806797997304', time=2024-09-12T20:21:31.049090+0000, chain.objs.size()=1 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:RyG5Ard8eof0K3uRBL18kehBl7iY7ry_.TMNkq2TB0hiNFz8R8AcN5nlHTiJfn6Z_0 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6799691796170794120', time=2024-09-12T20:22:28.943959+0000, chain.objs.size()=7 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.1 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__shadow_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.1_1 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.2 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__shadow_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.2_1 2024-09-12T18:33:04.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.800+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.3 2024-09-12T18:33:04.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.804+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__shadow_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.3_1 2024-09-12T18:33:04.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.804+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~taLZdnxll81pzbA8fjTD19EPkb8uhde.4 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8197020690812996912', time=2024-09-12T20:22:31.660708+0000, chain.objs.size()=1 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:pJUpo.ewSq-cWStemV4yS1K9Dj1mnJ8_.YSXSIZsqFBGSelXsCy-UcpZRNvTTrWZ_0 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11372893476892881324', time=2024-09-12T20:22:37.383581+0000, chain.objs.size()=1 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.585__shadow:CnDMCTKEL9qSx4.LfeVujnF0Grl-tjl_.9n23boO7Q3eLBwo-fM6dLtLRsKCj21p_0 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6101894189555080239', time=2024-09-12T20:22:49.034299+0000, chain.objs.size()=1 2024-09-12T18:33:04.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.606__shadow_.7EfKN4tnampU1OkR9HCmr1b_BPP8cMx_0 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10949512358092703404', time=2024-09-12T20:23:18.296061+0000, chain.objs.size()=12 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.1 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.1_1 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.2 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.2_1 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.3 2024-09-12T18:33:04.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.805+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.3_1 2024-09-12T18:33:04.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.808+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.4 2024-09-12T18:33:04.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.809+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.4_1 2024-09-12T18:33:04.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.810+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.5 2024-09-12T18:33:04.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.811+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.5_1 2024-09-12T18:33:04.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__multipart_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.6 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.613__shadow_multipart_enc.2~o2i582VVBpUiXBcf1CagaJqOYHBEWWQ.6_1 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12955829656721503081', time=2024-09-12T20:25:54.231539+0000, chain.objs.size()=1 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.618__shadow_.JwgRjhdBWIhWRet1QC2HuFg8LEsSeUS_0 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1848650448195448411', time=2024-09-12T20:26:29.338956+0000, chain.objs.size()=1 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.628__shadow_.qiBR77CyLCOhCf6zPDkRHpDR-3Ho_Fd_0 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5452193381783019846', time=2024-09-12T20:26:31.718979+0000, chain.objs.size()=1 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.632__shadow_.vqlImJctIgL6pBEaWtWjVWbC0hRr2eD_0 2024-09-12T18:33:04.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1457936777720737096', time=2024-09-12T20:27:12.664421+0000, chain.objs.size()=1 2024-09-12T18:33:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.663__shadow_.0F4eEjsvVypf4TXMleKLwmkg5hj1UF8_0 2024-09-12T18:33:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4154022069248456371', time=2024-09-12T20:27:29.084448+0000, chain.objs.size()=1 2024-09-12T18:33:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.694__shadow:ZdifzKt7wOHmTWk2MdvU4SrTyJwnYQq_.ndHpRGROmUuAarJNyq7-advBjBmcerH_0 2024-09-12T18:33:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5665575817202590494', time=2024-09-12T20:27:41.204173+0000, chain.objs.size()=1 2024-09-12T18:33:04.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.812+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.714__shadow:zXkVFat.C0KgkBYoPEx.Bd17yAkrtCJ_.iPRoaZDMCnGvKaZ1rcQ4pa11m6QVY6k_0 2024-09-12T18:33:04.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.819+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.822+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:33:04.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.823+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.823+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58725' 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8539457460171080247', time=2024-09-12T20:13:15.229158+0000, chain.objs.size()=1 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.241__shadow_.bUWMddNoFnzbiQAMn3l3gDWi7QCkB_-_0 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14619177429784821472', time=2024-09-12T20:13:15.843515+0000, chain.objs.size()=1 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.242__shadow_.D_Ds01xP0oNo5gdobVQJe35rqW8YbVI_0 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5977024056236963913', time=2024-09-12T20:13:19.493908+0000, chain.objs.size()=1 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.247__shadow_.Q6Mebhq92SdAiG120NjFXwTA4zlxo1i_0 2024-09-12T18:33:04.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4210280368401691072', time=2024-09-12T20:13:23.755374+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.254__shadow_.KQy7CBuHWwHiLuz6EjtBtXj7CSqbbYG_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14788496727199396499', time=2024-09-12T20:13:24.362775+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.255__shadow_.NnGxmshyVEgli1QdLHtkg5ar_ziaddj_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9839706799371623167', time=2024-09-12T20:14:04.581612+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.824+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.s8dM6DWEkg_lFmlcnmDUPj74qjNP9sc_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17047398006121974935', time=2024-09-12T20:14:04.673761+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lrKygyHCp7Ek2B4AnJXKRmb5R1ey_2C_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18309137555441764168', time=2024-09-12T20:14:04.714533+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.eeVUUqSRAIFNYv2a0SiFT_NTyjTtC7u_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12345147351622505732', time=2024-09-12T20:14:06.376967+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EglPhdRAef3zpVkFCJtgjjs54t9oy0y_0 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8437275690615308349', time=2024-09-12T20:14:06.443633+0000, chain.objs.size()=1 2024-09-12T18:33:04.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lM8eMNoH07aXwGlKaNZ50hNQqbWCZgo_0 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14934555289703372655', time=2024-09-12T20:14:06.632914+0000, chain.objs.size()=1 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Y-Re7xqrLPB4A16msBKQIVPxhQ3EZ81_0 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2077957419820161853', time=2024-09-12T20:14:07.305109+0000, chain.objs.size()=1 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.825+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JQ_WIWvRyZeapSMUQYXWTBJve0A92TA_0 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.827+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17414806245759142284', time=2024-09-12T20:14:07.765551+0000, chain.objs.size()=1 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.827+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Rj09N4bwPR8fQSvbwXGUFFrZFMTzCic_0 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.827+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9148064517469701139', time=2024-09-12T20:14:07.947520+0000, chain.objs.size()=1 2024-09-12T18:33:04.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.827+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZpU2IgcxkBGJV445jZr2OcAlRdzfap2_0 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12463452099310297148', time=2024-09-12T20:14:08.807748+0000, chain.objs.size()=1 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qQtw1HQtBo-pkLdNGnPsuJedq6Rv4TN_0 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17347775132990286664', time=2024-09-12T20:14:09.171444+0000, chain.objs.size()=1 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8mnd5BlYyD8y7fUtQftydJKjl_OTayb_0 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16332337798718795796', time=2024-09-12T20:14:09.293259+0000, chain.objs.size()=1 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1AinWJBORXTrOd5f0Bmj28ng1AR7fsl_0 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3098053112074602829', time=2024-09-12T20:14:09.507618+0000, chain.objs.size()=1 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.r4O-XAYUxkLLAOUXCqIH9W_6Tc5hzVs_0 2024-09-12T18:33:04.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4455157480674273271', time=2024-09-12T20:14:10.055815+0000, chain.objs.size()=1 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iN6Nwg5QUsukBdWqkjgCYQudnP1M05v_0 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13749934805250992441', time=2024-09-12T20:14:10.253161+0000, chain.objs.size()=1 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.HQs-wL5BAq5puXhsYr0DXsD9mwzDbqG_0 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18134994849601922812', time=2024-09-12T20:14:10.566699+0000, chain.objs.size()=1 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.F_2WRfYTs9vlemVEaGtn989X67DNivc_0 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2184033460255154682', time=2024-09-12T20:14:10.808714+0000, chain.objs.size()=1 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.w2guPAtN988PSdj2QOYeD5poVEYk3Mw_0 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15428535058547654570', time=2024-09-12T20:14:11.511675+0000, chain.objs.size()=1 2024-09-12T18:33:04.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.829+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.otKm9NMJlnv1E6GGiJ-_PEYQXio3-QY_0 2024-09-12T18:33:04.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3307317642360295291', time=2024-09-12T20:14:12.069637+0000, chain.objs.size()=1 2024-09-12T18:33:04.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fpXwz8J01CojDhbzduDBC7mFYHg6bF__0 2024-09-12T18:33:04.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10177512494740028565', time=2024-09-12T20:14:13.017140+0000, chain.objs.size()=1 2024-09-12T18:33:04.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hCXrj87hUNSHqesCMi_1MR1dL-lAMcO_0 2024-09-12T18:33:04.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15889141725450066833', time=2024-09-12T20:14:13.360127+0000, chain.objs.size()=1 2024-09-12T18:33:04.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.832+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Saslj0jm9qYXrQIIjmgADhqIE3iMPK5_0 2024-09-12T18:33:04.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.833+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6173154020628706104', time=2024-09-12T20:14:13.560198+0000, chain.objs.size()=1 2024-09-12T18:33:04.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.833+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UVOvujlKqWx8EynbDPXL41kQY7BWC9L_0 2024-09-12T18:33:04.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.834+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5059425012939750025', time=2024-09-12T20:14:13.628824+0000, chain.objs.size()=1 2024-09-12T18:33:04.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.834+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Dvl_wNQfQw1BxF8JKMjNgnFvQlcl23L_0 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2633073505031980941', time=2024-09-12T20:14:14.540566+0000, chain.objs.size()=1 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wIIbkqpZUFXTTu5Bp2ze-RGyQDZeGDu_0 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17785655547779879026', time=2024-09-12T20:14:15.020147+0000, chain.objs.size()=1 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9URG9FyLPlDN0Z9cGrJb0zU3hVxkMl__0 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13732100763182935277', time=2024-09-12T20:14:15.242573+0000, chain.objs.size()=1 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GgwISonq3Y67sVzzif7KsZiKoswNLqY_0 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14456055193755359160', time=2024-09-12T20:14:30.871230+0000, chain.objs.size()=1 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.288__shadow_.t3lYPla514bCtLHr2ibcObVg2V1c5Go_0 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14928131166652846085', time=2024-09-12T20:14:36.402810+0000, chain.objs.size()=1 2024-09-12T18:33:04.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.HfELws8wuMNx0wKy8Un_4dxW1HXX4iN_0 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1573441500500215043', time=2024-09-12T20:14:36.403573+0000, chain.objs.size()=1 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.zNVfxQknPj7VT4o2pficLIWG9XJx0OH_0 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5257997821374444107', time=2024-09-12T20:14:36.513544+0000, chain.objs.size()=1 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.835+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.R0Y3L6p8ppOpI2rUjApHOMuiqlmFmRN_0 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.836+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7020096759937154306', time=2024-09-12T20:14:37.136599+0000, chain.objs.size()=1 2024-09-12T18:33:04.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.836+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.294__shadow_.2BMOdVhcLWifPz8iA7zcbvPpkpPG3i3_0 2024-09-12T18:33:04.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.837+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18079878659909675231', time=2024-09-12T20:14:38.981926+0000, chain.objs.size()=1 2024-09-12T18:33:04.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.837+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.297__shadow_.5AJh15eUYTzVDxXXNEMfw0ZoAgV0F4T_0 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.838+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11094843461260676751', time=2024-09-12T20:14:40.387105+0000, chain.objs.size()=1 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.838+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.299__shadow_.NEEO3AOjrQ5UlutCJdQTM7aKn0d3dyH_0 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.838+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15410190980826975388', time=2024-09-12T20:14:42.792132+0000, chain.objs.size()=1 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.838+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.303__shadow_.OvkF1t2O0hzRcftsZafCYf2u_IE3fPE_0 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6561749521211470045', time=2024-09-12T20:14:43.387118+0000, chain.objs.size()=1 2024-09-12T18:33:04.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.304__shadow_.p_293rEhchUVDVgbKaSpHAvzdD3s9pA_0 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15360922703306156358', time=2024-09-12T20:14:45.965400+0000, chain.objs.size()=1 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.307__shadow:JKJYE9ePHBgSExNBKZakvaEhh5V1EoI_.huvX415H0ymxL8FRcO5T0E9bPQsmNSp_0 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15517956809911017992', time=2024-09-12T20:15:32.335608+0000, chain.objs.size()=1 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1Uli42zAQtdWBk53X-eKtkh0IIKDQyG_0 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13991057206256343239', time=2024-09-12T20:15:32.849954+0000, chain.objs.size()=1 2024-09-12T18:33:04.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.839+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.enZ6Pp5g2pcVDm7OC7pDl9oXCj1l-kT_0 2024-09-12T18:33:04.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11371237449098453162', time=2024-09-12T20:15:33.769310+0000, chain.objs.size()=1 2024-09-12T18:33:04.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.T38X8ibbd_9Y6e4XamQttTGg1P93gvT_0 2024-09-12T18:33:04.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10620694263508223289', time=2024-09-12T20:15:33.923134+0000, chain.objs.size()=1 2024-09-12T18:33:04.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.sT1ne3GMloHrjSIl6UUh_gThzJNUPOc_0 2024-09-12T18:33:04.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14054083874930237669', time=2024-09-12T20:15:34.191580+0000, chain.objs.size()=1 2024-09-12T18:33:04.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.843+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KGGaEpZqRG-frLz2WSoHNz0LYMRV-bF_0 2024-09-12T18:33:04.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10126493512572309962', time=2024-09-12T20:15:35.401998+0000, chain.objs.size()=1 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MYEn2hX9AVYeIuIX3xB9b-hdvzyczI3_0 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14812345580879105274', time=2024-09-12T20:15:35.551115+0000, chain.objs.size()=1 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jgrIPofUWubOiCrpzY884mPwFCMcC-W_0 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13140679043900498415', time=2024-09-12T20:15:35.571006+0000, chain.objs.size()=1 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KirAC4d8c_TdcWi42ZiIWP6Hb0Hj87R_0 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16400955772587472548', time=2024-09-12T20:15:36.004252+0000, chain.objs.size()=1 2024-09-12T18:33:04.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.845+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.enVfzelkPrdeztSv-PC_6BkV840lJ2D_0 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2120387710150635800', time=2024-09-12T20:15:36.642967+0000, chain.objs.size()=1 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7et2tYyAiwfwpU7O96EqN2Ba6dgdleK_0 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11103326867593212176', time=2024-09-12T20:15:36.678403+0000, chain.objs.size()=1 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._pH_asriJgfrbiKjisaJGszv3V2lbSk_0 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8653541126065712286', time=2024-09-12T20:15:36.679037+0000, chain.objs.size()=1 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lyUU3Sh-8NpMyGc8aN7BsF5vsV_iRl__0 2024-09-12T18:33:04.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1558947010616814415', time=2024-09-12T20:15:37.679501+0000, chain.objs.size()=1 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.846+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SBwFbWX7K7pXlvkb8LROzvnonGS_fTZ_0 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17828698779837182298', time=2024-09-12T20:15:38.225258+0000, chain.objs.size()=1 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wL0-TwwVtzZQDJaJxwUnsLdWce3F-cD_0 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.847+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7630232324305786961', time=2024-09-12T20:15:39.072277+0000, chain.objs.size()=1 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.847+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.l6uDHDciBhL78Bb34ncO0LB1-3B_2jf_0 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.848+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17958368306082999054', time=2024-09-12T20:15:39.461451+0000, chain.objs.size()=1 2024-09-12T18:33:04.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.848+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zJv79b6kEk6klGMCYFuyS3g_V8SPvyz_0 2024-09-12T18:33:04.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10898221787985178444', time=2024-09-12T20:15:39.560839+0000, chain.objs.size()=1 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vGKlRyHTJgfzj1bna4-kErXRCHco98M_0 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5016545063931906961', time=2024-09-12T20:15:39.987088+0000, chain.objs.size()=1 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wHRE2XV70atpkayc-fINovn9_rEfHki_0 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1487973976081203053', time=2024-09-12T20:15:40.179438+0000, chain.objs.size()=1 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.59OBhjfthNVsdXU60Jv_PCThT2QfbyN_0 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15259205661438449084', time=2024-09-12T20:15:40.363361+0000, chain.objs.size()=1 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iKhbq0xwf8mRAwN8NhjioRDsvPl_omI_0 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3487048915331841394', time=2024-09-12T20:15:40.884437+0000, chain.objs.size()=1 2024-09-12T18:33:04.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.851+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WJwxO-tBt7HF3k3o2rNmVB2D5Vy-ODD_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4184885741748311608', time=2024-09-12T20:15:41.138072+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FNI0Zt5DFWP6LZfl0P3weoGorRqXCcP_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15315524470711947966', time=2024-09-12T20:15:41.772618+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jVisYu2OtdOYxTVjuPWW1ILwGlet9uc_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14307006412965432784', time=2024-09-12T20:15:42.161798+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8zNXZbGh8qN0IMoQgkEqHwv1Xa-rjKh_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17386131312163603648', time=2024-09-12T20:15:42.217710+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0GXY9G76MrZ93NR6GqaL_kZ-bgSkmKa_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14742383548754324929', time=2024-09-12T20:16:20.428579+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uCHOLGJYUV8ZcvRAaQRtozU3_dV0H1i_0 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8946650185827939816', time=2024-09-12T20:16:21.758139+0000, chain.objs.size()=1 2024-09-12T18:33:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8E6Euy-i6tOvKd_voE8fgOEAqcOo3-U_0 2024-09-12T18:33:04.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7018488743810353865', time=2024-09-12T20:16:21.849005+0000, chain.objs.size()=1 2024-09-12T18:33:04.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OlQ1i-UiIxhMbwTnjryUj8IlUie7nFU_0 2024-09-12T18:33:04.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18230997669791419403', time=2024-09-12T20:16:21.849580+0000, chain.objs.size()=1 2024-09-12T18:33:04.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.854+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vmlfxolkrehB4nM0uybj4YKEgMul2NK_0 2024-09-12T18:33:04.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.856+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10237306586816832201', time=2024-09-12T20:16:21.949835+0000, chain.objs.size()=1 2024-09-12T18:33:04.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.856+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0p4qadpw15z3UrYyed6AkNI6yMFpNPi_0 2024-09-12T18:33:04.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.857+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11226618051203159416', time=2024-09-12T20:16:21.987238+0000, chain.objs.size()=1 2024-09-12T18:33:04.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.857+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YBsCEquoEUKbTkiZEnqB-SbhptOnBX6_0 2024-09-12T18:33:04.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.857+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3407550739939891005', time=2024-09-12T20:16:22.133743+0000, chain.objs.size()=1 2024-09-12T18:33:04.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.857+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hf1ejUjNSNmyTwomwWmMkz1VjX02f1S_0 2024-09-12T18:33:04.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.859+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17470770734637882984', time=2024-09-12T20:16:22.171941+0000, chain.objs.size()=1 2024-09-12T18:33:04.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.859+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KkIfb7WwAkyUgp0E2NzSjmj48707r6u_0 2024-09-12T18:33:04.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9567075036905180011', time=2024-09-12T20:16:22.238079+0000, chain.objs.size()=1 2024-09-12T18:33:04.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rP5UZ3ZH0E4D5VbCzhBjiep3D_Hff_a_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3800745048318026558', time=2024-09-12T20:16:23.110613+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2mQVgJKkrQftPd18A9GDjDmOXn6yAJX_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2749223328357571888', time=2024-09-12T20:16:24.111524+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AqHIDydU4_ael7Dh9NOv25qQhwNpfgH_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8460759497135479401', time=2024-09-12T20:16:24.640730+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eAk6qVHC2_ETmeG34tHT13DAGt3M2l8_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5084771297210432006', time=2024-09-12T20:16:24.858564+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.861+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3rqc0tmaAwItIzl9-YmV_ekUgplONZQ_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2616458745001189905', time=2024-09-12T20:16:25.123130+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.x7lkviZqCuUaVQg7sAYnNXU3iRyrdhz_0 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5434270660831239694', time=2024-09-12T20:16:25.291359+0000, chain.objs.size()=1 2024-09-12T18:33:04.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.STxoEmu46XHdbFZSj_UOkCmEpg9vh1g_0 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18375851370723654520', time=2024-09-12T20:16:25.525664+0000, chain.objs.size()=1 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ixQnlPdLnTuQbJHsJQa1bA3e2SJGugV_0 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8787176961093429052', time=2024-09-12T20:16:26.531329+0000, chain.objs.size()=1 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WDLJ4cttbWh4G1KqzID9I4StnrJaZ3I_0 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16327214292137709082', time=2024-09-12T20:16:26.583955+0000, chain.objs.size()=1 2024-09-12T18:33:04.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.862+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QtmKisZjkyWgpMmWbI1SpVTkyghbH7b_0 2024-09-12T18:33:04.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.864+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17461897958555679158', time=2024-09-12T20:16:26.840157+0000, chain.objs.size()=1 2024-09-12T18:33:04.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.864+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CZkWw97rHAeDLNSR-kTYIyaRLQa4jnw_0 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6432134891519750134', time=2024-09-12T20:16:27.269436+0000, chain.objs.size()=1 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bGTypqjMpQyLnmJs85lVsRS6jvhAUU2_0 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14039712082485219196', time=2024-09-12T20:16:27.822352+0000, chain.objs.size()=1 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PQjn3i2AHvNhVbPs_vk9D3ZqSnBjfpD_0 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3811864702584327860', time=2024-09-12T20:16:27.909492+0000, chain.objs.size()=1 2024-09-12T18:33:04.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.869+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BRaaoOwfWLw3GNbOJtqKDHMDlEaR8mf_0 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1967814385044530109', time=2024-09-12T20:16:28.211705+0000, chain.objs.size()=1 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.W0sjOl6DC9KUT0vrduFI_oBJpbyCSPA_0 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5541666872874797397', time=2024-09-12T20:16:28.323572+0000, chain.objs.size()=1 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XeYyeZCgvh9HzNGSouDRoUt5l3C8N0m_0 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5171987752440952585', time=2024-09-12T20:16:28.936139+0000, chain.objs.size()=1 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IKblWcwqhbg3NBQjkA8EhpOxN4ScvCn_0 2024-09-12T18:33:04.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9580228597440637067', time=2024-09-12T20:16:29.716187+0000, chain.objs.size()=1 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aYeOpod25b3nkv7DlC2pHX8XIgkg7cN_0 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8967712279709633303', time=2024-09-12T20:16:29.732886+0000, chain.objs.size()=1 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AEgUciniaZqlxqGEEix8aP_uxFY86L0_0 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3515285327187343365', time=2024-09-12T20:16:30.348921+0000, chain.objs.size()=1 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wseaGDa1o9oquKpgeT8kiQNcY7shJic_0 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6376742402271702314', time=2024-09-12T20:16:30.381518+0000, chain.objs.size()=1 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LDP5OECTZ4jeLxDiKx6IrPGQel6STXm_0 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2964536394602029873', time=2024-09-12T20:16:30.831563+0000, chain.objs.size()=1 2024-09-12T18:33:04.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.870+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.VHs2a4sY3waLMIoi6PUbWmF7v9z-Aj0_0 2024-09-12T18:33:04.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.874+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12267637426640080317', time=2024-09-12T20:16:30.901527+0000, chain.objs.size()=1 2024-09-12T18:33:04.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.874+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZtCG7ue8Sxfh0ofN91T1_Gh_x9T0EqU_0 2024-09-12T18:33:04.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.875+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4609779944270264651', time=2024-09-12T20:16:30.951975+0000, chain.objs.size()=1 2024-09-12T18:33:04.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.875+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OCUOntHEyVfgqR-RQLVanc-VydKs8_3_0 2024-09-12T18:33:04.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.875+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9578904635493772648', time=2024-09-12T20:16:36.216229+0000, chain.objs.size()=1 2024-09-12T18:33:04.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.875+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.334__shadow_.DvBj2vBERhgqt0axA2DYQWiqHyFg0mm_0 2024-09-12T18:33:04.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.877+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18191264126777473249', time=2024-09-12T20:17:28.159169+0000, chain.objs.size()=1 2024-09-12T18:33:04.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.877+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.434__shadow_.NhQ46wVkDwayVXNnD2K9CFfNalVim9T_0 2024-09-12T18:33:04.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.882+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/58725 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6584668582357495257', time=2024-09-12T20:17:46.366766+0000, chain.objs.size()=1 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.462__shadow_.W_fl61Ej0lycqMKnjsigsM2c3yCfRZp_0 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11929156677389243475', time=2024-09-12T20:17:48.896377+0000, chain.objs.size()=1 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.465__shadow_.kZHhTgiMZ7XEO0-xZJZYaxnOWFfJYFE_0 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2814593154103373143', time=2024-09-12T20:18:32.247350+0000, chain.objs.size()=2 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.517__shadow_.j4sJw1OBZErAfcFIoQbjsGgTJ0uUIlS_0 2024-09-12T18:33:04.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.517__shadow_.j4sJw1OBZErAfcFIoQbjsGgTJ0uUIlS_1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.418359+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.422129+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.2 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.426148+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.3 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.430017+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.4 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.433757+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.5 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU', time=2024-09-12T20:19:41.437819+0000, chain.objs.size()=1 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~A7KlfB7viITj1dRUCHr_3XuAxXzhBNU.6 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2785783005289311815', time=2024-09-12T20:20:05.500455+0000, chain.objs.size()=4 2024-09-12T18:33:04.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.524__shadow_.v7e_ytgFZ2O6-oAh-tnbyfVA4sKPh5t_0 2024-09-12T18:33:04.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.885+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.524__shadow_.v7e_ytgFZ2O6-oAh-tnbyfVA4sKPh5t_1 2024-09-12T18:33:04.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.888+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.524__shadow_.v7e_ytgFZ2O6-oAh-tnbyfVA4sKPh5t_2 2024-09-12T18:33:04.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.889+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.524__shadow_.v7e_ytgFZ2O6-oAh-tnbyfVA4sKPh5t_3 2024-09-12T18:33:04.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.889+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~8kbCIR9-_HB6sp6VC7a-1amSTJ9WDWl', time=2024-09-12T20:20:18.331979+0000, chain.objs.size()=1 2024-09-12T18:33:04.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.889+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.531__multipart_mymultipart2.2~8kbCIR9-_HB6sp6VC7a-1amSTJ9WDWl.1 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.889+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3768601630905634172', time=2024-09-12T20:21:05.301750+0000, chain.objs.size()=1 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.889+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.554__shadow_.lCPVvuRqmzVtdAesPyGYDo6_9aPBuAy_0 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11073459431291056322', time=2024-09-12T20:21:36.451668+0000, chain.objs.size()=1 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:sO8zbQba6VuOoTSCY90HuOTLNASL1OL_.l8WG-SF8qGLpn6-0FAbCkS21Mo3SbFu_0 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16953077065337359720', time=2024-09-12T20:21:45.192212+0000, chain.objs.size()=1 2024-09-12T18:33:04.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow_.T7gco7z7yjtErHwTdeqhoaytejBvvMC_0 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2625543928205699508', time=2024-09-12T20:21:48.355669+0000, chain.objs.size()=1 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:S6zFj-F9Qq46bqYgkxxP1LqD-CGi357_.6I9CoZkrQ35sC9AAnlPSE1Tpklf67Mj_0 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9741499496951972226', time=2024-09-12T20:21:49.481224+0000, chain.objs.size()=1 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.575__shadow_.ty1A_P9FZ57UBqJem9oVA0HnAea-3sG_0 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5260704683418105530', time=2024-09-12T20:22:05.848056+0000, chain.objs.size()=1 2024-09-12T18:33:04.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:FP95mtZAz9HZ9cHFSPtAVFiQXzIY184_.NFnlpzmgJ_kvJ305ZzxaZkvE7uXVw18_0 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4634410550392428982', time=2024-09-12T20:22:33.620113+0000, chain.objs.size()=1 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:6qkXM.SgrWj36dkPfIZYG8RDbPIOm2p_.GlfyLQiGbnvyGClyHNx-Ahlfqliwlpv_0 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14223627852432224174', time=2024-09-12T20:22:33.668299+0000, chain.objs.size()=1 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.890+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:MUwriHlaR-kqwP2vTsUzNPn6hwIeFdz_.8jT8nCTiYnC5zc_7ORWWTx9-OruPCPc_0 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.893+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7933390904498511421', time=2024-09-12T20:26:28.766729+0000, chain.objs.size()=1 2024-09-12T18:33:04.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.893+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.627__shadow_.FwUQ53ejwVFIb3LZs_VO_vEQWk9ATgo_0 2024-09-12T18:33:04.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7059119488891108854', time=2024-09-12T20:26:30.115273+0000, chain.objs.size()=1 2024-09-12T18:33:04.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.629__shadow_.41x3cUi8K-FW6gMMr1jojvuofqgWFx__0 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7024886525620307131', time=2024-09-12T20:26:39.424533+0000, chain.objs.size()=1 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.643__shadow_.DcokSCLejW__4jjQrASrf3nUDz1AR_A_0 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5608833125699659854', time=2024-09-12T20:27:18.339859+0000, chain.objs.size()=1 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.672__shadow_.IQvNw_qAqMRsJBX8mz65GfbUWCZY4bZ_0 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.894+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1478488043522141408', time=2024-09-12T20:27:30.902204+0000, chain.objs.size()=1 2024-09-12T18:33:04.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.895+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.697__shadow:rjHh0rR0bUqzGjMRzWjcdNX14f6pKoD_.vGLYmZ4D5iILQE3_oaOORrc4BQT4GMG_0 2024-09-12T18:33:04.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.897+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14371618214001300487', time=2024-09-12T20:27:32.111443+0000, chain.objs.size()=1 2024-09-12T18:33:04.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.897+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.699__shadow:A3t9zX.MuF4I1lGPtYuoNqaKUSlSGLE_.52eOGXZFuU_YVuOt1P84UGY80gO_Fph_0 2024-09-12T18:33:04.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.897+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10647750346837176099', time=2024-09-12T20:27:51.669068+0000, chain.objs.size()=1 2024-09-12T18:33:04.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.897+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.715__shadow:0Wp.HIjwnFNGA3pyMR40pxz7VfzqGjh_.MAb3J1iBnAzI2uILhGS1o1pGw5o9DJy_0 2024-09-12T18:33:04.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.899+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.903+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:33:04.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.904+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.904+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49768' 2024-09-12T18:33:04.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14547818837312862590', time=2024-09-12T20:11:31.144463+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.178__shadow_.YQsnhUT0agBsOP9bW1wqrTcaFI1jisH_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7533861718893691878', time=2024-09-12T20:13:13.594721+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.238__shadow_.XWW08jrx_3WeqXntNtqUlzrtdIpMJQf_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6437223726706023163', time=2024-09-12T20:13:14.069737+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.239__shadow_.1gmMOFlh9r7ByZFKIWzqTttRRyWm39b_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18107752921583767382', time=2024-09-12T20:13:18.866769+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.246__shadow_.vQCUoqdaZloPUwikAOSPlcy6biKRZ1P_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18157965551691341315', time=2024-09-12T20:13:20.095487+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.248__shadow_.Yg7K7eNXWXyfbGEBLrORfQg49u9uTwc_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10200230685136164710', time=2024-09-12T20:13:23.155265+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.253__shadow_.y38Pc0krHsJdbVMm7Dr_ozDlkY-GxZ3_0 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3862405004753538698', time=2024-09-12T20:14:04.343864+0000, chain.objs.size()=1 2024-09-12T18:33:04.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XYAcb5AM_yPeoZfu1ceJqmgAQnu6qps_0 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10697782408664143627', time=2024-09-12T20:14:04.507457+0000, chain.objs.size()=1 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.paRw518k9NdkNDgYJMtBu2F0UTxTA6L_0 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3974259436327778303', time=2024-09-12T20:14:04.567814+0000, chain.objs.size()=1 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DZi_MFb-hi_INIbpUNxF44RJCuzTF-f_0 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2810718923698396414', time=2024-09-12T20:14:04.998818+0000, chain.objs.size()=1 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._EWm_UlkMWfhkZzd4TSZfVYBOc8dSCx_0 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14278601080871798286', time=2024-09-12T20:14:05.829477+0000, chain.objs.size()=1 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2Qs9FiEgrvhnytxuCRgF8ZjMTcDuXNu_0 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5587358853465986653', time=2024-09-12T20:14:06.668914+0000, chain.objs.size()=1 2024-09-12T18:33:04.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.905+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PxDnWfWZPrx9JmYTdwPGXwmFoqcmwXl_0 2024-09-12T18:33:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.908+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16092484224733695902', time=2024-09-12T20:14:06.710619+0000, chain.objs.size()=1 2024-09-12T18:33:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.908+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5lGp7MWCkxUBk373u5N97Q4vitYFgkK_0 2024-09-12T18:33:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14896247553845274445', time=2024-09-12T20:14:07.194701+0000, chain.objs.size()=1 2024-09-12T18:33:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dGl_C1l_2E22esr6ADxzg-udzU1sDYu_0 2024-09-12T18:33:04.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17324512190449222109', time=2024-09-12T20:14:07.620490+0000, chain.objs.size()=1 2024-09-12T18:33:04.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tdarrhvq9cGjg0Nk3yASokBlXrC6ikM_0 2024-09-12T18:33:04.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8668175729616168899', time=2024-09-12T20:14:07.904079+0000, chain.objs.size()=1 2024-09-12T18:33:04.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._elyuNrpB6cBYc7Krat_Ab5QZW4F5BH_0 2024-09-12T18:33:04.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18148690499381763364', time=2024-09-12T20:14:08.087473+0000, chain.objs.size()=1 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EQNWSZODK8xYOhfFNEB8WM9tuceFRxu_0 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11585167232991033509', time=2024-09-12T20:14:08.660398+0000, chain.objs.size()=1 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.V5hT7e7Ngu0MIvfjtpKGV53evuyUhqc_0 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3062113701993737410', time=2024-09-12T20:14:08.973831+0000, chain.objs.size()=1 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.909+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zCrHrpeCjiNIA_IXyqzO3DyjcYiHSL__0 2024-09-12T18:33:04.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2252433580940360043', time=2024-09-12T20:14:09.343653+0000, chain.objs.size()=1 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DUb0jsLYAKyhWRMOPcA5LUi4nLA9Qt1_0 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11866019805434585638', time=2024-09-12T20:14:09.634151+0000, chain.objs.size()=1 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2XsjW-Si2kwq-y0g8X6trRe0zKBtCZj_0 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2248331386919779199', time=2024-09-12T20:14:10.585464+0000, chain.objs.size()=1 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7Pjw2yq7Vx-puP5YuSyWVehcbMequck_0 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8802572922274539079', time=2024-09-12T20:14:10.717284+0000, chain.objs.size()=1 2024-09-12T18:33:04.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.910+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xYBmaqtiMzEmJXcBlzRujYpfVfv-0Bq_0 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6561789301509878223', time=2024-09-12T20:14:11.008600+0000, chain.objs.size()=1 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MWSW_51YbENePqDP3lgJdZiplcOJDH8_0 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3838724828644411261', time=2024-09-12T20:14:11.883473+0000, chain.objs.size()=1 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Pmxmvyi4tp65Z1kaVDgciKKA1BsPD3D_0 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8590869518674232323', time=2024-09-12T20:14:12.172063+0000, chain.objs.size()=1 2024-09-12T18:33:04.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.913+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.yxYDggdYQGX-Bw6cZ7vZTngZtxUgMct_0 2024-09-12T18:33:04.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.914+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4768722901750402491', time=2024-09-12T20:14:12.343327+0000, chain.objs.size()=1 2024-09-12T18:33:04.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.914+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.d9mVsPyx0JlDopj5ggjRWthR_PA0UX0_0 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11136095095967437618', time=2024-09-12T20:14:12.893212+0000, chain.objs.size()=1 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nsx02a65iDP47n2ZRlZqsW-ycQsB0OX_0 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15490675262656988359', time=2024-09-12T20:14:12.981621+0000, chain.objs.size()=1 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NlwW2tA-4wg_BjIyjf-s4uVVWqGYvTD_0 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3549582541524198395', time=2024-09-12T20:14:13.028125+0000, chain.objs.size()=1 2024-09-12T18:33:04.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.916+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-MP8xR267mY9YGadJwZ-687NViOJwq6_0 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15156589738158561923', time=2024-09-12T20:14:13.165520+0000, chain.objs.size()=1 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Cfi6h3NQe8Lwzt88hNOMC7mZX-mzC3e_0 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7714047647776178035', time=2024-09-12T20:14:13.209229+0000, chain.objs.size()=1 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cy-JzMdAbApHUUZZ7rmFw2Grz2I9N8c_0 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5151913888875286503', time=2024-09-12T20:14:13.209932+0000, chain.objs.size()=1 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8t5TvrWkjzyJApvN-ykqGR3hS4Yotca_0 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7655694118330834906', time=2024-09-12T20:14:13.255676+0000, chain.objs.size()=1 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cFA4NgDF-wBzRj9N54axYEz4-_b77ww_0 2024-09-12T18:33:04.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.948898649799076731', time=2024-09-12T20:14:13.492725+0000, chain.objs.size()=1 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._xWQWoR_6w5NNh2UNDsGGIil--9KgaQ_0 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13902381064902811382', time=2024-09-12T20:14:13.734841+0000, chain.objs.size()=1 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JvPSNF6QCLkm3TmqB_2BrwAtjv-l8WX_0 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7993932060442953303', time=2024-09-12T20:14:13.735492+0000, chain.objs.size()=1 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rU6rX0qNflfWm1Vp6zhbyMtwb0TyBDo_0 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18004218632620107071', time=2024-09-12T20:14:15.021019+0000, chain.objs.size()=1 2024-09-12T18:33:04.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.919+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._xbIau8_LK9WsEb4dXVW5vjhG1_62F4_0 2024-09-12T18:33:04.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.921+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14484939137127486927', time=2024-09-12T20:14:15.064018+0000, chain.objs.size()=1 2024-09-12T18:33:04.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.921+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5azzcFR4YsGf31rYOHylVq4LW8wils9_0 2024-09-12T18:33:04.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.922+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8197836560595149278', time=2024-09-12T20:14:15.223563+0000, chain.objs.size()=1 2024-09-12T18:33:04.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.922+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3NyvpcvPvHTA92aJdN37l-5mjxGmme8_0 2024-09-12T18:33:04.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.922+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15294599728811744712', time=2024-09-12T20:14:15.240239+0000, chain.objs.size()=1 2024-09-12T18:33:04.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.922+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.QDT9WNGG5qsbdb5s1VnAsrjSnpuTu5b_0 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13245193926668575263', time=2024-09-12T20:14:15.822698+0000, chain.objs.size()=1 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.263__shadow_.tAKAo-fYRyorlVGFSsT2SZuF985qyx6_0 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1626494769044669581', time=2024-09-12T20:14:18.107460+0000, chain.objs.size()=1 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.267__shadow_.MGD59m_G3KYzvzjOKqj7BnrFoD7dGAO_0 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3862523894673617684', time=2024-09-12T20:14:28.942491+0000, chain.objs.size()=1 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.285__shadow_.k0HMSwHh8hfOsDFvtHYyngNuR0FDmID_0 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16891711030846365137', time=2024-09-12T20:14:29.621561+0000, chain.objs.size()=1 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.286__shadow_.Y0whuvWyoSrcdPtD4ltXQe6AKuYg5nW_0 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10723860629809256116', time=2024-09-12T20:14:30.863288+0000, chain.objs.size()=1 2024-09-12T18:33:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.288__shadow_.bcfFmFaobsTPGTTa_CCE1PC8_JqJUR7_0 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17225134012799999307', time=2024-09-12T20:14:30.868942+0000, chain.objs.size()=1 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.288__shadow_.s4o-Nm2NcBDEvEmT806r83gGHvE232g_0 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3407053857727543612', time=2024-09-12T20:14:32.080448+0000, chain.objs.size()=1 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.290__shadow_.RU_EOUYbL3j5WhzDWd6ukEkC5mWnD-e_0 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13606306916904917831', time=2024-09-12T20:14:36.504481+0000, chain.objs.size()=1 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.AF-RpAO7Cko71BSl1w8xtvK2gFgo86b_0 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6821072568382210542', time=2024-09-12T20:14:36.505306+0000, chain.objs.size()=1 2024-09-12T18:33:04.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.ZxjuaT9ceEWNLtQS3O12ELMwOPtNERR_0 2024-09-12T18:33:04.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7351667136199876794', time=2024-09-12T20:14:50.703146+0000, chain.objs.size()=1 2024-09-12T18:33:04.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.315__shadow_.dM2MTixmcOWfE9F6Mg3P7p0bCSa9Naj_0 2024-09-12T18:33:04.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8990585863238548528', time=2024-09-12T20:15:32.703733+0000, chain.objs.size()=1 2024-09-12T18:33:04.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.927+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DXecjMUCoJEMjDKV2-z2IVvP4U3Ktd5_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3380362651905592738', time=2024-09-12T20:15:33.743413+0000, chain.objs.size()=1 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eLeqbJAt7XJXqIbauaXuJ2PVBeGBdfL_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17309958131050755714', time=2024-09-12T20:15:33.898634+0000, chain.objs.size()=1 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.r6uTKAIzkltPP5rdeLOFceuNKMtxbeX_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.449821268934170376', time=2024-09-12T20:15:34.047100+0000, chain.objs.size()=1 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0tJjJDQJh8bDjkOji53sW8hBzamx8W6_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9395018423743019568', time=2024-09-12T20:15:34.297099+0000, chain.objs.size()=1 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0X7Nvh4DyzTDJAc8fVWlIcdOcDbpHc-_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8436530546613075085', time=2024-09-12T20:15:34.373220+0000, chain.objs.size()=1 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dJtAcUB974j0Q6CPXjQhhaX36t05erj_0 2024-09-12T18:33:04.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18118749455354080482', time=2024-09-12T20:15:34.428014+0000, chain.objs.size()=1 2024-09-12T18:33:04.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DpZDK7ww57Zr9IGLJVhNCZxtRNSSiOl_0 2024-09-12T18:33:04.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.671022029795948737', time=2024-09-12T20:15:36.115335+0000, chain.objs.size()=1 2024-09-12T18:33:04.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.McrZnQODjgV8rZnuPIaMEbohMK2EPiI_0 2024-09-12T18:33:04.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11440420539858870929', time=2024-09-12T20:15:36.765172+0000, chain.objs.size()=1 2024-09-12T18:33:04.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.933+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rvBbP_itxNOpruEgZitg6w3OvZheINR_0 2024-09-12T18:33:04.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.935+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2231875090947431839', time=2024-09-12T20:15:36.847605+0000, chain.objs.size()=1 2024-09-12T18:33:04.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.935+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oirsPliMdbBp-_Lw8hNjuberctV2dL6_0 2024-09-12T18:33:04.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.936+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14814500213181244135', time=2024-09-12T20:15:37.099028+0000, chain.objs.size()=1 2024-09-12T18:33:04.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.936+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Kk2mLB7KJXxLwrBqiqJSF3tB6nlxGuV_0 2024-09-12T18:33:04.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.936+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9656990704782765233', time=2024-09-12T20:15:37.138964+0000, chain.objs.size()=1 2024-09-12T18:33:04.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.936+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.RqFemEkzmekSg-2i5KLhVk4MdM-xVBm_0 2024-09-12T18:33:04.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7235654484465721222', time=2024-09-12T20:15:37.417193+0000, chain.objs.size()=1 2024-09-12T18:33:04.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HV5WjL57kT0yYXTbshoSwKa5QMZVtZA_0 2024-09-12T18:33:04.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2323531402432294329', time=2024-09-12T20:15:38.459135+0000, chain.objs.size()=1 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2GdTllCzYNNqCtCMSRBwZdhm6oqeaul_0 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7618473195944576325', time=2024-09-12T20:15:38.566409+0000, chain.objs.size()=1 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.auanyb5t10erWfaSsOH47r3n8LSP6t8_0 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15973063240670358304', time=2024-09-12T20:15:38.874608+0000, chain.objs.size()=1 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.aUFSlwiEKaO1VfT4dZBnD2raFonbUSu_0 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8598708883178378077', time=2024-09-12T20:15:38.969345+0000, chain.objs.size()=1 2024-09-12T18:33:04.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TrAh_s-p6PuDF1Z9MJ__sKASvLwiM4G_0 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3437248628933765250', time=2024-09-12T20:15:39.082155+0000, chain.objs.size()=1 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Dt2q1YsnfogOxwDIO-umSBXhl00v5V4_0 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12012959766549537002', time=2024-09-12T20:15:39.816241+0000, chain.objs.size()=1 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BYV4fxogNxQv0hdyJofb9GebbtVTE5Y_0 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7346925886846958145', time=2024-09-12T20:15:40.009539+0000, chain.objs.size()=1 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6FqmwqIqVzaliYHW3VGKMhfEXubUnun_0 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12531300786976648010', time=2024-09-12T20:15:41.349080+0000, chain.objs.size()=1 2024-09-12T18:33:04.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3BASzqQClOJWrlSVa4KTVfa1iG3eRMM_0 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1426145679232680696', time=2024-09-12T20:15:41.561253+0000, chain.objs.size()=1 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.941+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oQ3f4co9LZxg-37ad5m2STlPkJVFS5Z_0 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.942+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4883146263561707782', time=2024-09-12T20:15:41.562064+0000, chain.objs.size()=1 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.AS9jcdtNTjZXqG1GyoMUupkpDNRFgoy_0 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.943+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4728976853841318518', time=2024-09-12T20:15:42.062164+0000, chain.objs.size()=1 2024-09-12T18:33:04.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.943+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zNLkUKtMdE0ArQVPQUb5ft_KG1bz87__0 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.993945222751588208', time=2024-09-12T20:15:42.582179+0000, chain.objs.size()=1 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._Dw8b-Y5DKjA9Ls5fS2cok74sU58MGl_0 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4349316578653898030', time=2024-09-12T20:16:20.255960+0000, chain.objs.size()=1 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YCH0vo56r8ZyFl6Gjq2R-s2Y3Uj_aVD_0 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1397512452243456579', time=2024-09-12T20:16:20.256703+0000, chain.objs.size()=1 2024-09-12T18:33:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.944+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mfjTRJx3HA5b2l3EDzmQvJZNt3aej5N_0 2024-09-12T18:33:04.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.946+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15520853014922119972', time=2024-09-12T20:16:20.407751+0000, chain.objs.size()=1 2024-09-12T18:33:04.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.946+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Gc4mjJh5sKE1yTuRFLs4BPniuigUJ8n_0 2024-09-12T18:33:04.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8016760355334815211', time=2024-09-12T20:16:20.835498+0000, chain.objs.size()=1 2024-09-12T18:33:04.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2IS3n8C8A9clf3XWcn2R-rCwg_YaT-G_0 2024-09-12T18:33:04.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14451872300962738676', time=2024-09-12T20:16:20.836276+0000, chain.objs.size()=1 2024-09-12T18:33:04.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sbwzn4b0LRzOnVsfawj5q9tbYyli2ug_0 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9039503262807818729', time=2024-09-12T20:16:20.869174+0000, chain.objs.size()=1 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DhlgdFQ2Excl6mhMv1GF_YwNoQd4vaH_0 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7330638508965259665', time=2024-09-12T20:16:21.645041+0000, chain.objs.size()=1 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6rHUn79KyNdEbx0uFg5x6kcl84u8xTt_0 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14648993182193574975', time=2024-09-12T20:16:21.786210+0000, chain.objs.size()=1 2024-09-12T18:33:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.947+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QjO8WvZiUvNuzucqNWdWN3KrkobtD2r_0 2024-09-12T18:33:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16045207277138051448', time=2024-09-12T20:16:22.424855+0000, chain.objs.size()=1 2024-09-12T18:33:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.f68h2jmq3lyZ1SQMqaI3PZcH91m4GfS_0 2024-09-12T18:33:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12901863258099379807', time=2024-09-12T20:16:23.226738+0000, chain.objs.size()=1 2024-09-12T18:33:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-YUoOSUrw-mK7on6bSXCfoQwRIGE3nk_0 2024-09-12T18:33:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13374922281541801501', time=2024-09-12T20:16:23.908018+0000, chain.objs.size()=1 2024-09-12T18:33:04.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EBmpe7YXwpr22pBfpH2_GrexasTqAtv_0 2024-09-12T18:33:04.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13503952095320125028', time=2024-09-12T20:16:24.519803+0000, chain.objs.size()=1 2024-09-12T18:33:04.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fMfbVGFCueicfsMyN9KE0P3nbYsA71A_0 2024-09-12T18:33:04.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13749230184582324093', time=2024-09-12T20:16:25.166336+0000, chain.objs.size()=1 2024-09-12T18:33:04.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cWu9e8AQVwZ65QBBUwwxtpgEg49yIf5_0 2024-09-12T18:33:04.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1926245519423334823', time=2024-09-12T20:16:26.064443+0000, chain.objs.size()=1 2024-09-12T18:33:04.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gwBHJ5-Obdaapv_DlksrY6ccrtYhU8m_0 2024-09-12T18:33:04.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.321103349531655563', time=2024-09-12T20:16:26.096389+0000, chain.objs.size()=1 2024-09-12T18:33:04.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UfzUziaLewNZCX78pQc24j21zhUxymx_0 2024-09-12T18:33:04.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12995149578263181911', time=2024-09-12T20:16:26.686533+0000, chain.objs.size()=1 2024-09-12T18:33:04.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aqfWmXxa5PHk0kWyItZoZMbkWO3AgT2_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9346266229236098204', time=2024-09-12T20:16:26.687344+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QU9TIY8r_tspWKXYVvm1Rsp2zGTVksP_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17531962639054629256', time=2024-09-12T20:16:27.713647+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zIiW2-C2cu37-6Pt-E0pLZHqyCAHJra_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.357768773680702116', time=2024-09-12T20:16:27.863390+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pM0-mlrffa5T5VwHMcJzwzqdmsD8svP_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17586800493360630348', time=2024-09-12T20:16:28.044453+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BHLBERD9fj5EdqIioXajT8zAW1fI_ls_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15574284303676348806', time=2024-09-12T20:16:28.119424+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vG8-Q_a4gNBksygppn5SblGQOOXNOsa_0 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2532736880750530197', time=2024-09-12T20:16:28.643332+0000, chain.objs.size()=1 2024-09-12T18:33:04.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mTAN1gof8hBkuYcfpJL8QG7WbS97RDl_0 2024-09-12T18:33:04.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2648690650169748156', time=2024-09-12T20:16:28.785191+0000, chain.objs.size()=1 2024-09-12T18:33:04.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eCS4TFuFYOOxlVrWb0FSoo01swDP-O4_0 2024-09-12T18:33:04.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17827842614356529840', time=2024-09-12T20:16:29.073085+0000, chain.objs.size()=1 2024-09-12T18:33:04.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9AqjC-d4yUeo0OnrWs8iofvdUYIr9He_0 2024-09-12T18:33:04.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/49768 2024-09-12T18:33:04.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:33:04.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9602535498549981040', time=2024-09-12T20:16:29.202267+0000, chain.objs.size()=1 2024-09-12T18:33:04.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fSTjJefVXrl4Bl5Qd0I2H01xsf1KsXE_0 2024-09-12T18:33:04.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7964375090428804918', time=2024-09-12T20:16:29.831195+0000, chain.objs.size()=1 2024-09-12T18:33:04.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZZOyoAfgjbzD1IqvCr3Jsm1CUc_xCMS_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11850937695002197008', time=2024-09-12T20:16:30.351778+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PU86uQ2Hf27hgmTU1T1VVUJ2surQGo-_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15525311741262942394', time=2024-09-12T20:16:30.352559+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CEjeIHVJPI9IiJdDLdcOowfNVtHapVF_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16086845290126349687', time=2024-09-12T20:16:30.649831+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7k0igGJPyD8xOCi7eJEY7gq8OgPDj0z_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4058108789090347615', time=2024-09-12T20:16:30.802741+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.itQgMyzdRRMivCfFh2KCfW7SDJ9Y0pZ_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13883592080923248766', time=2024-09-12T20:16:30.901045+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3Is0khYe1U25UBXOe3HMxG1vFslOgUX_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4785975570348289430', time=2024-09-12T20:17:26.717715+0000, chain.objs.size()=1 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.431__shadow_.ZCR_fBWokqOUzjAMPH5WtwhpbIqUyog_0 2024-09-12T18:33:04.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7943311027289196030', time=2024-09-12T20:17:47.785237+0000, chain.objs.size()=1 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.464__shadow_.KHwg9eLa838zLwGTvHLiciS5-dsAUHH_0 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8599820085812845621', time=2024-09-12T20:17:57.249784+0000, chain.objs.size()=1 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.m2BN1F0Ecp6m4l1SbU3DjnR94xmGb52_0 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17698591631654035490', time=2024-09-12T20:18:25.891382+0000, chain.objs.size()=1 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.516__multipart_mymultipartcopy.2~xrvcpKz8puRgZGhUkcWj74_ChDWeQHW.1 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12692504257121259422', time=2024-09-12T20:18:52.558448+0000, chain.objs.size()=3 2024-09-12T18:33:04.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.963+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~6FTP6ndSC4dAkIF8FQer4mfCFuj0FbY.1 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~6FTP6ndSC4dAkIF8FQer4mfCFuj0FbY.2 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~6FTP6ndSC4dAkIF8FQer4mfCFuj0FbY.3 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1246562396959868988', time=2024-09-12T20:21:35.769890+0000, chain.objs.size()=1 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:QU4PTGcR2W7RDl8edNeo6YivsFCxg2L_.5curkZsDpjrIvdjTjkfXDPUJhDBsGMZ_0 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14274240838901767250', time=2024-09-12T20:21:57.831136+0000, chain.objs.size()=1 2024-09-12T18:33:04.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:jxzr1m96inQ4CvMjoaU1m9toGy.Ylhl_.xXFRNhAtkr6T5PRfFF91teLHFOgT2lp_0 2024-09-12T18:33:04.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8975410340831455304', time=2024-09-12T20:22:00.648622+0000, chain.objs.size()=1 2024-09-12T18:33:04.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:Wfj3nWwa5bqRA0rBUtaDe.p1nhFky0c_.k7o_diRLnJPjcrtDJSXMqlK__G89I2H_0 2024-09-12T18:33:04.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9253760478242002052', time=2024-09-12T20:22:07.485358+0000, chain.objs.size()=1 2024-09-12T18:33:04.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:9Dn7Hb3r9q7o.Wt7ghW8n4YZFhzVEhE_.s2IMFiYumvlcd7ncKKGFjfCTbmNZyeR_0 2024-09-12T18:33:04.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10044224254135651185', time=2024-09-12T20:22:39.223105+0000, chain.objs.size()=1 2024-09-12T18:33:04.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:jD4g613KMKWEsDGNSoQXs80eQeCLtoU_.OXgEBMuIaa7GHmaJv4QyjX5pfcHGV5B_0 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12464930956169835551', time=2024-09-12T20:22:39.695891+0000, chain.objs.size()=1 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.587__shadow:RZ3wi5ZrfX3umGumR5OrBYOXmpvP5Pc_.lkZsi8FyPPwpJoCWHoQoCiHr4fz7rJn_0 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4660408936060700743', time=2024-09-12T20:24:53.371285+0000, chain.objs.size()=1 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.617__shadow_.rAfH7eaAPpg3iqZzIjIoETZ24dbRK75_0 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9551729288579662030', time=2024-09-12T20:25:54.946735+0000, chain.objs.size()=1 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.619__shadow_.8XDxWpOwNu8cbXsd-N0B8OO3xI5iO_S_0 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2700336885007331682', time=2024-09-12T20:26:52.108361+0000, chain.objs.size()=1 2024-09-12T18:33:04.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.653__shadow_.dttK7tSZdVge1rC2fSYrCUG2sRbY2mj_0 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1704755737213055845', time=2024-09-12T20:27:17.337656+0000, chain.objs.size()=1 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.670__shadow_.y6BhSFBVNrKsax1dSFALA0i0iQXjV0e_0 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2451317317375658989', time=2024-09-12T20:27:36.462998+0000, chain.objs.size()=1 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.706__shadow_.6SwsgtTT-maonoAHIAVoWhGOazCPWVC_0 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13366746012871571395', time=2024-09-12T20:27:38.261683+0000, chain.objs.size()=1 2024-09-12T18:33:04.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.709__shadow_.0kF9Jdy_Rrw7-4lCAJgcQNhxrw68jZ0_0 2024-09-12T18:33:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.978+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:04.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.980+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:33:04.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.982+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:04.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.982+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47571' 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2306447321209986508', time=2024-09-12T20:13:09.941968+0000, chain.objs.size()=1 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.233__shadow_.7pt5W3pFjZCzLCuWqEoGBZilQMzY-c1_0 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12039000958344338412', time=2024-09-12T20:13:11.789564+0000, chain.objs.size()=1 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.236__shadow_.NTAojLcXFc0ePqF-QHcuk-EPt90iyUk_0 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.88448323767975352', time=2024-09-12T20:13:11.793655+0000, chain.objs.size()=1 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.236__shadow_.eLJbodiO-51wsTNh_SnK0ZBN20nd_qv_0 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12274658264904013344', time=2024-09-12T20:13:18.237367+0000, chain.objs.size()=1 2024-09-12T18:33:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.245__shadow_.mRZgeODK0Bfoj7PUjvy24tDhv3jZdJf_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9408213375202207746', time=2024-09-12T20:13:18.237901+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.245__shadow_.tkPJ8zyXdQefAfspG3_wXYLCqcBXmMp_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9063875554690476695', time=2024-09-12T20:13:19.498135+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.247__shadow_.2wvzKbpfy7yF8eQdC8-e0wHBCQm2PEe_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14960617252122555481', time=2024-09-12T20:13:20.703472+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.249__shadow_.lix8hOwqwZu0g6zxiZb5Cd5gatfpEj5_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11864246128975340324', time=2024-09-12T20:13:23.754556+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.254__shadow_.OXgpFN-4IwCpTLZLprUKSc3jzLVz97A_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4016103102549474440', time=2024-09-12T20:13:25.537387+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.257__shadow_.dBrm2B3gn-Ud4Q8IoZJQYF5qQU0JzfR_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9380017009935153319', time=2024-09-12T20:14:04.012023+0000, chain.objs.size()=1 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SrPGL1evX5vC9SOTFbhosEm6JYNaQpq_0 2024-09-12T18:33:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7486564185358721772', time=2024-09-12T20:14:04.715661+0000, chain.objs.size()=1 2024-09-12T18:33:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zgbvblq0AfOJbYV9KNF7dFLNbdahufH_0 2024-09-12T18:33:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10746035725930796761', time=2024-09-12T20:14:04.828857+0000, chain.objs.size()=1 2024-09-12T18:33:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.983+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bz8-CVvU5wSsoDN2RF6q0_3W5mydJpN_0 2024-09-12T18:33:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.989+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9618150741002363703', time=2024-09-12T20:14:05.065404+0000, chain.objs.size()=1 2024-09-12T18:33:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.989+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NtpCtQpSHoIsi7WQSFnl_sUOyG9cP7s_0 2024-09-12T18:33:04.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.989+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6592220697201014119', time=2024-09-12T20:14:05.854456+0000, chain.objs.size()=1 2024-09-12T18:33:04.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.989+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cCSs04DqmkHzeBP1vvS8uV331kHqZsE_0 2024-09-12T18:33:04.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11184783926325992764', time=2024-09-12T20:14:06.407588+0000, chain.objs.size()=1 2024-09-12T18:33:04.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Lp7rdBQtapIbg0wAedwI0YxWWDVxXMt_0 2024-09-12T18:33:04.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13078364561539385058', time=2024-09-12T20:14:06.408278+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.uW5DPj9NyLDjD55_R9zOxfaoT6cStgA_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15923051955910273551', time=2024-09-12T20:14:06.501306+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5NJ1HzQ9A4xuxhu-SkkmOx9eCmO5sX9_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11172759701918828384', time=2024-09-12T20:14:06.519496+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.J3ttZ8KZjCVNO28kn_GGuBLQ8d4QCOs_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1039693920977258453', time=2024-09-12T20:14:07.156084+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Swiyf0olIsmoLhj6wJbb8Z73ICO7vkn_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15113517426797624578', time=2024-09-12T20:14:07.844870+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ydKs5-BcZN4qpfdGfgUvcT-zhJcRKd5_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12745408555706772997', time=2024-09-12T20:14:08.877580+0000, chain.objs.size()=1 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-B_AYUFyZSP69SOB5bPQOaXHsi_EIAS_0 2024-09-12T18:33:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12369201280857973742', time=2024-09-12T20:14:09.232496+0000, chain.objs.size()=1 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2Em7nyd_SJLgrc1EPYO9k_NKAl5UoOq_0 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6245536113964132463', time=2024-09-12T20:14:09.341944+0000, chain.objs.size()=1 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2e0R8gDGXYzAVgbJGxWppsPz7rNoZTv_0 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12890923587993561694', time=2024-09-12T20:14:09.692957+0000, chain.objs.size()=1 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6WZi1r60XnwSMSLUtQ32LAE46QDIqER_0 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11266360340986450639', time=2024-09-12T20:14:11.472007+0000, chain.objs.size()=1 2024-09-12T18:33:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.990+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8cfAvSaLD4_AK4EFPyExraeeciNPmO8_0 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5208220302776187475', time=2024-09-12T20:14:12.185015+0000, chain.objs.size()=1 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.y50LZdgLpqSZWRv5RJ_Q-agTP-s08-e_0 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4899335180695136665', time=2024-09-12T20:14:12.532746+0000, chain.objs.size()=1 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.y8AC_o41fAkBJa6pWxQTT-BsmWzuHM8_0 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8971376168887723235', time=2024-09-12T20:14:13.031522+0000, chain.objs.size()=1 2024-09-12T18:33:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.995+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hHJJHrC4AzXRD_9kTUrJ1V_RqBW0tQg_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1826011245013474059', time=2024-09-12T20:14:13.056120+0000, chain.objs.size()=1 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.H8KZ8R_dknbLZcERg4LR5W4oMCy8G3F_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.851607138210155793', time=2024-09-12T20:14:13.276101+0000, chain.objs.size()=1 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2xCdbmSBazNaPbQVACZom4PufFHh8qL_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16137131098459360048', time=2024-09-12T20:14:13.922028+0000, chain.objs.size()=1 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-Q5leDfVzWVAGM65aOnXdRGY79GWJBu_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5212982397916003395', time=2024-09-12T20:14:13.934872+0000, chain.objs.size()=1 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nP1QKiCOtJ_V2emHZnyaUUZlSLAKHMK_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6790841062033239886', time=2024-09-12T20:14:14.256164+0000, chain.objs.size()=1 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.yYXR0_0iuOBx2JG_tmbutpKRh87WJOZ_0 2024-09-12T18:33:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6540859150056017056', time=2024-09-12T20:14:14.636132+0000, chain.objs.size()=1 2024-09-12T18:33:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8yZWQrqtfYxVrgvfJUAP8h7VBNjHCL7_0 2024-09-12T18:33:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15627018765041036423', time=2024-09-12T20:14:15.056666+0000, chain.objs.size()=1 2024-09-12T18:33:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RAJ9NrNt0Sl0BerD98R4Zc5GEVPq2iQ_0 2024-09-12T18:33:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7259097409019785319', time=2024-09-12T20:14:17.509695+0000, chain.objs.size()=1 2024-09-12T18:33:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:04.996+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.266__shadow_.zzIcUpdbt8rH8KfGOGNzNElfaK7YIL5_0 2024-09-12T18:33:05.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7048898374584415412', time=2024-09-12T20:14:22.733173+0000, chain.objs.size()=1 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.275__shadow_.7dj6T0zgD7LlV8-iVrOYMfhRAltLSZ9_0 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14501184812697888600', time=2024-09-12T20:14:23.954705+0000, chain.objs.size()=1 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.277__shadow_.sig6PuNhTUvVsmeWHsAzkn0hZaePBRF_0 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5387035875112005795', time=2024-09-12T20:14:27.050854+0000, chain.objs.size()=1 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.282__shadow_.78k6tHbGIGJde9z6d6WtF2jtG9SomGq_0 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11995203002285281043', time=2024-09-12T20:14:30.263152+0000, chain.objs.size()=1 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.287__shadow_.9YHmsagfgRsoN_-u6eHir7z6EpXRouh_0 2024-09-12T18:33:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3457842919906745417', time=2024-09-12T20:14:34.492561+0000, chain.objs.size()=1 2024-09-12T18:33:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.000+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.OkXuZbZBokQxhL7evyoQNRXutTfa9tC_0 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16792452348712382679', time=2024-09-12T20:14:34.520292+0000, chain.objs.size()=1 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.1Rw_KAQe3EjYBwHk_3k8CiYtZRk1IHe_0 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16446173651651136641', time=2024-09-12T20:14:45.965629+0000, chain.objs.size()=1 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.307__shadow:JTy0nZu3Cnc5RWS2w.EdvkLDToyNHXj_.w4xT7qx0LSoZqV2DN3uEysIrE6qShqP_0 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10766964795044412810', time=2024-09-12T20:15:32.183183+0000, chain.objs.size()=1 2024-09-12T18:33:05.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qmtv8OjgaHxElrS97yT9eUO9io7_2yl_0 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17135023386241288933', time=2024-09-12T20:15:32.321341+0000, chain.objs.size()=1 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._GKns89L0J66mYkcM1KrM1cVNvlEKCA_0 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7595950438827165445', time=2024-09-12T20:15:32.321937+0000, chain.objs.size()=1 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-aOFCwYMbWtGlV7S39kev9VP7x7LKIk_0 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9173122635097062797', time=2024-09-12T20:15:32.673155+0000, chain.objs.size()=1 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.002+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TU1TENC8mAQvFvWuwdzC_e0BJPnNttI_0 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.003+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7635448961539018926', time=2024-09-12T20:15:34.009388+0000, chain.objs.size()=1 2024-09-12T18:33:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.003+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4Hh-AEj54aHQVAF3MXKXRIywOGHUbMs_0 2024-09-12T18:33:05.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.004+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12921697950244577567', time=2024-09-12T20:15:34.390514+0000, chain.objs.size()=1 2024-09-12T18:33:05.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.004+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6cWDXB2HNdPDy8gyA2paZ8TA7Qw9E32_0 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5253632960130938668', time=2024-09-12T20:15:34.518950+0000, chain.objs.size()=1 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-oshnxnMA7JaC6PHU12FwEsGuVJNbH3_0 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14990875445459655568', time=2024-09-12T20:15:35.510681+0000, chain.objs.size()=1 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.kP_0TNK7Jrcjh4DMTtgn2YBsIW5Jaed_0 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2813161817133858724', time=2024-09-12T20:15:36.158223+0000, chain.objs.size()=1 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.s5u-2BQftUFPMVIl9hfKeCKhcKtIiNR_0 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15955446564303169700', time=2024-09-12T20:15:36.226568+0000, chain.objs.size()=1 2024-09-12T18:33:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.005+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8OudI_99stvZRji1eHQyDVaHqPG4Bcx_0 2024-09-12T18:33:05.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9012376855281548334', time=2024-09-12T20:15:37.078312+0000, chain.objs.size()=1 2024-09-12T18:33:05.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2jHxzt3UwoytOmALecyQ7cMjDYZbX4S_0 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8556700703389478969', time=2024-09-12T20:15:37.139345+0000, chain.objs.size()=1 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.RJoch9ZMa3NFlVwPRp2S5GLMnJk-q6S_0 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13700663882009632121', time=2024-09-12T20:15:37.580555+0000, chain.objs.size()=1 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JdS3OixNirN6GOceGm-YpnHszc5i5aD_0 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12229417426913006228', time=2024-09-12T20:15:38.026868+0000, chain.objs.size()=1 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZbVsBTyA6zT_eE3Snnw2gJYPBMMt-2W_0 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3818251152034390645', time=2024-09-12T20:15:38.182990+0000, chain.objs.size()=1 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.R5_NaG9RPQJe7wJFLLSCbeFxoj6kPER_0 2024-09-12T18:33:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17081097311235154834', time=2024-09-12T20:15:38.183716+0000, chain.objs.size()=1 2024-09-12T18:33:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.007+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.b6yP7umlbiijYlLVqKlBMVkMdpI9nwl_0 2024-09-12T18:33:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.009+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7153631374678502564', time=2024-09-12T20:15:38.224681+0000, chain.objs.size()=1 2024-09-12T18:33:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.009+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BNDBC15bqU8oJJADRKoNgWAO4gwlGRV_0 2024-09-12T18:33:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.009+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12056090032505199458', time=2024-09-12T20:15:38.331780+0000, chain.objs.size()=1 2024-09-12T18:33:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.009+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3Xinl_-IQCLFsfgN1tNbGX3GxEiTCn6_0 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14096001432347503824', time=2024-09-12T20:15:38.530538+0000, chain.objs.size()=1 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3bUFl9Ayo7h11KOjZYMGB2OVQ_T19tB_0 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8143656779885497759', time=2024-09-12T20:15:38.613186+0000, chain.objs.size()=1 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oTbe0J9G5LPNjttmV2YWTnN3KnYsKW7_0 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11998827240015006783', time=2024-09-12T20:15:38.652214+0000, chain.objs.size()=1 2024-09-12T18:33:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.012+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2mdt1sT6_bu29F9rej87ju_Qqbcho7S_0 2024-09-12T18:33:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11188878889712548357', time=2024-09-12T20:15:39.558561+0000, chain.objs.size()=1 2024-09-12T18:33:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zHU1oGsSBWAAOJQ0i5PuwKo9O-DhK9m_0 2024-09-12T18:33:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14633571294239495879', time=2024-09-12T20:15:39.745042+0000, chain.objs.size()=1 2024-09-12T18:33:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tEbCOc8S5b0Xe4MOzcTGCBfHgrD1kgo_0 2024-09-12T18:33:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17214587876447227962', time=2024-09-12T20:15:40.178541+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.V3E7Bw4lZJHcd3XTfvvbPZAcKW2iMQs_0 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2079293667617117885', time=2024-09-12T20:15:40.314967+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wjMSiGBEhOYRuw1x61hyf4ZSmH-hHaD_0 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14975439869337689050', time=2024-09-12T20:15:41.052617+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ud3xGkSdJq2zSs0ls4n5vWm4VJAXu5j_0 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6745847375574384440', time=2024-09-12T20:15:41.069451+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hFSsu9QNA46AtB4wmtgE0DfXLEk4Uln_0 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14860261826474638722', time=2024-09-12T20:15:41.097615+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nC6qjJSO8JEaGk3QQXG28IlYGgrmVY8_0 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7109087499369565204', time=2024-09-12T20:16:20.149666+0000, chain.objs.size()=1 2024-09-12T18:33:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.015+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WOmWUbfq8heFmXPyCk7I8PwZ6UIXLoH_0 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17987021867754012628', time=2024-09-12T20:16:20.510928+0000, chain.objs.size()=1 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Xx8-Ri_sUE720RRKMre889U6JNNF5QX_0 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6689209827841133133', time=2024-09-12T20:16:20.641529+0000, chain.objs.size()=1 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.URjtTIhOzvwbfc_bxFqt7DEdcgmLHGn_0 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13494417105260698245', time=2024-09-12T20:16:20.969667+0000, chain.objs.size()=1 2024-09-12T18:33:05.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.018+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.84tn7dmDc3MqRRt6mOgU8oA7BJ9dKNH_0 2024-09-12T18:33:05.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.021+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8157862997898055867', time=2024-09-12T20:16:21.047822+0000, chain.objs.size()=1 2024-09-12T18:33:05.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.021+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cfsF98yXWANMRPP8wdXfStmf4Ou_VpB_0 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11674145437463300246', time=2024-09-12T20:16:21.143908+0000, chain.objs.size()=1 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gzhzOSaCRz8fc5XDxc5DXaBBVgbnjx9_0 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13507519542400371183', time=2024-09-12T20:16:21.709872+0000, chain.objs.size()=1 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bnbAWn_Y_13fsP9r7pulxF2ce43QOaP_0 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12395202821204410960', time=2024-09-12T20:16:21.959245+0000, chain.objs.size()=1 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.XYVNwazn4pTAaJaI0g9kSDthDnFs2Ei_0 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4726329110337627732', time=2024-09-12T20:16:21.996501+0000, chain.objs.size()=1 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.e43zELQ7IJX1wo5YHuE9Wx5XNr3ZlEp_0 2024-09-12T18:33:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7584623078317049983', time=2024-09-12T20:16:22.235670+0000, chain.objs.size()=1 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mW9m3taibdJ-uiWTKLGrPjrmZ1pItr1_0 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10362320755137831690', time=2024-09-12T20:16:23.096690+0000, chain.objs.size()=1 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kEkueG-rTFXu4JjxpSbSVbbSVQfT5TX_0 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5096149244241218336', time=2024-09-12T20:16:23.097962+0000, chain.objs.size()=1 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vZcXNDnAk965K5XKs6HK_62gigVEzgd_0 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14838277260888305949', time=2024-09-12T20:16:23.373986+0000, chain.objs.size()=1 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wHAkDThMIDYMceGKucLVV0pJ3TxhiO__0 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17460116563979805762', time=2024-09-12T20:16:23.489343+0000, chain.objs.size()=1 2024-09-12T18:33:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mRU8hG8nOttGmJIInCT3hbB5Z4dS2vH_0 2024-09-12T18:33:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3220237351543480824', time=2024-09-12T20:16:23.559944+0000, chain.objs.size()=1 2024-09-12T18:33:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.023+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3vlvjET_xg54ANufrI10Io3OqLDgKIh_0 2024-09-12T18:33:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.026+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13307669069981078909', time=2024-09-12T20:16:23.728309+0000, chain.objs.size()=1 2024-09-12T18:33:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.026+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xNiDHhr7vzZx2oMudbuvkLE0TIY_Vl6_0 2024-09-12T18:33:05.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.029+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2944203800181752739', time=2024-09-12T20:16:23.834272+0000, chain.objs.size()=1 2024-09-12T18:33:05.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.029+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aS_vFMTEJDEFCrwnjwmUm6H4Fp465s2_0 2024-09-12T18:33:05.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.029+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3191693902958194825', time=2024-09-12T20:16:24.057085+0000, chain.objs.size()=1 2024-09-12T18:33:05.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.029+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3ezeZkMa0Saae4eYmEgif3Djk7l17mh_0 2024-09-12T18:33:05.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3868058909586525970', time=2024-09-12T20:16:24.080953+0000, chain.objs.size()=1 2024-09-12T18:33:05.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0bXWMQY3gSju9dg29SJ5Vdc8SbKN8z3_0 2024-09-12T18:33:05.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1882607206400469827', time=2024-09-12T20:16:24.520136+0000, chain.objs.size()=1 2024-09-12T18:33:05.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4cG90R2BragWcFn5iHHc_F82UdP69CY_0 2024-09-12T18:33:05.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14129834900404018057', time=2024-09-12T20:16:24.925889+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9RvTaKK-csW_Z0Dc246wjZe2S_L5eis_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15048345607036091282', time=2024-09-12T20:16:25.121715+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.iZjVYcD_uMy7j4KITLDK4bGaUkzKUus_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14196806750750355883', time=2024-09-12T20:16:25.291515+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._g6Hko0gLDY1G5eXXlpd5e_aabr8ofL_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1931096673554437106', time=2024-09-12T20:16:25.292377+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F1CXfPqBRKG5PYdW0yDGA2Zqxf0F2z5_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10477906500961917680', time=2024-09-12T20:16:25.925829+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jft90WfRjL5gmyq-I9-wqi1OeCXbNAB_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8518458015320102129', time=2024-09-12T20:16:26.182398+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.d-FYArc2bXORfeT6DUUXcWMQJ4pBymS_0 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1029584919079214329', time=2024-09-12T20:16:26.442549+0000, chain.objs.size()=1 2024-09-12T18:33:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.031+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mjRLwBzYY5qJfudUWxfr9BK4p3dB5yD_0 2024-09-12T18:33:05.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.034+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1998343958013892612', time=2024-09-12T20:16:26.854909+0000, chain.objs.size()=1 2024-09-12T18:33:05.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.034+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8knIvvSd8dpU7UHga1zcMqSYwVVtPb6_0 2024-09-12T18:33:05.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.034+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5445904658636071732', time=2024-09-12T20:16:26.949485+0000, chain.objs.size()=1 2024-09-12T18:33:05.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.034+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YFtOJ-QBb62qzwRVOeLt6pWEq4D1e1j_0 2024-09-12T18:33:05.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.044+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/47571 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9363221982273836104', time=2024-09-12T20:16:28.194620+0000, chain.objs.size()=1 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.USR6KBvfm__soEWgs1-K9OXEreUhV2o_0 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15477152989178737115', time=2024-09-12T20:16:28.239748+0000, chain.objs.size()=1 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sAE3MCq2oAmkh-aiVFSkug66-jqMdyd_0 2024-09-12T18:33:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8312397036015394519', time=2024-09-12T20:16:29.140147+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Xmzhf5z4H_9Aym9aWI2JF5pYHL2kV5Y_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1711259427302866518', time=2024-09-12T20:16:30.267622+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.p7wbRlxev_YIc4NNxAc1wPXF9YdOMuW_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2535417493896154601', time=2024-09-12T20:16:30.425337+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bxrkvvERcNWBBIyJQzgrWNAcwd34YpZ_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7329627918874515624', time=2024-09-12T20:16:30.473550+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FZZ1VyjbJZ7RU25zaLsO7TBcTLRAER7_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6944623910934570079', time=2024-09-12T20:16:30.517587+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._ACtP3VG4-x7D7HkSGMROC-TzBOIX3p_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14603171443182497294', time=2024-09-12T20:16:38.748734+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.339__shadow_.oRMBqa_kHGvQ6LhXfuqtyO-4dF5mPm-_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9916417300130348484', time=2024-09-12T20:18:01.149128+0000, chain.objs.size()=1 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.486__shadow_.sYEdO6JxhG_Yh_6suJ6yqwa2PeZ-tUW_0 2024-09-12T18:33:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5641739019590424861', time=2024-09-12T20:18:04.507348+0000, chain.objs.size()=1 2024-09-12T18:33:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.491__shadow_.rYPdRxGbM6pfMmdjsU4tqlYArV2I-uu_0 2024-09-12T18:33:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17427298331057515409', time=2024-09-12T20:21:32.160954+0000, chain.objs.size()=1 2024-09-12T18:33:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:rSESQbU-zkNnjTsO14CTdSxCo2YGPwM_.hGxbzXE_V93c3UkV-gCo6ZGhnDEX4N-_0 2024-09-12T18:33:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7155950423910340817', time=2024-09-12T20:21:34.889052+0000, chain.objs.size()=1 2024-09-12T18:33:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.046+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:jK7wodMsSQuslPU.reuSXEpAyrVhYxZ_.ob1xCtyfEdlOqr2b0BPWJGTXkUu4A6k_0 2024-09-12T18:33:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.051+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7074895508259923074', time=2024-09-12T20:22:00.340128+0000, chain.objs.size()=1 2024-09-12T18:33:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.051+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:9-eNJKmS-XWtx0xH--sZ5hc62C-d48c_.Zqt3Atirl3d_IOLRJoo-aA9KHKdMu3H_0 2024-09-12T18:33:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.051+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7690342199881719694', time=2024-09-12T20:22:11.272604+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.051+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:BRYnV1677VIotxDJhUtrBkdaPvYsCR._.ZPqd8GQWLoVd-LtKmQJOwJvbr409Q9Z_0 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18243720720911046743', time=2024-09-12T20:22:12.869972+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:rEPACudlZ5klQAZqL-f0pjcdaWTDDgI_.oQxQ9a_oJ8ua02ZnsVElYMizFnwHdVa_0 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4509529524951998233', time=2024-09-12T20:22:31.705838+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:Yo731Ygm61JRDCua-HkEz6wvzqam9UH_.D07mT4078_3yLYKulVmi7768WoHC6LQ_0 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15946010913319714597', time=2024-09-12T20:22:33.962627+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:MUwriHlaR-kqwP2vTsUzNPn6hwIeFdz_.8jT8nCTiYnC5zc_7ORWWTx9-OruPCPc_0 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13249488193129672427', time=2024-09-12T20:26:47.451553+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.648__shadow_.T9czivn3iwVOw_GHKK-wMA0ORjL1QEj_0 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14122546657531161117', time=2024-09-12T20:27:16.478854+0000, chain.objs.size()=1 2024-09-12T18:33:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.052+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.668__shadow_.8ylhJrXQquqPsYbCXoZfVrhKoUjZc3M_0 2024-09-12T18:33:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.056+0000 7f4494d0a640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.204:6824/1176062071,v1:172.21.15.204:6825/1176062071] conn(0x7f436008cbc0 msgr2=0x7f436008f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:33:05.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.057+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.062+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:33:05.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.064+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49978' 2024-09-12T18:33:05.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_Ig1YkeP284R7VxEALU9FaP1b-bdv3ea', time=2024-09-12T20:11:05.746137+0000, chain.objs.size()=1 2024-09-12T18:33:05.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.qWomapCVwi2_iRzwRd5VyrJGZ4Q1W8A_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11398948857223175705', time=2024-09-12T20:13:08.021466+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.230__shadow_.EjPY-77K2Yy806jMs2SGHyA-ICsSvbf_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1104262449878981400', time=2024-09-12T20:13:20.091578+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.248__shadow_.zOS-VJVgpTiskOX95ETgtxv7kED785L_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11497349438978614358', time=2024-09-12T20:13:21.301561+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.250__shadow_.VX0w42OAeGEnZqio4G09SYxzPjJ1Ndj_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10377292640814469189', time=2024-09-12T20:13:23.766312+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.254__shadow_.8SB2DWVrt6OJ7fF3DNPAVKFykZ6qCRx_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5487216747628085002', time=2024-09-12T20:14:04.186283+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qRfaycvSnNH_H65qdcOMA1ewfJJFshr_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7153731697309681718', time=2024-09-12T20:14:04.201965+0000, chain.objs.size()=1 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ugeJE-dSLUTyy_wQfNHv67oA6BUA-Qw_0 2024-09-12T18:33:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15064470099155930165', time=2024-09-12T20:14:04.484997+0000, chain.objs.size()=1 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Wr7tIT8c8l5kO0fOR4RLT4wSnve3OGg_0 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9321337595148566987', time=2024-09-12T20:14:05.680013+0000, chain.objs.size()=1 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Tp6xvM7JAk4rT3dHJ3lwTS4g0UPddP3_0 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17352618500284763175', time=2024-09-12T20:14:05.779706+0000, chain.objs.size()=1 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.krIBFiL_uVfzHpKWFq3W3F6u05VC12N_0 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5653796768627161024', time=2024-09-12T20:14:05.960652+0000, chain.objs.size()=1 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qBL8P2gmFFW1B0egxSOCbXOH78PzRpv_0 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5092960820253441222', time=2024-09-12T20:14:07.167452+0000, chain.objs.size()=1 2024-09-12T18:33:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.065+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iZJ411nTqRbLnEKZj0AKjwRoqMEcJq1_0 2024-09-12T18:33:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.068+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14627728065766538515', time=2024-09-12T20:14:08.092013+0000, chain.objs.size()=1 2024-09-12T18:33:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.068+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.SLgc-hWCUivChfhwUhhQlnBv7M4JlWB_0 2024-09-12T18:33:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.068+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2428589259214941309', time=2024-09-12T20:14:08.161178+0000, chain.objs.size()=1 2024-09-12T18:33:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.068+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.455vFGNC9xS4w9WDGMTOXl6XYacxqfY_0 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4672123123679948254', time=2024-09-12T20:14:08.586499+0000, chain.objs.size()=1 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6J_5Rc_kbA1E8_Oj9jdSILaByLQmqbJ_0 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17328674508039985594', time=2024-09-12T20:14:08.740915+0000, chain.objs.size()=1 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IZUaBtt1nXwYeecfSpIqF5ZkPGD7LXt_0 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8237801178952855944', time=2024-09-12T20:14:08.937556+0000, chain.objs.size()=1 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NX3cVIfbY3JClECK-qUudeaaPe3yJac_0 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11706367335279764323', time=2024-09-12T20:14:09.387288+0000, chain.objs.size()=1 2024-09-12T18:33:05.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.070+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Wjt2CnkYA5vYmMIB7kTAXQFe3x_UXiP_0 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.844980855909485162', time=2024-09-12T20:14:09.401069+0000, chain.objs.size()=1 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.e6T8HoO-vju6TQMktqEvlg3Rl_3Fdon_0 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2755709271503638969', time=2024-09-12T20:14:09.460603+0000, chain.objs.size()=1 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wCGF-YlS8sR0pNY4X2sPkqn8IqnIDOv_0 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15769372227833212771', time=2024-09-12T20:14:10.109957+0000, chain.objs.size()=1 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.c6EBh7DE6AjO_GMF79edwqwIl3rtOWQ_0 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7606142987082849887', time=2024-09-12T20:14:11.116037+0000, chain.objs.size()=1 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jcUHPUnzA-7raGl1PQZ5cLRbRy5sLux_0 2024-09-12T18:33:05.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1253146358469112348', time=2024-09-12T20:14:11.985488+0000, chain.objs.size()=1 2024-09-12T18:33:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.071+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VXx4xqijDpnpXUovtfQT_V0qaCavx3J_0 2024-09-12T18:33:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.073+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15920884002662824731', time=2024-09-12T20:14:12.822816+0000, chain.objs.size()=1 2024-09-12T18:33:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.073+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.X2PDaHz0TOV3impWRwTX2DdYjfZZGMi_0 2024-09-12T18:33:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.073+0000 7f4494509640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x5615083c9e60 msgr2=0x5615083cc2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:33:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.073+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.455924909754559879', time=2024-09-12T20:14:12.985795+0000, chain.objs.size()=1 2024-09-12T18:33:05.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.073+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PDxezQc0Myr8bf5GkUi66rdp-fIyo4r_0 2024-09-12T18:33:05.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.075+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14455048567950451357', time=2024-09-12T20:14:13.162246+0000, chain.objs.size()=1 2024-09-12T18:33:05.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.075+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.o5b5O8Xov98aee3BbfzwK2rK2cjY7mG_0 2024-09-12T18:33:05.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.075+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6181524915117507953', time=2024-09-12T20:14:14.741430+0000, chain.objs.size()=1 2024-09-12T18:33:05.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.075+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9buL7ZIYJL5YHTSzZmDD-Mw2h-w-3ZM_0 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.075+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14312365264121180574', time=2024-09-12T20:14:15.165409+0000, chain.objs.size()=1 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.076+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4HLL5dcu_sh_scIwhEti-JDgQ1NA8q9_0 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.076+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15335116224720882842', time=2024-09-12T20:14:19.244892+0000, chain.objs.size()=1 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.076+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.269__shadow_.nGoqq7GW6FNa6mEOlMvL8Ff0pcqcULJ_0 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.076+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.406435448277083661', time=2024-09-12T20:14:20.961791+0000, chain.objs.size()=1 2024-09-12T18:33:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.076+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.272__shadow_.1epL0esT-KPsWxJ2sCLbG25Wj2iTKWU_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13229918762387946486', time=2024-09-12T20:14:23.343719+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.276__shadow_.XnNVaqd8amqsx_hAqJBjaFbLskyVEHB_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13972453603105902201', time=2024-09-12T20:14:25.799504+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.280__shadow_.G-BldAmQMFnrz8lt1QKdoNGDvEcLIEI_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8105457024645177295', time=2024-09-12T20:14:36.536520+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.wK2mImJWqVzVzTqlkL5pifOo2-vqHnF_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13991092644308818645', time=2024-09-12T20:14:41.598033+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.301__shadow_.mMN0-Y1yJ4KiRSghm5y29sKIY75d3Q9_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10304163797146470722', time=2024-09-12T20:14:44.025278+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.305__shadow_.5zk9HhdOcialj-p7eLCBLPx9FuBWXYF_0 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.132397309238891305', time=2024-09-12T20:15:33.208385+0000, chain.objs.size()=1 2024-09-12T18:33:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XR9wzlk6mu0eigCq2cVisE5TjjrjPx7_0 2024-09-12T18:33:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.077+0000 7f4494509640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x7f436008cfa0 msgr2=0x7f436008f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:33:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.079+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18182734340877654383', time=2024-09-12T20:15:34.015878+0000, chain.objs.size()=1 2024-09-12T18:33:05.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.079+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6ZaQd2nBxZO8vGMh5F4Bhp_RV4UnFXE_0 2024-09-12T18:33:05.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.080+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13194185716363128908', time=2024-09-12T20:15:34.285227+0000, chain.objs.size()=1 2024-09-12T18:33:05.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.080+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SUcUIDQYh3Hr-qIxJxuXdLzPI6dCBbh_0 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10615387199325916400', time=2024-09-12T20:15:34.718451+0000, chain.objs.size()=1 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2BRKY-oA2jo6v194bxiCNLroA76tRzT_0 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16255011384092597396', time=2024-09-12T20:15:35.189295+0000, chain.objs.size()=1 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jdktn6Rlc3n3D4_r-YbG33uter-1i_O_0 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15818784136626829800', time=2024-09-12T20:15:35.452334+0000, chain.objs.size()=1 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.usTgGviZgI1CndlrbSuOYgg0fapeOZp_0 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14873553799856792987', time=2024-09-12T20:15:35.733769+0000, chain.objs.size()=1 2024-09-12T18:33:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.081+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ocPCir9HRUQ81H6nm0nt_-97ps22bBS_0 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9861532121356847825', time=2024-09-12T20:15:36.008968+0000, chain.objs.size()=1 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LgVwg44_SyGQRMOf3Z-T0ICvpsbEG7m_0 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8421599111254970294', time=2024-09-12T20:15:36.722662+0000, chain.objs.size()=1 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.a6PMvqeSfrDbIiWsJK0pNOWLtom-_kr_0 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5430839790484820239', time=2024-09-12T20:15:37.542090+0000, chain.objs.size()=1 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Ix8m9smZVYAYbsb5_VZZUOddi_zADLh_0 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9087424533554412197', time=2024-09-12T20:15:37.652734+0000, chain.objs.size()=1 2024-09-12T18:33:05.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.082+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MB8YfIt2OTxxih8lDAmTgOyI7g9XdqL_0 2024-09-12T18:33:05.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10651827614819982166', time=2024-09-12T20:15:38.073664+0000, chain.objs.size()=1 2024-09-12T18:33:05.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tyfkO-gI5es7eaXgxDeHfb9IqhtKkjy_0 2024-09-12T18:33:05.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.085+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16466970499161844674', time=2024-09-12T20:15:38.436126+0000, chain.objs.size()=1 2024-09-12T18:33:05.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.085+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YmQTygSSAmI49-bVFQXrsJWEQNOuehV_0 2024-09-12T18:33:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.086+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1256785008074378171', time=2024-09-12T20:15:38.610012+0000, chain.objs.size()=1 2024-09-12T18:33:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.086+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7LtZyJ6F2vFqhmXKjnmIk4BlFo2fRf2_0 2024-09-12T18:33:05.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14748372482985517890', time=2024-09-12T20:15:38.648424+0000, chain.objs.size()=1 2024-09-12T18:33:05.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6n1RUvKo7naufr_tzD-iA7PHm6ZCC7g_0 2024-09-12T18:33:05.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13119410654682771583', time=2024-09-12T20:15:38.940037+0000, chain.objs.size()=1 2024-09-12T18:33:05.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.C1v2q5_AtK7YN7HAKGHi8nUg-uISUW0_0 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12026494912145503528', time=2024-09-12T20:15:40.132500+0000, chain.objs.size()=1 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2h26hjE-KPph1b10hsH5dvSPZ-gNB3l_0 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5053902447086967780', time=2024-09-12T20:15:40.167140+0000, chain.objs.size()=1 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.087+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.die6RO4A9DMf8NqDBLCGkQuCjLLp4jB_0 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8636324524737933482', time=2024-09-12T20:15:40.788363+0000, chain.objs.size()=1 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yH_RWnzQym0NFvH9pFrThBxJ53LXOor_0 2024-09-12T18:33:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15288843849919729929', time=2024-09-12T20:15:41.105992+0000, chain.objs.size()=1 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Pu0DxuW0zperInnDkVJpAwY8d1a5gOr_0 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10158693694864176497', time=2024-09-12T20:15:41.360321+0000, chain.objs.size()=1 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nmR3CSF7SgMdjg7SwgHHzb7bmROMoUw_0 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.830161232309983075', time=2024-09-12T20:15:41.559768+0000, chain.objs.size()=1 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.D6boJzr8rAithvn2iTo0UMLxUlARnZl_0 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9342943912890077446', time=2024-09-12T20:15:42.127291+0000, chain.objs.size()=1 2024-09-12T18:33:05.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.088+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oUl_Z4Qkh0po8VjNbvePH5PhzQCMDV6_0 2024-09-12T18:33:05.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.091+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10315725009718449231', time=2024-09-12T20:15:42.128053+0000, chain.objs.size()=1 2024-09-12T18:33:05.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.091+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PfsZ6PUOD2LkCt1ijvTQtAocYfIK7h8_0 2024-09-12T18:33:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.092+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10030394699112564271', time=2024-09-12T20:15:42.252594+0000, chain.objs.size()=1 2024-09-12T18:33:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.092+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.47AAR_K2Cg5KWa1tyJSYz3fAIMi15jC_0 2024-09-12T18:33:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.092+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8619561546373376839', time=2024-09-12T20:15:42.387898+0000, chain.objs.size()=1 2024-09-12T18:33:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.092+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gx5q1K4ncZK2G_lzs0jxA8skVMN8rCr_0 2024-09-12T18:33:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.093+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15318580374594254097', time=2024-09-12T20:16:20.477233+0000, chain.objs.size()=1 2024-09-12T18:33:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.093+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EyTkIMhYT0sUtNDmnVt9vFmr2mumYZm_0 2024-09-12T18:33:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.093+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15020242432551211596', time=2024-09-12T20:16:20.558650+0000, chain.objs.size()=1 2024-09-12T18:33:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.093+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JvlTUtN5w5XLJE2B9p__OZ7t_pKRcsj_0 2024-09-12T18:33:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.094+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6655676189502899466', time=2024-09-12T20:16:20.670608+0000, chain.objs.size()=1 2024-09-12T18:33:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.094+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BwJT3llx9Y7mW8x_s_4Ps6J7g3NR0dA_0 2024-09-12T18:33:05.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7301917863675078471', time=2024-09-12T20:16:21.818078+0000, chain.objs.size()=1 2024-09-12T18:33:05.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pdyteyn_ww_ZeE0K50xBbNpKjpQJFgY_0 2024-09-12T18:33:05.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1680201365209489368', time=2024-09-12T20:16:22.246654+0000, chain.objs.size()=1 2024-09-12T18:33:05.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bs2Px_e0yKP-UP_bFihEQQkLcqy8Kky_0 2024-09-12T18:33:05.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2174634469251932742', time=2024-09-12T20:16:23.122967+0000, chain.objs.size()=1 2024-09-12T18:33:05.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.U7dF4yuzZLSe8nWT7eTOzlWm-De2eXK_0 2024-09-12T18:33:05.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3217821585333757616', time=2024-09-12T20:16:23.987420+0000, chain.objs.size()=1 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KN20B3g_iIdEMHJAJirgrS2M5S1k18I_0 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5255440912844931121', time=2024-09-12T20:16:24.522885+0000, chain.objs.size()=1 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.095+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-gx1lSeWs1Ar0Mxn60ZYyvC3jdJ2jTr_0 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.096+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6515341334186651700', time=2024-09-12T20:16:24.523666+0000, chain.objs.size()=1 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.096+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.j2TuOL4VWY2eto4hN4I9tlfNWJ284a2_0 2024-09-12T18:33:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2672909681387576871', time=2024-09-12T20:16:24.659919+0000, chain.objs.size()=1 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5EK7rmSa44V59p9Du5t6NuIU6mpA6As_0 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5427767486141554547', time=2024-09-12T20:16:24.976712+0000, chain.objs.size()=1 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.leRldLLs-qBhnEG2KZSSqMkx0im-kYw_0 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7919329808124065694', time=2024-09-12T20:16:25.147689+0000, chain.objs.size()=1 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pQiiMgAh2pP5PaJHhapqe-kSLupdmjC_0 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11350198966984257216', time=2024-09-12T20:16:25.284430+0000, chain.objs.size()=1 2024-09-12T18:33:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.097+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.PLHtQA-WEEyOYWKwewusgnjk6gMkdgn_0 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3299189866397794378', time=2024-09-12T20:16:25.930326+0000, chain.objs.size()=1 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HLBhcO8AdhWdrj-Uw5Q1cH3o_Oc1kac_0 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1085107194664639657', time=2024-09-12T20:16:25.931089+0000, chain.objs.size()=1 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aSmqrNwkkeY0JtDSAz2xLBCfNX1LcDf_0 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6672940639288271563', time=2024-09-12T20:16:25.931771+0000, chain.objs.size()=1 2024-09-12T18:33:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IAkXcN9f3Gnf8ULDstnGrF_sqb04Arx_0 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.89894222938061564', time=2024-09-12T20:16:26.546769+0000, chain.objs.size()=1 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ss9cTJHJOw0uL2QfNw2jmzQQmtUKODQ_0 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16105129014494297757', time=2024-09-12T20:16:26.547386+0000, chain.objs.size()=1 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.100+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.jDfpDtj3ehnn8m49p8X9-rk1DQp_jTH_0 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.101+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11527888987087581046', time=2024-09-12T20:16:26.605506+0000, chain.objs.size()=1 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.101+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AuvJ3QDTaiNq1Nrt1LOZlH-pq36zRf-_0 2024-09-12T18:33:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17569334912977831177', time=2024-09-12T20:16:26.716394+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.3AvlRUJeRLY_JXzqcErzfhUfrG69VMa_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12948319650066866643', time=2024-09-12T20:16:26.750442+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.q3l9VhnW7bzcby-lnUt3-r8ags5wrag_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17625360137464383623', time=2024-09-12T20:16:27.743552+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Hmdq5dk-ZwWNoXyTL4yCvoVmvJTszVL_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6866304118433758433', time=2024-09-12T20:16:27.907349+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.S9kiEp5OAH2lfs3xNHBehjJkhd17FoG_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12258202810751843560', time=2024-09-12T20:16:28.331158+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oG3AOVwLoRi1t4zqlyDaVQ63cuGQJXq_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17765827508591084660', time=2024-09-12T20:16:28.629846+0000, chain.objs.size()=1 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.B9HqXF6h3pV-D_EtQRPCTcwu4uLMyBI_0 2024-09-12T18:33:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3591470862870297408', time=2024-09-12T20:16:28.810341+0000, chain.objs.size()=1 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Mc5ndB_PuVSDIUwD0VcmxAF4VB3J0qb_0 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6539678761399455211', time=2024-09-12T20:16:29.208414+0000, chain.objs.size()=1 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CQfSL1FOfJ1hVBsY4ityhY7LHfP_WTq_0 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17216841791990309919', time=2024-09-12T20:16:29.694773+0000, chain.objs.size()=1 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.104+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._fOWzfiZCEAErFcQsHG74CulRdcRdSr_0 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.105+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7585707755025922071', time=2024-09-12T20:16:29.760892+0000, chain.objs.size()=1 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.105+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0pPyWuwkNICjTy6Mdsy2DvbhTWBRWTu_0 2024-09-12T18:33:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.107+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1251353384570779570', time=2024-09-12T20:16:29.953063+0000, chain.objs.size()=1 2024-09-12T18:33:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.107+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LRrudMbb6f1ThocfwCi9elnE_9_2B9d_0 2024-09-12T18:33:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.108+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10376975167232483581', time=2024-09-12T20:16:30.251205+0000, chain.objs.size()=1 2024-09-12T18:33:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.108+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-NHCPoiLmzpUAmRoeOZv4qeND6mmcuJ_0 2024-09-12T18:33:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8678526864337806032', time=2024-09-12T20:16:30.389591+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MWrB9-a_B6dsZFopGZvtTeG31IZMBJU_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1272654843147982149', time=2024-09-12T20:16:30.469890+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DEtQNF09vAHSHcDuLjSG0Dku_SszxzY_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14886595451996143760', time=2024-09-12T20:16:30.639817+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qv8xoACMCpeR3Uh2GPjssCOSccswtie_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12411812090076543675', time=2024-09-12T20:16:30.659082+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.U_EfSVf7g9OTvY48ZGGEo7bL2hDiyI2_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7568558376904840332', time=2024-09-12T20:16:30.808093+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HrdgeBYnxkUSSDzopXIzsAW_l9QrZo3_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13445447654575448230', time=2024-09-12T20:16:30.905862+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.o1dzjUdU83Vj3rXyUOxTuDClMEr4BJK_0 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11220982924114133176', time=2024-09-12T20:16:31.051417+0000, chain.objs.size()=1 2024-09-12T18:33:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cLCMxbQ69yfvtfism-CKSeE3IM1-Vl-_0 2024-09-12T18:33:05.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4660443276740444666', time=2024-09-12T20:16:36.786432+0000, chain.objs.size()=1 2024-09-12T18:33:05.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.111+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.335__shadow_.kkkjHffVd8Pkaeve_zD2lnay9NfDl5G_0 2024-09-12T18:33:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.115+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/49978 2024-09-12T18:33:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:33:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7621525247211069774', time=2024-09-12T20:17:34.362544+0000, chain.objs.size()=1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.444__shadow_.CxlU51ANATub_xNj4HDhd9q4DlinkGD_0 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6769153416302057058', time=2024-09-12T20:18:07.625805+0000, chain.objs.size()=1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.497__shadow_.GuvGe1CIbnVkAqCaxSp5aHpqHzJ8iEy_0 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14653733265453747645', time=2024-09-12T20:18:29.243240+0000, chain.objs.size()=1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.518__multipart_mymultipart.2~LH1ffc3N9j1qTPsSK0Fe7jDHBqVmAG6.1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17216151838749735561', time=2024-09-12T20:18:52.248128+0000, chain.objs.size()=1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.520__shadow:o-kg2PMMszIqdRysvsOinE6zgnrrZ2o_.qHVbgQpbDjpknFcJnB1mj5yWc6Ttk2w_0 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1703204183168182486', time=2024-09-12T20:20:02.443219+0000, chain.objs.size()=3 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~RHfcIUWab_u9zCmhiEWVhczNwhYyPBd.1 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~RHfcIUWab_u9zCmhiEWVhczNwhYyPBd.2 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~RHfcIUWab_u9zCmhiEWVhczNwhYyPBd.3 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4206259635515793877', time=2024-09-12T20:20:05.750382+0000, chain.objs.size()=2 2024-09-12T18:33:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~_dyYGnZ5M-2bxNkrAIj_u_UEcMnGqOO.1 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~_dyYGnZ5M-2bxNkrAIj_u_UEcMnGqOO.2 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18428897464469095585', time=2024-09-12T20:20:40.640168+0000, chain.objs.size()=1 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.537__shadow_.ct0CghSddRqTNaQSr4qf77LcNv-_gjg_0 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6185261215863372592', time=2024-09-12T20:21:16.555361+0000, chain.objs.size()=1 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.HBjfhoWVPAcPGMcoyITJLpA1bmceH7h_0 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.554501281602080206', time=2024-09-12T20:21:36.141329+0000, chain.objs.size()=1 2024-09-12T18:33:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.119+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:wYgLYCxP2bMXxBFrFghmo72wcTNhBDK_.Xy1rESprNZgPjNDT7EL7hsdEbP4ej_J_0 2024-09-12T18:33:05.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.123+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5885108943029992228', time=2024-09-12T20:21:43.752742+0000, chain.objs.size()=1 2024-09-12T18:33:05.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.123+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.573__shadow_.mkXHxM5C1qHsO9tgViQEMGlUclHE57__0 2024-09-12T18:33:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7497475212103497771', time=2024-09-12T20:21:45.094619+0000, chain.objs.size()=1 2024-09-12T18:33:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow_.o3z23ToqOBuqNq4KyGZ1PKJbhYItyo7_0 2024-09-12T18:33:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13461908183271188453', time=2024-09-12T20:22:04.217999+0000, chain.objs.size()=1 2024-09-12T18:33:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:5GfQIvzQnhnxjSanVousn2rOfWDNZ4E_.QzDs96bZgGvY9QF3RalJLST3aLnOmDs_0 2024-09-12T18:33:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15532135063172677134', time=2024-09-12T20:22:33.694227+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:gObDvdW3CTq7muuS1t8NLyu9AhQc1LK_.7bV0fcPle49Vhji7-p5GpbKaRwptKSc_0 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10341863030161175958', time=2024-09-12T20:22:47.149562+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.603__shadow_.JugMGs4kQg8nphaa7a0cpwZpo0sg90d_0 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16462701092165991438', time=2024-09-12T20:26:33.452700+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.635__shadow_.cVONKDpyMXT3JygRJ24VITj15OEqjX__0 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7363649039815613903', time=2024-09-12T20:27:13.573774+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.664__shadow_.rs0B3eldSip7jl6f01X1_JQmb6w7xu2_0 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8147950505176480767', time=2024-09-12T20:27:33.279409+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.701__shadow:0vRtUXQNVfqmfW16JFy2-ZoIq.6QCT6_.INjJqNy213boM2CMRO8a0Xk0eLD3_wX_0 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14284583252624064750', time=2024-09-12T20:27:35.954608+0000, chain.objs.size()=1 2024-09-12T18:33:05.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.126+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.705__shadow:2bakfk3GuCyKqUulQs2emFY3trfdQQV_.uupuMOqOXh1BL1ULPJZLttZ1uJSIuD0_0 2024-09-12T18:33:05.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.132+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.138+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:33:05.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.139+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.139+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54427' 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_CZ2flQJ1V8eG2yMURR9Izo8_hByJxmz', time=2024-09-12T20:11:11.623632+0000, chain.objs.size()=3 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.jx7wWagi8BsYFXtCmr9Lb7iEd66_5tQ_0 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.jx7wWagi8BsYFXtCmr9Lb7iEd66_5tQ_1 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.jx7wWagi8BsYFXtCmr9Lb7iEd66_5tQ_2 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_kdhDHT_8fihlkkurdDa2Lee3tGGecwC', time=2024-09-12T20:11:17.159027+0000, chain.objs.size()=1 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.165__shadow_.OKnF3ilAVPkKKGAqDC1ijUcOo5WGgIX_0 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5210980145803524861', time=2024-09-12T20:11:32.554142+0000, chain.objs.size()=1 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.181__shadow_.VZUI0GrHnsxcqpHc4qlzvYspeklJKu-_0 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15418886747036823430', time=2024-09-12T20:13:10.580445+0000, chain.objs.size()=1 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.234__shadow_.6wjot2sOCWa8XcVCO_Z2FaxD0vdXrGU_0 2024-09-12T18:33:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7751682539529794132', time=2024-09-12T20:13:11.183316+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.235__shadow_.PuHt8Jy5s3jGW-Ln8maBk_cEEjPyIJC_0 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14880353705421605021', time=2024-09-12T20:13:17.627604+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.244__shadow_.Pmr6vsYGhkqaFyfxl8e2fOlHndFhIkH_0 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5696380972462618740', time=2024-09-12T20:13:22.542299+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.252__shadow_.ngTnUg1popETx3DvUPS1OMGmrZYHYtk_0 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10918968914417914974', time=2024-09-12T20:14:04.967129+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.o2pHRYqo10WkRJBw1N6gqMbiZqCIPJS_0 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12850658888660038267', time=2024-09-12T20:14:05.065037+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tgAsDetYBa3TxuXIhHK-8AdmtG2bZrn_0 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.718472592065715976', time=2024-09-12T20:14:05.675508+0000, chain.objs.size()=1 2024-09-12T18:33:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.140+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.b9u0lmHhdXr1nHtmr0QaaA7WNnOCt4g_0 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7788460086825009074', time=2024-09-12T20:14:05.806850+0000, chain.objs.size()=1 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._C7YuL__mYPVFkwvg7JOxquYeHvfrJ2_0 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9390593769644401250', time=2024-09-12T20:14:05.907317+0000, chain.objs.size()=1 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._et-qZ7bZJxBLs0xRsXDAYMzS8FVdWh_0 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17493356087098481102', time=2024-09-12T20:14:06.088257+0000, chain.objs.size()=1 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sEpAiLuFAhrUxErE49XzhocCnHm4rAU_0 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6132905154816022646', time=2024-09-12T20:14:06.172737+0000, chain.objs.size()=1 2024-09-12T18:33:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.143+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cSawQq2WwFIpb2AUsejE8yH8Xuy-tke_0 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16406803622481387962', time=2024-09-12T20:14:06.478048+0000, chain.objs.size()=1 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ggHS2YFe9eA9pNLz_wCG_JWYsKtTICM_0 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2422772221657525539', time=2024-09-12T20:14:06.711344+0000, chain.objs.size()=1 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nV38ZAnNHtF5opOLLh0FyQOU1War8D7_0 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4586546581400422912', time=2024-09-12T20:14:07.123839+0000, chain.objs.size()=1 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.11nkG2vDMmZ4JiFhlZ0sRQX_VWzTJYe_0 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.219095572610086178', time=2024-09-12T20:14:08.046901+0000, chain.objs.size()=1 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8tbIdaHfdCOk6Mfqu4rSXnq4lt1PoXU_0 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16759949974451737278', time=2024-09-12T20:14:09.066858+0000, chain.objs.size()=1 2024-09-12T18:33:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iEOmYYyCj1TDVKr2WLwdK1ukaJXAEns_0 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3584060289781635776', time=2024-09-12T20:14:09.219292+0000, chain.objs.size()=1 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KK-HPnRbfiN3ueD2SiAVFFN_kgX2omI_0 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5866079488392204031', time=2024-09-12T20:14:09.507664+0000, chain.objs.size()=1 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.X84xmYv9YCABUzNK3Muc79H6EDw3zsl_0 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12799042130413689425', time=2024-09-12T20:14:09.546893+0000, chain.objs.size()=1 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2sNp6AKJsVrRvwfPOqYQXoptQJMjBT4_0 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12805916659471742756', time=2024-09-12T20:14:09.637010+0000, chain.objs.size()=1 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vec0qg96w3wwO0bmyR_sLt279GAupqt_0 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3900777122675217848', time=2024-09-12T20:14:09.700108+0000, chain.objs.size()=1 2024-09-12T18:33:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.147+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZJVc9Qcmegpo2QkhUv7slKDqDPy93Fo_0 2024-09-12T18:33:05.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.148+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7301394363194616143', time=2024-09-12T20:14:10.873571+0000, chain.objs.size()=1 2024-09-12T18:33:05.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.148+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sc4znRm3Fg53ptCqynluCOzlRu1_YrW_0 2024-09-12T18:33:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.150+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.809284738302457372', time=2024-09-12T20:14:10.935380+0000, chain.objs.size()=1 2024-09-12T18:33:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.150+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bh19KOUveWiR_pxBaoI-N0AiAbYw2n5_0 2024-09-12T18:33:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.150+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14291611018724442349', time=2024-09-12T20:14:11.994676+0000, chain.objs.size()=1 2024-09-12T18:33:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.150+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.pHgkbw_FPUW-UY0xjrM6LIPV3q1HfFx_0 2024-09-12T18:33:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14759587986639537941', time=2024-09-12T20:14:12.186939+0000, chain.objs.size()=1 2024-09-12T18:33:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8pAS-QkaIIAdlukpv3dyYlUJb09k6T__0 2024-09-12T18:33:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6578290037856599965', time=2024-09-12T20:14:12.259850+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Af-O6hBKRfNevFwIBGo-cE11Iup9XVV_0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1851321891514138505', time=2024-09-12T20:14:12.452623+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7ZARnLaIuorqeVTtcmp47BIylp3ryAy_0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1961706374060718751', time=2024-09-12T20:14:13.163757+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ElepBIorND-s0FHlxBMWcIUb7ZGmTV__0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10865356219857919871', time=2024-09-12T20:14:13.751791+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6RaFlbIFuSBfmydXQaibzDFDfBxvOuL_0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6412576481750348989', time=2024-09-12T20:14:13.892625+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0W7aoV7z5sODPAYE8eJP5FDOuR5a8pt_0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15951595922043168723', time=2024-09-12T20:14:14.205127+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MT7OW43GAzhgCGrvCd7kxo5oJ-HXSOa_0 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11985828454132215149', time=2024-09-12T20:14:14.667645+0000, chain.objs.size()=1 2024-09-12T18:33:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bX3nZHX5VjQGWXQvedV3QaXBAzDFZmR_0 2024-09-12T18:33:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17346472338955404272', time=2024-09-12T20:14:15.058827+0000, chain.objs.size()=1 2024-09-12T18:33:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.151+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Yg9fqI_sitnX1CXC3DO2htQRNCfuv4s_0 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12973196585228509144', time=2024-09-12T20:14:20.391605+0000, chain.objs.size()=1 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.271__shadow_.W1wiakCSF7G6XN7rDCbanTGJpiqacct_0 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15978912366179559606', time=2024-09-12T20:14:20.953765+0000, chain.objs.size()=1 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.272__shadow_.APTG7TB2-Vty4n4wELLggtcJHrRDK4D_0 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13273475201956040857', time=2024-09-12T20:14:20.957231+0000, chain.objs.size()=1 2024-09-12T18:33:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.154+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.272__shadow_.bZ1Rqr0-vnfha0qZZVhsQ2aN336fWxz_0 2024-09-12T18:33:05.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.156+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9807024844680596547', time=2024-09-12T20:14:22.738819+0000, chain.objs.size()=1 2024-09-12T18:33:05.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.156+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.275__shadow_._fcLJ6_UjK1ZoTB0tJ2N951wcjoPBRQ_0 2024-09-12T18:33:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16231020666532946635', time=2024-09-12T20:14:28.937275+0000, chain.objs.size()=1 2024-09-12T18:33:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.285__shadow_.VXvYit9h1bVtDKaeZlxCzzP-mf1YwI0_0 2024-09-12T18:33:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16623162261598969358', time=2024-09-12T20:14:29.617053+0000, chain.objs.size()=1 2024-09-12T18:33:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.286__shadow_.O2YIvRXtUcLbh0rmZYMvsyzihpS08xM_0 2024-09-12T18:33:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7625271763616589334', time=2024-09-12T20:14:32.072879+0000, chain.objs.size()=1 2024-09-12T18:33:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.290__shadow_.QyHnn1LjuKk7nUBD5CHoyOgmgQv6QtH_0 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16702776676895439731', time=2024-09-12T20:14:39.716630+0000, chain.objs.size()=1 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.298__shadow_.Tgf5KiIdfsL4vOlxSLOUM4D6EO5ckff_0 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12810838116325191706', time=2024-09-12T20:14:53.011276+0000, chain.objs.size()=1 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319__shadow:lcZS78S2cN.OYwG.3x-IDYEWIEs2GkF_.UrWTf4jLZImH6QZk4jzrtQPBSudJDYR_0 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6099008956123792636', time=2024-09-12T20:15:32.191669+0000, chain.objs.size()=1 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UtV3AjSCMp02T63RL-tcVegYdd_Zrts_0 2024-09-12T18:33:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17659817692775078251', time=2024-09-12T20:15:32.305325+0000, chain.objs.size()=1 2024-09-12T18:33:05.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.157+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.En6rozm5pWsbn1C2pDQkwGsXH-uc2Dw_0 2024-09-12T18:33:05.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.158+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9119368263489665119', time=2024-09-12T20:15:32.817374+0000, chain.objs.size()=1 2024-09-12T18:33:05.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.158+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.OC62Q0cL5ZWJyHl5whty9L_PSx8Vonc_0 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.160+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3426458214404448349', time=2024-09-12T20:15:33.071180+0000, chain.objs.size()=1 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.160+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.toatFXGxuwiB3o-ST60ml8pRdE1Hph__0 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.160+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14606757530566675489', time=2024-09-12T20:15:33.224749+0000, chain.objs.size()=1 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.160+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-LjtYRVBAP65rkdqkyGYBV1j4fiP3GB_0 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14894991021265133773', time=2024-09-12T20:15:33.708477+0000, chain.objs.size()=1 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PXODrmPbAo7n5YGuZqKZ1rRknJHHZCy_0 2024-09-12T18:33:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1667830912189273710', time=2024-09-12T20:15:34.049241+0000, chain.objs.size()=1 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._1s5_NFKdlQmrubWislTyc8zWxBDwwM_0 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9240278455364741387', time=2024-09-12T20:15:34.287522+0000, chain.objs.size()=1 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.161+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fjbFFVJkoY-Gp0V8VIQe3wuDeGe7edn_0 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15215171619917074354', time=2024-09-12T20:15:34.289032+0000, chain.objs.size()=1 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.h1EA985oQNRknO_t-uVuzV1cmVn5-Rr_0 2024-09-12T18:33:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9677186610799175305', time=2024-09-12T20:15:34.423703+0000, chain.objs.size()=1 2024-09-12T18:33:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cChWTw1o0tpEEAff6Z0JNb58QlpjtNc_0 2024-09-12T18:33:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1544642926713595385', time=2024-09-12T20:15:34.549113+0000, chain.objs.size()=1 2024-09-12T18:33:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.162+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XRec9Bwnh1YmfmnTEOdBdGpfuzpR-WQ_0 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.163+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17695899978208582213', time=2024-09-12T20:15:34.595231+0000, chain.objs.size()=1 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.163+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3wwgjVntBZDppkgCqMMhFhig8xsEDo5_0 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.163+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6394993959230364897', time=2024-09-12T20:15:35.241713+0000, chain.objs.size()=1 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.163+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._-mdNAHQbr0aVomIVeglkfiP5JRbBd5_0 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15405483780093739054', time=2024-09-12T20:15:35.664992+0000, chain.objs.size()=1 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Zr7e3Da14jaf2oZ_iKLcj1ajkGsqC7E_0 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10664416376293765251', time=2024-09-12T20:15:35.960647+0000, chain.objs.size()=1 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Msiwwh_tEPccYrF9i9xNASP7u38an0y_0 2024-09-12T18:33:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12211178722744554850', time=2024-09-12T20:15:36.102431+0000, chain.objs.size()=1 2024-09-12T18:33:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.164+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.i6HHAObIqBkyB5ZRoXs-o-8KTyWBIhv_0 2024-09-12T18:33:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.166+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2283621886788727996', time=2024-09-12T20:15:37.311287+0000, chain.objs.size()=1 2024-09-12T18:33:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.166+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GarN0yXoI0GffhNWzPnhUEr9cAooV42_0 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13805074726970746125', time=2024-09-12T20:15:37.527270+0000, chain.objs.size()=1 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eobOdLLd2PcvaasRMm8C9JnHF3O_xqI_0 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13420751854634531726', time=2024-09-12T20:15:37.610754+0000, chain.objs.size()=1 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.SPRuPJiHn7JR2amatEwiZJh1YoGpK_Y_0 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10617986415761853939', time=2024-09-12T20:15:39.785913+0000, chain.objs.size()=1 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FanRvxWhP61nMnRAaqNYPQnhslG9hKE_0 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2020753022162303960', time=2024-09-12T20:15:40.445217+0000, chain.objs.size()=1 2024-09-12T18:33:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.167+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vO9dZXMStx8-gcIudXj0BFS8Kufl_8P_0 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2785921284990997744', time=2024-09-12T20:15:40.784966+0000, chain.objs.size()=1 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.oi0olLJhdFoLGYkO213lanhoBcaIbFm_0 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6557999581690228403', time=2024-09-12T20:15:40.785457+0000, chain.objs.size()=1 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bgyLZdRNR9qMhuji4COD3kYYZuVq_FO_0 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17278939192120631318', time=2024-09-12T20:16:20.277793+0000, chain.objs.size()=1 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.osU1WgC0ovSP1jpaOqLKhPMvusxYGFf_0 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10326206439735071233', time=2024-09-12T20:16:21.713373+0000, chain.objs.size()=1 2024-09-12T18:33:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.168+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4k9rhqByO6ImircTxV0XoY9PGWyLVal_0 2024-09-12T18:33:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.170+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1627374273560245243', time=2024-09-12T20:16:22.091700+0000, chain.objs.size()=1 2024-09-12T18:33:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.170+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.aPg0Dpb8Vqft_JRMiicjvMr7dtDVPrB_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.950167414541780885', time=2024-09-12T20:16:23.596559+0000, chain.objs.size()=1 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qeuiu12OGdq3-zQ16FPc_1nyLLG530n_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14766601645809439783', time=2024-09-12T20:16:23.888016+0000, chain.objs.size()=1 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5ukBmMRFQReLBd2P7eHcNJzN_vVELxE_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14574686591294571853', time=2024-09-12T20:16:24.006365+0000, chain.objs.size()=1 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tndkYkQaebffE1bMfoW4GRP8V_ENRW3_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7731284463525720928', time=2024-09-12T20:16:24.532033+0000, chain.objs.size()=1 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MQrKRDL9PRXM2Nf4M0KUf5-KQhLbI07_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3195691382709186936', time=2024-09-12T20:16:24.532538+0000, chain.objs.size()=1 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.B_EDzQ2KKxyw7YinVYtqYux5aKurWtT_0 2024-09-12T18:33:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12169531849169404339', time=2024-09-12T20:16:24.705747+0000, chain.objs.size()=1 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.14dHgfFPAHaWpwhwsN5fndug0y0SmCh_0 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9156063582992534691', time=2024-09-12T20:16:24.908887+0000, chain.objs.size()=1 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.172+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7ccdNLimwKEH0cwBMyUca1Fs7WhWxdu_0 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9359610792756862792', time=2024-09-12T20:16:25.026385+0000, chain.objs.size()=1 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0SW2PKtNX1UvBsZCk3_rlVwxI8dARQq_0 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13129868902432003450', time=2024-09-12T20:16:26.292716+0000, chain.objs.size()=1 2024-09-12T18:33:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.n7mTuk754-mMDw0xR6USzCSmJxtZto3_0 2024-09-12T18:33:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13424331576827367229', time=2024-09-12T20:16:26.320440+0000, chain.objs.size()=1 2024-09-12T18:33:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.173+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yzUKh4R3HF6UsF4ftEA5ibRfnMvcGwi_0 2024-09-12T18:33:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.175+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3928834293405393368', time=2024-09-12T20:16:26.435511+0000, chain.objs.size()=1 2024-09-12T18:33:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.175+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oP_4x46VxOCj6vf64IbMNp5iIQ2zWcH_0 2024-09-12T18:33:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11102099341301690175', time=2024-09-12T20:16:26.477660+0000, chain.objs.size()=1 2024-09-12T18:33:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.465pG_dvrbaJEDJsgbpTECRBTU08igl_0 2024-09-12T18:33:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1887214065175022930', time=2024-09-12T20:16:26.495109+0000, chain.objs.size()=1 2024-09-12T18:33:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vN4qrFa8VZQ5qoeSWo-FuLbkQLPeGGQ_0 2024-09-12T18:33:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.964388029397392711', time=2024-09-12T20:16:27.504927+0000, chain.objs.size()=1 2024-09-12T18:33:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.177+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KkSgg0ogv9wdbweBiU8GV97vD9vX3bd_0 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3051551538845085326', time=2024-09-12T20:16:27.710049+0000, chain.objs.size()=1 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eS6t2rmlA40gm8QAln6WShcNQyMYebh_0 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4352318298952274518', time=2024-09-12T20:16:27.822304+0000, chain.objs.size()=1 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ArtmXg2DoAw2qiDM2lCQZ85mmazRYY4_0 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6649479319245327068', time=2024-09-12T20:16:27.822897+0000, chain.objs.size()=1 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ERl0UkQCTr6rJh9_xXKP9oYHN0abWoZ_0 2024-09-12T18:33:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16187203178957286037', time=2024-09-12T20:16:27.909469+0000, chain.objs.size()=1 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EbHYt9xViot0yueOKa0RJK5fOgAdNd1_0 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7691408824701783864', time=2024-09-12T20:16:28.205286+0000, chain.objs.size()=1 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.41hcdjpVzvMzBPhY2YyQjTv44wXUIgd_0 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.686671101822967509', time=2024-09-12T20:16:28.258760+0000, chain.objs.size()=1 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.I945ZyJ6mcO69L0OigNfIsxEPJp2g51_0 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6335536565159602125', time=2024-09-12T20:16:28.683126+0000, chain.objs.size()=1 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.o59HO_IxqaQ-rwsiyl2Ru9CZEVewgu0_0 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5956149576584863124', time=2024-09-12T20:16:28.968347+0000, chain.objs.size()=1 2024-09-12T18:33:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.178+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JhTJhR2XtH53bXM98JnLKiYVqQq-mIH_0 2024-09-12T18:33:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.180+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9532103168120977795', time=2024-09-12T20:16:29.641483+0000, chain.objs.size()=1 2024-09-12T18:33:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.180+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Q6oMaO7lWKz_w4ECuq2C3YcCunuJwa__0 2024-09-12T18:33:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.182+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13166827904925511886', time=2024-09-12T20:16:29.950964+0000, chain.objs.size()=1 2024-09-12T18:33:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.182+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.k1LpntyYlD4U41z-Ky22xeefLFfXfyg_0 2024-09-12T18:33:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8525195323394209666', time=2024-09-12T20:16:30.516519+0000, chain.objs.size()=1 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1G_NtTBgM1o8fhUYLdzzH0RwKmWdjPy_0 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16084337771959755248', time=2024-09-12T20:16:30.870331+0000, chain.objs.size()=1 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vT5Qt1Ku93nVUyBcjKrKBDaXekmkQ9F_0 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11220980778761180629', time=2024-09-12T20:16:35.682583+0000, chain.objs.size()=1 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.333__shadow_.a_Hw2GRCn1pv0NS5HWDmLL3oaunm-K2_0 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5911543801722868492', time=2024-09-12T20:17:57.236148+0000, chain.objs.size()=1 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.BnXewCxvjFZZZPtEbWs664ch6x_T73__0 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15844097602795572229', time=2024-09-12T20:18:49.699065+0000, chain.objs.size()=3 2024-09-12T18:33:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~hEv7xnkUEF3SB03M85XKn1Sw0O5v1Ks.1 2024-09-12T18:33:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.183+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~hEv7xnkUEF3SB03M85XKn1Sw0O5v1Ks.2 2024-09-12T18:33:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.184+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521__multipart_mymultipart.2~hEv7xnkUEF3SB03M85XKn1Sw0O5v1Ks.3 2024-09-12T18:33:05.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.190+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/54427 2024-09-12T18:33:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:33:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5299622182702362625', time=2024-09-12T20:19:45.894861+0000, chain.objs.size()=6 2024-09-12T18:33:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.lEgIKCR7rntVfDaMtRbdzUNDwbW_U9VK.1 2024-09-12T18:33:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.MJ9HkFaq1UPTu3YWqDpwaNLB93kvsydf.2 2024-09-12T18:33:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.c87whbY0Az8LGhkIhfKJbqHgKSuGKNqA.3 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.-FDLFtVzXZgmPk5-IHwghdA4P54TzUHc.4 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.RRnz0yjgBD65ZeglBJkszyKVhk2wmMsA.5 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.sdcvDqHjmGOCom5W7o-Ws8rxTKEDRcUB.6 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6958874515634008050', time=2024-09-12T20:21:12.361174+0000, chain.objs.size()=1 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.557__shadow_.RKjgcto_IMS-usNrjU_d0ztm_-W5JGm_0 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18064164701156469064', time=2024-09-12T20:21:26.900713+0000, chain.objs.size()=1 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.564__shadow_.NPx2lx2tL8Y9ANdgfSHW6AlRibv-aAa_0 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7283448943163064587', time=2024-09-12T20:21:33.523233+0000, chain.objs.size()=1 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:4dVw-ewNmg.eANzFBevZ.HKdyu-Y9SM_.Nsd1sai1W8VqPHgnp64t1uOD41VLebW_0 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16980134252481545372', time=2024-09-12T20:21:39.414018+0000, chain.objs.size()=1 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:Y0JGZzkZ-Vrz5dCjES1kIpoXgLHGnzP_.Gy8gOlMxMg3OTJBpjB1RoPc0nYD4YZO_0 2024-09-12T18:33:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14107481939704941334', time=2024-09-12T20:21:39.789670+0000, chain.objs.size()=1 2024-09-12T18:33:05.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:-f8pfqsLf4n1dnfNGZJ6CTqnra3WYx._.zHPvXXl3ABAV154DzclpqkuatBYUL02_0 2024-09-12T18:33:05.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1383300820382239652', time=2024-09-12T20:22:48.491063+0000, chain.objs.size()=1 2024-09-12T18:33:05.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.193+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.605__shadow_.4S4Mcaj2DZY3SPeg_CUSaACIZwu1Roe_0 2024-09-12T18:33:05.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.196+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10855561762351243463', time=2024-09-12T20:27:31.541572+0000, chain.objs.size()=1 2024-09-12T18:33:05.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.196+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.698__shadow:ZnSrmrLleL2X9LBd88hcU-1WNyk0wIb_.fGIDocXA5Bv8HR1J53zVW5TvmBvAKBj_0 2024-09-12T18:33:05.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.199+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.201+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:33:05.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.203+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.203+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56643' 2024-09-12T18:33:05.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10628417478302851279', time=2024-09-12T20:13:07.177611+0000, chain.objs.size()=1 2024-09-12T18:33:05.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.228__shadow_.PT32VtbQbhaLjNaAkZlgp4mojF0oqbZ_0 2024-09-12T18:33:05.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3984598639536898568', time=2024-09-12T20:13:21.297353+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.250__shadow_.1Xft11yKI4xr3oXk9Unrr0qNYOBWqpk_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2184296488258155381', time=2024-09-12T20:13:21.908128+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.251__shadow_.-C_M_aCV8CGRCdwt2qvWNltOc1_Cd0h_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3877619038286255571', time=2024-09-12T20:13:21.908739+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.251__shadow_.Nu5OCawCmF_Hw1giuLuRIae3KlSyw_c_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15290686197000960824', time=2024-09-12T20:13:22.542272+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.252__shadow_.XL4S4vdJ6yMMNL_tz77RlOQhuMdeR64_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.297977030969394062', time=2024-09-12T20:14:04.316148+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JFXUkByFtYnQeL6yu1APxy7S1-GO1RY_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1564343133790424473', time=2024-09-12T20:14:04.893070+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ewtmamB0uSwcZ5TX59vgePwiUL1t-Fy_0 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17961803553035341723', time=2024-09-12T20:14:05.624048+0000, chain.objs.size()=1 2024-09-12T18:33:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.I43dcR0rb2gvxDjP4v3OvYlk5iw1oMp_0 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2514883513325896486', time=2024-09-12T20:14:05.675477+0000, chain.objs.size()=1 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bco8yAzttE4QCskAsokdxgvKlta3wGK_0 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1754388713998322406', time=2024-09-12T20:14:05.817907+0000, chain.objs.size()=1 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._Qg03fN91UJSYldkKlLHLHrJ2uECRkm_0 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18441779842942331901', time=2024-09-12T20:14:06.023138+0000, chain.objs.size()=1 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.n0t3Hz6ZBEP0JHferZtQzoqYEK4-TAq_0 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12585153301502248241', time=2024-09-12T20:14:06.123842+0000, chain.objs.size()=1 2024-09-12T18:33:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.204+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VaJc095tqR2J8OjFHwTpLyC_w9mm-cp_0 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12117716687651186927', time=2024-09-12T20:14:06.125118+0000, chain.objs.size()=1 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.I5v650mBiGXDCyN2P5S6aX_EYy2Is6X_0 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10969362207296115244', time=2024-09-12T20:14:06.126274+0000, chain.objs.size()=1 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._7nBDT0Gd-RTSz36ABRqSJTYVE9D6gq_0 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9782223529452405535', time=2024-09-12T20:14:06.172710+0000, chain.objs.size()=1 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jwIjhAI4DyxinaUZJXgPd6Zs_dP1M5b_0 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8129467713959040956', time=2024-09-12T20:14:06.285157+0000, chain.objs.size()=1 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.m28MBDnjnADPT50ZGeVBzKkR--26zth_0 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.568912545105424819', time=2024-09-12T20:14:06.336388+0000, chain.objs.size()=1 2024-09-12T18:33:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.207+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nXCm6Oi_rdKtVW_3eWqDirIPZBR3MtW_0 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8626497944919481100', time=2024-09-12T20:14:06.543039+0000, chain.objs.size()=1 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0dy8qsfxHUC4IZkhyrHbO6qXsbvEFpt_0 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2615481473379974159', time=2024-09-12T20:14:07.305092+0000, chain.objs.size()=1 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hSybup1r0UEbIlT_QxpOKm4N2qiiJ1C_0 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13001838945537159870', time=2024-09-12T20:14:07.722508+0000, chain.objs.size()=1 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.i0_HHfp0-nlPB_u887_-5xOpN4x28SH_0 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4202298420604968383', time=2024-09-12T20:14:08.602063+0000, chain.objs.size()=1 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0GRh19kEYFH4zLbWnfRbEI5A39FB7MI_0 2024-09-12T18:33:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7332498858542788059', time=2024-09-12T20:14:08.602690+0000, chain.objs.size()=1 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Mnw2dSUGaOstZUSdzIqsZ0jP3tf60t8_0 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2842458894495667790', time=2024-09-12T20:14:08.603558+0000, chain.objs.size()=1 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3-OGvdH2hUoMMRT8Livjw5_NdMNN4m2_0 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15907435304697593720', time=2024-09-12T20:14:08.775040+0000, chain.objs.size()=1 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.210+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TdoYg_w3xhbmn3o_LXhwJbgZkKbAkAc_0 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9398390710277081183', time=2024-09-12T20:14:09.002593+0000, chain.objs.size()=1 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lxNKJjKsTSGZD8nj1b3a8AoPoQSLhMO_0 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6350240174342131793', time=2024-09-12T20:14:09.145380+0000, chain.objs.size()=1 2024-09-12T18:33:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WmzKZsF88FTqYiOl9w5hS3Drvaxy3gr_0 2024-09-12T18:33:05.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18308096687742133280', time=2024-09-12T20:14:09.210497+0000, chain.objs.size()=1 2024-09-12T18:33:05.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.211+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.L8XZ0Ma1Fx1pH2KPWCTn0UkSloApxbD_0 2024-09-12T18:33:05.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.213+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13748669519459022147', time=2024-09-12T20:14:09.211150+0000, chain.objs.size()=1 2024-09-12T18:33:05.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.213+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DzbhUvzaxu09iFZS_W6QpU9kEcKlVwH_0 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7557096713863877897', time=2024-09-12T20:14:09.331385+0000, chain.objs.size()=1 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0HInxVLBp_a1FPBplGeXNtbpbgfkrOw_0 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17003368813656623079', time=2024-09-12T20:14:10.117411+0000, chain.objs.size()=1 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4staQPbCuUcVLfR5jinf1vqkejtkFMi_0 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12122418751563339685', time=2024-09-12T20:14:10.179416+0000, chain.objs.size()=1 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZGiXUaI7hkUmr5TBROxtGPJH2RU6_v-_0 2024-09-12T18:33:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7703066341931577158', time=2024-09-12T20:14:10.594430+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kqZylk0FikqtuM23oPSHoOhD9XB2sZr_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16062674225478655986', time=2024-09-12T20:14:10.647318+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.edsHU6wz62-rImYmsIHsLf775hhFufa_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4087635543773122290', time=2024-09-12T20:14:10.751384+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MfKZlnE0c-6eJuHpal0DmR1nz2iBcXu_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15026870061334666258', time=2024-09-12T20:14:11.046086+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jNVX49cr0Yc8ZsQAAfMFVTbemu2J046_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.86217068649673451', time=2024-09-12T20:14:11.511715+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UGPIjJpwmcIQgEDIkSck1o4UJHS_nkH_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6244813368391623989', time=2024-09-12T20:14:11.657711+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RnVCE-8XCzn_J3x5K-XJhGIamIQ2uPF_0 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11657171849434300181', time=2024-09-12T20:14:11.756388+0000, chain.objs.size()=1 2024-09-12T18:33:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GAF6AzLJzER4dxZNgNVq0JZPdGOfWbD_0 2024-09-12T18:33:05.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12583567649445182148', time=2024-09-12T20:14:11.909106+0000, chain.objs.size()=1 2024-09-12T18:33:05.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.216+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VrmSs_04ZiqDclDxvbY-PmKMfX1g0zi_0 2024-09-12T18:33:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.220+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11623226159446630333', time=2024-09-12T20:14:12.035606+0000, chain.objs.size()=1 2024-09-12T18:33:05.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.220+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Zj0-fDBv53iUMGiXFigq0XUyy5OUI6K_0 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5506300334309808776', time=2024-09-12T20:14:12.519419+0000, chain.objs.size()=1 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sZZLcFLdtr_5G977C0nXuk1dBJdTnSr_0 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.447528133590298474', time=2024-09-12T20:14:12.892625+0000, chain.objs.size()=1 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.U3ce0sUvZ3OoQV7QYX0vFuQIUL75Utv_0 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11480721381625018346', time=2024-09-12T20:14:13.798921+0000, chain.objs.size()=1 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NjCjWOTt9p0QZJyN4L77F-nefH6j7lb_0 2024-09-12T18:33:05.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8289377431045660300', time=2024-09-12T20:14:14.190238+0000, chain.objs.size()=1 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zLJocl3ZLhJR032bcDyayBkl7oxnb7N_0 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5275522924027315885', time=2024-09-12T20:14:14.204608+0000, chain.objs.size()=1 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Uxbj1feyo5gmpLCYrVbvSDcadZ_2c-f_0 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3342001941506319924', time=2024-09-12T20:14:14.643813+0000, chain.objs.size()=1 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.eJ5ED2rIrhtYPq2axKmmK71HIU7AZdK_0 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1005363020948280859', time=2024-09-12T20:14:15.010581+0000, chain.objs.size()=1 2024-09-12T18:33:05.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.221+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2WLfip2zxGrOnRk5EzPSprsvXbN2lBC_0 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2116045913061995581', time=2024-09-12T20:14:15.011368+0000, chain.objs.size()=1 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0gdETgpcGJTtsHANal5lTQRa_Dg0Tgn_0 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3244082801434971594', time=2024-09-12T20:14:15.186848+0000, chain.objs.size()=1 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.FthW8Z8XcOb6zzTAK_uO72Izk9hv_Je_0 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13181487604166279063', time=2024-09-12T20:14:15.219025+0000, chain.objs.size()=1 2024-09-12T18:33:05.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.223+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.W0Yxd_QlJVXlSzsYJG97Al_caY3tdSV_0 2024-09-12T18:33:05.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.226+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17655232734210128036', time=2024-09-12T20:14:16.942713+0000, chain.objs.size()=1 2024-09-12T18:33:05.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.226+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.265__shadow_.jC301JGqalIU1wICELXDe0wXyAr7MkU_0 2024-09-12T18:33:05.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.226+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.389212552625477114', time=2024-09-12T20:14:21.524189+0000, chain.objs.size()=1 2024-09-12T18:33:05.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.226+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.273__shadow_.93LdaUIBIwCAuYQ2GTAp2mBFiosfsvu_0 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7887993314006938476', time=2024-09-12T20:14:27.048735+0000, chain.objs.size()=1 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.282__shadow_.QXfx4ND0Mr0GhFEAm_NF1jGvh57Q1Gc_0 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17687784760828747250', time=2024-09-12T20:14:27.055462+0000, chain.objs.size()=1 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.282__shadow_.1d_1mPIzDPpojvGzRLbTnpd4KP4peNH_0 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.166828123873928371', time=2024-09-12T20:14:34.597842+0000, chain.objs.size()=1 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.MVCpu0Jeyo8cFHcTDYujEjlNqQo8Cqv_0 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8348791827862336300', time=2024-09-12T20:14:42.792117+0000, chain.objs.size()=1 2024-09-12T18:33:05.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.303__shadow_.oRpPJ10IcLY1mZI0OzJtWcThEy-aebr_0 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4992099782803852431', time=2024-09-12T20:14:43.387136+0000, chain.objs.size()=1 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.304__shadow_.TU7lYb9lFMqokkBgZjVabFlg1EjLEsh_0 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6297395621366704325', time=2024-09-12T20:14:53.031295+0000, chain.objs.size()=1 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.319__shadow:VS5myl0hFnkyuIPSsrLStcZuk9YIsVv_.g4eYjv2zll8uC70EAyw_I89XC9EjxHw_0 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11439076891775353859', time=2024-09-12T20:14:54.186409+0000, chain.objs.size()=1 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.321__shadow_.yQYlux39751ON0QWbM1LSa-1eMSaXHQ_0 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.602664672287263965', time=2024-09-12T20:15:32.533924+0000, chain.objs.size()=1 2024-09-12T18:33:05.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.227+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cEz-KGKoDfW_I8fg3eL6LoyVt6uGdns_0 2024-09-12T18:33:05.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.228+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16307252858810759362', time=2024-09-12T20:15:32.702501+0000, chain.objs.size()=1 2024-09-12T18:33:05.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.228+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jQUUpTp2jaafZzoLVpjo_dLVv1xFhxp_0 2024-09-12T18:33:05.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.230+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1217053021998260442', time=2024-09-12T20:15:32.754281+0000, chain.objs.size()=1 2024-09-12T18:33:05.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.230+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.o7b4cEROXLOWQghMk_BdEKKlVIJ6R2y_0 2024-09-12T18:33:05.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.231+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9568096287188172744', time=2024-09-12T20:15:32.990222+0000, chain.objs.size()=1 2024-09-12T18:33:05.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.231+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.etU9_I4tLNCt7XuEtChYGf8QwomLh2q_0 2024-09-12T18:33:05.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.231+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7894963724665217351', time=2024-09-12T20:15:33.071215+0000, chain.objs.size()=1 2024-09-12T18:33:05.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.231+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FfT4h2bbbXig5k4BKjxzBgPahFt3e1K_0 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14329561423392147271', time=2024-09-12T20:15:33.135839+0000, chain.objs.size()=1 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.nkuVbKxxNLnArERM3ip4YFv2Q8BK8q5_0 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10991501867512664130', time=2024-09-12T20:15:33.724842+0000, chain.objs.size()=1 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UOGgCVRUD9-2FULngYnTmWXCVWFPIGR_0 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11902184928550580428', time=2024-09-12T20:15:34.701167+0000, chain.objs.size()=1 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.233+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7SzKUF3UlCaE4Wv8LtwV5ySm7PxXH5N_0 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6516069036190205698', time=2024-09-12T20:15:35.551036+0000, chain.objs.size()=1 2024-09-12T18:33:05.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uAsw-U1RFUTZg77anv9Hb1uRwJdlR1j_0 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2900341809954204622', time=2024-09-12T20:15:36.249793+0000, chain.objs.size()=1 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yTSO2tpv-gsUq8CbPG3NWWEj4fWefoN_0 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12139079523938836699', time=2024-09-12T20:15:36.916793+0000, chain.objs.size()=1 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.cQ-eZdIEH5sTfoyHQBptpUAvfoIYbhW_0 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15556824061979658987', time=2024-09-12T20:15:37.349114+0000, chain.objs.size()=1 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uEYfLhMkvYXAUlyVGKBUxSt85s8xkCJ_0 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5517175420486986561', time=2024-09-12T20:15:38.184134+0000, chain.objs.size()=1 2024-09-12T18:33:05.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.234+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-xS2S4AgVjDMHHBfQ9QlrNQHXeqGgNp_0 2024-09-12T18:33:05.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10074357535961402074', time=2024-09-12T20:15:38.275592+0000, chain.objs.size()=1 2024-09-12T18:33:05.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PjMZPq1qOKbvAnmNZQOBOI5Dp56WZf-_0 2024-09-12T18:33:05.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.891187796371835165', time=2024-09-12T20:15:38.313143+0000, chain.objs.size()=1 2024-09-12T18:33:05.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hLGa0K4hfsxFHCRtselFh1L9lmSC8i5_0 2024-09-12T18:33:05.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7943111193782042568', time=2024-09-12T20:15:38.411662+0000, chain.objs.size()=1 2024-09-12T18:33:05.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.236+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QWtu6g4ZY2Ny_tqL1DbWmb0ePY09V39_0 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9560730498073957974', time=2024-09-12T20:15:38.608239+0000, chain.objs.size()=1 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dESNywE_gD9K9ETa3BX_B1JLNm5B4hr_0 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15488303505174048480', time=2024-09-12T20:15:38.692729+0000, chain.objs.size()=1 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dlf5hSD8q7qUCYInDqKXTNagOJLCmPa_0 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8965748508657772076', time=2024-09-12T20:15:38.807398+0000, chain.objs.size()=1 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.N_Jlfg1lmS7iwxK6F_6TgkUwg2iuqdD_0 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13249543315171316837', time=2024-09-12T20:15:39.725229+0000, chain.objs.size()=1 2024-09-12T18:33:05.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.238+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gPFPlSzHBPTMHWURbSv_9A-veC5WMy3_0 2024-09-12T18:33:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18133643547826791250', time=2024-09-12T20:15:40.214274+0000, chain.objs.size()=1 2024-09-12T18:33:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.K7wj-51qF7wIP_8uB36snDGUg2I7NRP_0 2024-09-12T18:33:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3207404279680662194', time=2024-09-12T20:15:40.401579+0000, chain.objs.size()=1 2024-09-12T18:33:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.py_TK5DO5swwhSbgx7Ttr640poGY2ML_0 2024-09-12T18:33:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3494521233353527682', time=2024-09-12T20:15:41.500074+0000, chain.objs.size()=1 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hYXcqpi2XFr2pqM7EoWBH7L3ydlS2q8_0 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5478148639199677202', time=2024-09-12T20:15:41.661275+0000, chain.objs.size()=1 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NwSp0gf6gZ6cPTWAeNcEWD54omGohTT_0 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14417379977619726784', time=2024-09-12T20:15:42.515478+0000, chain.objs.size()=1 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.239+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CcXiSvYMLB_1cAQ84X_CFeywPo3mMv0_0 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.240+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7990263401666357258', time=2024-09-12T20:15:42.544553+0000, chain.objs.size()=1 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.240+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.x_AmSsgE__NEha5QS-yHg9-TpFtatyA_0 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.240+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15786549705997738821', time=2024-09-12T20:16:20.175803+0000, chain.objs.size()=1 2024-09-12T18:33:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.240+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zc-SDeRSepn320eFGVFB3mR0d1_ahiH_0 2024-09-12T18:33:05.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.242+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9532343892184273636', time=2024-09-12T20:16:20.400861+0000, chain.objs.size()=1 2024-09-12T18:33:05.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.242+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dJ-0w7uWbQdL6u8mJM2sZCisCqO0XjR_0 2024-09-12T18:33:05.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.244+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4104071225888621303', time=2024-09-12T20:16:20.679365+0000, chain.objs.size()=1 2024-09-12T18:33:05.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.244+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.W1X24POcKhcC6LRwN0gYg_afJ3jyOnH_0 2024-09-12T18:33:05.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.244+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15235859419502296306', time=2024-09-12T20:16:20.890265+0000, chain.objs.size()=1 2024-09-12T18:33:05.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.244+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lqOEP8hMIblfTnMtr70AifqsKASABI5_0 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4234934403753780826', time=2024-09-12T20:16:20.890839+0000, chain.objs.size()=1 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FpSsLt5Fiil7LGYAkmRw8xwcWPrJJgK_0 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17416860729377638684', time=2024-09-12T20:16:21.082058+0000, chain.objs.size()=1 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1TgUm-OUlpoNj4YkX_aImITTMuRlQ0K_0 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.615460394822220825', time=2024-09-12T20:16:21.120444+0000, chain.objs.size()=1 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.r_RgpqzVbIVeu1d6g-HfFo1pv7VxaFK_0 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3416766473991956190', time=2024-09-12T20:16:22.282467+0000, chain.objs.size()=1 2024-09-12T18:33:05.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MOkQIKAH0-piBydS9CeTD-rrCdzGFfR_0 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13534384547581500606', time=2024-09-12T20:16:22.416235+0000, chain.objs.size()=1 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.44ObGZchiREPfDPoFeSkk1ymb5VB0FA_0 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3611752443417296721', time=2024-09-12T20:16:23.285979+0000, chain.objs.size()=1 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6QT1fYnDtwn7m4qGWFmVamfaiR-lYEC_0 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18275248956753620519', time=2024-09-12T20:16:23.411376+0000, chain.objs.size()=1 2024-09-12T18:33:05.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.245+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.K9ODr9TVWxrRAb0Q7A7acggtU1PHPci_0 2024-09-12T18:33:05.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.247+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10081886904480122760', time=2024-09-12T20:16:23.411971+0000, chain.objs.size()=1 2024-09-12T18:33:05.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.247+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xw_HgZleOYj3TscYjyX4Ze7y9NZv2sK_0 2024-09-12T18:33:05.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.247+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5231517250986925285', time=2024-09-12T20:16:24.006382+0000, chain.objs.size()=1 2024-09-12T18:33:05.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.247+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qzG-3sZTpG6_SaKjdzWgur1848klccg_0 2024-09-12T18:33:05.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.248+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2127278072729529100', time=2024-09-12T20:16:24.128853+0000, chain.objs.size()=1 2024-09-12T18:33:05.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.248+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ABnCim6_aBhTCiTt0Kbq1GzsBlDCoRJ_0 2024-09-12T18:33:05.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.250+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9019064850302736826', time=2024-09-12T20:16:25.195024+0000, chain.objs.size()=1 2024-09-12T18:33:05.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.250+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Bpj-IEfeotLDs9s8C8-XLkO7yMpm9cd_0 2024-09-12T18:33:05.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.251+0000 7f4494509640 0 -- 172.21.15.94:0/2053380075 >> [v2:172.21.15.94:6808/627469579,v1:172.21.15.94:6809/627469579] conn(0x7f43600918c0 msgr2=0x7f436008fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:33:05.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.255+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/56643 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.566448625493027186', time=2024-09-12T20:16:26.357273+0000, chain.objs.size()=1 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wIvEkGnqk3JGKdEBVrQgQLDBNzQUTOc_0 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3016699287983615663', time=2024-09-12T20:16:26.690838+0000, chain.objs.size()=1 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DPF78LmUyMRWc-aabWVqOxsLFrB-U4t_0 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16650898030968830733', time=2024-09-12T20:16:26.839948+0000, chain.objs.size()=1 2024-09-12T18:33:05.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9R69XV-nfpxJJLP2g_2vJF5WheMy6P7_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6376507768519691181', time=2024-09-12T20:16:26.935260+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-hHYii_X006n8vQJOFeudctH06_i2e-_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.111669108727647064', time=2024-09-12T20:16:27.504977+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eivBxRyETB4grNvmv9uSxplUOKX93O4_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9651642320544225365', time=2024-09-12T20:16:28.305215+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ycIlBNjr13jx0oSTtHkircP4BBF3VXv_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13878138606602557696', time=2024-09-12T20:16:28.968363+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xRdRLCcV3STdAD4RrCtbpcGSx7zHshg_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5108937081154511780', time=2024-09-12T20:16:29.107980+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0Vfa1-lnClObD682glYdVxr8O8_CGh4_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10073750740380869235', time=2024-09-12T20:16:29.920949+0000, chain.objs.size()=1 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NpH5pQIy39H2QLrgD3jkAJgbha42xAL_0 2024-09-12T18:33:05.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2448958863658025445', time=2024-09-12T20:16:30.864814+0000, chain.objs.size()=1 2024-09-12T18:33:05.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tND0NcZ0dOdci6T5r7Uc_3sGHx8suiz_0 2024-09-12T18:33:05.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.93440538613850199', time=2024-09-12T20:16:30.952167+0000, chain.objs.size()=1 2024-09-12T18:33:05.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.emwO0pnDXjatYlVRNFKv9V5RyV70D1e_0 2024-09-12T18:33:05.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3183531913018493522', time=2024-09-12T20:16:31.036103+0000, chain.objs.size()=1 2024-09-12T18:33:05.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.258+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.keRwFrVuH9HjhaTHWmlcuJPqUV8DOcS_0 2024-09-12T18:33:05.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10774372550612480106', time=2024-09-12T20:16:34.994158+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.332__shadow_.8BSXR85JBE5dvP7XnpOcriWT1mFaTIm_0 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16420436865898064334', time=2024-09-12T20:16:51.476669+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.367__shadow_.uYHMB_O29Dp3gmHe9-fgbQbro9AATTi_0 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11908559289720593276', time=2024-09-12T20:17:08.899033+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.262+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.394__shadow:ZbUEQ3yjcANfiB3lkU28I-DW-rZm3zO_.2v6Ho53sssUah6eAazl951cheBcsVf1_0 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12350859129445200901', time=2024-09-12T20:17:38.256810+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.451__shadow_.KYp_mO2Eg8tw8BbVWCeAkGgRZig6Igu_0 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6031420728049900685', time=2024-09-12T20:17:39.778735+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.454__shadow_.Jd-nv8KXfnaNaTi5QP1Tr8W0XkaKEPc_0 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6933733566766656923', time=2024-09-12T20:17:49.492480+0000, chain.objs.size()=1 2024-09-12T18:33:05.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466__shadow_.GkjXjyO5EYvNDxX77uUX8D7WT8ZPQ69_0 2024-09-12T18:33:05.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17453721054225314964', time=2024-09-12T20:17:57.230573+0000, chain.objs.size()=1 2024-09-12T18:33:05.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.263+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.caRNYULkrbgHFWRquAysuaoR-HcBG95_0 2024-09-12T18:33:05.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14045559700449102492', time=2024-09-12T20:17:57.232149+0000, chain.objs.size()=1 2024-09-12T18:33:05.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.UeWwDnyQJNZhL253FkYvyCSm6hiLZ4o_0 2024-09-12T18:33:05.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10030107185309398466', time=2024-09-12T20:17:57.237054+0000, chain.objs.size()=1 2024-09-12T18:33:05.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.483__shadow_.AwXNj6EZrX-G719qt6L8RMHm4lKLhQu_0 2024-09-12T18:33:05.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1000333510462038761', time=2024-09-12T20:18:07.622339+0000, chain.objs.size()=1 2024-09-12T18:33:05.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.497__shadow_.GuvGe1CIbnVkAqCaxSp5aHpqHzJ8iEy_0 2024-09-12T18:33:05.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb', time=2024-09-12T20:19:18.730664+0000, chain.objs.size()=1 2024-09-12T18:33:05.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.264+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~vJaHnE17W025DxFfIAR_mQHO6OCqiCb.3 2024-09-12T18:33:05.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4921193647202352925', time=2024-09-12T20:21:17.353899+0000, chain.objs.size()=3 2024-09-12T18:33:05.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.u4A46LJ8EwV5rmyPJTNkQNLpVEl7cur_0 2024-09-12T18:33:05.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.u4A46LJ8EwV5rmyPJTNkQNLpVEl7cur_1 2024-09-12T18:33:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.u4A46LJ8EwV5rmyPJTNkQNLpVEl7cur_2 2024-09-12T18:33:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17225446671685986095', time=2024-09-12T20:21:33.960956+0000, chain.objs.size()=1 2024-09-12T18:33:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.268+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:HEUk4amaVQ8NgcSG.kRnmRhnI.g6zp._.4arf1QCbHEdpsd_kGbR_caqnJmHDxNt_0 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10008759952760040192', time=2024-09-12T20:21:34.644637+0000, chain.objs.size()=1 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:zCEYHwIWUL9UC533YMHqPmyb67uZNHZ_.uwoa9EN3SX1xUwpRynq4a2gfF4c0K5p_0 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17313931240966590375', time=2024-09-12T20:22:02.287680+0000, chain.objs.size()=1 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:sXkTZlsuWjU1Udd0Stf7kWB--DG9lkU_._6JSD4KiIHXK7snAq4VOxbgqGe11N26_0 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17076419801843181678', time=2024-09-12T20:22:06.721129+0000, chain.objs.size()=1 2024-09-12T18:33:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:wRaw8HGRu62g5uXI4kSsJJmHVw0nriS_.V25kurLJ6Kdozaj6xtMmNlGrTmLjLud_0 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4816951795494403656', time=2024-09-12T20:22:31.538405+0000, chain.objs.size()=1 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:crUA3jonoAF8VW7RN8AB9DercP1f6EG_.kM8GsClDSlqVsP-FAeqhFmgqNN96vzD_0 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4575769670353954475', time=2024-09-12T20:23:45.115637+0000, chain.objs.size()=12 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.1 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.1_1 2024-09-12T18:33:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.270+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.2 2024-09-12T18:33:05.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.272+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.2_1 2024-09-12T18:33:05.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.3 2024-09-12T18:33:05.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.3_1 2024-09-12T18:33:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.4 2024-09-12T18:33:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.273+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.4_1 2024-09-12T18:33:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.274+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.5 2024-09-12T18:33:05.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.274+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.5_1 2024-09-12T18:33:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.275+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__multipart_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.6 2024-09-12T18:33:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.275+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.614__shadow_multipart_enc.2~jtLueLfzl9Ag02_cfAop04jz9tRTJ_P.6_1 2024-09-12T18:33:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.276+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10256171326022358039', time=2024-09-12T20:26:48.907737+0000, chain.objs.size()=1 2024-09-12T18:33:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.276+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.649__shadow_.cBUKO6MpeXWTXJEMr5o-F_vG5Taftij_0 2024-09-12T18:33:05.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.276+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6724864964697016324', time=2024-09-12T20:26:56.979710+0000, chain.objs.size()=1 2024-09-12T18:33:05.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.276+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.656__shadow_.kNTOha6-9zXeSH4S4cGuwdZC7K7jKML_0 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11517477204805650740', time=2024-09-12T20:27:11.342395+0000, chain.objs.size()=6 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.1 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.2 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.3 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.4 2024-09-12T18:33:05.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.5 2024-09-12T18:33:05.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.660__multipart_bar.2~mqmAwayx07ic_M0DD4u4FLb_6mT_Rid.6 2024-09-12T18:33:05.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3625983119312530852', time=2024-09-12T20:27:15.430363+0000, chain.objs.size()=1 2024-09-12T18:33:05.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.666__shadow_.4FF7zeBkqJZxIx3TtRUy4yxOSGXJrWJ_0 2024-09-12T18:33:05.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2348011460182701547', time=2024-09-12T20:27:21.930963+0000, chain.objs.size()=1 2024-09-12T18:33:05.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.280+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.679__shadow_.sXGzz9GwJWS1Dlp4Dn1hNc-IiqX-SIi_0 2024-09-12T18:33:05.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.283+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9320223583583490113', time=2024-09-12T20:27:26.849891+0000, chain.objs.size()=1 2024-09-12T18:33:05.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.283+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.690__shadow:25rAGpZT.iriDSLBAWEicmJJCucbAje_.NfYElKz0TNuMwZKYvyxzU3YIL8kcxYE_0 2024-09-12T18:33:05.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.286+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.293+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:33:05.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.294+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.295+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53550' 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_pmiNwJTHDPP_sq5yCnQExcAbvw_ne7z', time=2024-09-12T20:11:11.995046+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.wQ52rlbGPmgeg0aRkNU333OKgxMm5ou_0 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5839341086952797576', time=2024-09-12T20:11:30.649922+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.177__shadow_.EwYKyfTid4-NWTaqkiw1nBxtyQba_rz_0 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17124547653543368740', time=2024-09-12T20:13:13.583950+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.238__shadow_.iTsm_GI4Sb9LPK6pvesKfXAzyZN0B49_0 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7032222455888223389', time=2024-09-12T20:13:15.833136+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.242__shadow_.LY6yBsPCuNcEvmpiUKMLumIrL6YrkHN_0 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14957920506953528141', time=2024-09-12T20:13:20.702294+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.249__shadow_.rAdYJyDJlc07Ja9k3EfAlGvQGwbt0D4_0 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8806567717649948134', time=2024-09-12T20:13:27.908893+0000, chain.objs.size()=1 2024-09-12T18:33:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.261__shadow_.iPn8dSyQfeHIP_kxuQnpJmRe31Sv9Di_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3353912494419506108', time=2024-09-12T20:14:04.166584+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6H4fPI11AWQDnwwNa4oNNwyoyzDJM54_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12800615668420716951', time=2024-09-12T20:14:04.401257+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iIn_WRpWmJn8HwZO4VjDb2XLJvZiN6O_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2644416561622907380', time=2024-09-12T20:14:04.427776+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rRXlrC-q6E44P4cxSXOmjlCrGCB23Ri_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6268008872975979791', time=2024-09-12T20:14:05.181162+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.MLT0MmS4W0ky51I9XawBWKn_jsQjavs_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1781523056538783442', time=2024-09-12T20:14:05.643939+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2IisTUchtHXZYTLATH18oe9cBWUfCMN_0 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16350456025964316615', time=2024-09-12T20:14:05.806835+0000, chain.objs.size()=1 2024-09-12T18:33:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.296+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.P5cWGFclf6dCzaOmp-exgfwxInQaj8U_0 2024-09-12T18:33:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.300+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4545386675028011487', time=2024-09-12T20:14:06.477946+0000, chain.objs.size()=1 2024-09-12T18:33:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.300+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ubja2qGsdBK0CyLCtK9VPqNq4-T3N6J_0 2024-09-12T18:33:05.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8779717865232031885', time=2024-09-12T20:14:06.604869+0000, chain.objs.size()=1 2024-09-12T18:33:05.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Hy_laD9GH6KimusaJerPXuWOeqODYyv_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13038465983115609048', time=2024-09-12T20:14:07.548259+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1cxjwT-3M-D0CGnLWH30G7qLAVIEuHo_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3654070258411544793', time=2024-09-12T20:14:08.094075+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VYFKO0WchTNmCXzP5PQm_UZuNdpmf4L_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4728637449984706874', time=2024-09-12T20:14:08.189811+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kHDthprkHpA1yjwP2G5VKRi5hIse57s_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13125277048243115458', time=2024-09-12T20:14:09.636992+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G52Y4yYq1iacrT-lTgHyEuJnJUk0xNE_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11236665501443219654', time=2024-09-12T20:14:10.695898+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2TppJrt3T4O8PrgRtRwkQqXvu2Y9O0l_0 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9636662216383371041', time=2024-09-12T20:14:10.750655+0000, chain.objs.size()=1 2024-09-12T18:33:05.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fiq3_1UY3MR483pTOs4zQO2oIE0-4Ov_0 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.596969204730492525', time=2024-09-12T20:14:10.773872+0000, chain.objs.size()=1 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.49qnWp2DX18E1zet6FVkCv-3tjcjj80_0 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1045859169290643620', time=2024-09-12T20:14:10.832461+0000, chain.objs.size()=1 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.u6R9APieib1zQXBAdG4bL2Z_hgvo647_0 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14526777645053078152', time=2024-09-12T20:14:11.046051+0000, chain.objs.size()=1 2024-09-12T18:33:05.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.301+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NQ4Ql6HVHwCNUt5t117mpYAcyApza3p_0 2024-09-12T18:33:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.305+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10232804438016850119', time=2024-09-12T20:14:11.437099+0000, chain.objs.size()=1 2024-09-12T18:33:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.305+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ruUk6Timz_c-pKKH3RTV7Zj2ZXMPNSF_0 2024-09-12T18:33:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.306+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1231909986335639293', time=2024-09-12T20:14:11.601538+0000, chain.objs.size()=1 2024-09-12T18:33:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.306+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Rq613vmZQRi_eGuLFZFj-28stIjA5NU_0 2024-09-12T18:33:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17546399356880826472', time=2024-09-12T20:14:11.909043+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UJTY_FfQjeWXNEJmEkRN-nBqNHhGje1_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4565839357673603575', time=2024-09-12T20:14:12.068904+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.joqWbkq9RTKHdXnGj6X7Zn-ZJ5ecf_f_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8375178651265063054', time=2024-09-12T20:14:12.116218+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5gGX4vxCHeOgLX_pKN-9RRzhmV54art_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4302407731963435465', time=2024-09-12T20:14:12.372222+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.xh1GuhkkEdX0NGCxbgQeUq6JQY-lo3z_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4042149089712787399', time=2024-09-12T20:14:12.372983+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.m-s1O1zXhG2NXo0QGpdsbUnZYScues4_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14210960760879401108', time=2024-09-12T20:14:12.398927+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gLIQjyxCjNM9qPJTF_IUXTZD6JEfg7d_0 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8564212099476908498', time=2024-09-12T20:14:13.689634+0000, chain.objs.size()=1 2024-09-12T18:33:05.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ybadZVTk0Kt_C-QQozZnCEmRs6uit1i_0 2024-09-12T18:33:05.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3237092550020007452', time=2024-09-12T20:14:13.892547+0000, chain.objs.size()=1 2024-09-12T18:33:05.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kUi4T2bcfGB0qxMmK_25gdu6mBZm-DJ_0 2024-09-12T18:33:05.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8284167264231293224', time=2024-09-12T20:14:14.260920+0000, chain.objs.size()=1 2024-09-12T18:33:05.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.307+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DdsbrwgJ6vYSnzRXvyrfddWOfEYDa1C_0 2024-09-12T18:33:05.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.310+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.524071359096238262', time=2024-09-12T20:14:14.345904+0000, chain.objs.size()=1 2024-09-12T18:33:05.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.310+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zz-e8Gklp0_-hAOOC6-vPrpf5nhB2q7_0 2024-09-12T18:33:05.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.310+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8528209056810120236', time=2024-09-12T20:14:14.645437+0000, chain.objs.size()=1 2024-09-12T18:33:05.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.310+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.w4BFlFTyb4tJKsBlUvPofgVdZtl11Gp_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2378797915008768263', time=2024-09-12T20:14:15.058847+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.x8Qliqy79-MDAvgNT37L_UGFA5WJaTR_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15471201380652917747', time=2024-09-12T20:14:15.142997+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.i2XFcIX7c5OaXkEy23mOnhDTKG46daH_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13683670296456413720', time=2024-09-12T20:14:15.166404+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IrbR22iX8v_3HHtkTmwRkztEqIPPTlD_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9338914886357447571', time=2024-09-12T20:14:25.184515+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.279__shadow_.UQNmkikOp9hwfSurHjP7LSBtyOw1EUM_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13925104336285019325', time=2024-09-12T20:14:27.656855+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.283__shadow_.I6rfXA5O3LWkA_AhZb5yRCuqwHXk7s1_0 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15841066882651078429', time=2024-09-12T20:14:32.079199+0000, chain.objs.size()=1 2024-09-12T18:33:05.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.290__shadow_.VY64iysneXB2LG0ZjgEKLQ8v14jXsoK_0 2024-09-12T18:33:05.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7651618031473261183', time=2024-09-12T20:14:40.387939+0000, chain.objs.size()=1 2024-09-12T18:33:05.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.299__shadow_.ggshide-BaiB6T2E0nMc-1KAgcUpORi_0 2024-09-12T18:33:05.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2537016280065991242', time=2024-09-12T20:14:41.590596+0000, chain.objs.size()=1 2024-09-12T18:33:05.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.312+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.301__shadow_.HCPNkiYdxevTGW2ZrrNwukUn4O3w5ak_0 2024-09-12T18:33:05.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1340194971506727806', time=2024-09-12T20:15:32.617037+0000, chain.objs.size()=1 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.t6VYaEdE5WZiSGXHuoahJ_0HDmOzfGj_0 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11863291283701372063', time=2024-09-12T20:15:32.850608+0000, chain.objs.size()=1 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.M0iId2ziSFeUHeuFpTzI08IkYul8MYn_0 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4814754320558227445', time=2024-09-12T20:15:32.974173+0000, chain.objs.size()=1 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.wkuxhRzlxaOh1UUMm-WHNI4L7-V_PBy_0 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8757489158909182548', time=2024-09-12T20:15:32.991918+0000, chain.objs.size()=1 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ttNBw25DEcCKs3ro_vubXjvbXBD7PtR_0 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15639957968523759572', time=2024-09-12T20:15:33.134270+0000, chain.objs.size()=1 2024-09-12T18:33:05.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.315+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YzgsGI_tUv_U-7BkIpG-YyZngRBJMN4_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17936489575761491480', time=2024-09-12T20:15:33.984249+0000, chain.objs.size()=1 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rSgkhfF2pXwbhxhwrO_6-38H_OPgjO1_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4808820553466171601', time=2024-09-12T20:15:34.101834+0000, chain.objs.size()=1 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tLCFG3pqRuj8AeP-ijO7kjK0JTNDT1i_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4159325274372449219', time=2024-09-12T20:15:34.666197+0000, chain.objs.size()=1 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rqHSluxmuOXz9JmRdo1V_KGES5BnTjd_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.460672760523871050', time=2024-09-12T20:15:34.666948+0000, chain.objs.size()=1 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gKq5LTynQ6uX8D18XahyJtLA8qeMlfK_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4499390520325125246', time=2024-09-12T20:15:34.758884+0000, chain.objs.size()=1 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XJEmeQvXuG2H-MSd0Or08ijm-__C25w_0 2024-09-12T18:33:05.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10629782313625837647', time=2024-09-12T20:15:35.405290+0000, chain.objs.size()=1 2024-09-12T18:33:05.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.316+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mDB9dEutE028yn9kn1OCHtT10FqdImo_0 2024-09-12T18:33:05.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.319+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16462071833730703413', time=2024-09-12T20:15:35.451101+0000, chain.objs.size()=1 2024-09-12T18:33:05.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.319+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WkQdT2msO3Xi9IRDgj-PYBNAjGh8YHo_0 2024-09-12T18:33:05.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.319+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16489522118685343874', time=2024-09-12T20:15:36.244727+0000, chain.objs.size()=1 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.319+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ApO2jERaXex0y7MoxizC4m05IE4n3ff_0 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1016430119435995892', time=2024-09-12T20:15:36.915501+0000, chain.objs.size()=1 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.N3MciAJ4EioNuYxhDY0p4xQYiJ6ZllZ_0 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6107628292792501602', time=2024-09-12T20:15:37.056938+0000, chain.objs.size()=1 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.E9BV4uXuCjhGKKojAQWN1-KycHoGnDD_0 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12737774105695886115', time=2024-09-12T20:15:37.157081+0000, chain.objs.size()=1 2024-09-12T18:33:05.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.320+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XN1tdBHz6WrhRhAntN9LDL20u9D6wiq_0 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4526992820394332218', time=2024-09-12T20:15:37.408601+0000, chain.objs.size()=1 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XVigWt04jiBHyiTcJdt5qPsWpA9JGdR_0 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12016307597348439853', time=2024-09-12T20:15:38.608315+0000, chain.objs.size()=1 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8naYmkDfkbSoDddDUtTj8UV2oCi3FUA_0 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12431169403608508188', time=2024-09-12T20:15:39.049904+0000, chain.objs.size()=1 2024-09-12T18:33:05.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WiuVgIGCs8uLTR1to4AqhfZxR76iCOQ_0 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8125122040632083072', time=2024-09-12T20:15:39.672993+0000, chain.objs.size()=1 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.kmatR6Maff0fDVsPIGTTRhOQbs2cHyH_0 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.638878075508443101', time=2024-09-12T20:15:39.925326+0000, chain.objs.size()=1 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.b3a0Ku0s9D8W-ka46tCEDxv0Fwk1ipk_0 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15680799984699097507', time=2024-09-12T20:15:39.949026+0000, chain.objs.size()=1 2024-09-12T18:33:05.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.323+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1OojFdiz4gG_Cy4fJwROYEyW89BQ7JM_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5406765603877562274', time=2024-09-12T20:15:40.183392+0000, chain.objs.size()=1 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EXGiUj9odGwhYd9iYroVSb3AP2dgYZY_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10212222246061422154', time=2024-09-12T20:15:41.215264+0000, chain.objs.size()=1 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ybBeQEhJ77Pus0yTr_Aqxqmf546ruk-_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4494734941207778126', time=2024-09-12T20:15:41.413040+0000, chain.objs.size()=1 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MclQHj63UhQnaRdZhpYrTfqoPNVT-zx_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8912443372670154274', time=2024-09-12T20:15:42.183904+0000, chain.objs.size()=1 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NGQkkj7lIyC1bayBTWs4eR-ZKqKkXE8_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5705089907145227772', time=2024-09-12T20:15:42.399351+0000, chain.objs.size()=1 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3-w9VUfzaLuMFezy2TX2ZKIiMDWGcAz_0 2024-09-12T18:33:05.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5737716001054470956', time=2024-09-12T20:16:20.298745+0000, chain.objs.size()=1 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Pqx_bVBaE988GnAc-Y6amLHOn21C2c3_0 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16243378545938009978', time=2024-09-12T20:16:20.866324+0000, chain.objs.size()=1 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ewOB80TReC35BFte2DQCMjNumUcR8Iv_0 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7075916653315376804', time=2024-09-12T20:16:20.889003+0000, chain.objs.size()=1 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.327+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1ZN9J2fHVXEeyHbaKaVhyinj3aboGnU_0 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.328+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12215723473658523546', time=2024-09-12T20:16:20.891701+0000, chain.objs.size()=1 2024-09-12T18:33:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.328+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.q1JcDt9VUhaRBxx1KtFjgXsorZcYuk1_0 2024-09-12T18:33:05.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.330+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9807729040144175201', time=2024-09-12T20:16:21.002617+0000, chain.objs.size()=1 2024-09-12T18:33:05.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.330+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._tWZ6Y1OLtCQLVXrUlv9jCIadDTMqXJ_0 2024-09-12T18:33:05.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.330+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10503735886934523347', time=2024-09-12T20:16:21.889706+0000, chain.objs.size()=1 2024-09-12T18:33:05.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.330+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wSaycTUpxfmizJp7tWCYCsAImSxDolh_0 2024-09-12T18:33:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.331+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.395998482257341024', time=2024-09-12T20:16:22.196803+0000, chain.objs.size()=1 2024-09-12T18:33:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.331+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5VG2OsEiEvndllykIH2MrJCrUaTLpLd_0 2024-09-12T18:33:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.332+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18329205938586274194', time=2024-09-12T20:16:22.544839+0000, chain.objs.size()=1 2024-09-12T18:33:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.332+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1o5pM6cX8TdpNw5xL1mjipZ7OFMsV0Q_0 2024-09-12T18:33:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.332+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.521929828694379960', time=2024-09-12T20:16:22.664758+0000, chain.objs.size()=1 2024-09-12T18:33:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.332+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ceNWWyRZuR1IMxlqj-KxRJe-OUkfAvw_0 2024-09-12T18:33:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17280444828310818631', time=2024-09-12T20:16:23.111253+0000, chain.objs.size()=1 2024-09-12T18:33:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.AQ3mBzaLh2yLCJ05R7eCTlkhi5FgwBh_0 2024-09-12T18:33:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5650608941644526650', time=2024-09-12T20:16:23.980919+0000, chain.objs.size()=1 2024-09-12T18:33:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.a0XjQ6DbtXlgXmH0h11PW-DIjQRW2Bi_0 2024-09-12T18:33:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12968399653336327852', time=2024-09-12T20:16:24.022749+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZwTBXV8ukJMjTw9y6X-d5nXkmKPKOde_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16975952542961674491', time=2024-09-12T20:16:24.679886+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xOBMt87tU7LHHKpldylpMMl3n_XaPr7_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13382826148369536757', time=2024-09-12T20:16:24.680428+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yMZdFJqv9XZbsjwReSK5TowakwplIlq_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17043188033348642121', time=2024-09-12T20:16:24.986155+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.96wESPkg_Gh9npcRwqHXhV51-KFC9uF_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3947868498314183601', time=2024-09-12T20:16:25.497854+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WPCOOFyu5QoxsJD5bGktxH-DjZ8ncrN_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1961155052711887808', time=2024-09-12T20:16:26.225515+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.b7mVJ5_zQBmlKSInqK-l7ZVq5cf0mND_0 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7975925752331041032', time=2024-09-12T20:16:26.231693+0000, chain.objs.size()=1 2024-09-12T18:33:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EJuprpTDVbTO0gcGmES13rEHNCE6bOr_0 2024-09-12T18:33:05.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.335+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11968316154877044157', time=2024-09-12T20:16:27.395591+0000, chain.objs.size()=1 2024-09-12T18:33:05.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.336+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.nTbHOP2KVZQFjZeym5C3gtxmHb2MtXW_0 2024-09-12T18:33:05.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.336+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.950954074022771545', time=2024-09-12T20:16:27.592089+0000, chain.objs.size()=1 2024-09-12T18:33:05.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.336+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.n3e-NK2F_bAamWLrpVsQGBAXwIr-8E__0 2024-09-12T18:33:05.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.339+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3621919829410156556', time=2024-09-12T20:16:28.025750+0000, chain.objs.size()=1 2024-09-12T18:33:05.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.339+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yniwy-PAHBnDMAvRyLEnxfTvFJXp6TL_0 2024-09-12T18:33:05.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.339+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11245183959278148945', time=2024-09-12T20:16:28.047694+0000, chain.objs.size()=1 2024-09-12T18:33:05.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.339+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MLgqUHlzBKnIG6G9S10TrSJspDggb8D_0 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3000256231351561048', time=2024-09-12T20:16:28.063156+0000, chain.objs.size()=1 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TFx4PD2tyVLXyHBGZ-PzbHMLn6LzKOO_0 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1445985033601361919', time=2024-09-12T20:16:28.620045+0000, chain.objs.size()=1 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.loXFjhO-x56ykBqm1sACKBKaYVw9Sr1_0 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6079924527621891286', time=2024-09-12T20:16:28.682051+0000, chain.objs.size()=1 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FY4GfY41e2PqCHQIuGl8x3BtL4Gi_OD_0 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11559204360537753009', time=2024-09-12T20:16:29.641497+0000, chain.objs.size()=1 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.J0w0lTcXefqNn-vbgrKIPzQwQg6FNtw_0 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16996198535131166688', time=2024-09-12T20:16:29.825838+0000, chain.objs.size()=1 2024-09-12T18:33:05.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.340+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vFjARI027ByHr8fUSKCssJXHTL1avvO_0 2024-09-12T18:33:05.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.342+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11515131779973265547', time=2024-09-12T20:16:29.908088+0000, chain.objs.size()=1 2024-09-12T18:33:05.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.342+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2AmdRjzGZUClFgOOOMcqpm7xedQF2xu_0 2024-09-12T18:33:05.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.342+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17828708447884221704', time=2024-09-12T20:16:30.348111+0000, chain.objs.size()=1 2024-09-12T18:33:05.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.342+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QJxDBs_RV-9AwwFwNT7W3nZy6DlfGe1_0 2024-09-12T18:33:05.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.345+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/53550 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.629649626106195703', time=2024-09-12T20:16:30.382848+0000, chain.objs.size()=1 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.81WFFpkvh-2EtYaMBU6iXFZTcHqN12A_0 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18219036553980084140', time=2024-09-12T20:16:30.385223+0000, chain.objs.size()=1 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kx-9YkrgCdIosFDcSLbHC9FIDhsr51-_0 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4299614538254062989', time=2024-09-12T20:16:30.576382+0000, chain.objs.size()=1 2024-09-12T18:33:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.SeYOzhRHpc5eGO8Sb6mlNCCMfYn3rrw_0 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9464695785355233880', time=2024-09-12T20:16:30.654147+0000, chain.objs.size()=1 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QD_Llt6BVwcK0ncjiip64o1M3oRlap4_0 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8787985750566587877', time=2024-09-12T20:16:30.654647+0000, chain.objs.size()=1 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qz3zXS_fvc7JdsCUNuJTi2FAbwqWRS0_0 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9014167698859414930', time=2024-09-12T20:17:27.242637+0000, chain.objs.size()=1 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.432__shadow_.Osxvrmk2Mx0DzlZBPH9r8CyOuciflVl_0 2024-09-12T18:33:05.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2286480652276932374', time=2024-09-12T20:17:36.155942+0000, chain.objs.size()=1 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.447__shadow_.6jqhlX0vUPRITJq_Pzj6Pwqq2dFix_r_0 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2993363218757108746', time=2024-09-12T20:17:57.944275+0000, chain.objs.size()=1 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484__shadow_.iw17DOVkoJdvnZ_yRVnnwpoBrR3LE03_0 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.341065624678766053', time=2024-09-12T20:18:04.255756+0000, chain.objs.size()=1 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.491__shadow_.rYPdRxGbM6pfMmdjsU4tqlYArV2I-uu_0 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7537350260364793454', time=2024-09-12T20:18:07.877164+0000, chain.objs.size()=1 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.498__shadow_.1txvxufwv7H0X_m8dYczKe6JXFM929G_0 2024-09-12T18:33:05.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13378889406373873651', time=2024-09-12T20:18:08.793296+0000, chain.objs.size()=1 2024-09-12T18:33:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.499__shadow_.nw9XyS5D9FeGmBQ7TA9swrG6fwEf40w_0 2024-09-12T18:33:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13895217774343829053', time=2024-09-12T20:18:11.350751+0000, chain.objs.size()=1 2024-09-12T18:33:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.348+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.351+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17919649579440688445', time=2024-09-12T20:21:12.597095+0000, chain.objs.size()=1 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.351+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.557__shadow_.bqWd1z9I0bXJRhCO6cenHmAL68B3Wkc_0 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.351+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10258721218667907880', time=2024-09-12T20:21:34.334286+0000, chain.objs.size()=1 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.351+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:Culh-EJge.0jsS66FJ9nNpZpPepRYwB_.qK-ydzKVOeLaIVWyDDkLBIGePSTqWnC_0 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9642567621436927308', time=2024-09-12T20:21:38.261272+0000, chain.objs.size()=1 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:394JQcsqoIHXRa5ul1ceBpwPDW6HEOa_.NfIxdK9zEXaDF98seEBHj7LWUjNvu69_0 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4632071825761457149', time=2024-09-12T20:26:35.337017+0000, chain.objs.size()=1 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.638__shadow_.11lJ2eazWlSY7I66rrzqD_PBVaY5eYw_0 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10521158779303317784', time=2024-09-12T20:26:42.274202+0000, chain.objs.size()=2 2024-09-12T18:33:05.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.645__shadow_.LSPT6zr5M9qzJQS3Aqnr1YasXM_Ul5b_0 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.645__shadow_.LSPT6zr5M9qzJQS3Aqnr1YasXM_Ul5b_1 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12133033936498193145', time=2024-09-12T20:27:11.590426+0000, chain.objs.size()=12 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.352+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.1 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.353+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.1_1 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.353+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.2 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.353+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.2_1 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.354+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.3 2024-09-12T18:33:05.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.356+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.3_1 2024-09-12T18:33:05.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.357+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.4 2024-09-12T18:33:05.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.4_1 2024-09-12T18:33:05.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.5 2024-09-12T18:33:05.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.5_1 2024-09-12T18:33:05.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__multipart_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.6 2024-09-12T18:33:05.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.661__shadow_baz.2~Q_lOSLPcNqeNnHVE-jsSy7o2xVvTeE9.6_1 2024-09-12T18:33:05.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6424606364821207024', time=2024-09-12T20:27:21.931007+0000, chain.objs.size()=1 2024-09-12T18:33:05.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.358+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.679__shadow_.zMSMxrvGtRAjiVQCslzgcEcyuqngxxB_0 2024-09-12T18:33:05.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.363+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.369+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:33:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.370+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48623' 2024-09-12T18:33:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13116672679652547096', time=2024-09-12T20:11:03.534922+0000, chain.objs.size()=3 2024-09-12T18:33:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.gh7Zc0JUX06vsMROpvAJ3E_3mAGfyES_0 2024-09-12T18:33:05.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.gh7Zc0JUX06vsMROpvAJ3E_3mAGfyES_1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.gh7Zc0JUX06vsMROpvAJ3E_3mAGfyES_2 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3338591169616640096', time=2024-09-12T20:13:16.737471+0000, chain.objs.size()=1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.243__shadow_.dGhwIq-xK5ojVn_PVNr-kfr4q90smPU_0 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10403664652906571602', time=2024-09-12T20:13:16.738262+0000, chain.objs.size()=1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.243__shadow_.iesifjwIOw13uDHR0PIdQ734uFILp-__0 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15290992434860593142', time=2024-09-12T20:13:26.094671+0000, chain.objs.size()=1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.258__shadow_.NltS_App3VuqOnCWASW2kj0_d4agfUr_0 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9726589772823447265', time=2024-09-12T20:13:27.303606+0000, chain.objs.size()=1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.260__shadow_.QuvAU2jUvAO9_Mfyfn3Ek2gmtIKvxK1_0 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7973311980137033059', time=2024-09-12T20:14:04.151880+0000, chain.objs.size()=1 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PhtfyWep9t_gzqUrER6GbnamUPpr6L__0 2024-09-12T18:33:05.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6246052351598062745', time=2024-09-12T20:14:04.386413+0000, chain.objs.size()=1 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ptd-m-rTi8WNyCI_PHuQ6rVrn3Ag2oO_0 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15259428943503065659', time=2024-09-12T20:14:04.510057+0000, chain.objs.size()=1 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aJe2p-c-S9XzuEfvv-dpsNB5hEKxj09_0 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2425419752558671478', time=2024-09-12T20:14:04.706162+0000, chain.objs.size()=1 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Qges9BB0qtyZe67lABTwxROaaMIMCHx_0 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1431412915871586247', time=2024-09-12T20:14:05.135516+0000, chain.objs.size()=1 2024-09-12T18:33:05.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.371+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zZrx7ApXJRxrVUfzZyorNKJ1k-eUIqK_0 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.374+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18307351058404797638', time=2024-09-12T20:14:06.170697+0000, chain.objs.size()=1 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.9Y7DBQI5dIKrW22U-fzW8OzlUnAL02E_0 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7170134146855670556', time=2024-09-12T20:14:06.248053+0000, chain.objs.size()=1 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_._6g035BvBqDj-f4JMIWUV4uF9R6Ithe_0 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8992849446828669891', time=2024-09-12T20:14:07.154888+0000, chain.objs.size()=1 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YhyUi-gLmrjTmuJJ5F64uucxSaSVEO6_0 2024-09-12T18:33:05.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2137331943995943808', time=2024-09-12T20:14:07.270920+0000, chain.objs.size()=1 2024-09-12T18:33:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ZgMvNUoMPgLXK7TJ6wbzGGRSvXF479l_0 2024-09-12T18:33:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16718263556803228419', time=2024-09-12T20:14:07.294872+0000, chain.objs.size()=1 2024-09-12T18:33:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cqsy-VLfxHjHChkxQEyvlRLaXm0v2f9_0 2024-09-12T18:33:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.375+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12332841080948328885', time=2024-09-12T20:14:07.361264+0000, chain.objs.size()=1 2024-09-12T18:33:05.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.376+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jmD_XKdCG8gzNXX9W3XX9IyYSOO0XZl_0 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.376+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5941014455103792189', time=2024-09-12T20:14:07.419837+0000, chain.objs.size()=1 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.376+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zQG2zZn_vabBlizTPiJ9q3e0Sxgabgp_0 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3344611259784405181', time=2024-09-12T20:14:07.464743+0000, chain.objs.size()=1 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CU4c_3oqGgIsrKQxWgTFL__pY9Rj-Eo_0 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13962001937445558779', time=2024-09-12T20:14:07.582630+0000, chain.objs.size()=1 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0y5OiZpip-5JtKP0RSaPdsLNKdgr06b_0 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7136642593083814330', time=2024-09-12T20:14:07.939406+0000, chain.objs.size()=1 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qTRqVGBJH7EPDH2mv3nYFSAf0lNgRee_0 2024-09-12T18:33:05.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12918524406287439290', time=2024-09-12T20:14:08.060412+0000, chain.objs.size()=1 2024-09-12T18:33:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.377+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PYhdDm4EQ--CVUol941tDaaMwYaRuUM_0 2024-09-12T18:33:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.378+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4958627951676156557', time=2024-09-12T20:14:08.086788+0000, chain.objs.size()=1 2024-09-12T18:33:05.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.378+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4LzUo37Xn3hfT-o8OBUFLc5cOK-Te1P_0 2024-09-12T18:33:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10390690994926580521', time=2024-09-12T20:14:08.851905+0000, chain.objs.size()=1 2024-09-12T18:33:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3ouokuKcUwGoWWmeR2iyJWNqPLFBf0Y_0 2024-09-12T18:33:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4467966569252049603', time=2024-09-12T20:14:10.105834+0000, chain.objs.size()=1 2024-09-12T18:33:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ae1aU0mP9WCwxNj9F1YpRKPZPE6_1fa_0 2024-09-12T18:33:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5665911029138334688', time=2024-09-12T20:14:10.605331+0000, chain.objs.size()=1 2024-09-12T18:33:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2-_Ebq5l5e8imVariakGdV0O5DjqJco_0 2024-09-12T18:33:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3313228770502558803', time=2024-09-12T20:14:10.869270+0000, chain.objs.size()=1 2024-09-12T18:33:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.379+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bEPDpqtUWBhtFC1xb_x03ITiOpaKamP_0 2024-09-12T18:33:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4072224193603749259', time=2024-09-12T20:14:11.462385+0000, chain.objs.size()=1 2024-09-12T18:33:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8jBMgGw91Km_pBHTuUQFegSEwacwu2X_0 2024-09-12T18:33:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.380+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10521153648924735567', time=2024-09-12T20:14:11.719768+0000, chain.objs.size()=1 2024-09-12T18:33:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.380+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qNQDzCn-ncKLv7965F9m3IFL1DZ3LLE_0 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.381+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12890152411990837164', time=2024-09-12T20:14:11.765781+0000, chain.objs.size()=1 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.381+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.khkZMpy7-qQ70X9D_mcROqZCKZIqsbC_0 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16483576364245759384', time=2024-09-12T20:14:11.766729+0000, chain.objs.size()=1 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.URYOHGZyIXctgHAg7PNfYqVHp1fnviG_0 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13567502066904423304', time=2024-09-12T20:14:11.813725+0000, chain.objs.size()=1 2024-09-12T18:33:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5XA_OhHcfQ9cpTiPWTdHfnRwq4fvi-7_0 2024-09-12T18:33:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16855396866903931241', time=2024-09-12T20:14:12.558063+0000, chain.objs.size()=1 2024-09-12T18:33:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.yC6uSK5mh_mC6f1E-U2deThE7umy8eE_0 2024-09-12T18:33:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8252196967567919433', time=2024-09-12T20:14:12.558662+0000, chain.objs.size()=1 2024-09-12T18:33:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.382+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PjJ3WASB710A8qE6T5Z1rmoy-kZ6EKo_0 2024-09-12T18:33:05.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15185875938430559738', time=2024-09-12T20:14:13.289184+0000, chain.objs.size()=1 2024-09-12T18:33:05.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ipE3F150W-ofRDyEXCFWZSt84wCPtpQ_0 2024-09-12T18:33:05.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.361903925390735151', time=2024-09-12T20:14:13.617545+0000, chain.objs.size()=1 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.x16Moxv7VZlLjMFCqYBJ6r_0onjop1g_0 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14086910264059231710', time=2024-09-12T20:14:13.823488+0000, chain.objs.size()=1 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4OtQ7hYkm9FY4wVIZeDx8Sg0kam15nb_0 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4994204294592918725', time=2024-09-12T20:14:14.219612+0000, chain.objs.size()=1 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.sY75D3MUvB7WLgDB23g5bHGKrHyEZFj_0 2024-09-12T18:33:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1845469654276780806', time=2024-09-12T20:14:14.655806+0000, chain.objs.size()=1 2024-09-12T18:33:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.kokd--T1rqSg9c8Pwvd6Y06v8I3gBVn_0 2024-09-12T18:33:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5230234660636304717', time=2024-09-12T20:14:15.122411+0000, chain.objs.size()=1 2024-09-12T18:33:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.384+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PAXnJkt8HcTO2Bm3SFtyfOvNqyYQG6a_0 2024-09-12T18:33:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.385+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4875435907999792356', time=2024-09-12T20:14:15.151651+0000, chain.objs.size()=1 2024-09-12T18:33:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.385+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8MKwdk7d7pPBlmUE3JfKBledMgGKQ2V_0 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8176751670996147196', time=2024-09-12T20:14:16.947998+0000, chain.objs.size()=1 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.265__shadow_.PXLqNbk_VMjNnRGrhm3BJIE6mabsae3_0 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6143210751790553914', time=2024-09-12T20:14:18.112559+0000, chain.objs.size()=1 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.267__shadow_.0SNzAIj0vlBPM-3G7VQFs90YQQ_JjBE_0 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7929855678515062078', time=2024-09-12T20:14:19.825684+0000, chain.objs.size()=1 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.270__shadow_.dKe_CMm1rBYuxYwEfwEbcAUm5yNH2tr_0 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16143085374180742042', time=2024-09-12T20:14:30.256532+0000, chain.objs.size()=1 2024-09-12T18:33:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.387+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.287__shadow_.mdfGoL0ohjT2dp8ETpkbVGeQtT3oc2I_0 2024-09-12T18:33:05.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.389+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13124452326464095826', time=2024-09-12T20:14:34.498779+0000, chain.objs.size()=1 2024-09-12T18:33:05.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.389+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.CiVC8Q18KJgyVDzbWNwFVxvRdzV1pGB_0 2024-09-12T18:33:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7137033068796199220', time=2024-09-12T20:14:39.705153+0000, chain.objs.size()=1 2024-09-12T18:33:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.298__shadow_.IYuhLzas6pFcMygKZIzLj2-KKopDg_W_0 2024-09-12T18:33:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.670603486252626331', time=2024-09-12T20:14:43.388445+0000, chain.objs.size()=1 2024-09-12T18:33:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.304__shadow_.Aua9cHDkZNStEh9xyabBf_F1Yf9JmCk_0 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6927205609921727350', time=2024-09-12T20:15:32.150116+0000, chain.objs.size()=1 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.gTroaiTuMwrq0xEiVsxaEIXAeWk2lJJ_0 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13028718418428841154', time=2024-09-12T20:15:32.437738+0000, chain.objs.size()=1 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.xWS-3KT9yO-PYgNihEFZlbMkI-zWsE5_0 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2644892020370735645', time=2024-09-12T20:15:32.460400+0000, chain.objs.size()=1 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.B3HRU2dJsl7KhXdwL7Uhlr4Bc1vAeze_0 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13591663774892643284', time=2024-09-12T20:15:32.485394+0000, chain.objs.size()=1 2024-09-12T18:33:05.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.390+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vFhjgidGT48j475_lCVuQB9e5UVjlIr_0 2024-09-12T18:33:05.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.394+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9316379244237318691', time=2024-09-12T20:15:32.650278+0000, chain.objs.size()=1 2024-09-12T18:33:05.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.394+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mxONG0bGU4Jm3QBfdcfZlJqqjVi93DD_0 2024-09-12T18:33:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10062773542704634947', time=2024-09-12T20:15:32.976081+0000, chain.objs.size()=1 2024-09-12T18:33:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dyXVm_-7c_wAgFBf8VRLEE878BNwi6v_0 2024-09-12T18:33:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11028165507088851046', time=2024-09-12T20:15:33.071206+0000, chain.objs.size()=1 2024-09-12T18:33:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.8ktZaEjGeZKB1XR5bkCOYcUp98X12Nb_0 2024-09-12T18:33:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4102359109677344881', time=2024-09-12T20:15:33.703568+0000, chain.objs.size()=1 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0uOB9Rz7yXAmRD-gLC2zDRGLSRh49yD_0 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10470872571535223165', time=2024-09-12T20:15:33.734605+0000, chain.objs.size()=1 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Geb5PTO6XrPd13SHtz9rLRde1rwrtng_0 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5106352953056740213', time=2024-09-12T20:15:33.862453+0000, chain.objs.size()=1 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yOG-3z7g-cemBalujwd1ZFcg3CZsZD3_0 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3138520522565903544', time=2024-09-12T20:15:33.898100+0000, chain.objs.size()=1 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JMzozgJ8z0_LN-O3leguqg3DI71Ii4K_0 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2313753405516606972', time=2024-09-12T20:15:33.898808+0000, chain.objs.size()=1 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4o2QuZ6-GDq_yZJvsOe0R2uYtnkk5gh_0 2024-09-12T18:33:05.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17797830226068797392', time=2024-09-12T20:15:34.044569+0000, chain.objs.size()=1 2024-09-12T18:33:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YlHgPocb0WQok6LPw_eG5sfvHGvADQN_0 2024-09-12T18:33:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5372189957516957176', time=2024-09-12T20:15:34.513048+0000, chain.objs.size()=1 2024-09-12T18:33:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JSV0UT7v7dmEhPYR-q71xDiCC9xjnF6_0 2024-09-12T18:33:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16205262871782959435', time=2024-09-12T20:15:34.513851+0000, chain.objs.size()=1 2024-09-12T18:33:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.395+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FdB2SI2rv8uk1zr4aNkq4mWW0bfnAOT_0 2024-09-12T18:33:05.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.398+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3676311276354491179', time=2024-09-12T20:15:34.732364+0000, chain.objs.size()=1 2024-09-12T18:33:05.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.398+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9prfA499eOOgcllI6PECG2Y7JZWqu79_0 2024-09-12T18:33:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15076445912460382566', time=2024-09-12T20:15:35.190608+0000, chain.objs.size()=1 2024-09-12T18:33:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ldxhjbh9QHKO_vkGPy8EItqgDYfQVl__0 2024-09-12T18:33:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18196856190039932286', time=2024-09-12T20:15:35.191200+0000, chain.objs.size()=1 2024-09-12T18:33:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FsFjmdgyxrCsGT5BUANePntdXH4o54v_0 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9541267905479768783', time=2024-09-12T20:15:35.367853+0000, chain.objs.size()=1 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.l5eG86cZnQkGGeRHf65lAkxk755nOmc_0 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3780627500298145550', time=2024-09-12T20:15:35.631198+0000, chain.objs.size()=1 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.G3XbPVtc4bV3viblj6Ud1Rr1Jy6ecOz_0 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11173961106014823287', time=2024-09-12T20:15:35.921327+0000, chain.objs.size()=1 2024-09-12T18:33:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3Lz8-wAPcyjrKZEgV5SwneHBA-T_x6__0 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7896345235329221264', time=2024-09-12T20:15:35.961015+0000, chain.objs.size()=1 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.O8ucBJ0zCa4FDX3Mka9AjyTfpnhe3zX_0 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14385326991451410228', time=2024-09-12T20:15:36.042267+0000, chain.objs.size()=1 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iO_BPmbY39LR74zAeEiHgBL_VROAT2I_0 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.399+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10838137875689722481', time=2024-09-12T20:15:36.078164+0000, chain.objs.size()=1 2024-09-12T18:33:05.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.400+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.u8eLpThBfs5qjyx5FxW-qQA3cD_IhnF_0 2024-09-12T18:33:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.400+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9920666570014470745', time=2024-09-12T20:15:36.078954+0000, chain.objs.size()=1 2024-09-12T18:33:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.400+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.XU16ddoh8I3h4dxgZLp74XXor4NiDTF_0 2024-09-12T18:33:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.400+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13065528206148356985', time=2024-09-12T20:15:36.114212+0000, chain.objs.size()=1 2024-09-12T18:33:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.400+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.J8x9n-ujWBn-BKTA2_9oktab7chEUSb_0 2024-09-12T18:33:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17344435636640641906', time=2024-09-12T20:15:37.267716+0000, chain.objs.size()=1 2024-09-12T18:33:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3unKH7VtgUNDbKf9Z7MlvfdfEI3W4Qe_0 2024-09-12T18:33:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6478387086259163012', time=2024-09-12T20:15:37.400845+0000, chain.objs.size()=1 2024-09-12T18:33:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Uwq-ICFQbm9Wcu8js2Vfmv3AVi02ibv_0 2024-09-12T18:33:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16195433536721425854', time=2024-09-12T20:15:37.513757+0000, chain.objs.size()=1 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n7ifq0lUJ3SPEscgdsfShToaCG8PsAz_0 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2336825428824898468', time=2024-09-12T20:15:37.560577+0000, chain.objs.size()=1 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yJAF9E8cub4D7QuUfKtEJ6S0ByrenUW_0 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12582330229619073176', time=2024-09-12T20:15:37.675913+0000, chain.objs.size()=1 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._ch0ZHdH730e8h_l5upt82YBxfHS5GQ_0 2024-09-12T18:33:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15577932159616056640', time=2024-09-12T20:15:38.140853+0000, chain.objs.size()=1 2024-09-12T18:33:05.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.skXMKQ5dR6SqBKIhHZbh1M9mt-I9pZG_0 2024-09-12T18:33:05.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2780916442842442451', time=2024-09-12T20:15:38.226367+0000, chain.objs.size()=1 2024-09-12T18:33:05.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZmKf5-oGaykwLCuOEDEBmHYCIIsldjK_0 2024-09-12T18:33:05.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12639756208521188868', time=2024-09-12T20:15:38.406995+0000, chain.objs.size()=1 2024-09-12T18:33:05.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4GphbL8IWwcIw_0IJ60QO7aueV314uI_0 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.945776832685349865', time=2024-09-12T20:15:40.289285+0000, chain.objs.size()=1 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.h0upsVwtj_wfuBSjDU_dzpH3ZTbrPg8_0 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3511949470850966442', time=2024-09-12T20:15:40.759919+0000, chain.objs.size()=1 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9-XjaEVy8Ga0UrEzr7NBJGRtojkxJXI_0 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10538150818656210025', time=2024-09-12T20:15:41.254099+0000, chain.objs.size()=1 2024-09-12T18:33:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.405+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.byM4Tw_vck7xbyZndoRAP7SMTpq7TLm_0 2024-09-12T18:33:05.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.409+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13996271088246494005', time=2024-09-12T20:15:42.367702+0000, chain.objs.size()=1 2024-09-12T18:33:05.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.409+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Bk0_-z2BznSBLOP1K1qS5uGDZTdsffp_0 2024-09-12T18:33:05.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3661914867111779967', time=2024-09-12T20:15:42.520417+0000, chain.objs.size()=1 2024-09-12T18:33:05.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.KbfrRcwGe-C7ichKdZ6tAdUqXu_-oiA_0 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16230091934864486854', time=2024-09-12T20:15:42.666546+0000, chain.objs.size()=1 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hVKB0fUWle1rzFGoPHzK5lfQ2-VjOlS_0 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13524266650736580156', time=2024-09-12T20:15:42.703103+0000, chain.objs.size()=1 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.RKzDGbRFaD9akx3dL7WJq4q7leMZrhc_0 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6506550004206645158', time=2024-09-12T20:15:42.768296+0000, chain.objs.size()=1 2024-09-12T18:33:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eDxq4lmqXFuRx14VeJms0smS2NtYGms_0 2024-09-12T18:33:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13145388239661655586', time=2024-09-12T20:15:42.794796+0000, chain.objs.size()=1 2024-09-12T18:33:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PslblW-YPUJnzeA1-4_B6tDXRMD564__0 2024-09-12T18:33:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4928430300671827446', time=2024-09-12T20:16:20.639436+0000, chain.objs.size()=1 2024-09-12T18:33:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.MQ-_RPo0ZklBqyMshtz4hYZlRXW5tXX_0 2024-09-12T18:33:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15652144814550244636', time=2024-09-12T20:16:21.151008+0000, chain.objs.size()=1 2024-09-12T18:33:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4NSClu9FUUD3KxdoOaqR2o92f0fW9yg_0 2024-09-12T18:33:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9031993593310753412', time=2024-09-12T20:16:21.742452+0000, chain.objs.size()=1 2024-09-12T18:33:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.L3bHnQkbvIt3YE3s7Cp9Fu_e1s-3llh_0 2024-09-12T18:33:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12465611125398362847', time=2024-09-12T20:16:21.987449+0000, chain.objs.size()=1 2024-09-12T18:33:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.410+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._IsKYozAWLMfHRXDxEh3x4TqT7ldDyW_0 2024-09-12T18:33:05.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.411+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7729520158758435700', time=2024-09-12T20:16:22.087405+0000, chain.objs.size()=1 2024-09-12T18:33:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.411+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xjLgcqpx-lUeKaM1yBl9g2P7ukMiiQw_0 2024-09-12T18:33:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.413+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1602819334616559174', time=2024-09-12T20:16:22.640507+0000, chain.objs.size()=1 2024-09-12T18:33:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.413+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FhwuX3J559pLwS1Sd5bZFxpKF8O6Iyp_0 2024-09-12T18:33:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1623472733392007713', time=2024-09-12T20:16:22.666834+0000, chain.objs.size()=1 2024-09-12T18:33:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Lm-8pj9fS_kApjDdZ6B6kuSHPxPJczC_0 2024-09-12T18:33:05.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16360405453546182862', time=2024-09-12T20:16:23.315158+0000, chain.objs.size()=1 2024-09-12T18:33:05.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ESvnAJwpgXGcc-iWA_tdcMcGKtsog2U_0 2024-09-12T18:33:05.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6092577967514334631', time=2024-09-12T20:16:23.524117+0000, chain.objs.size()=1 2024-09-12T18:33:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lT6i3n_q2uboaOUtK-SkbvKd9hUITFl_0 2024-09-12T18:33:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17525525231566300428', time=2024-09-12T20:16:23.818680+0000, chain.objs.size()=1 2024-09-12T18:33:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.416+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gpdGlzxNGW4jou7HvDih366pC8SbcNG_0 2024-09-12T18:33:05.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.419+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/48623 2024-09-12T18:33:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T18:33:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13360856984656452900', time=2024-09-12T20:16:24.025698+0000, chain.objs.size()=1 2024-09-12T18:33:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7KuPjXhr1LGS2IbrMqmTLSBl5Ane8TN_0 2024-09-12T18:33:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8985420235583576672', time=2024-09-12T20:16:25.126565+0000, chain.objs.size()=1 2024-09-12T18:33:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QzL7Ha_3FjcO6ZCHWS7H2V7VyvC6ZWj_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7569686055162783292', time=2024-09-12T20:16:25.421453+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9YhOAr9MAIwyAx3PxcuokXnpyirLCZ-_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14021627654749328144', time=2024-09-12T20:16:25.422419+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rFMaZvUE2c6AIoTO_k8TADccbZR2N0X_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14095451169716396210', time=2024-09-12T20:16:25.545114+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.akgVzhyXHp6X4Or6l_jmj-BjI0rJL1a_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8856631283308577978', time=2024-09-12T20:16:25.970716+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CkPgfxwKw94YmhzIylw0tn_ZNJQWhdi_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1509934661462498466', time=2024-09-12T20:16:26.562820+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.a0SLDIAaYYGZkMt3AyJ_4ocKNS82nLy_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.21679732192030329', time=2024-09-12T20:16:26.750097+0000, chain.objs.size()=1 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RDCcbS9LG7uKwlIgBTqwzNjUCpK3AOl_0 2024-09-12T18:33:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8990841074339900307', time=2024-09-12T20:16:26.886207+0000, chain.objs.size()=1 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zJiIwwqoK3XHr6HcAG-gvkV4mDg4nlo_0 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11808624235138884426', time=2024-09-12T20:16:27.743785+0000, chain.objs.size()=1 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.915x3fcMCunbPSCo6bUp8VrcdKDIaec_0 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10417455048258898061', time=2024-09-12T20:16:27.960559+0000, chain.objs.size()=1 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EqaRJHfNzq885dK8HrSC7PXRQccLGb7_0 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11103713965287384497', time=2024-09-12T20:16:28.243417+0000, chain.objs.size()=1 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.422+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zf7itT4iwvDm_IYDbLn6BUA3WgZ64W2_0 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.425+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9390541312650835819', time=2024-09-12T20:16:28.679472+0000, chain.objs.size()=1 2024-09-12T18:33:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.425+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.25TNwaY-eEl1rJXr05A1telhUmeOSVJ_0 2024-09-12T18:33:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5402622012490748949', time=2024-09-12T20:16:29.182101+0000, chain.objs.size()=1 2024-09-12T18:33:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7tUJ21USGeJGSr0Uqa66jrMNNDJvLly_0 2024-09-12T18:33:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14631910971444161717', time=2024-09-12T20:16:29.873602+0000, chain.objs.size()=1 2024-09-12T18:33:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CGVlqtx7E5QcI1zIuKMLwdacdBSeXax_0 2024-09-12T18:33:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3038455591451781354', time=2024-09-12T20:16:29.945038+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.I1uAh_vO8WyA9avKoWPSUpzJ65SFwFQ_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16185003178560577098', time=2024-09-12T20:16:30.255840+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4gB_r0JsYRbIur4evcaqrzXm-kvk6nH_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5599982696507169946', time=2024-09-12T20:16:30.412208+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.t2a0QzZt36UYDs8HJuuh7Js4GGPrzbO_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6911735716742521892', time=2024-09-12T20:16:30.733560+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-V41RG3qKFq82xALnA2tsUHTc1xCwoZ_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15674550614497950618', time=2024-09-12T20:16:30.912252+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BmL-hmDNzG-SLLqRVfOuFIEOauocYqr_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16657581151163990915', time=2024-09-12T20:16:31.013440+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.gwPJIIkc25eeycaFQnRJOk3c6i7WXyR_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14511492791250422245', time=2024-09-12T20:17:15.695883+0000, chain.objs.size()=1 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.408__shadow_.PymAQKBE0VachO36i6P4kGD1v4X_pPf_0 2024-09-12T18:33:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17620017497789572336', time=2024-09-12T20:17:47.193009+0000, chain.objs.size()=1 2024-09-12T18:33:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.463__shadow_.MGTDXvuPyhDkr6H6lLi43UTcmCxkzWK_0 2024-09-12T18:33:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12570190265674994361', time=2024-09-12T20:18:05.944846+0000, chain.objs.size()=1 2024-09-12T18:33:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.427+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.495__shadow_.49wjxiK3wvH213eSI0M0WgyerESt9c7_0 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1', time=2024-09-12T20:19:06.676307+0000, chain.objs.size()=1 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.522__multipart_mymultipart.2~OUcvZneAgymzbN4Mqs0PhqEm7EtbkY1.2 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~zZ9LxwhJLq0VFs92D7kmgmDzuYC_Vj_', time=2024-09-12T20:20:18.298602+0000, chain.objs.size()=2 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.531__multipart_mymultipart.2~zZ9LxwhJLq0VFs92D7kmgmDzuYC_Vj_.1 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.531__multipart_mymultipart.2~zZ9LxwhJLq0VFs92D7kmgmDzuYC_Vj_.2 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13750367026224700004', time=2024-09-12T20:21:54.732641+0000, chain.objs.size()=1 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:hUnpS8BsMJq2vJfxexDlH5GfTtpoQq6_.03jncU5vz_9V4QjMm4lOA1IVNJt7JVn_0 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17352760613274757709', time=2024-09-12T20:22:01.526877+0000, chain.objs.size()=1 2024-09-12T18:33:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.432+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:kg3eeikO1e9-L6fkdk.TeTfXEkEMZ.R_.nCOO9Z_8SQ9b_ZFWjja4wDigF_BQXq7_0 2024-09-12T18:33:05.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6152364362949497909', time=2024-09-12T20:22:09.901777+0000, chain.objs.size()=1 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:MT2ZWY8qmVt7O0BcliyEHPT6hn.ojbV_.AzD2BqnL7SiBMgd1HClevh98S_chEqM_0 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15052172424926066677', time=2024-09-12T20:26:34.056552+0000, chain.objs.size()=1 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.636__shadow_.qgUZUApe23iVOUksI4_j1jqgZXYqZPK_0 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9068364650982705443', time=2024-09-12T20:27:15.423847+0000, chain.objs.size()=1 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.666__shadow_.9pC_Psv3Ba_q1G972LGZDhQh0PGFi4__0 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10303100118697044874', time=2024-09-12T20:28:02.695778+0000, chain.objs.size()=1 2024-09-12T18:33:05.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.434+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.718__shadow_.3FvkuQmQeaENd0RML5q1Abr39KKAowq_0 2024-09-12T18:33:05.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.437+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.440+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:33:05.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.441+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.442+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46311' 2024-09-12T18:33:05.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3791417476737370039', time=2024-09-12T20:11:11.163147+0000, chain.objs.size()=5 2024-09-12T18:33:05.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-FROZEN.2~tKJpceasCw6xt0lc9gYYMFlSi16b5we.1 2024-09-12T18:33:05.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_foo-FROZEN.2~tKJpceasCw6xt0lc9gYYMFlSi16b5we.1_1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-FROZEN.2~tKJpceasCw6xt0lc9gYYMFlSi16b5we.2 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_foo-FROZEN.2~tKJpceasCw6xt0lc9gYYMFlSi16b5we.2_1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__multipart_foo-FROZEN.2~tKJpceasCw6xt0lc9gYYMFlSi16b5we.3 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5767617485976309125', time=2024-09-12T20:11:17.587785+0000, chain.objs.size()=1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.166__shadow_.yDzOI8UL_K_qeA4eMOgux6bKwzLEyd4_0 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1246175009353118706', time=2024-09-12T20:11:36.151597+0000, chain.objs.size()=1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.189__shadow_.XOOk7oMOJjOwY2MPsC4hHk_6T74ealL_0 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7418171419862567936', time=2024-09-12T20:13:11.798491+0000, chain.objs.size()=1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.236__shadow_.R9ooeNoK5xZQbMrQ9Z_KJLB6jbe6MJw_0 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4603358832015373187', time=2024-09-12T20:13:16.727277+0000, chain.objs.size()=1 2024-09-12T18:33:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.243__shadow_.LwVf8TPdxU9taxMaGJz519Dr-Jn9bp1_0 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11543419568629605090', time=2024-09-12T20:13:27.905052+0000, chain.objs.size()=1 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.261__shadow_.nKRy5EXYiHqpotzAxflF5S0TJijZ9OK_0 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17343883915856726705', time=2024-09-12T20:14:04.140739+0000, chain.objs.size()=1 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G5RDSMQQeNgUgqrUAJpFOogzmawPZO8_0 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18144253196505476876', time=2024-09-12T20:14:04.276336+0000, chain.objs.size()=1 2024-09-12T18:33:05.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.443+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1mqlwNjbWxFEsiAEABEOCA8mCQqhi_X_0 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5551711701016787716', time=2024-09-12T20:14:04.341512+0000, chain.objs.size()=1 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.x2jZL9yc6H9WViA2pALNxTRcvYEJdRF_0 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8138098191860100086', time=2024-09-12T20:14:04.784574+0000, chain.objs.size()=1 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ve9QcBRqq0jbE3KU6qwVoUmwVi-Ki9l_0 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1405168873331494910', time=2024-09-12T20:14:05.164464+0000, chain.objs.size()=1 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VxMqvMv0O2EiNZlPjRedy7-y0ZdBZux_0 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1631321860433212805', time=2024-09-12T20:14:07.194506+0000, chain.objs.size()=1 2024-09-12T18:33:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.S1vQdOpaTVux2iDZcXMYtnLOqV2iNQn_0 2024-09-12T18:33:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5082697971422944178', time=2024-09-12T20:14:07.468038+0000, chain.objs.size()=1 2024-09-12T18:33:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hs3VsZuoLOyXHFT5zpEypUp8ldh3k7s_0 2024-09-12T18:33:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15084633010975380345', time=2024-09-12T20:14:07.611200+0000, chain.objs.size()=1 2024-09-12T18:33:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.446+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.S7KIwLKdB_4CmwkT_PVn1BrorasN-Qg_0 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10681526268324034485', time=2024-09-12T20:14:07.667798+0000, chain.objs.size()=1 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EnxSaYf1m0NOInYFYdba-IcBgfU1yCW_0 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17973930376424148631', time=2024-09-12T20:14:07.690711+0000, chain.objs.size()=1 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.tIQHBHjUaY7JV8IzjQaPAj3WIPo_0y6_0 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.695208292304348319', time=2024-09-12T20:14:07.723800+0000, chain.objs.size()=1 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.IEM_gxIMy_BeHuN3oTJA7ZKnGoQ0iYk_0 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16806142110045964299', time=2024-09-12T20:14:08.143123+0000, chain.objs.size()=1 2024-09-12T18:33:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8GNdu02CMDVb1BOM693ZPFCbO05fZgo_0 2024-09-12T18:33:05.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16923310864354058739', time=2024-09-12T20:14:08.613190+0000, chain.objs.size()=1 2024-09-12T18:33:05.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.448+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vVjKuYc1OR0cTU43Bm_m6XYs-YCBFit_0 2024-09-12T18:33:05.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12943315267483425098', time=2024-09-12T20:14:08.738539+0000, chain.objs.size()=1 2024-09-12T18:33:05.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3118vDRPkCLCXIhb7grqWRkizGvPLoc_0 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9261154195599608087', time=2024-09-12T20:14:08.739141+0000, chain.objs.size()=1 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2Nz-c2TwsgZHj0KKCjQrRVfexSUSiX0_0 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17708542455111196187', time=2024-09-12T20:14:09.047979+0000, chain.objs.size()=1 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7AjE2EeKxEpZ2ZH4zbMz3pT64vRK6g7_0 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5478069851703057538', time=2024-09-12T20:14:09.088248+0000, chain.objs.size()=1 2024-09-12T18:33:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hFvnb7T-udAj8xCIghUPMfR-da5-sIc_0 2024-09-12T18:33:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7046562551226538776', time=2024-09-12T20:14:09.686505+0000, chain.objs.size()=1 2024-09-12T18:33:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Xx3mgvVWHAh6W_TMICjG-1X-e35B_AR_0 2024-09-12T18:33:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5290574701015805890', time=2024-09-12T20:14:10.080555+0000, chain.objs.size()=1 2024-09-12T18:33:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.452+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JI5erGlrwq6YXVASDKkAVMIJa3yOQY9_0 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6048540702594779948', time=2024-09-12T20:14:10.081576+0000, chain.objs.size()=1 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.JkwSPdJ4H_C6uwscXTBOJY47LIePoKb_0 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17701885055528961586', time=2024-09-12T20:14:10.117765+0000, chain.objs.size()=1 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.owXzTE3NIZimuXEQvzqbIlVk47kJQX6_0 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11101027268272976744', time=2024-09-12T20:14:10.184735+0000, chain.objs.size()=1 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.E6P9v4MN9XmyeP6-YMYJrJIj88fLCAF_0 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14069059684090185993', time=2024-09-12T20:14:10.344802+0000, chain.objs.size()=1 2024-09-12T18:33:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.454+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.VUQaLs1HRSn3Ln4z3Gmj3DBVBOZEtNc_0 2024-09-12T18:33:05.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.455+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15794026044140273125', time=2024-09-12T20:14:10.378833+0000, chain.objs.size()=1 2024-09-12T18:33:05.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.455+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.G_2X0h3o3C7zz4koR8wsYCMwVOIgQL3_0 2024-09-12T18:33:05.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.459+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18154303913093726127', time=2024-09-12T20:14:10.957595+0000, chain.objs.size()=1 2024-09-12T18:33:05.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.459+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.O2ICKzcLOWcuBe6BqsJ8_e2LSwq_eE9_0 2024-09-12T18:33:05.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2394043222590582175', time=2024-09-12T20:14:12.452636+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LZcj7PVSOQRKz3k5D7GlWMSXsmytSWs_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.52917797773377939', time=2024-09-12T20:14:13.110867+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.z7_j0oo8PaH1L-DA_tNXQ7r_AqsL0HI_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7495942435802568638', time=2024-09-12T20:14:13.297462+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7g7369aFmvpOYX79HUdZI5ANHVTiq9Z_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9093401306490539819', time=2024-09-12T20:14:13.625674+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.p1MBQ6EP_7Y8kDQFPWEGMPkHnfP9SWS_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4577603869818466688', time=2024-09-12T20:14:14.190216+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.THUwGS9XrBVWsBZU6Upq-U-u_6csc0l_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17276917874499114244', time=2024-09-12T20:14:14.203552+0000, chain.objs.size()=1 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7YH13WfdQb804m4v3guAYwGesx8Yb58_0 2024-09-12T18:33:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2079729367541559308', time=2024-09-12T20:14:14.934492+0000, chain.objs.size()=1 2024-09-12T18:33:05.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.460+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.drS4X8VHW5NZEgaLQVLG9SV1xvg7vK2_0 2024-09-12T18:33:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14597444390189063130', time=2024-09-12T20:14:16.382981+0000, chain.objs.size()=1 2024-09-12T18:33:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.264__shadow_.mPOeJaTlRhVFp_JMcMbA2lPneGLSh5E_0 2024-09-12T18:33:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5137963027994094172', time=2024-09-12T20:14:18.676166+0000, chain.objs.size()=1 2024-09-12T18:33:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.268__shadow_.5MnVHqALL6w02RMp-4p1EeRW8kcz1LB_0 2024-09-12T18:33:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9513811633293882164', time=2024-09-12T20:14:31.471909+0000, chain.objs.size()=1 2024-09-12T18:33:05.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.289__shadow_.nl-HnM_X1efRGH7zPxaqYSVTwDXfBn4_0 2024-09-12T18:33:05.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10584484680690350040', time=2024-09-12T20:14:36.537858+0000, chain.objs.size()=1 2024-09-12T18:33:05.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.462+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.XraypqBZxtWfxNC5rDfZsPZiHFcp8iV_0 2024-09-12T18:33:05.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17048461806978943410', time=2024-09-12T20:14:44.017762+0000, chain.objs.size()=1 2024-09-12T18:33:05.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.305__shadow_.nHhWZC6M0P1NFmZIU37JCJWnDHUSxe5_0 2024-09-12T18:33:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12931255523418768098', time=2024-09-12T20:15:32.465037+0000, chain.objs.size()=1 2024-09-12T18:33:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JMwap1On9sX9Nfvo6_6i_wERK8WDbyP_0 2024-09-12T18:33:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18313212613646620904', time=2024-09-12T20:15:32.468001+0000, chain.objs.size()=1 2024-09-12T18:33:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.I3Eg__yj0aooANdsJq0KdGq-v9gpQAC_0 2024-09-12T18:33:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7073980735344390987', time=2024-09-12T20:15:32.602674+0000, chain.objs.size()=1 2024-09-12T18:33:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YhsZN1Bx3BoS6PjOYX10J9RVV6psA9h_0 2024-09-12T18:33:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9758091761915501281', time=2024-09-12T20:15:32.757694+0000, chain.objs.size()=1 2024-09-12T18:33:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.465+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Rbg50pwvcv2OxtXrdNbBE0N_vDJjSlV_0 2024-09-12T18:33:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14264351442547564165', time=2024-09-12T20:15:33.135571+0000, chain.objs.size()=1 2024-09-12T18:33:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1C0ysQqn4HlX52CFyIi1_ZfUTMglE1j_0 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2593704723559995455', time=2024-09-12T20:15:33.205589+0000, chain.objs.size()=1 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.sP39MqUXbAG6F-lRG7op7MHW_RkoNhq_0 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5067899816385470732', time=2024-09-12T20:15:33.224935+0000, chain.objs.size()=1 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.466+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.uf1mBAgTB-lhTHjsfYrXF3TM4yw2nXN_0 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.467+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3764580249474600171', time=2024-09-12T20:15:33.722047+0000, chain.objs.size()=1 2024-09-12T18:33:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.467+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1H5ckVCq3jLFVJWQZ7FMelj8FDRXf6j_0 2024-09-12T18:33:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2019677283350317258', time=2024-09-12T20:15:34.101874+0000, chain.objs.size()=1 2024-09-12T18:33:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9CfgO9it3jNFhAqCw1spcPFnkAaY3vM_0 2024-09-12T18:33:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4078338692186445936', time=2024-09-12T20:15:34.370890+0000, chain.objs.size()=1 2024-09-12T18:33:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2RQe2m2Hu7au_f6ugjTQKPwMcW1Cn4C_0 2024-09-12T18:33:05.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15346063694548346251', time=2024-09-12T20:15:34.551535+0000, chain.objs.size()=1 2024-09-12T18:33:05.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ygX9sLS4bRqA1gxOwT4y3FNsT1vqKn-_0 2024-09-12T18:33:05.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4095199603014160738', time=2024-09-12T20:15:34.631716+0000, chain.objs.size()=1 2024-09-12T18:33:05.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.469+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.p9ALo0zK0AogaOmH5KTaepjmuL_Go2O_0 2024-09-12T18:33:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10275937457068110127', time=2024-09-12T20:15:34.665845+0000, chain.objs.size()=1 2024-09-12T18:33:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Syzw6OWm1JBvQ7rQTiOQeR6I9M10Te9_0 2024-09-12T18:33:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7067025423761797155', time=2024-09-12T20:15:35.508001+0000, chain.objs.size()=1 2024-09-12T18:33:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7Nh42aSnwU9sGFIeMk3k9tKe7GXmsOn_0 2024-09-12T18:33:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14734389519120053662', time=2024-09-12T20:15:35.798955+0000, chain.objs.size()=1 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1v-HRWV8KIgpfDk0pjw8QvcweOPfEl__0 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11220864684886674643', time=2024-09-12T20:15:37.466737+0000, chain.objs.size()=1 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.471+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IrQ7whwDuX9eUeRLNsmau_Bmd-FxpDP_0 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.472+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14889225978988686039', time=2024-09-12T20:15:37.582074+0000, chain.objs.size()=1 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.472+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-mNbyfdGFRFFQSL1Q30GvoBO3WKUL3A_0 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.472+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3859553304541807884', time=2024-09-12T20:15:38.294820+0000, chain.objs.size()=1 2024-09-12T18:33:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.472+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.9P7CGYxvl7IkIvBbTxVHyh-LJQ3nqWK_0 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9143814298390395458', time=2024-09-12T20:15:38.497608+0000, chain.objs.size()=1 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.LIRt7uA2ZxKiW6uvHrrsCz1bq6Vj9ki_0 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9618008518489862872', time=2024-09-12T20:15:38.830477+0000, chain.objs.size()=1 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ItDjCk_l2_LMhytQnPvfo11bdedUMQw_0 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13548104820601535256', time=2024-09-12T20:15:39.418571+0000, chain.objs.size()=1 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.x91qcgipZRlsofJsyHbU4iqCQZKi9n-_0 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10986265544142779514', time=2024-09-12T20:15:39.687399+0000, chain.objs.size()=1 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.0uD_eWTd1XvgCqWmjiCYWCU1RGuFcjV_0 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3978902398879964048', time=2024-09-12T20:15:39.725063+0000, chain.objs.size()=1 2024-09-12T18:33:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.475+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.DxmyJzgnRLpkJ8ZHnDHwmSyRAEMqYah_0 2024-09-12T18:33:05.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16837847108798358570', time=2024-09-12T20:15:39.817851+0000, chain.objs.size()=1 2024-09-12T18:33:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BT9Uizvw4Figp2XEU9glRImn21MIWwK_0 2024-09-12T18:33:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10945222940687629114', time=2024-09-12T20:15:39.914061+0000, chain.objs.size()=1 2024-09-12T18:33:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.liaFGi2Ua-gk06_yFTEX_Yyn9GPnaj7_0 2024-09-12T18:33:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6187475795640656948', time=2024-09-12T20:15:39.970238+0000, chain.objs.size()=1 2024-09-12T18:33:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qc92mCsrn6TwLRGaxO_oywHeo_PG6t__0 2024-09-12T18:33:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2106705600361151413', time=2024-09-12T20:15:40.098282+0000, chain.objs.size()=1 2024-09-12T18:33:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.5JAa9KoYta7GwTFsvTcwSuERwg9AwxM_0 2024-09-12T18:33:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2594525176108114523', time=2024-09-12T20:15:40.126835+0000, chain.objs.size()=1 2024-09-12T18:33:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.477+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.m5kXH8BVpOLcs53wUe_w8HPl-MknDFI_0 2024-09-12T18:33:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5048062257327168217', time=2024-09-12T20:15:41.174711+0000, chain.objs.size()=1 2024-09-12T18:33:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bTdWpkoXk9ycnUWlRDvfuPQVoG2IoWS_0 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14958729944971823772', time=2024-09-12T20:15:41.453657+0000, chain.objs.size()=1 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.q2KwfmgdVR2JAS7Ra61LWdnhzGJ2KY4_0 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6811336050437772880', time=2024-09-12T20:15:41.661342+0000, chain.objs.size()=1 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.itZixsW4MSeion9SzTSS92dFTCKzByR_0 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13379155501007521234', time=2024-09-12T20:15:42.057804+0000, chain.objs.size()=1 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rUPscWlyLAOhWtDhipACslxud4p1p_T_0 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1924884573223668838', time=2024-09-12T20:15:42.098688+0000, chain.objs.size()=1 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ll0WUUJq9jq8Vtjk93mvkOgcokptWwQ_0 2024-09-12T18:33:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1284175732103937871', time=2024-09-12T20:15:42.130753+0000, chain.objs.size()=1 2024-09-12T18:33:05.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.480+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hkKPbbIN_rsIiQjA2OZE-uW5DsxkHQQ_0 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9199715740950820178', time=2024-09-12T20:15:42.615988+0000, chain.objs.size()=1 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.GxEiZ7RiQdEjm8soDE36g-YbkrPngAP_0 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6346401525872160821', time=2024-09-12T20:15:42.699543+0000, chain.objs.size()=1 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Cx25U3WDYhRbuLqE3b-o-yY1PKE3aSr_0 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5519838061201319808', time=2024-09-12T20:16:20.123848+0000, chain.objs.size()=1 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.yXpp4dyriM6vxIAGW0aR-tHpjfWSTii_0 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4816762693046997029', time=2024-09-12T20:16:20.124603+0000, chain.objs.size()=1 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.j4KT6DGZs_Tg0QT-pMmbD0-F9pWLhNX_0 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6374351802619771007', time=2024-09-12T20:16:20.524421+0000, chain.objs.size()=1 2024-09-12T18:33:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lEYQgyJBnQUIuCGYbA7ND3Z8yQ6qwPr_0 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.884068697077174670', time=2024-09-12T20:16:20.921302+0000, chain.objs.size()=1 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mmaJ_R4tTplIGWJMZrQcQLzPYGSIP4y_0 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1871820846351991384', time=2024-09-12T20:16:20.962089+0000, chain.objs.size()=1 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.M-eA_Pm55k31IrHHFrOh9Ik63eBgZD4_0 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3581625604092921638', time=2024-09-12T20:16:21.646515+0000, chain.objs.size()=1 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0UeUP-Xp06p-_WvM9riT1b90sQGo8Io_0 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10650012515224498935', time=2024-09-12T20:16:21.673676+0000, chain.objs.size()=1 2024-09-12T18:33:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mS5u6nJOqLBExRl40QyjsV9qHzY0-Dl_0 2024-09-12T18:33:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11970771671320169201', time=2024-09-12T20:16:22.282395+0000, chain.objs.size()=1 2024-09-12T18:33:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.74TboAm83juzs9cx1qDt16O_vvXng1u_0 2024-09-12T18:33:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16071982529685248189', time=2024-09-12T20:16:22.291662+0000, chain.objs.size()=1 2024-09-12T18:33:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.484+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._i6VGLeJcvr_J2WtQUtACcs68NzNrH4_0 2024-09-12T18:33:05.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.488+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16814874686561077214', time=2024-09-12T20:16:23.332092+0000, chain.objs.size()=1 2024-09-12T18:33:05.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.488+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sOr6vKeYYdMFNEYJuO4zwxcmy5s5_7Z_0 2024-09-12T18:33:05.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.489+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3178625748515770385', time=2024-09-12T20:16:23.567988+0000, chain.objs.size()=1 2024-09-12T18:33:05.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.489+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Pclh53c72sGyherZG7ldJdKvi0HmD9u_0 2024-09-12T18:33:05.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6707533023267407343', time=2024-09-12T20:16:23.635604+0000, chain.objs.size()=1 2024-09-12T18:33:05.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LqQ8Ntg78wmbYfeyfAzaL49gbslGqYj_0 2024-09-12T18:33:05.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18353876466741859794', time=2024-09-12T20:16:23.738955+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HVHU6Nu0WSDV51hTjbmb2tyjxcyUujY_0 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5346444571024570604', time=2024-09-12T20:16:23.794183+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.-eXtBkyzqb6o8Qa711YOJ6UzidAQOxD_0 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11240073468697307864', time=2024-09-12T20:16:23.982231+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._eOsUcVdxk-wxHMWw2xdB9huDBVdyWn_0 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11590337273759436280', time=2024-09-12T20:16:24.832853+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.491+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5sdEdk5YKYKrX2Gc6Bleonf5jNVHa8i_0 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3001342673305805502', time=2024-09-12T20:16:24.986141+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.moZ4LEEEjJo_GbItcKLzB_jFP4qX5nY_0 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5501812663957897626', time=2024-09-12T20:16:25.408283+0000, chain.objs.size()=1 2024-09-12T18:33:05.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.wpm5aezOSpm0d-JRC--BhKvNrSj4vM3_0 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17011015429257593012', time=2024-09-12T20:16:26.583860+0000, chain.objs.size()=1 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.RXQpQmNZztoR4hhWqm66hojIIxVa1D-_0 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13444448147734542122', time=2024-09-12T20:16:27.301493+0000, chain.objs.size()=1 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.SWSwly1dL-QFdgRBK-34OguugLJvGWm_0 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6038404534816005374', time=2024-09-12T20:16:27.939324+0000, chain.objs.size()=1 2024-09-12T18:33:05.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.492+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.E0L8yISA7e67F8Bxv5DUTr7B7ux9AXc_0 2024-09-12T18:33:05.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.498+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/46311 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1201620400836917252', time=2024-09-12T20:16:28.124106+0000, chain.objs.size()=1 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.R3Cj811kuIH5sd0DpYz4SVyMo9pqg8O_0 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12014539575257887288', time=2024-09-12T20:16:28.879144+0000, chain.objs.size()=1 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WPCI-NuZrJ1ApjMXRAppbIs8tcNbWLh_0 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8168909493266424818', time=2024-09-12T20:16:28.970042+0000, chain.objs.size()=1 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.sZgUDxweYVc7MNGsoXbImo3fI_SKkIb_0 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2507676499657691077', time=2024-09-12T20:16:29.312804+0000, chain.objs.size()=1 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.faZVy3zRQLJTy_cd1Q5Su8MHJM1cAMQ_0 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11150723845431676159', time=2024-09-12T20:16:29.776307+0000, chain.objs.size()=1 2024-09-12T18:33:05.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YyY9l2r860wzINdwikYOzOEshZjnEpN_0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9739723578502237174', time=2024-09-12T20:16:29.936513+0000, chain.objs.size()=1 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0gJyADzMg_BbLtlr3e4u1xeo8IcWyv5_0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7821589971455556952', time=2024-09-12T20:16:31.054573+0000, chain.objs.size()=1 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._wcMrv5hRZcV1ZhQE2MfI8n8w7irnW4_0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13080637613459003698', time=2024-09-12T20:16:32.513766+0000, chain.objs.size()=1 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.327__shadow_.vAMEkWr6jFlbpOSBhKfxIEvghKBpcpO_0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3313941966140552786', time=2024-09-12T20:16:41.365883+0000, chain.objs.size()=1 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.344__shadow_.Ox32AJqFyCOl6HE14Bk4h2bfs9IJsHy_0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4013116337444252644', time=2024-09-12T20:16:52.926325+0000, chain.objs.size()=1 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.370__shadow_.7sJIag6SlyGgE-dP-3HVAlTZSJGzHW__0 2024-09-12T18:33:05.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1648868169653057958', time=2024-09-12T20:16:53.417897+0000, chain.objs.size()=1 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.371__shadow_.Nbw7zMpLqnEFlFbqlK0qRtC631yqTzg_0 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1048220388988877434', time=2024-09-12T20:16:57.105254+0000, chain.objs.size()=1 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.500+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.376__shadow_.hflw_W6fw9ZO4QgTimRoPGmX5cMSGrz_0 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.503+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7341913749639380817', time=2024-09-12T20:17:02.070331+0000, chain.objs.size()=1 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.503+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.384__shadow_.rQ9Ofq-mAlTEzJ66oBmf9XrqQ8F8yc3_0 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12226062752030159666', time=2024-09-12T20:17:16.709903+0000, chain.objs.size()=1 2024-09-12T18:33:05.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.410__shadow_.tzhDGiYm4Jzd2NVqRgnlmlx1QKeZU0O_0 2024-09-12T18:33:05.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.348102197678518211', time=2024-09-12T20:17:31.181337+0000, chain.objs.size()=1 2024-09-12T18:33:05.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.439__shadow_.-ytBmABk2UFgXeF3pcbhpFAVkj6lu1F_0 2024-09-12T18:33:05.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.113298101638872409', time=2024-09-12T20:17:43.055596+0000, chain.objs.size()=1 2024-09-12T18:33:05.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.504+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.458__shadow_.x6PB7xOuF-r5xiKFKV8LIRbVFYMh8uG_0 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13238389326667772971', time=2024-09-12T20:17:49.739598+0000, chain.objs.size()=1 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.466__shadow_.Hs1dau40kZZbMkndW97X0kOIUH1ueMY_0 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17720953863112551008', time=2024-09-12T20:17:57.945715+0000, chain.objs.size()=1 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484__shadow_.DktfwAvqcZ702cXr6hVNMb0BR5gc_e6_0 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15995346489209729741', time=2024-09-12T20:18:09.037698+0000, chain.objs.size()=1 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.500__shadow_.H32a70XjJuNS6vYqQiEZu7J8cQ3R2Iz_0 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14792997574614104063', time=2024-09-12T20:18:11.621306+0000, chain.objs.size()=1 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.503__shadow:W2kk7dH3zAoKobtAmeNkMaca3cT4cjJ_.dT09hxOSM2Ezh2qv3mYJwG0n3oXr8-L_0 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6788692358979851758', time=2024-09-12T20:20:56.991253+0000, chain.objs.size()=1 2024-09-12T18:33:05.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.550__shadow_.MTg8hIRiEkwdZ9PjigzUn3MVwpOzBaG_0 2024-09-12T18:33:05.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10875814841272230560', time=2024-09-12T20:21:43.932883+0000, chain.objs.size()=1 2024-09-12T18:33:05.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.573__shadow_.KWFpOE-Ra7JbJGlbN3qqODK5JPLHO6j_0 2024-09-12T18:33:05.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5021237708907072861', time=2024-09-12T20:21:45.037889+0000, chain.objs.size()=1 2024-09-12T18:33:05.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.505+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow_.Foh-4Q74EvYoS1XfT3eoqX42SmwH78b_0 2024-09-12T18:33:05.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.507+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4567188952185875002', time=2024-09-12T20:22:16.687630+0000, chain.objs.size()=1 2024-09-12T18:33:05.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.507+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:kvASubkEAbCh2cohNlgZYrml8JrhRCV_.awxc7JlSjNaT4ya-wYnRNKG7pSuLIlO_0 2024-09-12T18:33:05.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.510+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1606885454924530524', time=2024-09-12T20:22:28.055230+0000, chain.objs.size()=4 2024-09-12T18:33:05.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.510+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~3FEzI3X1KwJQ7rruki7J9sSLrm1tSvP.1 2024-09-12T18:33:05.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.510+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~3FEzI3X1KwJQ7rruki7J9sSLrm1tSvP.2 2024-09-12T18:33:05.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.510+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~3FEzI3X1KwJQ7rruki7J9sSLrm1tSvP.3 2024-09-12T18:33:05.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.510+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.578__multipart_testobj.2~3FEzI3X1KwJQ7rruki7J9sSLrm1tSvP.4 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13398256018582816460', time=2024-09-12T20:22:31.780953+0000, chain.objs.size()=1 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:OOGPmFPjQh4r0SIn5kp-ZLPqHXqgSZ-_.wBr1aqVr2HBDKfM5rCF-VlWJbCeW_gc_0 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10332940752046030029', time=2024-09-12T20:27:15.428466+0000, chain.objs.size()=1 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.666__shadow_.daFMM8qRNK997pIkMBBph4U5cMURxe-_0 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10977791052084624492', time=2024-09-12T20:27:18.085324+0000, chain.objs.size()=1 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.671__shadow_.dEYwCKtnKSdEjqFZeUeHf-4O4jDrr6V_0 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1331240845959863887', time=2024-09-12T20:27:30.362083+0000, chain.objs.size()=1 2024-09-12T18:33:05.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.511+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.696__shadow:eu-mr71JROjX6E85lvFlBkX7Q.H5xJ7_.8Xzm_WLi6-f5OiNT88M9PEW2ddlOzD-_0 2024-09-12T18:33:05.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.516+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.524+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.525+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.526+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48250' 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_2qht1y34WwxFXV8dexQ22_OR1pm1NPo', time=2024-09-12T20:11:14.217405+0000, chain.objs.size()=3 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.PATCY6KqlK1oXe4PywGwAKiVG23lxkv_0 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.PATCY6KqlK1oXe4PywGwAKiVG23lxkv_1 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.163__shadow_.PATCY6KqlK1oXe4PywGwAKiVG23lxkv_2 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3353608305275322758', time=2024-09-12T20:11:31.644643+0000, chain.objs.size()=1 2024-09-12T18:33:05.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.179__shadow_.GrSJMqJEZ6PHJGE1rqGm5z6lq6-rHK9_0 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11487456065453572317', time=2024-09-12T20:13:08.663614+0000, chain.objs.size()=1 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.231__shadow_.G-0MaU4AwjpHF6Sh3goBvO4jzQIgOiA_0 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18201988391850353197', time=2024-09-12T20:13:20.706398+0000, chain.objs.size()=1 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.249__shadow_.FKO6LcSVY5BrFh2M8s-cp3SoVjRptV0_0 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5639935733394933583', time=2024-09-12T20:14:04.027102+0000, chain.objs.size()=1 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.r2vsk3Io7qGz-cIkcivoqaYlYmJq47G_0 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1679485371378405126', time=2024-09-12T20:14:04.132822+0000, chain.objs.size()=1 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.drcMiMhyQQlvA2v84ZWw1DU9b8sz_jd_0 2024-09-12T18:33:05.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6689826403138728934', time=2024-09-12T20:14:04.435009+0000, chain.objs.size()=1 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oEIO_CM3nQDb6QK6KVRZaIPEI_mOu4q_0 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8328849395619394724', time=2024-09-12T20:14:04.790335+0000, chain.objs.size()=1 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.h7UTlFDgPHPETuyvxpoVVjuB0SmldHw_0 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6744235463881762257', time=2024-09-12T20:14:05.784060+0000, chain.objs.size()=1 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-fHDXl8Nh4F4hl8-rNwXe6PKx1FWL1l_0 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10978449054813475922', time=2024-09-12T20:14:05.901329+0000, chain.objs.size()=1 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.527+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.GCZv4jR1tTqo3hSicoLOdtYMNBLUQOi_0 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.529+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17214331305978089434', time=2024-09-12T20:14:05.902126+0000, chain.objs.size()=1 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.529+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-a-3_Oxaxw4aQKliQt5ND6GnMmLLP4J_0 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15015837022204152611', time=2024-09-12T20:14:06.580338+0000, chain.objs.size()=1 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.7tQJ_zYka11XpJy579O_pShIRWuL8sI_0 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17152958640005695987', time=2024-09-12T20:14:07.329624+0000, chain.objs.size()=1 2024-09-12T18:33:05.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EILsmsxvOApzF4dnu44IM_jkAlvfRL0_0 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2271714879398806521', time=2024-09-12T20:14:07.512299+0000, chain.objs.size()=1 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.530+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lz-u1IV3gfUFgfz9eOw6Gih0ieuJpTQ_0 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4610117595766506647', time=2024-09-12T20:14:09.052552+0000, chain.objs.size()=1 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.cZaRrws3diU1l-lTfpfzROeOHUOBdiy_0 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9952497476718424406', time=2024-09-12T20:14:09.053421+0000, chain.objs.size()=1 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ieGn8XPaVaChdW5SHJ_YIoYakZ7wuLk_0 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17051109333585071637', time=2024-09-12T20:14:09.308522+0000, chain.objs.size()=1 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.6ax-yGirOLGrlwfu5MtXO11yqk11RYO_0 2024-09-12T18:33:05.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1164337866662645295', time=2024-09-12T20:14:10.603926+0000, chain.objs.size()=1 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-HERrEjs0gUueilDop6JR07pNpJ0Bxa_0 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12674969192213786177', time=2024-09-12T20:14:10.636804+0000, chain.objs.size()=1 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.p3HiUl7nW3u9dfu4yPmjCxlK-sZNCKK_0 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16831959650406088024', time=2024-09-12T20:14:11.129083+0000, chain.objs.size()=1 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.RNiKksVbrnPsyTXac8D-rlCssgQ0tkW_0 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.461889121960537904', time=2024-09-12T20:14:11.710235+0000, chain.objs.size()=1 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.531+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4gABFWqVTlgbCWYWmbOm4rk8HDH4OQS_0 2024-09-12T18:33:05.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.533+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14010071999908538805', time=2024-09-12T20:14:12.393820+0000, chain.objs.size()=1 2024-09-12T18:33:05.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.533+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.oJrBmY8DSoUV2J92-1RQ58W1dJ9OEOs_0 2024-09-12T18:33:05.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.535+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9029358311752191385', time=2024-09-12T20:14:12.895171+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.535+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mbKLFzV0G2SeEZ11wkfwEGb3XffHE0p_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4964803379141688944', time=2024-09-12T20:14:13.364362+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.q0BaVY2O0-Yh5G0HMDiQCVlytaZAz75_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3226759842999757512', time=2024-09-12T20:14:13.557956+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fhzE4U3uwFteyJm1RRw2qEWpbm9HJeM_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11200007441073209632', time=2024-09-12T20:14:13.594410+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WEdBmVa1P4WCBDtyIpt1r9RdBCIari5_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10761389211700446901', time=2024-09-12T20:14:15.063974+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iFRwc4QsYXR5_9OzT1O7MOUmaukne0K_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17347651363949178462', time=2024-09-12T20:14:15.184091+0000, chain.objs.size()=1 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.llq1_4zQ-KNtHYn7U0uTYDvtKFcw2AY_0 2024-09-12T18:33:05.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8934604980341349626', time=2024-09-12T20:14:22.128636+0000, chain.objs.size()=1 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.274__shadow_.qbwMgsDLg4hd5m1ywqTmmXufGqe1gEK_0 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11758877754364675003', time=2024-09-12T20:14:44.877796+0000, chain.objs.size()=1 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.306__shadow_._bbnhM3CYFI-qY8otoU9hzE6-nrzqs5_0 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9443521349282342604', time=2024-09-12T20:14:54.185070+0000, chain.objs.size()=1 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.321__shadow_.S3r6XCMSJql2t0IvmS5Au5mdkVckmbF_0 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6875494024497875387', time=2024-09-12T20:15:32.188872+0000, chain.objs.size()=1 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.536+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.80IaKO-0SmYzdN9kNt3o2nrOhCSyMRa_0 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.537+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3335168897862017647', time=2024-09-12T20:15:32.459289+0000, chain.objs.size()=1 2024-09-12T18:33:05.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.537+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2YRUG1sySaeZvrmz8N9hrzvIfuO59kV_0 2024-09-12T18:33:05.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.538+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8913187026307073156', time=2024-09-12T20:15:33.083175+0000, chain.objs.size()=1 2024-09-12T18:33:05.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.538+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dGFqStgt-W7Dyv8qE7CgkGEyEcQFdw7_0 2024-09-12T18:33:05.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.540+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4751247045577918909', time=2024-09-12T20:15:33.743486+0000, chain.objs.size()=1 2024-09-12T18:33:05.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.540+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.JDtbWBg_qz5gsFljDvSp7Hnwrhr7gP9_0 2024-09-12T18:33:05.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.542+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9298855067157158962', time=2024-09-12T20:15:33.855660+0000, chain.objs.size()=1 2024-09-12T18:33:05.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.542+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yZiyRdiibUhL2jZOShqW75hEPmzE38Q_0 2024-09-12T18:33:05.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.542+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10688854377395284111', time=2024-09-12T20:15:34.047033+0000, chain.objs.size()=1 2024-09-12T18:33:05.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.542+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MnXw6scfD7Dpm-P8my-O7xpG8_Jmdzu_0 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12467210684668362568', time=2024-09-12T20:15:34.297160+0000, chain.objs.size()=1 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jiHglzfDo73st9RPXjmGyjaiEkv72cH_0 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4824614880276347646', time=2024-09-12T20:15:34.433040+0000, chain.objs.size()=1 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.G6hcVD1jebyjVtGwAVGlrfgpfyqZqjw_0 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7887945489171850166', time=2024-09-12T20:15:35.218248+0000, chain.objs.size()=1 2024-09-12T18:33:05.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jBXUuV1Qkp5XxRsyquipHkoPpWAuX2Z_0 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1429281704209387804', time=2024-09-12T20:15:35.476544+0000, chain.objs.size()=1 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.c3qnc44F85M4_NFYE_Kyh3AlT_GMPjC_0 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16416340650518744642', time=2024-09-12T20:15:35.926722+0000, chain.objs.size()=1 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.V6IOcse_QCc71n28uBI_cKZXbMUosph_0 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10758339709516991163', time=2024-09-12T20:15:36.619444+0000, chain.objs.size()=1 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ffWCwgx83kKspOL6K0KMT2ey97W1tM-_0 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11869315690345030872', time=2024-09-12T20:15:36.681877+0000, chain.objs.size()=1 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Y7gWVOb5cS0-1NZWYk8k8dB3JrCXE75_0 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17438578876057755471', time=2024-09-12T20:15:36.847589+0000, chain.objs.size()=1 2024-09-12T18:33:05.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.543+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mnETPNRzAorA8CDqjm7G29Wl_TYHVg2_0 2024-09-12T18:33:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.544+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1408646445370265756', time=2024-09-12T20:15:36.983650+0000, chain.objs.size()=1 2024-09-12T18:33:05.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.544+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_._6eHr5XbHBJDFA7jHFwgzGKxJBcz1og_0 2024-09-12T18:33:05.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1872411602251640766', time=2024-09-12T20:15:37.308718+0000, chain.objs.size()=1 2024-09-12T18:33:05.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.BHjmZ1k7eKrGrgUwjqyy1xqAmo-7hD1_0 2024-09-12T18:33:05.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16404960661215010703', time=2024-09-12T20:15:37.578007+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WGyHS8kDZUqDrSGL2JwoXJKynBE0mEw_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5635476450851510640', time=2024-09-12T20:15:37.617845+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.549+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hw3Yv4AmUm9jst6r8QCGPohN-o73BTs_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17864854621456219222', time=2024-09-12T20:15:37.618729+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.n-yrsXjk3bCnD8e3-iMeiwNY1DT4ZU6_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1953313916519868329', time=2024-09-12T20:15:38.553913+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.elJHSqeYZKQfAfF8qyCqcyYDJvznQnK_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8031210630331389022', time=2024-09-12T20:15:38.566434+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mmLw5TFNzQXg6CqfPg7_z2_0vc2haig_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.617378256609381012', time=2024-09-12T20:15:39.556614+0000, chain.objs.size()=1 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yOBxFtrR0fZC5dCwPoSUHR7QnfVsk0q_0 2024-09-12T18:33:05.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.82447906851860200', time=2024-09-12T20:15:39.664712+0000, chain.objs.size()=1 2024-09-12T18:33:05.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.550+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4rL_7aTAl0aUb4hb_-kzRbnj5eRWLeZ_0 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9144785337965279792', time=2024-09-12T20:15:39.943792+0000, chain.objs.size()=1 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Kx7tmf4DzvqTri61bCQdQnM96qEltH5_0 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15270509246971049383', time=2024-09-12T20:15:40.215270+0000, chain.objs.size()=1 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.d-7aQswDGTOeyhj6IOOhJ17T88h3X7K_0 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2355697271961939636', time=2024-09-12T20:15:40.421215+0000, chain.objs.size()=1 2024-09-12T18:33:05.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.551+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tqgunZEvk7717nkN1qPaKkTIqmezGcr_0 2024-09-12T18:33:05.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.554+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8575914480138665415', time=2024-09-12T20:15:40.801158+0000, chain.objs.size()=1 2024-09-12T18:33:05.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.554+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.A7wQtZN7w_kQGIJJSCD1VKMereITxqo_0 2024-09-12T18:33:05.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.554+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6404001503850980385', time=2024-09-12T20:15:41.106879+0000, chain.objs.size()=1 2024-09-12T18:33:05.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.554+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vXaSIjtNJ24qTDFlHlYiB8O9tbwMTXB_0 2024-09-12T18:33:05.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9011543187015641504', time=2024-09-12T20:15:41.584943+0000, chain.objs.size()=1 2024-09-12T18:33:05.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ipeRWdC5zS1jJRFHDgNI8txqNSRkcBL_0 2024-09-12T18:33:05.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.556+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15814637744899425763', time=2024-09-12T20:15:41.699867+0000, chain.objs.size()=1 2024-09-12T18:33:05.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.556+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Fdsr6fWpYYzL9-y0i6-YaWN6fMV0hvX_0 2024-09-12T18:33:05.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10877954436776197515', time=2024-09-12T20:15:42.445053+0000, chain.objs.size()=1 2024-09-12T18:33:05.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.QY-QvaqZO0Jf6iu_M-CB76QGo5XN9X-_0 2024-09-12T18:33:05.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11006531490886480987', time=2024-09-12T20:15:42.507176+0000, chain.objs.size()=1 2024-09-12T18:33:05.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Z6vEKAoA1_Z7x8Z6yfZWEvrFMd7ZKNL_0 2024-09-12T18:33:05.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15485176396619205422', time=2024-09-12T20:15:42.798995+0000, chain.objs.size()=1 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.at316DfNf-3ha9LYXkvpM9lBDj0beqb_0 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5132345523293785250', time=2024-09-12T20:16:20.604788+0000, chain.objs.size()=1 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.dkeqbP9syvzK29DvvJlotm7EUq2e7nq_0 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16224930303707858031', time=2024-09-12T20:16:20.869962+0000, chain.objs.size()=1 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._tvUt3vzNKxgUG9TSmdsikfQEATrPpA_0 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3160818810050930534', time=2024-09-12T20:16:21.119265+0000, chain.objs.size()=1 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.t8jVf5DvTKG7qahz6fnOdfEZ7zA5oJB_0 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2456711917971447870', time=2024-09-12T20:16:21.120582+0000, chain.objs.size()=1 2024-09-12T18:33:05.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.EqrSd3dispDBM_yAenMpR9zmcbJfech_0 2024-09-12T18:33:05.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2600401617823077985', time=2024-09-12T20:16:21.628127+0000, chain.objs.size()=1 2024-09-12T18:33:05.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.g2waH464lR7ZfNNgvaQ2cVTocEuNXv4_0 2024-09-12T18:33:05.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5276098245841209556', time=2024-09-12T20:16:21.947794+0000, chain.objs.size()=1 2024-09-12T18:33:05.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.557+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NqaYJ2-MzdrGehulxt0EDPaswmaYGL6_0 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1837377196106746737', time=2024-09-12T20:16:21.987669+0000, chain.objs.size()=1 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.maJ_9W4saKnqNWpzv1D0grrayPN0WS9_0 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2816441396073364329', time=2024-09-12T20:16:22.133474+0000, chain.objs.size()=1 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Yrv4cPchmvTZwpQ5TpBULmMl6pbP5V3_0 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6811278177448064983', time=2024-09-12T20:16:24.576894+0000, chain.objs.size()=1 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uGWlvd6PcjB0g2UExQ8uJAWdqDLVZk__0 2024-09-12T18:33:05.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18404535063973540943', time=2024-09-12T20:16:24.647437+0000, chain.objs.size()=1 2024-09-12T18:33:05.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.561+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.A_BZLfTEFkhri-8Q49KJtfxAPJmYnWX_0 2024-09-12T18:33:05.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.562+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15568744008059826593', time=2024-09-12T20:16:24.983618+0000, chain.objs.size()=1 2024-09-12T18:33:05.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.562+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.euzunY_zd7TO9KFW6AjhyOIK2AzyDK2_0 2024-09-12T18:33:05.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17125728722957574186', time=2024-09-12T20:16:25.087321+0000, chain.objs.size()=1 2024-09-12T18:33:05.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WO2uhhak6BEHac5fdomYsO_lF4HFIW8_0 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7724208707232703332', time=2024-09-12T20:16:25.323553+0000, chain.objs.size()=1 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_._-gDGfse0FCFtVwLQPnO8WI2WpVwBm9_0 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10133489199310920647', time=2024-09-12T20:16:25.375502+0000, chain.objs.size()=1 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.P7KBduPbD9z8Ot2XuSs3eA_R2LGEK92_0 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3446610740911707821', time=2024-09-12T20:16:26.399554+0000, chain.objs.size()=1 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.NIJ64pSvQr19mIq3nlCQiO1vCE4865G_0 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6816344429519557458', time=2024-09-12T20:16:26.591442+0000, chain.objs.size()=1 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.w17mQ8wNgz-z30_E_UL0qHCtd3vHe91_0 2024-09-12T18:33:05.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18294209757949443565', time=2024-09-12T20:16:26.696070+0000, chain.objs.size()=1 2024-09-12T18:33:05.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.563+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kCfcNaxvSPEy17mJ5DKJ39QsxuIi29i_0 2024-09-12T18:33:05.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.565+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4537387802780218705', time=2024-09-12T20:16:26.919073+0000, chain.objs.size()=1 2024-09-12T18:33:05.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.565+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DnClyRMeXpj0XN9-MB59lbQDQW-_CZn_0 2024-09-12T18:33:05.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.565+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2029134115130757106', time=2024-09-12T20:16:27.449332+0000, chain.objs.size()=1 2024-09-12T18:33:05.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.565+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.tb75Y8zDGFzaoYKggTjgU716hPmgqgV_0 2024-09-12T18:33:05.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.566+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1605870376557839713', time=2024-09-12T20:16:27.490487+0000, chain.objs.size()=1 2024-09-12T18:33:05.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.566+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ZDj9HHgqB5BH761WpwhMoDvFntvxdTN_0 2024-09-12T18:33:05.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.566+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17768457640443560393', time=2024-09-12T20:16:27.603711+0000, chain.objs.size()=1 2024-09-12T18:33:05.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.566+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.cwiYkAJJY1ExlckMFcuZILdbi7gDkzm_0 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11400284370574976811', time=2024-09-12T20:16:28.942972+0000, chain.objs.size()=1 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QQuW9t1KHhoOfzSEBm9NzfGFDVmuSLC_0 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8726239039407775443', time=2024-09-12T20:16:29.649817+0000, chain.objs.size()=1 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rY2lqakf2JdnenHzpAQzdu23eM3f3wf_0 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8634013260195254160', time=2024-09-12T20:16:29.831195+0000, chain.objs.size()=1 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.IJRcBil7cyjJ92wkqB6bTCKI3UjzAjc_0 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8644532909277438203', time=2024-09-12T20:16:29.909389+0000, chain.objs.size()=1 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.rgozx-GE8xCfbAel_oCEDHHQPGB2w3g_0 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13792444424248200208', time=2024-09-12T20:16:30.218316+0000, chain.objs.size()=1 2024-09-12T18:33:05.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.568+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ue8hvEIh5y2xCX_77pY_iIO9_phoey4_0 2024-09-12T18:33:05.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.569+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12515065528930943840', time=2024-09-12T20:16:30.530199+0000, chain.objs.size()=1 2024-09-12T18:33:05.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.569+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DTTUGF2yQn1V8oT-yR6JZ3c3gTLrkeE_0 2024-09-12T18:33:05.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.569+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7164846908397528957', time=2024-09-12T20:16:30.533466+0000, chain.objs.size()=1 2024-09-12T18:33:05.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.569+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YQwXBLX-SU4F2DwyBk_BGBG1-uKbRAd_0 2024-09-12T18:33:05.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.570+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16444439454840202473', time=2024-09-12T20:16:31.038100+0000, chain.objs.size()=1 2024-09-12T18:33:05.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.570+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.40Gk_nmR1QZu79anKGK2B6WTjU5A4GD_0 2024-09-12T18:33:05.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.571+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11865979853336158026', time=2024-09-12T20:16:39.902925+0000, chain.objs.size()=1 2024-09-12T18:33:05.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.571+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.341__shadow_.nsGinqh3uFhkpMaa8VwZS7CtZ0V97z8_0 2024-09-12T18:33:05.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.571+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14565822957121813254', time=2024-09-12T20:16:52.398426+0000, chain.objs.size()=1 2024-09-12T18:33:05.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.571+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.369__shadow_.cUBgMkELeF6d4SBg4xP9sdLooWJRWMT_0 2024-09-12T18:33:05.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.572+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13733114600294364254', time=2024-09-12T20:17:04.979585+0000, chain.objs.size()=1 2024-09-12T18:33:05.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.572+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.390__shadow_.PZR5TptpItd1Of0shULKGRigBgNHek1_0 2024-09-12T18:33:05.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.574+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16453895189247910838', time=2024-09-12T20:17:33.025591+0000, chain.objs.size()=1 2024-09-12T18:33:05.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.574+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.442__shadow_.vbjJMRPtcvqU9rEYG2wnqwl6mx4ipZ2_0 2024-09-12T18:33:05.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6687203443937783027', time=2024-09-12T20:17:45.544984+0000, chain.objs.size()=1 2024-09-12T18:33:05.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.461__shadow_.y2l4zjFg4Jfn4gvhfZ-7qOgry0mIvRN_0 2024-09-12T18:33:05.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9114045378671520979', time=2024-09-12T20:17:47.680789+0000, chain.objs.size()=1 2024-09-12T18:33:05.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.464__shadow_.mid50VBuK_VOgwvhqNtdQ4qVD8GjEKh_0 2024-09-12T18:33:05.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9868609636452736428', time=2024-09-12T20:18:02.994921+0000, chain.objs.size()=1 2024-09-12T18:33:05.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.575+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.489__shadow_.pYJSMwM3qBjFq40rK-xodxFCW-aNFjI_0 2024-09-12T18:33:05.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.581+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/48250 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12064511487744666739', time=2024-09-12T20:20:04.775024+0000, chain.objs.size()=3 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~P2kVH9n89SrbtvkCrn7oV9wtdnNkkKa.1 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~P2kVH9n89SrbtvkCrn7oV9wtdnNkkKa.2 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.525__multipart_mymultipart.2~P2kVH9n89SrbtvkCrn7oV9wtdnNkkKa.3 2024-09-12T18:33:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8', time=2024-09-12T20:20:06.738810+0000, chain.objs.size()=10 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.1 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.2 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.3 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.4 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.5 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.6 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.7 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.8 2024-09-12T18:33:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.584+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.9 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.526__multipart_mymultipart.2~6lBW2CXS4OYzOtHNmMTKpqnoxOE5lA8.10 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9055445520186716485', time=2024-09-12T20:21:31.726210+0000, chain.objs.size()=1 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:vF-2sIy3UOFurWEYL4r9zvRFLKTgkif_.EBJEQlimYIiostI-PBf5hdFJMzf8Qsg_0 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.468759886450297126', time=2024-09-12T20:21:41.483693+0000, chain.objs.size()=1 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.570__shadow:qcKlX4ZukrWM52AbvUMsT.h1QDCrDun_._5IREkTW9J1_fV2Tyw_GnEmhCyJYmRo_0 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.743625154615516927', time=2024-09-12T20:21:55.042573+0000, chain.objs.size()=1 2024-09-12T18:33:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.587+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.576__shadow:kmPmt6Q-vKDU7cM6LDv2g11FvLi6SJd_.O8uRBUI3moRt4XpenpuhupI-6Eio2KX_0 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8563491409062350351', time=2024-09-12T20:21:58.461583+0000, chain.objs.size()=1 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:AKAXJJI1MOOKa3mGJknxZKkwwLcURWV_.tmGLZI7jV42_5EVXn1sUj60Ku9f92Zd_0 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1019535581186255904', time=2024-09-12T20:22:31.735874+0000, chain.objs.size()=1 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:0V84vcrzvvcbks30IYjUKZeb6TEqb3T_.QFW5UD4tyVyWPXhIybcFqtM5pTkzDie_0 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15104477057632568179', time=2024-09-12T20:22:31.768266+0000, chain.objs.size()=1 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:ZSggQwhkMWWxu1417gy3z879KV1r3mJ_.bZvQjTIU51gk_QnuYX-So4FSHAaqb6v_0 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1731479630139418638', time=2024-09-12T20:26:40.876285+0000, chain.objs.size()=2 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.644__shadow_.teTMUyooexDTEQmhKns3H8VB14Z0Lt9_0 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.644__shadow_.teTMUyooexDTEQmhKns3H8VB14Z0Lt9_1 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14919213355338659202', time=2024-09-12T20:27:13.581277+0000, chain.objs.size()=1 2024-09-12T18:33:05.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.664__shadow_.52wQJlU6GKRcVWNVKaiaLc0QnzoRw6w_0 2024-09-12T18:33:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9865885525685436509', time=2024-09-12T20:27:14.438609+0000, chain.objs.size()=1 2024-09-12T18:33:05.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.588+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.665__shadow_.uRIFwWuXUMpoajB-S1P9d5RZMWvXm0E_0 2024-09-12T18:33:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.592+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7273661958957964619', time=2024-09-12T20:28:02.090244+0000, chain.objs.size()=1 2024-09-12T18:33:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.592+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.717__shadow:x3WDNrG6sLdZa8FSLw9W0hPniK21paC_.s8YW2HOG9uMjdXCQUhrm_cgcTrMG0Bt_0 2024-09-12T18:33:05.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.595+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.597+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:33:05.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.599+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.599+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52381' 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8961831772776312312', time=2024-09-12T20:10:57.453716+0000, chain.objs.size()=3 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.rK6gZOxvBOS1tukbaXTZiC_uZYNfvFH_0 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.rK6gZOxvBOS1tukbaXTZiC_uZYNfvFH_1 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.rK6gZOxvBOS1tukbaXTZiC_uZYNfvFH_2 2024-09-12T18:33:05.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2471877317061405652', time=2024-09-12T20:10:57.479448+0000, chain.objs.size()=3 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.l8TP58VdaPAILFKBjT4fZUkGbC52ktk_0 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.l8TP58VdaPAILFKBjT4fZUkGbC52ktk_1 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.158__shadow_.l8TP58VdaPAILFKBjT4fZUkGbC52ktk_2 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_G8R-HpvXYbpj3xMmd9f1sqOZ6jgoxWr', time=2024-09-12T20:11:03.909487+0000, chain.objs.size()=3 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.TEX6CngnQNZmv9BW6g_PAySJVlNIJZl_0 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.TEX6CngnQNZmv9BW6g_PAySJVlNIJZl_1 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.TEX6CngnQNZmv9BW6g_PAySJVlNIJZl_2 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_MoJNuxFTNUG2bAfnodIt3xj5KFvmsYU', time=2024-09-12T20:11:11.943509+0000, chain.objs.size()=3 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.rHzqAI1wCTaX8FBV-MIe8uzkdmffYsx_0 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.rHzqAI1wCTaX8FBV-MIe8uzkdmffYsx_1 2024-09-12T18:33:05.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.600+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.161__shadow_.rHzqAI1wCTaX8FBV-MIe8uzkdmffYsx_2 2024-09-12T18:33:05.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7107598849907961121', time=2024-09-12T20:11:30.148735+0000, chain.objs.size()=1 2024-09-12T18:33:05.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.176__shadow_.YWYKR1R6vC8_JlI-E7CSj6EIWPVlyub_0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12217467707886558230', time=2024-09-12T20:11:33.470717+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.183__shadow_.hjMrIrQwpjE3w9RSbnSvZaZEBFy_tr__0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4843161166639681308', time=2024-09-12T20:13:08.023745+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.230__shadow_.F0rhmGfp_ROFSdVwVVDMVChFWKUpUvX_0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7549535014725820490', time=2024-09-12T20:13:15.841624+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.242__shadow_.49k5z9qg8l5pvXba_NLoheXRt_y4W8y_0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13377994815667615664', time=2024-09-12T20:13:18.229413+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.603+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.245__shadow_.xJIaiMq_nLMqc8KzMLAX2eO7NSFALgs_0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11041435943188962174', time=2024-09-12T20:14:05.029431+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.zgq_JZ2j8gpYmJjGYAjoHUoDWUWQkuw_0 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8620725029906372668', time=2024-09-12T20:14:06.080196+0000, chain.objs.size()=1 2024-09-12T18:33:05.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.n-giVIejYdOtKiNyTYtSXgS6MhWeXs__0 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2737451205471103343', time=2024-09-12T20:14:06.292455+0000, chain.objs.size()=1 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4runpFUjAiX6gxWigu6b8a55MAj87mZ_0 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4431393186972401824', time=2024-09-12T20:14:06.293073+0000, chain.objs.size()=1 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.vGpPGt8wHHnRxMRUExXj--IMe6oZbbs_0 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10408605390019087586', time=2024-09-12T20:14:06.444961+0000, chain.objs.size()=1 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.evhBuqM5USYbsrtjAhhoFzjFj3Ph15O_0 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11628840125066192711', time=2024-09-12T20:14:06.684410+0000, chain.objs.size()=1 2024-09-12T18:33:05.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.604+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.j_-XvwRk-AkKgENJM-ylSFz4OsP7QIh_0 2024-09-12T18:33:05.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.606+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1872397164606095247', time=2024-09-12T20:14:07.254338+0000, chain.objs.size()=1 2024-09-12T18:33:05.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.606+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Rj0GnMh9q0xQ-c3POooobwMF9XJ4k5T_0 2024-09-12T18:33:05.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3975624746248364784', time=2024-09-12T20:14:07.579496+0000, chain.objs.size()=1 2024-09-12T18:33:05.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rmcivRVJR8r0LsMktNluUYd_3kYIh7-_0 2024-09-12T18:33:05.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9080718821654486455', time=2024-09-12T20:14:07.666749+0000, chain.objs.size()=1 2024-09-12T18:33:05.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BpmUzxbPNrs86nYDIfDcRAp272_Uq8S_0 2024-09-12T18:33:05.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8258963430108176898', time=2024-09-12T20:14:08.092020+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YE4Hwbj5BiTTNBbZBq0JsZ6H6rar3Iz_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17376902529898802841', time=2024-09-12T20:14:09.049292+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.0oL1tjCQKMkk9JGWHQrtEoChXTZIs-k_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11605439562106081298', time=2024-09-12T20:14:09.363829+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ID9sCFoXxZuy_c6VMIZpV1D-Fm24-5F_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14069913536712850570', time=2024-09-12T20:14:10.402341+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.EjGzbO0XDvpwGnmZoca80TbvGrjfyjB_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6118692498597106444', time=2024-09-12T20:14:10.452684+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hDqpjm8k3-L5VmSOGX84YNJjxZIGbBT_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12577616882739540356', time=2024-09-12T20:14:10.500506+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.YjgklBs52YNaZH1lyv6NwlF-p_gxDTF_0 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2827200616011100952', time=2024-09-12T20:14:10.594576+0000, chain.objs.size()=1 2024-09-12T18:33:05.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.e3YTxpBT0fed7pHZYidXooUGKakZ2tW_0 2024-09-12T18:33:05.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14429413932351443707', time=2024-09-12T20:14:10.728298+0000, chain.objs.size()=1 2024-09-12T18:33:05.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.608+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.r-N71NkG_3HpR_0m8mWrrbQ8HbvohWj_0 2024-09-12T18:33:05.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.609+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16037978837857826458', time=2024-09-12T20:14:10.874803+0000, chain.objs.size()=1 2024-09-12T18:33:05.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.609+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.1HXM2k3wQOGPKa-VyBdO0W4dLxqbQbA_0 2024-09-12T18:33:05.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.614+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11687204931036414543', time=2024-09-12T20:14:11.101817+0000, chain.objs.size()=1 2024-09-12T18:33:05.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.614+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aRfNE4yNQcCFVjEXMus25ziB33AwqoX_0 2024-09-12T18:33:05.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5694675425455228045', time=2024-09-12T20:14:11.515485+0000, chain.objs.size()=1 2024-09-12T18:33:05.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.-Vb1MKlxklWBjxz8niNmNJ-jm4VzJwL_0 2024-09-12T18:33:05.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5305098233695332890', time=2024-09-12T20:14:11.633014+0000, chain.objs.size()=1 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.4o50Q7engBB23V1opZjA3kXMj_VjplS_0 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13920561200291391285', time=2024-09-12T20:14:11.901170+0000, chain.objs.size()=1 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5fnWh2n7Z2OycqnenSdBK5cw4GTp4E2_0 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13079344521831151154', time=2024-09-12T20:14:12.227601+0000, chain.objs.size()=1 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KmT0U67ON3pxkMqpZM09woOr15MM1Q6_0 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3317249958658552034', time=2024-09-12T20:14:12.303854+0000, chain.objs.size()=1 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mWiVHGmjR0kfExpC0TBaLBRzTPH_I79_0 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12473081441949626939', time=2024-09-12T20:14:12.457412+0000, chain.objs.size()=1 2024-09-12T18:33:05.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.24QrBa_FxuqvLK8G3S3FiN5Hb6NFl5h_0 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13600804080138797297', time=2024-09-12T20:14:12.900868+0000, chain.objs.size()=1 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.U96kJV3syEvEjvIhF_C9B99duCYrNbW_0 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1291206122449869036', time=2024-09-12T20:14:13.071395+0000, chain.objs.size()=1 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.WLXi0MV2aw-ZeMSy11JDToaPDeO_DeP_0 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9465735375292095233', time=2024-09-12T20:14:13.158513+0000, chain.objs.size()=1 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Ekvl_szZtvmf_MQ1b0x489ZSiuOiQDB_0 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10411893290522848566', time=2024-09-12T20:14:13.499485+0000, chain.objs.size()=1 2024-09-12T18:33:05.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.615+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2qgVV6R-XJ-dCsqUAUek_IiOACeWVlX_0 2024-09-12T18:33:05.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.618+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1479242819063906377', time=2024-09-12T20:14:13.535221+0000, chain.objs.size()=1 2024-09-12T18:33:05.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.618+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8Dubv8mYei9MX4c1MLifC3x-3x7Q3zD_0 2024-09-12T18:33:05.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.618+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10626861942792121252', time=2024-09-12T20:14:13.678464+0000, chain.objs.size()=1 2024-09-12T18:33:05.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.618+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Yuxlns77mSo-KvqemoXHzyM7i3XlJFX_0 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8171963719950877156', time=2024-09-12T20:14:13.679243+0000, chain.objs.size()=1 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.KdLoDipvTq9Gm88pSdqPXeKxrDaGYpR_0 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14550924777955723621', time=2024-09-12T20:14:13.803170+0000, chain.objs.size()=1 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.V_C2F63YuQ2AtNOofRQa60pAcuia2fm_0 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11892221263040710791', time=2024-09-12T20:14:14.503833+0000, chain.objs.size()=1 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wqCot1JwOT1wftYObSYxQULMWil69R2_0 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18052264731125532070', time=2024-09-12T20:14:14.901795+0000, chain.objs.size()=1 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.PfB75aiJNaomwvTFlx7rqAtABvC4vZ5_0 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9354136887116845074', time=2024-09-12T20:14:15.065523+0000, chain.objs.size()=1 2024-09-12T18:33:05.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.620+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.R6yapp2gRfxh96BQQfn8H3p-e1ceaFK_0 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1344220050933525067', time=2024-09-12T20:14:36.404300+0000, chain.objs.size()=1 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.usZ4Nl8rf3bx1zzRkLK-Z18-PBpc5xf_0 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15567857416792756031', time=2024-09-12T20:15:32.547117+0000, chain.objs.size()=1 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.VotVEJoep2OaXfnhxLcdf1WphOpBH5T_0 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13827893933640690937', time=2024-09-12T20:15:33.735344+0000, chain.objs.size()=1 2024-09-12T18:33:05.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.622+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ffI2sSq_IpPq0ECasdSWqxlX21MZyGs_0 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16362121175410703065', time=2024-09-12T20:15:33.864198+0000, chain.objs.size()=1 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1wt3HhT8jg3feprHjO2LGzRa8pv5sDP_0 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17460002216023168065', time=2024-09-12T20:15:34.164610+0000, chain.objs.size()=1 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.g_D_US8H30Vl7fDhbPNw_D70V6y80uO_0 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6511133691451327197', time=2024-09-12T20:15:34.409653+0000, chain.objs.size()=1 2024-09-12T18:33:05.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.623+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZBv6q2gXV2hn__VbwwkTno7UccGmpx0_0 2024-09-12T18:33:05.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9107580292049870240', time=2024-09-12T20:15:35.248045+0000, chain.objs.size()=1 2024-09-12T18:33:05.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.MteNYOE8zBQsKuP_iIbf-JZAMW-2r3O_0 2024-09-12T18:33:05.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.624+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3930776134182628559', time=2024-09-12T20:15:36.245080+0000, chain.objs.size()=1 2024-09-12T18:33:05.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.624+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Anj8w6HwGlD5Wvup9nS5xa669YJnifB_0 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.628373598516959503', time=2024-09-12T20:15:36.680198+0000, chain.objs.size()=1 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.7wlBMJ6h3pk9J2TghhxeV5QY6iTCHdi_0 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14607355641655376396', time=2024-09-12T20:15:36.839757+0000, chain.objs.size()=1 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bgR1NkEcccUyILK-WYsQ837PZblcWHE_0 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13439426172827389601', time=2024-09-12T20:15:37.495640+0000, chain.objs.size()=1 2024-09-12T18:33:05.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.625+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hXhWpGsCT_K0fU6pyY1nsJnzHp10GCK_0 2024-09-12T18:33:05.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10940797245051291091', time=2024-09-12T20:15:38.912535+0000, chain.objs.size()=1 2024-09-12T18:33:05.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.F9qE59QlHZsyGBAnEN2UmQYm8dVFEf__0 2024-09-12T18:33:05.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.626+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4855366227765008718', time=2024-09-12T20:15:40.015279+0000, chain.objs.size()=1 2024-09-12T18:33:05.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.626+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NQag0HfYRArVTFGgzyOzT_PbtEsdc7e_0 2024-09-12T18:33:05.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10228272769675657905', time=2024-09-12T20:15:40.788371+0000, chain.objs.size()=1 2024-09-12T18:33:05.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.PtGexSR3uBUUd8hvnCzf9P7O3ceoX64_0 2024-09-12T18:33:05.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.627+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11055645642299771401', time=2024-09-12T20:15:40.827924+0000, chain.objs.size()=1 2024-09-12T18:33:05.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.627+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.4CAqwmhX_nSgFEb_EyeenD-BXznsDyA_0 2024-09-12T18:33:05.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8622540619131975989', time=2024-09-12T20:15:41.105998+0000, chain.objs.size()=1 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.52gDSVhKleLf9b9nGFKNBoXCGA5KTIC_0 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16219195375830262716', time=2024-09-12T20:15:41.402803+0000, chain.objs.size()=1 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Xu8P07N33PULeQu-0KRf2gPch0x1_-t_0 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16323908182977607115', time=2024-09-12T20:15:42.073148+0000, chain.objs.size()=1 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.CJXUn04WwzGeV1cJl3x3ukyOifjl8U4_0 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3810612379105075068', time=2024-09-12T20:15:42.364611+0000, chain.objs.size()=1 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qFqHXEIXJHH7zpv0RsOss3AU4Y8Hm5i_0 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8908991731699353403', time=2024-09-12T20:16:20.255905+0000, chain.objs.size()=1 2024-09-12T18:33:05.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.629+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.TA9iWuHMuXz6vk9p5Oktk7EsyHkol1J_0 2024-09-12T18:33:05.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.630+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4489395505603642715', time=2024-09-12T20:16:20.335187+0000, chain.objs.size()=1 2024-09-12T18:33:05.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.630+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.24kS69udx5TpHUhW7yA84mZflxi5xrl_0 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.813092872938491667', time=2024-09-12T20:16:20.383935+0000, chain.objs.size()=1 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UMgTvL8LZCQgE3uDtUVj-xbRwPajYGx_0 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2883108352895370221', time=2024-09-12T20:16:20.537704+0000, chain.objs.size()=1 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OQVV2cGrr-uVkqJLz8-yddF3u9oj80g_0 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12919242594863986498', time=2024-09-12T20:16:20.670608+0000, chain.objs.size()=1 2024-09-12T18:33:05.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.631+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.X4xwoEBVaIZRrr0lGKMTWKH8QyuEuv6_0 2024-09-12T18:33:05.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14978038074300913226', time=2024-09-12T20:16:20.742613+0000, chain.objs.size()=1 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.oK54RqpujqnwwNCczUPvO0188t7sFlC_0 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3728436592773150375', time=2024-09-12T20:16:21.039771+0000, chain.objs.size()=1 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uOW7BUZyAur731rklWZsiunEDUfSal4_0 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12946912599179975201', time=2024-09-12T20:16:21.153465+0000, chain.objs.size()=1 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FddWI79iKG7QtUO4a4OBhvSioPZcpDU_0 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17062159421721681651', time=2024-09-12T20:16:21.781772+0000, chain.objs.size()=1 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.633+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.CcFbjUidVIIcOLwlcWih3feaURjGUmX_0 2024-09-12T18:33:05.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.634+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.616493578765214073', time=2024-09-12T20:16:21.849832+0000, chain.objs.size()=1 2024-09-12T18:33:05.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.634+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HtGt_61Nhzf0jE8Zqyxdh2bvUcDfZnM_0 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.449068832020398724', time=2024-09-12T20:16:22.639839+0000, chain.objs.size()=1 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8M3GmVdbIzcxczVL6_pYdAYJee8Gna3_0 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4713702791228422130', time=2024-09-12T20:16:23.123729+0000, chain.objs.size()=1 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.krU0SRJMFcEigYgxblc5ah55u6ehZ4p_0 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4853371446806589365', time=2024-09-12T20:16:23.124579+0000, chain.objs.size()=1 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.f5NnaTwFqqRBhfYApjvbQ9Ivd2y60rW_0 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6390901246424284048', time=2024-09-12T20:16:23.202661+0000, chain.objs.size()=1 2024-09-12T18:33:05.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.635+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.vUilI8xzdxozecnCiJEilyaXxVMfOQZ_0 2024-09-12T18:33:05.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8297991143423405', time=2024-09-12T20:16:23.313003+0000, chain.objs.size()=1 2024-09-12T18:33:05.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Jj51yUl1PVsB3KUpxGCMMF3kKFXG3H8_0 2024-09-12T18:33:05.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.638+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11697073707091267922', time=2024-09-12T20:16:23.694436+0000, chain.objs.size()=1 2024-09-12T18:33:05.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.638+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zhAOO5xPgumaqlQCm3o9KGANs9LERDw_0 2024-09-12T18:33:05.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14245878688747241676', time=2024-09-12T20:16:23.695033+0000, chain.objs.size()=1 2024-09-12T18:33:05.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KzV4Fszr5ip-hSu1JSBfP-Bz55ZRrr0_0 2024-09-12T18:33:05.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6968751258915542059', time=2024-09-12T20:16:24.125814+0000, chain.objs.size()=1 2024-09-12T18:33:05.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Wodve1NZxjhsO5EvUZPA-XmWFiWgNLR_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10548549496890376125', time=2024-09-12T20:16:24.750828+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.thQbLCxmw7k94iuLmGEktH9oys3Ps19_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6459939829731702186', time=2024-09-12T20:16:26.064069+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kruGPB8FKQP0TURq3wGpxqVhNEjl-IR_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7639469445314863573', time=2024-09-12T20:16:26.222002+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.t0ijMjvJtTAbiWz2kF76tDkhzlhdMMt_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15803219038310024687', time=2024-09-12T20:16:27.272480+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qthfTpFU_6p2za3lmmadL3Di8V6tBDL_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17665289491717151576', time=2024-09-12T20:16:27.308636+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Ovxa5ZLgW6sNh6AjfG9sMy-bt9G_yjk_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1995950302468833492', time=2024-09-12T20:16:28.300730+0000, chain.objs.size()=1 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.fc2ryBQuQqmHZMEUoeSglzUSFrNgleA_0 2024-09-12T18:33:05.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14978930476704209606', time=2024-09-12T20:16:28.776202+0000, chain.objs.size()=1 2024-09-12T18:33:05.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.YxVzk6z2gC0iA_M6M8fqA_kCdWrs26I_0 2024-09-12T18:33:05.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18217864662982798010', time=2024-09-12T20:16:29.209726+0000, chain.objs.size()=1 2024-09-12T18:33:05.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.640+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.qk41fDW9P4baP8zqA02eiZpaG78s7UV_0 2024-09-12T18:33:05.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.641+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1026357816460778232', time=2024-09-12T20:16:29.210318+0000, chain.objs.size()=1 2024-09-12T18:33:05.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.641+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.U37hQ5Ri1z0WpLBfgNrR6KhddOXk1ia_0 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9583780049937509278', time=2024-09-12T20:16:29.905928+0000, chain.objs.size()=1 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Wbu5v44sLSOyJGixN8DsHhgz4CsP-iJ_0 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577674508016736586', time=2024-09-12T20:16:29.953107+0000, chain.objs.size()=1 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.klknMpdafIXUHNBUyF--B4SU0eib75g_0 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15930315730162969009', time=2024-09-12T20:16:30.919125+0000, chain.objs.size()=1 2024-09-12T18:33:05.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.645+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.O4voTDduolxK74QaXKdNKpI4tdSE27r_0 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6010786519338483348', time=2024-09-12T20:16:33.442008+0000, chain.objs.size()=1 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.329__shadow_.Uf89ca090HW6FbiOvdkYaOI3QkrTRTy_0 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11341157831161539096', time=2024-09-12T20:18:08.790246+0000, chain.objs.size()=1 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.499__shadow_.nw9XyS5D9FeGmBQ7TA9swrG6fwEf40w_0 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14187054401432561899', time=2024-09-12T20:18:30.544209+0000, chain.objs.size()=1 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.518__multipart_mymultipart.2~5SDq0U8_QCzTDE6gYfZioBar0drDMa6.1 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16880607207953420157', time=2024-09-12T20:18:32.247101+0000, chain.objs.size()=1 2024-09-12T18:33:05.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.517__shadow_.Iz9WAaXc24DGDekQy4eYzyyxTXLIZuc_0 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11831759442205520894', time=2024-09-12T20:19:51.783226+0000, chain.objs.size()=3 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~n3WUxEfelT6T6MVbRynmQvK6nJrs94_.1 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~n3WUxEfelT6T6MVbRynmQvK6nJrs94_.2 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~n3WUxEfelT6T6MVbRynmQvK6nJrs94_.3 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8985091423199199224', time=2024-09-12T20:19:54.045089+0000, chain.objs.size()=2 2024-09-12T18:33:05.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.646+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~5hWbnSq3kuxcHztPsEydDa8eROlao84.1 2024-09-12T18:33:05.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.650+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~5hWbnSq3kuxcHztPsEydDa8eROlao84.2 2024-09-12T18:33:05.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.653+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/52381 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3024947255251470080', time=2024-09-12T20:20:58.842933+0000, chain.objs.size()=1 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.551__shadow_.O9Ut_P26eSUepamyDAuajNLJRQQH3Yw_0 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10422681572584215638', time=2024-09-12T20:21:15.000353+0000, chain.objs.size()=1 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.X9wTLEv7ROW96CTvPVeFb0OYlRrYFLB_0 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2919729824152645223', time=2024-09-12T20:21:20.005326+0000, chain.objs.size()=1 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.561__multipart_mymultipart.pja2x6k7j63hDwH4cBIGz-mln9uSl64x.1 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.852215129948440953', time=2024-09-12T20:21:37.951650+0000, chain.objs.size()=1 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569__shadow:QmAv5qf.UCyZrd6eju0hvPkUTgMsIEQ_.cNY1TP-Fb_QjjwlhFjbIvTVsUNllfqG_0 2024-09-12T18:33:05.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12283010373058835543', time=2024-09-12T20:21:59.026212+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:fy6ytDb8jbajToaU.YHSuCcDer1Y-65_.VRdZ9JWkerGbfdh0jFlMFuwqk6LGrrs_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10794967831583169106', time=2024-09-12T20:22:08.184467+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:E4k5sFqd0moSoujZxEto8wgfADw7bIg_._TClywSiZSFjg11hpQAAqRoFcQs1ueH_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6562334115932336576', time=2024-09-12T20:22:33.962223+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.580__shadow:gObDvdW3CTq7muuS1t8NLyu9AhQc1LK_.7bV0fcPle49Vhji7-p5GpbKaRwptKSc_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4021157242718411995', time=2024-09-12T20:22:34.492301+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.582__shadow:GFL-dvFDNTC0zUXyMi0.qA8daO9KvZX_.Jdu39OYNPj-LF7S0hCzww_NgIjacZSh_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15558277874688931310', time=2024-09-12T20:22:34.509891+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.582__shadow:8BHhyew8DXJyRurXTBeSDgDoYctHxMY_.HtrY4ce6rbTJWy1BnG25qVhNlu4-B_v_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7085396126193092631', time=2024-09-12T20:22:35.433093+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.583__shadow:T0qdyK3Ykj3Vnn4LQL5aqipNp.J60fJ_.NW7GG9e6eIQma2cEj7emcRyPCRCxPid_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18403203016687470979', time=2024-09-12T20:26:32.251505+0000, chain.objs.size()=1 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.633__shadow_.uCm7ZdxXEiXkZoLUHAiOM0LIAu7mWFV_0 2024-09-12T18:33:05.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7453150993878395516', time=2024-09-12T20:26:35.595435+0000, chain.objs.size()=1 2024-09-12T18:33:05.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.655+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.639__shadow_.lAq7CwCAnUO66jFR_nyoBYL_VnkzLXl_0 2024-09-12T18:33:05.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.658+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9364410859999705464', time=2024-09-12T20:26:36.332574+0000, chain.objs.size()=1 2024-09-12T18:33:05.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.658+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.640__shadow_.K2CMVo2_r0Dn53q6ULXETFZFV6a51RC_0 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.493545507745160808', time=2024-09-12T20:27:16.728664+0000, chain.objs.size()=1 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.668__shadow_.8ylhJrXQquqPsYbCXoZfVrhKoUjZc3M_0 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18216375440138572976', time=2024-09-12T20:28:02.698981+0000, chain.objs.size()=1 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.718__shadow_.3FvkuQmQeaENd0RML5q1Abr39KKAowq_0 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13650039296890125586', time=2024-09-12T20:28:20.914325+0000, chain.objs.size()=2 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.740__shadow_.RMKB3iSFeWnt3trwVL538WWgvtHDaHL_0 2024-09-12T18:33:05.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.660+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.740__shadow_.RMKB3iSFeWnt3trwVL538WWgvtHDaHL_1 2024-09-12T18:33:05.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.663+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.667+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:33:05.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.668+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.668+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47575' 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14660957557910597892', time=2024-09-12T20:10:47.102990+0000, chain.objs.size()=1 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.147__shadow_.Wrcu2PE-S6T_L2ZH0Gwp7vXOBRgM2AP_0 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7658958967564733384', time=2024-09-12T20:13:09.931499+0000, chain.objs.size()=1 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.233__shadow_.UROlO_MyPwZSD6_OFa6SH9hZXkRG0PN_0 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10966258631051236160', time=2024-09-12T20:13:21.307022+0000, chain.objs.size()=1 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.250__shadow_.tUhHx9BI9xQGD1DUi39u6cofwVdORWg_0 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17087153505180552561', time=2024-09-12T20:13:23.148500+0000, chain.objs.size()=1 2024-09-12T18:33:05.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.253__shadow_.uef1pgYHqc_TzXPkKssd2GlsDeHU9Ou_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5235553362123566413', time=2024-09-12T20:14:04.052692+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2agteqdnyVrEIyfB0eb1bYvkH_2Ct0e_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5003720180488298814', time=2024-09-12T20:14:04.634965+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.92N6iXhZ8pZlhxFIAc3lERsQJJnG6Dw_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14370868532330610034', time=2024-09-12T20:14:04.673498+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.2U8k9mlPH_1P9tZLNumhc5D2CWUrCYN_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14405835156918722830', time=2024-09-12T20:14:04.852165+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wgFlP2OWSFujZVxQTWZ3394xVhpcTCR_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10574752663906861866', time=2024-09-12T20:14:05.136066+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.boOPqXUexNtmwGvNPgeenyeljqQhSUr_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14948657167111420852', time=2024-09-12T20:14:05.937334+0000, chain.objs.size()=1 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.k05L58L9i6kWIL09-Qn5fHZ6Bl10GIX_0 2024-09-12T18:33:05.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6276459789774161779', time=2024-09-12T20:14:07.515830+0000, chain.objs.size()=1 2024-09-12T18:33:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8rSJoOTizgcRJD-6QNRXalVijNnomm3_0 2024-09-12T18:33:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16895270555797440175', time=2024-09-12T20:14:07.634815+0000, chain.objs.size()=1 2024-09-12T18:33:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.669+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.hzg-708o9zirtFRYkFRKgoAiFCm4NAg_0 2024-09-12T18:33:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.672+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8568091105922892699', time=2024-09-12T20:14:07.921826+0000, chain.objs.size()=1 2024-09-12T18:33:05.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.672+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.gI8Ix9q2aYq_DZ0jy5IX018ZlrAbQqp_0 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2721058243582115859', time=2024-09-12T20:14:08.608765+0000, chain.objs.size()=1 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.XlXooC5m27ujwbsxe1ELXJiAaHofh-J_0 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17517367751377533619', time=2024-09-12T20:14:08.883346+0000, chain.objs.size()=1 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.46BerHZfhK98UHjicfZYExtX50DVOwA_0 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7755861227516510836', time=2024-09-12T20:14:09.125152+0000, chain.objs.size()=1 2024-09-12T18:33:05.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.qQpLxpifg4yYlRnY_doAvxCWTv0nVd5_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16552278219482130316', time=2024-09-12T20:14:09.547495+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.UYMh3DGAVX0nNmDRufsVjpxkghS2WIO_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4509475964143199960', time=2024-09-12T20:14:09.601559+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.BXAFW5W7akau7d0fbidRmVQm5T3pi5y_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9624160521020453935', time=2024-09-12T20:14:11.461981+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.5m8VNEvbBFBlAIuspgqEtOMUz7Z4Apt_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.759319489509583580', time=2024-09-12T20:14:11.644259+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Lgj71d1QBkutXOQ-r4OUFJkfqVW5bD4_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1695274941475077776', time=2024-09-12T20:14:11.765997+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.LXubh51BkSCvIsPZrXE08RVbhqi3ePn_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16960600560442341451', time=2024-09-12T20:14:13.415462+0000, chain.objs.size()=1 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.89b7KCcZK1vwHhgDJ3cDsN-mGvjzZii_0 2024-09-12T18:33:05.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2709048250660453510', time=2024-09-12T20:14:14.505081+0000, chain.objs.size()=1 2024-09-12T18:33:05.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.8xI1lKI2NnYJCfav2buVcQzSCDHQXqS_0 2024-09-12T18:33:05.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5743550459135578268', time=2024-09-12T20:14:14.811723+0000, chain.objs.size()=1 2024-09-12T18:33:05.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.675+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.DN58OeXL-UK_Av1cuuMaUcijaxAsC4S_0 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12970774108079853505', time=2024-09-12T20:14:15.010603+0000, chain.objs.size()=1 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Na0Z-mAQTKyr-nYMywZXZ2GOXWBAi1B_0 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8758803373351473994', time=2024-09-12T20:14:24.579446+0000, chain.objs.size()=1 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.278__shadow_.cw0uBnHl4D5v42wpCzjrpG7gt1VK7HF_0 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1337972113115197135', time=2024-09-12T20:14:25.190725+0000, chain.objs.size()=1 2024-09-12T18:33:05.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.279__shadow_.mLfAOIomR2_r4bZRzuE98CxG5op_Jiz_0 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6363903877905216711', time=2024-09-12T20:14:28.255225+0000, chain.objs.size()=1 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.284__shadow_.sC88pqyPbl8h_2BFV5hUaKr5sNhar9C_0 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11808963368410455798', time=2024-09-12T20:14:30.254990+0000, chain.objs.size()=1 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.287__shadow_.i846XMcHhjnaRyX6HK7AozHUS8rQf2__0 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2119055787419592110', time=2024-09-12T20:14:32.079447+0000, chain.objs.size()=1 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.290__shadow_.PKmnCintUau1YGNsu3mlQvH2QK92o6C_0 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13406738956760253131', time=2024-09-12T20:14:34.622222+0000, chain.objs.size()=1 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.AF5p-xeZWwGchzjfTZGQjAXIBAAaJ6H_0 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15169293590624122637', time=2024-09-12T20:14:36.525428+0000, chain.objs.size()=1 2024-09-12T18:33:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.680+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.293__shadow_.uXeXbqTkK2gAevdmQfiIifV6qhGcbF9_0 2024-09-12T18:33:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.681+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17691536725442916071', time=2024-09-12T20:14:38.366986+0000, chain.objs.size()=1 2024-09-12T18:33:05.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.681+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.296__shadow_.5Ln6Ryudr2t19wteSPsSa8gyTw1WAla_0 2024-09-12T18:33:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.449785817996692252', time=2024-09-12T20:14:45.959864+0000, chain.objs.size()=1 2024-09-12T18:33:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.307__shadow:07eYbK4RlJfumzq3VdRFhbkm-HoiLSQ_.aYSlpOfvS2bQyUY_ZiOaR-hBBzAsVAM_0 2024-09-12T18:33:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.683+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13027385735482637102', time=2024-09-12T20:14:54.948645+0000, chain.objs.size()=1 2024-09-12T18:33:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.683+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.322__shadow_.r6RkcqkjBhmpq1cQmgMiJqQZi1vN4Ox_0 2024-09-12T18:33:05.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.685+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6898272613344252157', time=2024-09-12T20:15:32.182276+0000, chain.objs.size()=1 2024-09-12T18:33:05.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.685+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.NAoRD9xsZTkmj6x3eynoYfk3P8IjuM__0 2024-09-12T18:33:05.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.685+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17414186898038444854', time=2024-09-12T20:15:32.301000+0000, chain.objs.size()=1 2024-09-12T18:33:05.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.685+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YGXJNMNMgaqHJVbh5JvJxOWWR0xaoWL_0 2024-09-12T18:33:05.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10546526463416013910', time=2024-09-12T20:15:32.461783+0000, chain.objs.size()=1 2024-09-12T18:33:05.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Q5_R1Rs8jDt9d-zC9XOvXJ1c3GXjGMX_0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15193070588938674032', time=2024-09-12T20:15:32.462519+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.j2unvOnIq4FuCPL4EI7IA0GfJzZWk6x_0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4968106733058709712', time=2024-09-12T20:15:32.975055+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.H3RvmCE0ECAMshxugRPmQgQH0C_8Ifq_0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11445012703287840959', time=2024-09-12T20:15:33.854929+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.S654b570Jr8mISuABEkhhUp2G9mY3Xr_0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7311320687966609016', time=2024-09-12T20:15:33.855623+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.vqbudquE5Ye-njyrlsXD79QJDc341N1_0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5734753764699423326', time=2024-09-12T20:15:33.894180+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.2o4K2mjAfsXR7sOZsDllLPMmHpys9i__0 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9730994959830459138', time=2024-09-12T20:15:33.980375+0000, chain.objs.size()=1 2024-09-12T18:33:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.687+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fFnhETCY9KLtYUAgKEqhwJ2CXV5ewZ6_0 2024-09-12T18:33:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.688+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16228895536592047894', time=2024-09-12T20:15:34.151763+0000, chain.objs.size()=1 2024-09-12T18:33:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.688+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iXfD092QX34zooypiln1zpfRWuM2OiJ_0 2024-09-12T18:33:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.688+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13569761739896236560', time=2024-09-12T20:15:34.152352+0000, chain.objs.size()=1 2024-09-12T18:33:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.688+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ZNRe67PXs085dmumO2JG5lgleoZ5E8n_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11278728238481127227', time=2024-09-12T20:15:34.334012+0000, chain.objs.size()=1 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.62DQ5S7wAUdNYt4y8O103pdFIxVLQtl_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16567781946530989595', time=2024-09-12T20:15:34.541535+0000, chain.objs.size()=1 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.6nMor9y6aFhbV9v6MGSe9BU9DdSe7Ks_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.750227168013568205', time=2024-09-12T20:15:35.410222+0000, chain.objs.size()=1 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yX4NhQysWx_OjcUOIvrKpNWqcY-YpTn_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7012530428640619778', time=2024-09-12T20:15:35.693751+0000, chain.objs.size()=1 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Sbel-ayb15b5aZU2BpzpGhZJdbYpe-v_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.654952618915228851', time=2024-09-12T20:15:36.641023+0000, chain.objs.size()=1 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.L1ORjITIYgqEcqaPewMfXmA25hYmcM3_0 2024-09-12T18:33:05.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6035389205807258225', time=2024-09-12T20:15:36.966013+0000, chain.objs.size()=1 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UihjJcpgUMhp5sz2gYfdCxbW8yhAaXz_0 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11253881110625789172', time=2024-09-12T20:15:37.098467+0000, chain.objs.size()=1 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qJ5WiXUfMwjnMfghNYa3HWknJjrS3Vb_0 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7425833720806829775', time=2024-09-12T20:15:37.440061+0000, chain.objs.size()=1 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.i_ssTKFfyHTFf3dE9wl4K_qsrS1v8e0_0 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9808407950937437039', time=2024-09-12T20:15:37.507011+0000, chain.objs.size()=1 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.691+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.b_-sk2xW9me0IgUWrFS_THpdJcVySQo_0 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8602202842793122572', time=2024-09-12T20:15:38.188686+0000, chain.objs.size()=1 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Z0Em0kedsAmy437dfvIVESbLu419SS-_0 2024-09-12T18:33:05.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.692+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12519952937164710475', time=2024-09-12T20:15:38.873997+0000, chain.objs.size()=1 2024-09-12T18:33:05.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.692+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qb3WX90zOoEfHZpyTgQ421CeHYCcBY0_0 2024-09-12T18:33:05.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8226011233960127952', time=2024-09-12T20:15:39.421367+0000, chain.objs.size()=1 2024-09-12T18:33:05.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.FSpeFRaUbkDvmh8_QgumY8Ktsnrqrpo_0 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10353231800922526619', time=2024-09-12T20:15:39.499014+0000, chain.objs.size()=1 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.lSpFkETTcbrEUckc2eYKMa-591Qw5G2_0 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9488996870417871272', time=2024-09-12T20:15:39.852323+0000, chain.objs.size()=1 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.L_PU2r0DjZFrxxeb4q3oE9D2jyyP3ng_0 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18034232197738087763', time=2024-09-12T20:15:40.127498+0000, chain.objs.size()=1 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.Qeq9N6uMJalnW70NfFsSZSswqtMTKDg_0 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5368918015089062439', time=2024-09-12T20:15:40.378981+0000, chain.objs.size()=1 2024-09-12T18:33:05.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.697+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.byzygbbwRn0tbf4LB8qCvDiJaEnUe16_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3507907531398095872', time=2024-09-12T20:15:40.941738+0000, chain.objs.size()=1 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.bWroC7dHylSDq25FlqjTlq8Y7V3cPeJ_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6175073177358656256', time=2024-09-12T20:15:40.942896+0000, chain.objs.size()=1 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.TgjlTIqSMSgYtXqgVYZr13zkH5Ej8NC_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3300895557287698618', time=2024-09-12T20:15:41.212351+0000, chain.objs.size()=1 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.w5of-b_gBtqH6gT5StMNA1Im8kKhqIx_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17127998085471414572', time=2024-09-12T20:15:41.213296+0000, chain.objs.size()=1 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.EkjDz-hWFcZeYfgFF2-hLzvC6QtvbCC_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4192928523937866881', time=2024-09-12T20:15:41.389953+0000, chain.objs.size()=1 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.-YzmcfRMnR1Ho5lPB1NKXfIs79mof2h_0 2024-09-12T18:33:05.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3128903186601606476', time=2024-09-12T20:15:41.605261+0000, chain.objs.size()=1 2024-09-12T18:33:05.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.698+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.yrqGetFshw70yHDUAThrCYC0K3NZgnR_0 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7767770657286960101', time=2024-09-12T20:15:42.279009+0000, chain.objs.size()=1 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.HGtOA1HhQXM8Pc4n6tnPwvV7KRO2WxC_0 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10162760543174801414', time=2024-09-12T20:15:42.280287+0000, chain.objs.size()=1 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.iTY4z3OuqY3HMOS1YP-W6eDQ1D8rvdS_0 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.753328734198006475', time=2024-09-12T20:15:42.388081+0000, chain.objs.size()=1 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.YNtMLaODbs89v0rg-IZg4nklgdjTHrF_0 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.484288382769364501', time=2024-09-12T20:15:42.663869+0000, chain.objs.size()=1 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.eME8wkSK0z0ZawDBG0S5K0QepXHgUFH_0 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7970795360863518806', time=2024-09-12T20:16:20.100475+0000, chain.objs.size()=1 2024-09-12T18:33:05.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.701+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.r_zTWvwTeOSnIWnHbG5uRo0Sblf8JID_0 2024-09-12T18:33:05.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1324217499415418562', time=2024-09-12T20:16:20.428285+0000, chain.objs.size()=1 2024-09-12T18:33:05.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.1FCcsS2SXcuQ9XVC-yFpi12tZ8enEPV_0 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12379125960644619617', time=2024-09-12T20:16:20.524034+0000, chain.objs.size()=1 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8b_cmr6glYOeVF02goRHDfMRM15TP9__0 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.370771341311808289', time=2024-09-12T20:16:20.807551+0000, chain.objs.size()=1 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.y59JKNLx_uh75Mu6zSzt9i28PEro-6O_0 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6570880407520637200', time=2024-09-12T20:16:21.997913+0000, chain.objs.size()=1 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FG-clwdxfu37C81LeDHGKXo6-t8ZBIv_0 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10322921326686898247', time=2024-09-12T20:16:22.097548+0000, chain.objs.size()=1 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6MmVlOOWgUbqZ0IVjt8VMWYG3t9meTh_0 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13134306776543427242', time=2024-09-12T20:16:22.135769+0000, chain.objs.size()=1 2024-09-12T18:33:05.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.703+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.9zxRS7p08JZVHlfuytcRqxn43TOxh7r_0 2024-09-12T18:33:05.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.704+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14237116670000918131', time=2024-09-12T20:16:22.145680+0000, chain.objs.size()=1 2024-09-12T18:33:05.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.704+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FqC29AS5b2C6Rmy8VU28R5gN9XQK0XF_0 2024-09-12T18:33:05.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.705+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6361264443080795388', time=2024-09-12T20:16:22.292719+0000, chain.objs.size()=1 2024-09-12T18:33:05.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.705+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.0AWMlfE2cpaByQvRGZRhoB76E9rJKRe_0 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7149673668783417272', time=2024-09-12T20:16:22.576033+0000, chain.objs.size()=1 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4-I2w22mfX8-zcgV4uLo5U9KbenZwIo_0 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16874233924828634715', time=2024-09-12T20:16:23.250983+0000, chain.objs.size()=1 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.LO5bCZ3sANPdWnXGSQjg_uVjakAbXT4_0 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14834302508134607937', time=2024-09-12T20:16:23.937046+0000, chain.objs.size()=1 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.zHqdrKMu53C8UMuuZOphSO7j6PHR_yH_0 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14202226292416405906', time=2024-09-12T20:16:24.682095+0000, chain.objs.size()=1 2024-09-12T18:33:05.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.706+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.suMguvrF96GblETCKfaT87m4jNe4PYu_0 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16782943553863481590', time=2024-09-12T20:16:24.804663+0000, chain.objs.size()=1 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.FDxutwsISAZW4HeCzS8J4EIaySZuK5K_0 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11559143843974987469', time=2024-09-12T20:16:25.379174+0000, chain.objs.size()=1 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.Gh6DXPLeeP5y7v5peyvk_kJ8qTu0K4Y_0 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17764530001702300748', time=2024-09-12T20:16:25.460327+0000, chain.objs.size()=1 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.eX0k1AzTSTiIH3dVsQl8KbWpYs8fp-R_0 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3657423406421569272', time=2024-09-12T20:16:25.546293+0000, chain.objs.size()=1 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.8rpYlYY-8RVUAHKy5g86zOrRIfIjokt_0 2024-09-12T18:33:05.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12036871430322495121', time=2024-09-12T20:16:26.363671+0000, chain.objs.size()=1 2024-09-12T18:33:05.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.708+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WJ3AJCEL3KguSx-94Zhnkc9VWHI4BAO_0 2024-09-12T18:33:05.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.709+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9840333966141453164', time=2024-09-12T20:16:26.441761+0000, chain.objs.size()=1 2024-09-12T18:33:05.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.709+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.djiZY05VJjQL7MRiHQFHIHo2rGhW2wy_0 2024-09-12T18:33:05.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.709+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2429123076287579849', time=2024-09-12T20:16:26.514478+0000, chain.objs.size()=1 2024-09-12T18:33:05.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.709+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2JzUfsTusxiVONRuvSAwPSJ2NbW7ilT_0 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12036444724129967668', time=2024-09-12T20:16:26.584550+0000, chain.objs.size()=1 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.xssCFS8iKbJBVgET2DVRDLgCB7EiMGH_0 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15172410797054360106', time=2024-09-12T20:16:26.929766+0000, chain.objs.size()=1 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.OaRtv9d4nuEZwobi29yNOxdo6i8XAnf_0 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6752050834363346642', time=2024-09-12T20:16:26.958836+0000, chain.objs.size()=1 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.z1VQre5qmxfFm4KmVk8-QF12Wp0sKdM_0 2024-09-12T18:33:05.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15654853186286724518', time=2024-09-12T20:16:27.293131+0000, chain.objs.size()=1 2024-09-12T18:33:05.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mtE9K2XQDjJl1KbYHagJ1_xYIkUWgIl_0 2024-09-12T18:33:05.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6592631685837742871', time=2024-09-12T20:16:27.463493+0000, chain.objs.size()=1 2024-09-12T18:33:05.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.GzhI_qHh31LUoy8RBJose5gixP9XEud_0 2024-09-12T18:33:05.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.640222870357202073', time=2024-09-12T20:16:27.920631+0000, chain.objs.size()=1 2024-09-12T18:33:05.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.711+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DO8a8OvDg9fl5eF-Jyr8ycKGL0WprmJ_0 2024-09-12T18:33:05.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11348496823765084526', time=2024-09-12T20:16:28.096639+0000, chain.objs.size()=1 2024-09-12T18:33:05.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.kLxhLwWvePTBa-b7Qz63rg27xR81Ct0_0 2024-09-12T18:33:05.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.713+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11999237960214178910', time=2024-09-12T20:16:28.097219+0000, chain.objs.size()=1 2024-09-12T18:33:05.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.713+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.F3d2QVEjg5Pgyb7oLpPjOnexW_z4osd_0 2024-09-12T18:33:05.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.717+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 0/47575 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10544669300729140962', time=2024-09-12T20:16:28.292144+0000, chain.objs.size()=1 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.BYRmPauqrjsgDHypjG0VXW87GUU0LBX_0 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10067897644143330336', time=2024-09-12T20:16:28.305078+0000, chain.objs.size()=1 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hY_xIuaaTyNcwE6Y89ZPkKYn35J6q3w_0 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4706369689218619279', time=2024-09-12T20:16:29.075195+0000, chain.objs.size()=1 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.UWMQieSqdZZBBUXW8tU3knEVJnKAhmy_0 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11004342200074531159', time=2024-09-12T20:16:29.333159+0000, chain.objs.size()=1 2024-09-12T18:33:05.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uwfCwb_ej7HwQjLLaWOSQrKai0_jCU8_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14949552829420404886', time=2024-09-12T20:16:29.874258+0000, chain.objs.size()=1 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ftaKMHuMDUW-a6KCzDxH0sw-tnKi_6D_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16338393601819094271', time=2024-09-12T20:16:30.216936+0000, chain.objs.size()=1 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.WR7YZhHLqIsa8TaAfgqjN-qE9jIgATV_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5101429621435395794', time=2024-09-12T20:16:30.754768+0000, chain.objs.size()=1 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.bAF46jqJ5fkSNE_OS5usLoMf7Mkxukt_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4661876952337952402', time=2024-09-12T20:16:31.027220+0000, chain.objs.size()=1 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.JMB2hlTNDlU595bq1Y3Po1ie-uhHt08_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7239234973316218446', time=2024-09-12T20:16:54.517211+0000, chain.objs.size()=1 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.373__shadow_.0TBC0wFETqylEMl_DiwHaIj_yBsCW8z_0 2024-09-12T18:33:05.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9809849610941629029', time=2024-09-12T20:16:56.042597+0000, chain.objs.size()=1 2024-09-12T18:33:05.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.374__shadow_.wYVQFN7BRyYsJVB3AHzATKYLEx8YBgI_0 2024-09-12T18:33:05.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13005356211974320774', time=2024-09-12T20:17:37.708622+0000, chain.objs.size()=1 2024-09-12T18:33:05.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.450__shadow_.MO_2t5O85rwJOep7HEceZfG0ulBV4tC_0 2024-09-12T18:33:05.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17026662375259163314', time=2024-09-12T20:17:45.547537+0000, chain.objs.size()=1 2024-09-12T18:33:05.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.720+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.461__shadow_.8MfGmdigKJJYAl5hDgIyzYVErU5PWUt_0 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7237599479921121870', time=2024-09-12T20:18:02.415504+0000, chain.objs.size()=1 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.488__shadow_.7z-sAIOHrJ1Gu97ScVUMFMj8qk1J38F_0 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5750205971064914682', time=2024-09-12T20:18:23.916979+0000, chain.objs.size()=1 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.512__shadow_.ET-sZ1vZckOU7vkGviyti6Wf1XLm7J1_0 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~cXLF29mkuaRLPK2FJoN8O9KcPa7fc4B', time=2024-09-12T20:20:18.264325+0000, chain.objs.size()=1 2024-09-12T18:33:05.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.723+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.531__multipart_mymultipart.2~cXLF29mkuaRLPK2FJoN8O9KcPa7fc4B.1 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3983725150170091759', time=2024-09-12T20:21:17.041907+0000, chain.objs.size()=1 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.558__shadow_.ZvKVdVsnp6g4WzLarV6zAL4Te3xDvDd_0 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15721178286806584634', time=2024-09-12T20:21:42.014934+0000, chain.objs.size()=1 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.571__shadow_.PWuVjmXvizzlAJX_IS-ncUQw8b8wBQd_0 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12049297462801934872', time=2024-09-12T20:22:31.614977+0000, chain.objs.size()=1 2024-09-12T18:33:05.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:.s7mbFW-CA6AW3hrJyk2ihCfGOI7F2g_.dSZSus5ANadqTjA0eCecqHJtUrWUzjT_0 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1209552541655633512', time=2024-09-12T20:22:31.658823+0000, chain.objs.size()=1 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.579__shadow:fZCTgFPCdJoT2J6QV-yfuFmPcTe2.RH_.cSobRTSyqKD1j5ilDCnJIgL-Bya0-v4_0 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2042339127629567589', time=2024-09-12T20:27:11.849573+0000, chain.objs.size()=6 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.1 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.2 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.3 2024-09-12T18:33:05.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.724+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.4 2024-09-12T18:33:05.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.5 2024-09-12T18:33:05.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.662__multipart_foo.2~Oo8O45tjl2xU_kS3MMyPTmqw0gE39PC.6 2024-09-12T18:33:05.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.727+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.1594185281127228993', time=2024-09-12T20:27:35.233722+0000, chain.objs.size()=1 2024-09-12T18:33:05.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.727+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.704__shadow:Eza9fDy2qVUWrr.XP74oCf31aGhi.Cq_.SJszIjsby1PXHlrXmsWcmBRjp4Oxsvz_0 2024-09-12T18:33:05.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.729+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16271081720545995719', time=2024-09-12T20:27:35.289725+0000, chain.objs.size()=1 2024-09-12T18:33:05.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.729+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.704__shadow:bRSLXn3S.jaqFIaWS0t87FYNGcKNMcQ_.0nhuXuFEkR_Powz23DX7hRF7oIypzkg_0 2024-09-12T18:33:05.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10542836643169937197', time=2024-09-12T20:28:21.520043+0000, chain.objs.size()=1 2024-09-12T18:33:05.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.741__shadow_.zEjl-tyxSUFdN-mgPORGHSKTdxwcB47_0 2024-09-12T18:33:05.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='2~7jXanFUc0zb_EPef2C61i0jFjoBLJWR', time=2024-09-12T20:28:22.636014+0000, chain.objs.size()=1 2024-09-12T18:33:05.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.742__multipart_mymultipart.2~7jXanFUc0zb_EPef2C61i0jFjoBLJWR.1 2024-09-12T18:33:05.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5091075916155733226', time=2024-09-12T20:28:35.845685+0000, chain.objs.size()=1 2024-09-12T18:33:05.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.730+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.745__shadow_.BqnmzvyqHhyRjktOQENzbjZzqoVeWVE_0 2024-09-12T18:33:05.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.733+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.736+0000 7f4497220800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:33:05.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.738+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:33:05.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=98, truncated=0, next_marker='' 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='_xSgUy8id5DVHbWbREBVclrDOO8nTmxu', time=2024-09-12T20:11:02.507914+0000, chain.objs.size()=1 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.obc4VrVzOEQbfDRnt4guFpsTwn3rpGp_0 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.488297682362849924', time=2024-09-12T20:11:05.084719+0000, chain.objs.size()=3 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.8ANATi4vtFaX883LQQE7Sdhbz-lM0_9_0 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.8ANATi4vtFaX883LQQE7Sdhbz-lM0_9_1 2024-09-12T18:33:05.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.160__shadow_.8ANATi4vtFaX883LQQE7Sdhbz-lM0_9_2 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14970508688602188916', time=2024-09-12T20:13:18.234076+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.739+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.245__shadow_.5hEPzbVp2JEde-M3HN0CoYl0ad6xWEE_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6914299256753433742', time=2024-09-12T20:13:24.967836+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.256__shadow_.K5w2CrdVucG5_oWO69VS_MteBS2RStO_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3422218137969782187', time=2024-09-12T20:14:04.171380+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nq5sET7GOpBZp5QeRPmZdhkmm4usLak_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12573457015446793744', time=2024-09-12T20:14:04.304311+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.jjC0iUdjhLdwjy2AB6QJJoHMxh3xzZq_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4885965263784023959', time=2024-09-12T20:14:05.110336+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.peFjwyW1KLPqc1dwBeVY4ArMi0Fc7li_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2869300313679305108', time=2024-09-12T20:14:05.135724+0000, chain.objs.size()=1 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.A2FBl0uIsCxJxNkUspADG0-qDwvdYJ4_0 2024-09-12T18:33:05.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15663653398328604668', time=2024-09-12T20:14:05.157967+0000, chain.objs.size()=1 2024-09-12T18:33:05.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.V9LTXStfiD6kPF5I2f54bhcbyjspHCo_0 2024-09-12T18:33:05.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8689142790160315777', time=2024-09-12T20:14:06.571012+0000, chain.objs.size()=1 2024-09-12T18:33:05.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.740+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.mkjlhQlaWxZi0EFBF-ct3i0782RxPGu_0 2024-09-12T18:33:05.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.743+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8755701938164563357', time=2024-09-12T20:14:08.097981+0000, chain.objs.size()=1 2024-09-12T18:33:05.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.743+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.co6MN7rbVf33res8kJ9m1siuRFKpQIX_0 2024-09-12T18:33:05.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.743+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12237342904037816829', time=2024-09-12T20:14:08.738165+0000, chain.objs.size()=1 2024-09-12T18:33:05.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.743+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.69c7DLBPK54PoKjrdXTv7-fvQeyb0Vu_0 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11357653879514771939', time=2024-09-12T20:14:08.738739+0000, chain.objs.size()=1 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.NDMsKP5p4Pcz160y7qDvE2-lXgiKQsQ_0 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.261888498457072323', time=2024-09-12T20:14:10.055228+0000, chain.objs.size()=1 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.U1ZRfM29ruTHnLdk40sYs_pX2f6oRc1_0 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15343795291967208356', time=2024-09-12T20:14:10.081606+0000, chain.objs.size()=1 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.v0IoZiIbsid9lbExKbBbRFENFIYaZSr_0 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11186858401026206141', time=2024-09-12T20:14:10.297359+0000, chain.objs.size()=1 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.iEbXjz-u2fglZpSweydc3vWde4cSwp-_0 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4422970763210247046', time=2024-09-12T20:14:10.845021+0000, chain.objs.size()=1 2024-09-12T18:33:05.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.3j1sP-NUX2n3ip1neJF5ySvBrApl8Lp_0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8876151038069825123', time=2024-09-12T20:14:10.935387+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.c9MndQDjgp3sJ-ZEstpLzz2SK--CSlw_0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16679662751558292493', time=2024-09-12T20:14:10.957623+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.lLcypWLlC6Q_HXOTpzLh9g6T8-WpDDb_0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13351980540643492156', time=2024-09-12T20:14:11.682482+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.dtKyJQoR49goOATIWyg619RqoQpzVtn_0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15335924653413965563', time=2024-09-12T20:14:12.478267+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.Q_iZWnqIHlZrf3say0xzH0eFVW-b63__0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4951463993244533345', time=2024-09-12T20:14:12.859867+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.ivMsQiDCzKMkyctFohXH84F-Cnwuucw_0 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13945511985846112003', time=2024-09-12T20:14:12.870484+0000, chain.objs.size()=1 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.938+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.nHGVeTKkZO4d3tGnKnex4dNJiYCHHLf_0 2024-09-12T18:33:05.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.941+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16650710661554289677', time=2024-09-12T20:14:12.893775+0000, chain.objs.size()=1 2024-09-12T18:33:05.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.942+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.aI76C3Ydjx3BBveADJIuKOVkCgjlwzi_0 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18011930332517306075', time=2024-09-12T20:14:13.504015+0000, chain.objs.size()=1 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.TbH-KApnZGUxNfuBgDmtvZrKRTSah7x_0 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.68555393557975879', time=2024-09-12T20:14:13.726185+0000, chain.objs.size()=1 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.wygmes6lkYz__cV2nzcneLTS2B7LJj3_0 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3850077383629858125', time=2024-09-12T20:14:14.240427+0000, chain.objs.size()=1 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.fDWwUXuZHh_fI7wTJWm43m2f0tRkEv3_0 2024-09-12T18:33:05.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13252870980940966018', time=2024-09-12T20:14:14.330947+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.rFpYnIgqLRdCLbeiVznEeWeWv4AKIOk_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7712680299877661657', time=2024-09-12T20:14:14.683454+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.bBaudywRjICqela3T-sF56dbTcV1wCy_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11251528287654326588', time=2024-09-12T20:14:14.808816+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.siTbRr1cC1-kyFVwOGkfBJ-jnxkgRFu_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5112334544983884367', time=2024-09-12T20:14:14.934577+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.262__shadow_.CNxQRTgRxUbTb1QwPb0booxXWVXxikE_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16596198591657010497', time=2024-09-12T20:14:17.505614+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.266__shadow_._QSoFeBZwUdhhqldCZtqMy35B10ccC9_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.498170691141096166', time=2024-09-12T20:14:25.798685+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.280__shadow_.9UNzY-7fOdftoQUGdeZkwuilV0k4iNj_0 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.569888092283760000', time=2024-09-12T20:14:31.479083+0000, chain.objs.size()=1 2024-09-12T18:33:05.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.945+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.289__shadow_.V6qG0lF0fZJZHeVdOAo1dIOJ5gX97Do_0 2024-09-12T18:33:05.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.948+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12645768544064818170', time=2024-09-12T20:14:34.489641+0000, chain.objs.size()=1 2024-09-12T18:33:05.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.948+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.OBVJKUe9d3grsd2re4upYRMXQnlT58n_0 2024-09-12T18:33:05.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15135756892097743445', time=2024-09-12T20:14:34.624323+0000, chain.objs.size()=1 2024-09-12T18:33:05.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.292__shadow_.dmm5etGfm-1_7ItkxuIh0RF7qBJB3J9_0 2024-09-12T18:33:05.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.547144565677296167', time=2024-09-12T20:14:38.357834+0000, chain.objs.size()=1 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.296__shadow_.8nQ4XtZ2m9QiYUXJWHajGzl9COazPrQ_0 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2653068540298501946', time=2024-09-12T20:15:32.158777+0000, chain.objs.size()=1 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.949+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.sTpWLawqiukhgv9l7uZspvXCglKzeFo_0 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13717324450372569294', time=2024-09-12T20:15:32.617714+0000, chain.objs.size()=1 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.jSVtRCGFGpuPDNq06c5qy_dmfi3xn2I_0 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15387402848488585486', time=2024-09-12T20:15:32.721484+0000, chain.objs.size()=1 2024-09-12T18:33:05.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.rFpq0_SZOZl5MG2eyDDHbqMg6w8fnBC_0 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3894003092343364011', time=2024-09-12T20:15:32.991383+0000, chain.objs.size()=1 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.951+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.3oMbex_9rnykF90DSAHOgW4HfVsKiJg_0 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4635162830540449', time=2024-09-12T20:15:33.206047+0000, chain.objs.size()=1 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.zkmsA3b-suy7zxMys9-d-IBa2V45oUY_0 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7534484590662615875', time=2024-09-12T20:15:34.719239+0000, chain.objs.size()=1 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.v5iOIMxYW0aMnl4EVv_Czg_tAHcmk2a_0 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13805858513096130671', time=2024-09-12T20:15:34.750960+0000, chain.objs.size()=1 2024-09-12T18:33:05.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.T0-bADSx3ZtyrDJbWlTN612AQaA5Vqp_0 2024-09-12T18:33:05.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8619722585284863662', time=2024-09-12T20:15:35.960594+0000, chain.objs.size()=1 2024-09-12T18:33:05.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.tuKmU9nBSnuY5oGPIFKxpp_xv1XFNz2_0 2024-09-12T18:33:05.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16530927757092090730', time=2024-09-12T20:15:37.111483+0000, chain.objs.size()=1 2024-09-12T18:33:05.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.952+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.mbAbtil0xy43uXWmMfbzZt2SnSx-DNI_0 2024-09-12T18:33:05.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.954+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.11640529689445246124', time=2024-09-12T20:15:37.643322+0000, chain.objs.size()=1 2024-09-12T18:33:05.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.954+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.1kFB3UZ8bPqLScsATc7Qg_m7SSEZr02_0 2024-09-12T18:33:05.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.956+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3024639950084129427', time=2024-09-12T20:15:38.070502+0000, chain.objs.size()=1 2024-09-12T18:33:05.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.956+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.hO-rUzGeZF-f5xR0uGQcBsKQXKFhgB__0 2024-09-12T18:33:05.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.956+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6227473964397940833', time=2024-09-12T20:15:38.114501+0000, chain.objs.size()=1 2024-09-12T18:33:05.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.956+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.W4_D7jh-w6tkB4Wr4X9DUvt-yilfuX9_0 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13127173619710801409', time=2024-09-12T20:15:38.271811+0000, chain.objs.size()=1 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.V3PDPMWLynA1YEC73sPaaa7Uyp2BSCM_0 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6444999677669275474', time=2024-09-12T20:15:38.294798+0000, chain.objs.size()=1 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.ejpB8ARVFvsw-1VMnOjxy6X_Tf_hrab_0 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6868622873458034625', time=2024-09-12T20:15:38.746526+0000, chain.objs.size()=1 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.fAnPQDFbB4r-Pj1mK8VF7xD0T6mqq_0_0 2024-09-12T18:33:05.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14673051204564923209', time=2024-09-12T20:15:39.970229+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.IsLZXZyfXwacgk1FBSQU5Jo9XbP2ZKm_0 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7712937188176867229', time=2024-09-12T20:15:40.256786+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.A2Ue_4Pu-eCRtf9Wr7E4pDqYAB9nuvS_0 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8375837850151666805', time=2024-09-12T20:15:40.327390+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.WLGCTUuIM0u560cXp7VhjIPbZnCdaUo_0 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3280139933195686373', time=2024-09-12T20:15:40.401144+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.E_o_FyrgcKTgV7qFVuSv7WfGGgy1577_0 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15775340498815046966', time=2024-09-12T20:15:40.780824+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.P8YUBS3fyI9Xp_1CimoTDM9kS1QnfrG_0 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3151974082472160147', time=2024-09-12T20:15:40.937500+0000, chain.objs.size()=1 2024-09-12T18:33:05.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.dmA5Ef0qcOPrpKXRyQeZhQP9pXkuURA_0 2024-09-12T18:33:05.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13916329239260937010', time=2024-09-12T20:15:41.214314+0000, chain.objs.size()=1 2024-09-12T18:33:05.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.r8Qfcvo67wrjaUEu1pYZERG0MB6zSTq_0 2024-09-12T18:33:05.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7418435001920685509', time=2024-09-12T20:15:42.699423+0000, chain.objs.size()=1 2024-09-12T18:33:05.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.960+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.qoUSZBlnbXDNXKp7EWWFn4AH9vToH8r_0 2024-09-12T18:33:05.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6516363482124833787', time=2024-09-12T20:15:42.712471+0000, chain.objs.size()=1 2024-09-12T18:33:05.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.pXAtOuSpGDSYgYpyMQt_ee7JIb2V524_0 2024-09-12T18:33:05.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.65410684089436839', time=2024-09-12T20:15:42.801600+0000, chain.objs.size()=1 2024-09-12T18:33:05.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.323__shadow_.UXhxFeRPAG7j30DKZxHN6VW8aKEQxIN_0 2024-09-12T18:33:05.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16209166875134216556', time=2024-09-12T20:16:20.679380+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.lG5blN_8R1EcEBOtpBBA7HWagvihou9_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.14898293995074574360', time=2024-09-12T20:16:21.781583+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.owC3ag7YyOtuHz9oDuADTZSSRy5lIkj_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.3619668276117572899', time=2024-09-12T20:16:21.986691+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.v1Lkf9CYyLJdBI0RbgA0C5gH3nPzvyB_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4178441917528646022', time=2024-09-12T20:16:22.091612+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.068fP9iPCIq7kJBuVEC5CYlljQW9bJT_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10932183414573726811', time=2024-09-12T20:16:22.416379+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.964+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HYJPUSvmLkSRFu4Oa8ss-t_rNYIrVVQ_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13273143365891025585', time=2024-09-12T20:16:22.544331+0000, chain.objs.size()=1 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.B_psQujxFntpHbUTjvHsdUtcV_uro6e_0 2024-09-12T18:33:05.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4451326698498461638', time=2024-09-12T20:16:23.111866+0000, chain.objs.size()=1 2024-09-12T18:33:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.2Ryj8mDhirllEG1jkcwyOUIEk4rkk9E_0 2024-09-12T18:33:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.2384547323481918157', time=2024-09-12T20:16:23.285891+0000, chain.objs.size()=1 2024-09-12T18:33:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.N0fPFkY9q5IVNggpS0gN7v9w17hHK2M_0 2024-09-12T18:33:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13260854019667918831', time=2024-09-12T20:16:24.110962+0000, chain.objs.size()=1 2024-09-12T18:33:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.965+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hPbDXfQt1Z0WfMtroLjbEMgtKCAixqU_0 2024-09-12T18:33:05.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.969+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9944888575520410059', time=2024-09-12T20:16:24.512471+0000, chain.objs.size()=1 2024-09-12T18:33:05.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.969+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.QjTwC7NGwpLHj2fp1xxW8_oPonZjwEs_0 2024-09-12T18:33:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17957783253944552840', time=2024-09-12T20:16:24.550116+0000, chain.objs.size()=1 2024-09-12T18:33:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.5vpOs2D6RCvIlpayQk1X43uU3BOoEYQ_0 2024-09-12T18:33:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16612430521077012517', time=2024-09-12T20:16:24.550697+0000, chain.objs.size()=1 2024-09-12T18:33:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ceYsHsBF7fGs66TkMjR2YTQJpgI85qx_0 2024-09-12T18:33:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8316231267076916864', time=2024-09-12T20:16:24.705696+0000, chain.objs.size()=1 2024-09-12T18:33:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.uO-G83vtfRDRqrDObf_joPyd8Pa_6Pn_0 2024-09-12T18:33:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6648388850727733239', time=2024-09-12T20:16:24.832854+0000, chain.objs.size()=1 2024-09-12T18:33:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.hkztV_jBZNM3l2amenXFheTj4GMsUTH_0 2024-09-12T18:33:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.15742910308487145060', time=2024-09-12T20:16:24.908927+0000, chain.objs.size()=1 2024-09-12T18:33:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.L9RbRiBJMpgCyTM3JL4uFyEoGLl7h1-_0 2024-09-12T18:33:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.706913552764212709', time=2024-09-12T20:16:25.147570+0000, chain.objs.size()=1 2024-09-12T18:33:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.970+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.HZ8gMGY1uiQLcDbquHnRSDq8j2oINNd_0 2024-09-12T18:33:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16206913408418729276', time=2024-09-12T20:16:25.292110+0000, chain.objs.size()=1 2024-09-12T18:33:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.6eCOI4qARx5p9g3iKnGo5PUU_FOek6y_0 2024-09-12T18:33:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.7932103419994358466', time=2024-09-12T20:16:25.349683+0000, chain.objs.size()=1 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.4GRoXq4ewm0yljZAD07vojP5iZ5XAN-_0 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6143240891959411769', time=2024-09-12T20:16:26.104822+0000, chain.objs.size()=1 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.pRoMX5Vcfwa5TiMzUNhyz1pSDdXbk7z_0 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.4889188945434238427', time=2024-09-12T20:16:26.105453+0000, chain.objs.size()=1 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.971+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.DXzN_Mhztmm_ejgSbj0nrGAjXrn_3H9_0 2024-09-12T18:33:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.973+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.5791252807243457945', time=2024-09-12T20:16:26.320360+0000, chain.objs.size()=1 2024-09-12T18:33:05.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.973+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.ITTo2-Szs3Dj_6mSTI2k2AY9f3jxy0T_0 2024-09-12T18:33:05.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17170767305060900050', time=2024-09-12T20:16:27.772745+0000, chain.objs.size()=1 2024-09-12T18:33:05.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.mjeLuEvsFcxl_FyzTRZ5gZwQ5pliJIS_0 2024-09-12T18:33:05.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.974+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12865323799884388069', time=2024-09-12T20:16:29.035810+0000, chain.objs.size()=1 2024-09-12T18:33:05.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.974+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.a-5qrKbdvlwbC1fu794zY7-i2CLUTnI_0 2024-09-12T18:33:05.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8182699925126258978', time=2024-09-12T20:16:30.433638+0000, chain.objs.size()=1 2024-09-12T18:33:05.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.KS4E3uQk25gMfV0a1M_VwPIvYVPTy08_0 2024-09-12T18:33:05.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.8315418081670347554', time=2024-09-12T20:16:31.036059+0000, chain.objs.size()=1 2024-09-12T18:33:05.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.324__shadow_.7S87ehm6isjqCpsYFQYal2czq_VbaAt_0 2024-09-12T18:33:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.18093512545428987050', time=2024-09-12T20:17:26.097879+0000, chain.objs.size()=1 2024-09-12T18:33:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.975+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.430__shadow_.tIKmOZ8YbYomkJY_780dS6ASb5NWQRM_0 2024-09-12T18:33:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.274596710348552627', time=2024-09-12T20:17:48.037595+0000, chain.objs.size()=1 2024-09-12T18:33:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.464__shadow_.UhjLG7YM338tt6G8bQgpbM6nbOinW0j_0 2024-09-12T18:33:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.12659954687243158440', time=2024-09-12T20:17:48.640064+0000, chain.objs.size()=1 2024-09-12T18:33:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.465__shadow_.tITbgI-LQ_8t-clvWxkGluJUSYOT-Vf_0 2024-09-12T18:33:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17061419743108118078', time=2024-09-12T20:18:32.246382+0000, chain.objs.size()=1 2024-09-12T18:33:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.517__shadow_.psDgC9mYMdm_BTWSG3jfiyOxDyHx0tU_0 2024-09-12T18:33:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17766923025882243492', time=2024-09-12T20:19:47.701169+0000, chain.objs.size()=1 2024-09-12T18:33:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.523__multipart_mymultipart.2~XKeFCB3sXAGQWIPZ62N1-0J2C9Pdfqs.1 2024-09-12T18:33:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.17881490147816373962', time=2024-09-12T20:21:27.437614+0000, chain.objs.size()=1 2024-09-12T18:33:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.565__shadow_.v1yDIxXJ2qMG_eXq25-kp20uUTuN9He_0 2024-09-12T18:33:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.16484277312688653102', time=2024-09-12T20:21:45.541528+0000, chain.objs.size()=1 2024-09-12T18:33:05.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.977+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.574__shadow:7URgTUlDFT.q3rA4l.eZvpWZSui5zPb_.PRf7sRf5yBEPBkU_t-96085gNsAPrzI_0 2024-09-12T18:33:05.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.979+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.6542013515302089447', time=2024-09-12T20:22:14.797843+0000, chain.objs.size()=1 2024-09-12T18:33:05.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.979+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.577__shadow:bFFbD3faL57uhglqB6SdQeC4dCBbJyZ_.e91_kyQmGFyIq46gmLykEIPuAZvj0Yl_0 2024-09-12T18:33:05.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.10932675765560118374', time=2024-09-12T20:27:15.673117+0000, chain.objs.size()=1 2024-09-12T18:33:05.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.666__shadow_.daFMM8qRNK997pIkMBBph4U5cMURxe-_0 2024-09-12T18:33:05.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.13046810776883905135', time=2024-09-12T20:27:29.686771+0000, chain.objs.size()=1 2024-09-12T18:33:05.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.695__shadow_.o4Ry8PYYqZMgb1DshAYwTBq-mtfuRjy_0 2024-09-12T18:33:05.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 20 garbage collection: RGWGC::process iterating over entry tag='42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.9755746710748194910', time=2024-09-12T20:27:30.211459+0000, chain.objs.size()=1 2024-09-12T18:33:05.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.980+0000 7f4497220800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:42c5264b-1887-4ec0-ad3b-497d0463fb19.4571.696__shadow:FBWLrJuB56U6oWSRrktWSwVfvEYMboN_.g832qYOTyEYEMNvi_0KhV_6xmdUtwWK_0 2024-09-12T18:33:05.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.985+0000 7f4497220800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:33:05.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.993+0000 7f434afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:33:05.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.995+0000 7f4497220800 20 remove_watcher() i=0 2024-09-12T18:33:05.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.995+0000 7f4497220800 2 removed watcher, disabling cache 2024-09-12T18:33:05.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.996+0000 7f4497220800 20 remove_watcher() i=1 2024-09-12T18:33:06.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.997+0000 7f4497220800 20 remove_watcher() i=2 2024-09-12T18:33:06.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.998+0000 7f4497220800 20 remove_watcher() i=3 2024-09-12T18:33:06.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:05.999+0000 7f4497220800 20 remove_watcher() i=4 2024-09-12T18:33:06.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:06.000+0000 7f4497220800 20 remove_watcher() i=5 2024-09-12T18:33:06.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:06.001+0000 7f4497220800 20 remove_watcher() i=6 2024-09-12T18:33:06.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:06.002+0000 7f4497220800 20 remove_watcher() i=7 2024-09-12T18:33:06.017 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:33:06.028 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:33:06.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:33:06.150 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:06.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:06.493 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:06.496 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1986,"stamp":"2024-09-12T18:33:05.561651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":712394457,"num_objects":4981,"num_object_clones":0,"num_object_copies":18878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4981,"num_whiteouts":0,"num_read":287425,"num_read_kb":2654355,"num_write":157295,"num_write_kb":2423504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14250,"ondisk_log_size":14250,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2792704,"kb_used_data":1123136,"kb_used_omap":12,"kb_used_meta":1669427,"kb_avail":752182016,"statfs":{"total":773094113280,"available":770234384384,"internally_reserved":0,"allocated":1150091264,"data_stored":1134169684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1709493808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2101562,"num_objects":-25,"num_object_clones":0,"num_object_copies":-98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005770"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.645460+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:28:47.645460+0000","last_peered":"2024-09-12T18:28:47.645460+0000","last_clean":"2024-09-12T18:28:47.645460+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:28:47.645460+0000","last_undegraded":"2024-09-12T18:28:47.645460+0000","last_fullsized":"2024-09-12T18:28:47.645460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641171+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:28:17.641171+0000","last_peered":"2024-09-12T18:28:17.641171+0000","last_clean":"2024-09-12T18:28:17.641171+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:28:17.641171+0000","last_undegraded":"2024-09-12T18:28:17.641171+0000","last_fullsized":"2024-09-12T18:28:17.641171+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:41.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.404279+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:28:12.404279+0000","last_peered":"2024-09-12T18:28:12.404279+0000","last_clean":"2024-09-12T18:28:12.404279+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:28:12.404279+0000","last_undegraded":"2024-09-12T18:28:12.404279+0000","last_fullsized":"2024-09-12T18:28:12.404279+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.080783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.503031+0000","last_change":"2024-09-12T18:08:44.184390+0000","last_active":"2024-09-12T18:28:47.503031+0000","last_peered":"2024-09-12T18:28:47.503031+0000","last_clean":"2024-09-12T18:28:47.503031+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:28:47.503031+0000","last_undegraded":"2024-09-12T18:28:47.503031+0000","last_fullsized":"2024-09-12T18:28:47.503031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:51.778841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525188+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:28:18.525188+0000","last_peered":"2024-09-12T18:28:18.525188+0000","last_clean":"2024-09-12T18:28:18.525188+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:28:18.525188+0000","last_undegraded":"2024-09-12T18:28:18.525188+0000","last_fullsized":"2024-09-12T18:28:18.525188+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:47.933301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'1","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.598765+0000","last_change":"2024-09-12T17:53:12.148575+0000","last_active":"2024-09-12T18:28:12.598765+0000","last_peered":"2024-09-12T18:28:12.598765+0000","last_clean":"2024-09-12T18:28:12.598765+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:28:12.598765+0000","last_undegraded":"2024-09-12T18:28:12.598765+0000","last_fullsized":"2024-09-12T18:28:12.598765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:30.531081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514184+0000","last_change":"2024-09-12T17:50:14.836684+0000","last_active":"2024-09-12T18:30:27.514184+0000","last_peered":"2024-09-12T18:30:27.514184+0000","last_clean":"2024-09-12T18:30:27.514184+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:30:27.514184+0000","last_undegraded":"2024-09-12T18:30:27.514184+0000","last_fullsized":"2024-09-12T18:30:27.514184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:16.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425027+0000","last_change":"2024-09-12T18:08:44.178158+0000","last_active":"2024-09-12T18:30:32.425027+0000","last_peered":"2024-09-12T18:30:32.425027+0000","last_clean":"2024-09-12T18:30:32.425027+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:30:32.425027+0000","last_undegraded":"2024-09-12T18:30:32.425027+0000","last_fullsized":"2024-09-12T18:30:32.425027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:48.796260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851978+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:30:47.851978+0000","last_peered":"2024-09-12T18:30:47.851978+0000","last_clean":"2024-09-12T18:30:47.851978+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:30:47.851978+0000","last_undegraded":"2024-09-12T18:30:47.851978+0000","last_fullsized":"2024-09-12T18:30:47.851978+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506777+0000","last_change":"2024-09-12T17:53:12.146240+0000","last_active":"2024-09-12T18:29:22.506777+0000","last_peered":"2024-09-12T18:29:22.506777+0000","last_clean":"2024-09-12T18:29:22.506777+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:29:22.506777+0000","last_undegraded":"2024-09-12T18:29:22.506777+0000","last_fullsized":"2024-09-12T18:29:22.506777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.969445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.848535+0000","last_change":"2024-09-12T17:50:14.830812+0000","last_active":"2024-09-12T18:30:17.848535+0000","last_peered":"2024-09-12T18:30:17.848535+0000","last_clean":"2024-09-12T18:30:17.848535+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:30:17.848535+0000","last_undegraded":"2024-09-12T18:30:17.848535+0000","last_fullsized":"2024-09-12T18:30:17.848535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:04.011300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413604+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:29:27.413604+0000","last_peered":"2024-09-12T18:29:27.413604+0000","last_clean":"2024-09-12T18:29:27.413604+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:29:27.413604+0000","last_undegraded":"2024-09-12T18:29:27.413604+0000","last_fullsized":"2024-09-12T18:29:27.413604+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:57.846394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":2101,"num_write":11,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:43.545564+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:30:43.545564+0000","last_peered":"2024-09-12T18:30:43.545564+0000","last_clean":"2024-09-12T18:30:43.545564+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:30:43.545564+0000","last_undegraded":"2024-09-12T18:30:43.545564+0000","last_fullsized":"2024-09-12T18:30:43.545564+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8188,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653099+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:29:37.653099+0000","last_peered":"2024-09-12T18:29:37.653099+0000","last_clean":"2024-09-12T18:29:37.653099+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:29:37.653099+0000","last_undegraded":"2024-09-12T18:29:37.653099+0000","last_fullsized":"2024-09-12T18:29:37.653099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842273+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:29:27.842273+0000","last_peered":"2024-09-12T18:29:27.842273+0000","last_clean":"2024-09-12T18:29:27.842273+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:29:27.842273+0000","last_undegraded":"2024-09-12T18:29:27.842273+0000","last_fullsized":"2024-09-12T18:29:27.842273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4114,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.608852+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:29:37.608852+0000","last_peered":"2024-09-12T18:29:37.608852+0000","last_clean":"2024-09-12T18:29:37.608852+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:29:37.608852+0000","last_undegraded":"2024-09-12T18:29:37.608852+0000","last_fullsized":"2024-09-12T18:29:37.608852+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.447117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'8","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414003+0000","last_change":"2024-09-12T17:53:15.163967+0000","last_active":"2024-09-12T18:29:32.414003+0000","last_peered":"2024-09-12T18:29:32.414003+0000","last_clean":"2024-09-12T18:29:32.414003+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:29:32.414003+0000","last_undegraded":"2024-09-12T18:29:32.414003+0000","last_fullsized":"2024-09-12T18:29:32.414003+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:21.391926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8424657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16462,"num_write":13,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.536175+0000","last_change":"2024-09-12T17:53:12.139099+0000","last_active":"2024-09-12T18:29:38.536175+0000","last_peered":"2024-09-12T18:29:38.536175+0000","last_clean":"2024-09-12T18:29:38.536175+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:29:38.536175+0000","last_undegraded":"2024-09-12T18:29:38.536175+0000","last_fullsized":"2024-09-12T18:29:38.536175+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:32.128312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13304,"num_write":13,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422211+0000","last_change":"2024-09-12T17:50:14.842952+0000","last_active":"2024-09-12T18:30:17.422211+0000","last_peered":"2024-09-12T18:30:17.422211+0000","last_clean":"2024-09-12T18:30:17.422211+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:30:17.422211+0000","last_undegraded":"2024-09-12T18:30:17.422211+0000","last_fullsized":"2024-09-12T18:30:17.422211+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:31.774447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406069+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:28:47.406069+0000","last_peered":"2024-09-12T18:28:47.406069+0000","last_clean":"2024-09-12T18:28:47.406069+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:28:47.406069+0000","last_undegraded":"2024-09-12T18:28:47.406069+0000","last_fullsized":"2024-09-12T18:28:47.406069+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:26.401744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400909+0000","last_change":"2024-09-12T17:53:15.159424+0000","last_active":"2024-09-12T18:28:17.400909+0000","last_peered":"2024-09-12T18:28:17.400909+0000","last_clean":"2024-09-12T18:28:17.400909+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:28:17.400909+0000","last_undegraded":"2024-09-12T18:28:17.400909+0000","last_fullsized":"2024-09-12T18:28:17.400909+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:39.982738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6178,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:13.524378+0000","last_change":"2024-09-12T17:53:12.146586+0000","last_active":"2024-09-12T18:28:13.524378+0000","last_peered":"2024-09-12T18:28:13.524378+0000","last_clean":"2024-09-12T18:28:13.524378+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:28:13.524378+0000","last_undegraded":"2024-09-12T18:28:13.524378+0000","last_fullsized":"2024-09-12T18:28:13.524378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:27.151552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839397+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:29:02.839397+0000","last_peered":"2024-09-12T18:29:02.839397+0000","last_clean":"2024-09-12T18:29:02.839397+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:29:02.839397+0000","last_undegraded":"2024-09-12T18:29:02.839397+0000","last_fullsized":"2024-09-12T18:29:02.839397+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:50.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406134+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:28:47.406134+0000","last_peered":"2024-09-12T18:28:47.406134+0000","last_clean":"2024-09-12T18:28:47.406134+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:28:47.406134+0000","last_undegraded":"2024-09-12T18:28:47.406134+0000","last_fullsized":"2024-09-12T18:28:47.406134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:07.255733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.404892+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:28:17.404892+0000","last_peered":"2024-09-12T18:28:17.404892+0000","last_clean":"2024-09-12T18:28:17.404892+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:28:17.404892+0000","last_undegraded":"2024-09-12T18:28:17.404892+0000","last_fullsized":"2024-09-12T18:28:17.404892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:55.589172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832136+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:28:12.832136+0000","last_peered":"2024-09-12T18:28:12.832136+0000","last_clean":"2024-09-12T18:28:12.832136+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:28:12.832136+0000","last_undegraded":"2024-09-12T18:28:12.832136+0000","last_fullsized":"2024-09-12T18:28:12.832136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:08.474574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":15356,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.604077+0000","last_change":"2024-09-12T17:50:14.841323+0000","last_active":"2024-09-12T18:28:57.604077+0000","last_peered":"2024-09-12T18:28:57.604077+0000","last_clean":"2024-09-12T18:28:57.604077+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:28:57.604077+0000","last_undegraded":"2024-09-12T18:28:57.604077+0000","last_fullsized":"2024-09-12T18:28:57.604077+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:41.858948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.609892+0000","last_change":"2024-09-12T18:08:44.184970+0000","last_active":"2024-09-12T18:29:47.609892+0000","last_peered":"2024-09-12T18:29:47.609892+0000","last_clean":"2024-09-12T18:29:47.609892+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:29:47.609892+0000","last_undegraded":"2024-09-12T18:29:47.609892+0000","last_fullsized":"2024-09-12T18:29:47.609892+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:13.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414229+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:29:32.414229+0000","last_peered":"2024-09-12T18:29:32.414229+0000","last_clean":"2024-09-12T18:29:32.414229+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:29:32.414229+0000","last_undegraded":"2024-09-12T18:29:32.414229+0000","last_fullsized":"2024-09-12T18:29:32.414229+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.661852+0000","last_change":"2024-09-12T17:53:12.143997+0000","last_active":"2024-09-12T18:30:37.661852+0000","last_peered":"2024-09-12T18:30:37.661852+0000","last_clean":"2024-09-12T18:30:37.661852+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:30:37.661852+0000","last_undegraded":"2024-09-12T18:30:37.661852+0000","last_fullsized":"2024-09-12T18:30:37.661852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:11.692360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":103,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.838922+0000","last_change":"2024-09-12T17:50:14.839525+0000","last_active":"2024-09-12T18:28:57.838922+0000","last_peered":"2024-09-12T18:28:57.838922+0000","last_clean":"2024-09-12T18:28:57.838922+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:28:57.838922+0000","last_undegraded":"2024-09-12T18:28:57.838922+0000","last_fullsized":"2024-09-12T18:28:57.838922+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:08.454207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509504+0000","last_change":"2024-09-12T18:08:44.184023+0000","last_active":"2024-09-12T18:29:47.509504+0000","last_peered":"2024-09-12T18:29:47.509504+0000","last_clean":"2024-09-12T18:29:47.509504+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:29:47.509504+0000","last_undegraded":"2024-09-12T18:29:47.509504+0000","last_fullsized":"2024-09-12T18:29:47.509504+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841144+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:29:17.841144+0000","last_peered":"2024-09-12T18:29:17.841144+0000","last_clean":"2024-09-12T18:29:17.841144+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:29:17.841144+0000","last_undegraded":"2024-09-12T18:29:17.841144+0000","last_fullsized":"2024-09-12T18:29:17.841144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409647+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:28:57.409647+0000","last_peered":"2024-09-12T18:28:57.409647+0000","last_clean":"2024-09-12T18:28:57.409647+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:28:57.409647+0000","last_undegraded":"2024-09-12T18:28:57.409647+0000","last_fullsized":"2024-09-12T18:28:57.409647+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:39.923261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414257+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:29:32.414257+0000","last_peered":"2024-09-12T18:29:32.414257+0000","last_clean":"2024-09-12T18:29:32.414257+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:29:32.414257+0000","last_undegraded":"2024-09-12T18:29:32.414257+0000","last_fullsized":"2024-09-12T18:29:32.414257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20478,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.507284+0000","last_change":"2024-09-12T17:53:12.144615+0000","last_active":"2024-09-12T18:29:27.507284+0000","last_peered":"2024-09-12T18:29:27.507284+0000","last_clean":"2024-09-12T18:29:27.507284+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:29:27.507284+0000","last_undegraded":"2024-09-12T18:29:27.507284+0000","last_fullsized":"2024-09-12T18:29:27.507284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:01.824724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4132,"num_write":3,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.504229+0000","last_change":"2024-09-12T17:50:14.845069+0000","last_active":"2024-09-12T18:28:57.504229+0000","last_peered":"2024-09-12T18:28:57.504229+0000","last_clean":"2024-09-12T18:28:57.504229+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:28:57.504229+0000","last_undegraded":"2024-09-12T18:28:57.504229+0000","last_fullsized":"2024-09-12T18:28:57.504229+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:11.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'68","reported_seq":308,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420555+0000","last_change":"2024-09-12T17:50:14.842178+0000","last_active":"2024-09-12T18:30:07.420555+0000","last_peered":"2024-09-12T18:30:07.420555+0000","last_clean":"2024-09-12T18:30:07.420555+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:30:07.420555+0000","last_undegraded":"2024-09-12T18:30:07.420555+0000","last_fullsized":"2024-09-12T18:30:07.420555+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:23.280624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615983+0000","last_change":"2024-09-12T17:53:15.160000+0000","last_active":"2024-09-12T18:30:37.615983+0000","last_peered":"2024-09-12T18:30:37.615983+0000","last_clean":"2024-09-12T18:30:37.615983+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:30:37.615983+0000","last_undegraded":"2024-09-12T18:30:37.615983+0000","last_fullsized":"2024-09-12T18:30:37.615983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:16.584362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:33.544028+0000","last_change":"2024-09-12T17:53:12.138225+0000","last_active":"2024-09-12T18:30:33.544028+0000","last_peered":"2024-09-12T18:30:33.544028+0000","last_clean":"2024-09-12T18:30:33.544028+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:30:33.544028+0000","last_undegraded":"2024-09-12T18:30:33.544028+0000","last_fullsized":"2024-09-12T18:30:33.544028+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":298,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418863+0000","last_change":"2024-09-12T17:50:14.839535+0000","last_active":"2024-09-12T18:29:57.418863+0000","last_peered":"2024-09-12T18:29:57.418863+0000","last_clean":"2024-09-12T18:29:57.418863+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:29:57.418863+0000","last_undegraded":"2024-09-12T18:29:57.418863+0000","last_fullsized":"2024-09-12T18:29:57.418863+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:47.803289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615945+0000","last_change":"2024-09-12T17:53:15.161893+0000","last_active":"2024-09-12T18:30:37.615945+0000","last_peered":"2024-09-12T18:30:37.615945+0000","last_clean":"2024-09-12T18:30:37.615945+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:30:37.615945+0000","last_undegraded":"2024-09-12T18:30:37.615945+0000","last_fullsized":"2024-09-12T18:30:37.615945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:04.296609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421756+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:30:32.421756+0000","last_peered":"2024-09-12T18:30:32.421756+0000","last_clean":"2024-09-12T18:30:32.421756+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:30:32.421756+0000","last_undegraded":"2024-09-12T18:30:32.421756+0000","last_fullsized":"2024-09-12T18:30:32.421756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846075+0000","last_change":"2024-09-12T17:50:14.840630+0000","last_active":"2024-09-12T18:29:57.846075+0000","last_peered":"2024-09-12T18:29:57.846075+0000","last_clean":"2024-09-12T18:29:57.846075+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:29:57.846075+0000","last_undegraded":"2024-09-12T18:29:57.846075+0000","last_fullsized":"2024-09-12T18:29:57.846075+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.197122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422364+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:30:37.422364+0000","last_peered":"2024-09-12T18:30:37.422364+0000","last_clean":"2024-09-12T18:30:37.422364+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:30:37.422364+0000","last_undegraded":"2024-09-12T18:30:37.422364+0000","last_fullsized":"2024-09-12T18:30:37.422364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425105+0000","last_change":"2024-09-12T17:53:12.148814+0000","last_active":"2024-09-12T18:30:32.425105+0000","last_peered":"2024-09-12T18:30:32.425105+0000","last_clean":"2024-09-12T18:30:32.425105+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:30:32.425105+0000","last_undegraded":"2024-09-12T18:30:32.425105+0000","last_fullsized":"2024-09-12T18:30:32.425105+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:08.076954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538860+0000","last_change":"2024-09-12T17:50:14.841498+0000","last_active":"2024-09-12T18:29:58.538860+0000","last_peered":"2024-09-12T18:29:58.538860+0000","last_clean":"2024-09-12T18:29:58.538860+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:29:58.538860+0000","last_undegraded":"2024-09-12T18:29:58.538860+0000","last_fullsized":"2024-09-12T18:29:58.538860+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.140268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.426002+0000","last_change":"2024-09-12T17:53:15.158874+0000","last_active":"2024-09-12T18:30:37.426002+0000","last_peered":"2024-09-12T18:30:37.426002+0000","last_clean":"2024-09-12T18:30:37.426002+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:30:37.426002+0000","last_undegraded":"2024-09-12T18:30:37.426002+0000","last_fullsized":"2024-09-12T18:30:37.426002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:50.215733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.661208+0000","last_change":"2024-09-12T17:53:12.146649+0000","last_active":"2024-09-12T18:30:32.661208+0000","last_peered":"2024-09-12T18:30:32.661208+0000","last_clean":"2024-09-12T18:30:32.661208+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:30:32.661208+0000","last_undegraded":"2024-09-12T18:30:32.661208+0000","last_fullsized":"2024-09-12T18:30:32.661208+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:57.575965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6140,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.515181+0000","last_change":"2024-09-12T18:08:44.180436+0000","last_active":"2024-09-12T18:30:37.515181+0000","last_peered":"2024-09-12T18:30:37.515181+0000","last_clean":"2024-09-12T18:30:37.515181+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:30:37.515181+0000","last_undegraded":"2024-09-12T18:30:37.515181+0000","last_fullsized":"2024-09-12T18:30:37.515181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:14.400883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412252+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:29:17.412252+0000","last_peered":"2024-09-12T18:29:17.412252+0000","last_clean":"2024-09-12T18:29:17.412252+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:29:17.412252+0000","last_undegraded":"2024-09-12T18:29:17.412252+0000","last_fullsized":"2024-09-12T18:29:17.412252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:02.994171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4210688,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8208,"num_write":10,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410711+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:29:12.410711+0000","last_peered":"2024-09-12T18:29:12.410711+0000","last_clean":"2024-09-12T18:29:12.410711+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:29:12.410711+0000","last_undegraded":"2024-09-12T18:29:12.410711+0000","last_fullsized":"2024-09-12T18:29:12.410711+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:44.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":50,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.408326+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:28:47.408326+0000","last_peered":"2024-09-12T18:28:47.408326+0000","last_clean":"2024-09-12T18:28:47.408326+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:28:47.408326+0000","last_undegraded":"2024-09-12T18:28:47.408326+0000","last_fullsized":"2024-09-12T18:28:47.408326+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.905410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408851+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:29:02.408851+0000","last_peered":"2024-09-12T18:29:02.408851+0000","last_clean":"2024-09-12T18:29:02.408851+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:29:02.408851+0000","last_undegraded":"2024-09-12T18:29:02.408851+0000","last_fullsized":"2024-09-12T18:29:02.408851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:26.810924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412214+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:29:17.412214+0000","last_peered":"2024-09-12T18:29:17.412214+0000","last_clean":"2024-09-12T18:29:17.412214+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:29:17.412214+0000","last_undegraded":"2024-09-12T18:29:17.412214+0000","last_fullsized":"2024-09-12T18:29:17.412214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.836700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.505743+0000","last_change":"2024-09-12T17:53:12.143791+0000","last_active":"2024-09-12T18:29:12.505743+0000","last_peered":"2024-09-12T18:29:12.505743+0000","last_clean":"2024-09-12T18:29:12.505743+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:29:12.505743+0000","last_undegraded":"2024-09-12T18:29:12.505743+0000","last_fullsized":"2024-09-12T18:29:12.505743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:50.203716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7180,"num_write":5,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663487+0000","last_change":"2024-09-12T17:50:14.842898+0000","last_active":"2024-09-12T18:30:47.663487+0000","last_peered":"2024-09-12T18:30:47.663487+0000","last_clean":"2024-09-12T18:30:47.663487+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:30:47.663487+0000","last_undegraded":"2024-09-12T18:30:47.663487+0000","last_fullsized":"2024-09-12T18:30:47.663487+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:36.700805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424139+0000","last_change":"2024-09-12T18:08:44.182811+0000","last_active":"2024-09-12T18:30:27.424139+0000","last_peered":"2024-09-12T18:30:27.424139+0000","last_clean":"2024-09-12T18:30:27.424139+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:30:27.424139+0000","last_undegraded":"2024-09-12T18:30:27.424139+0000","last_fullsized":"2024-09-12T18:30:27.424139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.055368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607709+0000","last_change":"2024-09-12T17:53:15.162967+0000","last_active":"2024-09-12T18:29:27.607709+0000","last_peered":"2024-09-12T18:29:27.607709+0000","last_clean":"2024-09-12T18:29:27.607709+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:29:27.607709+0000","last_undegraded":"2024-09-12T18:29:27.607709+0000","last_fullsized":"2024-09-12T18:29:27.607709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:00.026005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8190,"num_write":11,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'6","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.840579+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:29:12.840579+0000","last_peered":"2024-09-12T18:29:12.840579+0000","last_clean":"2024-09-12T18:29:12.840579+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:29:12.840579+0000","last_undegraded":"2024-09-12T18:29:12.840579+0000","last_fullsized":"2024-09-12T18:29:12.840579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:33.879161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":11,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:50:14.845493+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:34.662412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412282+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:29:17.412282+0000","last_peered":"2024-09-12T18:29:17.412282+0000","last_clean":"2024-09-12T18:29:17.412282+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:29:17.412282+0000","last_undegraded":"2024-09-12T18:29:17.412282+0000","last_fullsized":"2024-09-12T18:29:17.412282+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:25.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607128+0000","last_change":"2024-09-12T17:53:12.149630+0000","last_active":"2024-09-12T18:29:22.607128+0000","last_peered":"2024-09-12T18:29:22.607128+0000","last_clean":"2024-09-12T18:29:22.607128+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:29:22.607128+0000","last_undegraded":"2024-09-12T18:29:22.607128+0000","last_fullsized":"2024-09-12T18:29:22.607128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:16.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.516222+0000","last_change":"2024-09-12T17:50:14.840844+0000","last_active":"2024-09-12T18:30:47.516222+0000","last_peered":"2024-09-12T18:30:47.516222+0000","last_clean":"2024-09-12T18:30:47.516222+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:30:47.516222+0000","last_undegraded":"2024-09-12T18:30:47.516222+0000","last_fullsized":"2024-09-12T18:30:47.516222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:46.536171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.410294+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:29:02.410294+0000","last_peered":"2024-09-12T18:29:02.410294+0000","last_clean":"2024-09-12T18:29:02.410294+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:29:02.410294+0000","last_undegraded":"2024-09-12T18:29:02.410294+0000","last_fullsized":"2024-09-12T18:29:02.410294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.278214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846735+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:30:02.846735+0000","last_peered":"2024-09-12T18:30:02.846735+0000","last_clean":"2024-09-12T18:30:02.846735+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:30:02.846735+0000","last_undegraded":"2024-09-12T18:30:02.846735+0000","last_fullsized":"2024-09-12T18:30:02.846735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"259'83","reported_seq":352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851871+0000","last_change":"2024-09-12T17:50:14.839010+0000","last_active":"2024-09-12T18:30:47.851871+0000","last_peered":"2024-09-12T18:30:47.851871+0000","last_clean":"2024-09-12T18:30:47.851871+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:30:47.851871+0000","last_undegraded":"2024-09-12T18:30:47.851871+0000","last_fullsized":"2024-09-12T18:30:47.851871+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:25.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:07.409815+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:29:07.409815+0000","last_peered":"2024-09-12T18:29:07.409815+0000","last_clean":"2024-09-12T18:29:07.409815+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:29:07.409815+0000","last_undegraded":"2024-09-12T18:29:07.409815+0000","last_fullsized":"2024-09-12T18:29:07.409815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:47.977130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611696+0000","last_change":"2024-09-12T17:53:12.148669+0000","last_active":"2024-09-12T18:30:02.611696+0000","last_peered":"2024-09-12T18:30:02.611696+0000","last_clean":"2024-09-12T18:30:02.611696+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:30:02.611696+0000","last_undegraded":"2024-09-12T18:30:02.611696+0000","last_fullsized":"2024-09-12T18:30:02.611696+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:34.792507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2093,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":207,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413248+0000","last_change":"2024-09-12T17:50:14.841525+0000","last_active":"2024-09-12T18:29:27.413248+0000","last_peered":"2024-09-12T18:29:27.413248+0000","last_clean":"2024-09-12T18:29:27.413248+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:29:27.413248+0000","last_undegraded":"2024-09-12T18:29:27.413248+0000","last_fullsized":"2024-09-12T18:29:27.413248+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.064279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408899+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:29:02.408899+0000","last_peered":"2024-09-12T18:29:02.408899+0000","last_clean":"2024-09-12T18:29:02.408899+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:29:02.408899+0000","last_undegraded":"2024-09-12T18:29:02.408899+0000","last_fullsized":"2024-09-12T18:29:02.408899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.682875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.606374+0000","last_change":"2024-09-12T17:53:15.162122+0000","last_active":"2024-09-12T18:29:17.606374+0000","last_peered":"2024-09-12T18:29:17.606374+0000","last_clean":"2024-09-12T18:29:17.606374+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:29:17.606374+0000","last_undegraded":"2024-09-12T18:29:17.606374+0000","last_fullsized":"2024-09-12T18:29:17.606374+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412132+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:29:17.412132+0000","last_peered":"2024-09-12T18:29:17.412132+0000","last_clean":"2024-09-12T18:29:17.412132+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:29:17.412132+0000","last_undegraded":"2024-09-12T18:29:17.412132+0000","last_fullsized":"2024-09-12T18:29:17.412132+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:32.030251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839464+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:29:02.839464+0000","last_peered":"2024-09-12T18:29:02.839464+0000","last_clean":"2024-09-12T18:29:02.839464+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:29:02.839464+0000","last_undegraded":"2024-09-12T18:29:02.839464+0000","last_fullsized":"2024-09-12T18:29:02.839464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:21.136369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422237+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:30:17.422237+0000","last_peered":"2024-09-12T18:30:17.422237+0000","last_clean":"2024-09-12T18:30:17.422237+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:30:17.422237+0000","last_undegraded":"2024-09-12T18:30:17.422237+0000","last_fullsized":"2024-09-12T18:30:17.422237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":10,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:13.532493+0000","last_change":"2024-09-12T17:53:12.147444+0000","last_active":"2024-09-12T18:29:13.532493+0000","last_peered":"2024-09-12T18:29:13.532493+0000","last_clean":"2024-09-12T18:29:13.532493+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:29:13.532493+0000","last_undegraded":"2024-09-12T18:29:13.532493+0000","last_fullsized":"2024-09-12T18:29:13.532493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:33.139490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411513+0000","last_change":"2024-09-12T17:50:14.845091+0000","last_active":"2024-09-12T18:29:17.411513+0000","last_peered":"2024-09-12T18:29:17.411513+0000","last_clean":"2024-09-12T18:29:17.411513+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:29:17.411513+0000","last_undegraded":"2024-09-12T18:29:17.411513+0000","last_fullsized":"2024-09-12T18:29:17.411513+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:59.523739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.415011+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:29:37.415011+0000","last_peered":"2024-09-12T18:29:37.415011+0000","last_clean":"2024-09-12T18:29:37.415011+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:29:37.415011+0000","last_undegraded":"2024-09-12T18:29:37.415011+0000","last_fullsized":"2024-09-12T18:29:37.415011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:49.644621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.427023+0000","last_change":"2024-09-12T17:53:12.146834+0000","last_active":"2024-09-12T18:30:42.427023+0000","last_peered":"2024-09-12T18:30:42.427023+0000","last_clean":"2024-09-12T18:30:42.427023+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:30:42.427023+0000","last_undegraded":"2024-09-12T18:30:42.427023+0000","last_fullsized":"2024-09-12T18:30:42.427023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:24.998862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841210+0000","last_change":"2024-09-12T17:50:14.843252+0000","last_active":"2024-09-12T18:29:17.841210+0000","last_peered":"2024-09-12T18:29:17.841210+0000","last_clean":"2024-09-12T18:29:17.841210+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:29:17.841210+0000","last_undegraded":"2024-09-12T18:29:17.841210+0000","last_fullsized":"2024-09-12T18:29:17.841210+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.189495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653142+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:29:37.653142+0000","last_peered":"2024-09-12T18:29:37.653142+0000","last_clean":"2024-09-12T18:29:37.653142+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:29:37.653142+0000","last_undegraded":"2024-09-12T18:29:37.653142+0000","last_fullsized":"2024-09-12T18:29:37.653142+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:54.893645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.516737+0000","last_change":"2024-09-12T17:53:12.145287+0000","last_active":"2024-09-12T18:30:52.516737+0000","last_peered":"2024-09-12T18:30:52.516737+0000","last_clean":"2024-09-12T18:30:52.516737+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:30:52.516737+0000","last_undegraded":"2024-09-12T18:30:52.516737+0000","last_fullsized":"2024-09-12T18:30:52.516737+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411632+0000","last_change":"2024-09-12T17:50:14.845672+0000","last_active":"2024-09-12T18:29:17.411632+0000","last_peered":"2024-09-12T18:29:17.411632+0000","last_clean":"2024-09-12T18:29:17.411632+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:29:17.411632+0000","last_undegraded":"2024-09-12T18:29:17.411632+0000","last_fullsized":"2024-09-12T18:29:17.411632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:46.707631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617831+0000","last_change":"2024-09-12T18:08:44.180779+0000","last_active":"2024-09-12T18:30:52.617831+0000","last_peered":"2024-09-12T18:30:52.617831+0000","last_clean":"2024-09-12T18:30:52.617831+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:30:52.617831+0000","last_undegraded":"2024-09-12T18:30:52.617831+0000","last_fullsized":"2024-09-12T18:30:52.617831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:51.232292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.657166+0000","last_change":"2024-09-12T17:53:12.147578+0000","last_active":"2024-09-12T18:30:02.657166+0000","last_peered":"2024-09-12T18:30:02.657166+0000","last_clean":"2024-09-12T18:30:02.657166+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:30:02.657166+0000","last_undegraded":"2024-09-12T18:30:02.657166+0000","last_fullsized":"2024-09-12T18:30:02.657166+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.387228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12574720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20468,"num_write":9,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419760+0000","last_change":"2024-09-12T17:50:14.843005+0000","last_active":"2024-09-12T18:30:02.419760+0000","last_peered":"2024-09-12T18:30:02.419760+0000","last_clean":"2024-09-12T18:30:02.419760+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:30:02.419760+0000","last_undegraded":"2024-09-12T18:30:02.419760+0000","last_fullsized":"2024-09-12T18:30:02.419760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:21.412702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535480+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:29:33.535480+0000","last_peered":"2024-09-12T18:29:33.535480+0000","last_clean":"2024-09-12T18:29:33.535480+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:29:33.535480+0000","last_undegraded":"2024-09-12T18:29:33.535480+0000","last_fullsized":"2024-09-12T18:29:33.535480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:09.211455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:08.540387+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:30:08.540387+0000","last_peered":"2024-09-12T18:30:08.540387+0000","last_clean":"2024-09-12T18:30:08.540387+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:30:08.540387+0000","last_undegraded":"2024-09-12T18:30:08.540387+0000","last_fullsized":"2024-09-12T18:30:08.540387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610519+0000","last_change":"2024-09-12T17:50:14.843405+0000","last_active":"2024-09-12T18:29:52.610519+0000","last_peered":"2024-09-12T18:29:52.610519+0000","last_clean":"2024-09-12T18:29:52.610519+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:29:52.610519+0000","last_undegraded":"2024-09-12T18:29:52.610519+0000","last_fullsized":"2024-09-12T18:29:52.610519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.738965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514158+0000","last_change":"2024-09-12T18:08:44.185535+0000","last_active":"2024-09-12T18:30:27.514158+0000","last_peered":"2024-09-12T18:30:27.514158+0000","last_clean":"2024-09-12T18:30:27.514158+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:30:27.514158+0000","last_undegraded":"2024-09-12T18:30:27.514158+0000","last_fullsized":"2024-09-12T18:30:27.514158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:31.002329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.617257+0000","last_change":"2024-09-12T17:53:15.156207+0000","last_active":"2024-09-12T18:30:47.617257+0000","last_peered":"2024-09-12T18:30:47.617257+0000","last_clean":"2024-09-12T18:30:47.617257+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:30:47.617257+0000","last_undegraded":"2024-09-12T18:30:47.617257+0000","last_fullsized":"2024-09-12T18:30:47.617257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.717848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":21492,"num_write":12,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.412301+0000","last_change":"2024-09-12T17:53:12.148444+0000","last_active":"2024-09-12T18:29:22.412301+0000","last_peered":"2024-09-12T18:29:22.412301+0000","last_clean":"2024-09-12T18:29:22.412301+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:29:22.412301+0000","last_undegraded":"2024-09-12T18:29:22.412301+0000","last_fullsized":"2024-09-12T18:29:22.412301+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:25.525568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655558+0000","last_change":"2024-09-12T17:50:14.845855+0000","last_active":"2024-09-12T18:29:52.655558+0000","last_peered":"2024-09-12T18:29:52.655558+0000","last_clean":"2024-09-12T18:29:52.655558+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:29:52.655558+0000","last_undegraded":"2024-09-12T18:29:52.655558+0000","last_fullsized":"2024-09-12T18:29:52.655558+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.841767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650945+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:29:22.650945+0000","last_peered":"2024-09-12T18:29:22.650945+0000","last_clean":"2024-09-12T18:29:22.650945+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:29:22.650945+0000","last_undegraded":"2024-09-12T18:29:22.650945+0000","last_fullsized":"2024-09-12T18:29:22.650945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:54.256446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4240667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4192,"num_write":2,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426884+0000","last_change":"2024-09-12T17:53:12.141323+0000","last_active":"2024-09-12T18:30:42.426884+0000","last_peered":"2024-09-12T18:30:42.426884+0000","last_clean":"2024-09-12T18:30:42.426884+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:30:42.426884+0000","last_undegraded":"2024-09-12T18:30:42.426884+0000","last_fullsized":"2024-09-12T18:30:42.426884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:51.866615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:53.538225+0000","last_change":"2024-09-12T17:50:14.841037+0000","last_active":"2024-09-12T18:29:53.538225+0000","last_peered":"2024-09-12T18:29:53.538225+0000","last_clean":"2024-09-12T18:29:53.538225+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:29:53.538225+0000","last_undegraded":"2024-09-12T18:29:53.538225+0000","last_fullsized":"2024-09-12T18:29:53.538225+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:08.998454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.843448+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:29:37.843448+0000","last_peered":"2024-09-12T18:29:37.843448+0000","last_clean":"2024-09-12T18:29:37.843448+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:29:37.843448+0000","last_undegraded":"2024-09-12T18:29:37.843448+0000","last_fullsized":"2024-09-12T18:29:37.843448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:46.217476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427908+0000","last_change":"2024-09-12T17:53:15.167067+0000","last_active":"2024-09-12T18:30:47.427908+0000","last_peered":"2024-09-12T18:30:47.427908+0000","last_clean":"2024-09-12T18:30:47.427908+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:30:47.427908+0000","last_undegraded":"2024-09-12T18:30:47.427908+0000","last_fullsized":"2024-09-12T18:30:47.427908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:46.459018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.616631+0000","last_change":"2024-09-12T17:53:12.145714+0000","last_active":"2024-09-12T18:30:42.616631+0000","last_peered":"2024-09-12T18:30:42.616631+0000","last_clean":"2024-09-12T18:30:42.616631+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:30:42.616631+0000","last_undegraded":"2024-09-12T18:30:42.616631+0000","last_fullsized":"2024-09-12T18:30:42.616631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:38.676442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417826+0000","last_change":"2024-09-12T17:50:14.840332+0000","last_active":"2024-09-12T18:29:52.417826+0000","last_peered":"2024-09-12T18:29:52.417826+0000","last_clean":"2024-09-12T18:29:52.417826+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:29:52.417826+0000","last_undegraded":"2024-09-12T18:29:52.417826+0000","last_fullsized":"2024-09-12T18:29:52.417826+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415951+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:29:42.415951+0000","last_peered":"2024-09-12T18:29:42.415951+0000","last_clean":"2024-09-12T18:29:42.415951+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:29:42.415951+0000","last_undegraded":"2024-09-12T18:29:42.415951+0000","last_fullsized":"2024-09-12T18:29:42.415951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:51.046197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546288+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:30:48.546288+0000","last_peered":"2024-09-12T18:30:48.546288+0000","last_clean":"2024-09-12T18:30:48.546288+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:30:48.546288+0000","last_undegraded":"2024-09-12T18:30:48.546288+0000","last_fullsized":"2024-09-12T18:30:48.546288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426935+0000","last_change":"2024-09-12T17:53:12.143851+0000","last_active":"2024-09-12T18:30:42.426935+0000","last_peered":"2024-09-12T18:30:42.426935+0000","last_clean":"2024-09-12T18:30:42.426935+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:30:42.426935+0000","last_undegraded":"2024-09-12T18:30:42.426935+0000","last_fullsized":"2024-09-12T18:30:42.426935+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:28.807772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424131+0000","last_change":"2024-09-12T17:50:14.843604+0000","last_active":"2024-09-12T18:30:27.424131+0000","last_peered":"2024-09-12T18:30:27.424131+0000","last_clean":"2024-09-12T18:30:27.424131+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:30:27.424131+0000","last_undegraded":"2024-09-12T18:30:27.424131+0000","last_fullsized":"2024-09-12T18:30:27.424131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:57.939262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'291","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417950+0000","last_change":"2024-09-12T17:35:40.897067+0000","last_active":"2024-09-12T18:29:52.417950+0000","last_peered":"2024-09-12T18:29:52.417950+0000","last_clean":"2024-09-12T18:29:52.417950+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:29:52.417950+0000","last_undegraded":"2024-09-12T18:29:52.417950+0000","last_fullsized":"2024-09-12T18:29:52.417950+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:44.766786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3645575,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":537,"num_read_kb":13512,"num_write":1059,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'535","reported_seq":1946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698681+0000","last_change":"2024-09-12T17:35:42.890337+0000","last_active":"2024-09-12T18:30:18.698681+0000","last_peered":"2024-09-12T18:30:18.698681+0000","last_clean":"2024-09-12T18:30:18.698681+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:30:18.698681+0000","last_undegraded":"2024-09-12T18:30:18.698681+0000","last_fullsized":"2024-09-12T18:30:18.698681+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:56.529947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'333","reported_seq":1112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:55.497873+0000","last_change":"2024-09-12T17:35:40.895813+0000","last_active":"2024-09-12T18:29:55.497873+0000","last_peered":"2024-09-12T18:29:55.497873+0000","last_clean":"2024-09-12T18:29:55.497873+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:29:55.497873+0000","last_undegraded":"2024-09-12T18:29:55.497873+0000","last_fullsized":"2024-09-12T18:29:55.497873+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:08.595904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10473446,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":723,"num_read_kb":23031,"num_write":1260,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'484","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812590+0000","last_change":"2024-09-12T17:35:42.888061+0000","last_active":"2024-09-12T18:30:18.812590+0000","last_peered":"2024-09-12T18:30:18.812590+0000","last_clean":"2024-09-12T18:30:18.812590+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:30:18.812590+0000","last_undegraded":"2024-09-12T18:30:18.812590+0000","last_fullsized":"2024-09-12T18:30:18.812590+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:42.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'322","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.421200+0000","last_change":"2024-09-12T17:36:16.048276+0000","last_active":"2024-09-12T18:30:27.421200+0000","last_peered":"2024-09-12T18:30:27.421200+0000","last_clean":"2024-09-12T18:30:27.421200+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:30:27.421200+0000","last_undegraded":"2024-09-12T18:30:27.421200+0000","last_fullsized":"2024-09-12T18:30:27.421200+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:44.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699446,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":700,"num_read_kb":32762,"num_write":1141,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'419","reported_seq":1922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.442221+0000","last_change":"2024-09-12T17:35:42.892018+0000","last_active":"2024-09-12T18:30:15.442221+0000","last_peered":"2024-09-12T18:30:15.442221+0000","last_clean":"2024-09-12T18:30:15.442221+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:30:15.442221+0000","last_undegraded":"2024-09-12T18:30:15.442221+0000","last_fullsized":"2024-09-12T18:30:15.442221+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:47.496306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'281","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.127721+0000","last_change":"2024-09-12T17:35:40.878718+0000","last_active":"2024-09-12T18:29:50.127721+0000","last_peered":"2024-09-12T18:29:50.127721+0000","last_clean":"2024-09-12T18:29:50.127721+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:29:50.127721+0000","last_undegraded":"2024-09-12T18:29:50.127721+0000","last_fullsized":"2024-09-12T18:29:50.127721+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.836799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12627198,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":435,"num_read_kb":25007,"num_write":1013,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'459","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816024+0000","last_change":"2024-09-12T17:35:42.901523+0000","last_active":"2024-09-12T18:30:18.816024+0000","last_peered":"2024-09-12T18:30:18.816024+0000","last_clean":"2024-09-12T18:30:18.816024+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:30:18.816024+0000","last_undegraded":"2024-09-12T18:30:18.816024+0000","last_fullsized":"2024-09-12T18:30:18.816024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:21.733978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'267","reported_seq":981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:40.942677+0000","last_change":"2024-09-12T17:35:40.893806+0000","last_active":"2024-09-12T18:29:40.942677+0000","last_peered":"2024-09-12T18:29:40.942677+0000","last_clean":"2024-09-12T18:29:40.942677+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:29:40.942677+0000","last_undegraded":"2024-09-12T18:29:40.942677+0000","last_fullsized":"2024-09-12T18:29:40.942677+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:58.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640253,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":10932,"num_write":983,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'856","reported_seq":2380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978627+0000","last_change":"2024-09-12T17:35:42.896618+0000","last_active":"2024-09-12T18:30:25.978627+0000","last_peered":"2024-09-12T18:30:25.978627+0000","last_clean":"2024-09-12T18:30:25.978627+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:30:25.978627+0000","last_undegraded":"2024-09-12T18:30:25.978627+0000","last_fullsized":"2024-09-12T18:30:25.978627+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:28.451347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'290","reported_seq":1084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:23.396215+0000","last_change":"2024-09-12T17:35:40.882513+0000","last_active":"2024-09-12T18:29:23.396215+0000","last_peered":"2024-09-12T18:29:23.396215+0000","last_clean":"2024-09-12T18:29:23.396215+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:29:23.396215+0000","last_undegraded":"2024-09-12T18:29:23.396215+0000","last_fullsized":"2024-09-12T18:29:23.396215+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.278996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238044,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":42334,"num_write":1239,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2407,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136019+0000","last_change":"2024-09-12T17:35:42.892097+0000","last_active":"2024-09-12T18:31:29.136019+0000","last_peered":"2024-09-12T18:31:29.136019+0000","last_clean":"2024-09-12T18:31:29.136019+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:31:29.136019+0000","last_undegraded":"2024-09-12T18:31:29.136019+0000","last_fullsized":"2024-09-12T18:31:29.136019+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:35.311382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'300","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.871088+0000","last_change":"2024-09-12T17:35:40.894162+0000","last_active":"2024-09-12T18:32:38.871088+0000","last_peered":"2024-09-12T18:32:38.871088+0000","last_clean":"2024-09-12T18:32:38.871088+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:32:38.871088+0000","last_undegraded":"2024-09-12T18:32:38.871088+0000","last_fullsized":"2024-09-12T18:32:38.871088+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:33.543998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18336797,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":449,"num_read_kb":26409,"num_write":1112,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'465","reported_seq":1962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440637+0000","last_change":"2024-09-12T17:35:42.887897+0000","last_active":"2024-09-12T18:30:15.440637+0000","last_peered":"2024-09-12T18:30:15.440637+0000","last_clean":"2024-09-12T18:30:15.440637+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:30:15.440637+0000","last_undegraded":"2024-09-12T18:30:15.440637+0000","last_fullsized":"2024-09-12T18:30:15.440637+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.371385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'320","reported_seq":954,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.333736+0000","last_change":"2024-09-12T17:35:40.879524+0000","last_active":"2024-09-12T18:32:43.333736+0000","last_peered":"2024-09-12T18:32:43.333736+0000","last_clean":"2024-09-12T18:32:43.333736+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:32:43.333736+0000","last_undegraded":"2024-09-12T18:32:43.333736+0000","last_fullsized":"2024-09-12T18:32:43.333736+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:11.574981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6294073,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":445,"num_read_kb":10679,"num_write":1174,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'484","reported_seq":2063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304996+0000","last_change":"2024-09-12T17:35:42.889118+0000","last_active":"2024-09-12T18:31:28.304996+0000","last_peered":"2024-09-12T18:31:28.304996+0000","last_clean":"2024-09-12T18:31:28.304996+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:31:28.304996+0000","last_undegraded":"2024-09-12T18:31:28.304996+0000","last_fullsized":"2024-09-12T18:31:28.304996+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:50.990196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'759","reported_seq":2185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699100+0000","last_change":"2024-09-12T17:35:42.896662+0000","last_active":"2024-09-12T18:30:18.699100+0000","last_peered":"2024-09-12T18:30:18.699100+0000","last_clean":"2024-09-12T18:30:18.699100+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:30:18.699100+0000","last_undegraded":"2024-09-12T18:30:18.699100+0000","last_fullsized":"2024-09-12T18:30:18.699100+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:32.589294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'292","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409020+0000","last_change":"2024-09-12T17:35:40.895257+0000","last_active":"2024-09-12T18:29:02.409020+0000","last_peered":"2024-09-12T18:29:02.409020+0000","last_clean":"2024-09-12T18:29:02.409020+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:29:02.409020+0000","last_undegraded":"2024-09-12T18:29:02.409020+0000","last_fullsized":"2024-09-12T18:29:02.409020+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:16.477537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370512,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":487,"num_read_kb":71616,"num_write":1078,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'417","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392437+0000","last_change":"2024-09-12T17:36:16.050871+0000","last_active":"2024-09-12T18:32:48.392437+0000","last_peered":"2024-09-12T18:32:48.392437+0000","last_clean":"2024-09-12T18:32:48.392437+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:32:48.392437+0000","last_undegraded":"2024-09-12T18:32:48.392437+0000","last_fullsized":"2024-09-12T18:32:48.392437+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:59.500853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'259","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:10.596848+0000","last_change":"2024-09-12T17:35:40.901655+0000","last_active":"2024-09-12T18:29:10.596848+0000","last_peered":"2024-09-12T18:29:10.596848+0000","last_clean":"2024-09-12T18:29:10.596848+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:29:10.596848+0000","last_undegraded":"2024-09-12T18:29:10.596848+0000","last_fullsized":"2024-09-12T18:29:10.596848+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.400186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1427699,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":423,"num_read_kb":3270,"num_write":960,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'870","reported_seq":2483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392732+0000","last_change":"2024-09-12T17:35:42.888574+0000","last_active":"2024-09-12T18:32:48.392732+0000","last_peered":"2024-09-12T18:32:48.392732+0000","last_clean":"2024-09-12T18:32:48.392732+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:32:48.392732+0000","last_undegraded":"2024-09-12T18:32:48.392732+0000","last_fullsized":"2024-09-12T18:32:48.392732+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:49.201685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'307","reported_seq":953,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:16.582596+0000","last_change":"2024-09-12T17:35:40.899223+0000","last_active":"2024-09-12T18:29:16.582596+0000","last_peered":"2024-09-12T18:29:16.582596+0000","last_clean":"2024-09-12T18:29:16.582596+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:29:16.582596+0000","last_undegraded":"2024-09-12T18:29:16.582596+0000","last_fullsized":"2024-09-12T18:29:16.582596+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:10.653659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8860185,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":470,"num_read_kb":65942,"num_write":1184,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1104","reported_seq":2609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527373+0000","last_change":"2024-09-12T17:35:42.889897+0000","last_active":"2024-09-12T18:30:04.527373+0000","last_peered":"2024-09-12T18:30:04.527373+0000","last_clean":"2024-09-12T18:30:04.527373+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:30:04.527373+0000","last_undegraded":"2024-09-12T18:30:04.527373+0000","last_fullsized":"2024-09-12T18:30:04.527373+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:49.298029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'254","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.502714+0000","last_change":"2024-09-12T17:35:40.896331+0000","last_active":"2024-09-12T18:33:03.502714+0000","last_peered":"2024-09-12T18:33:03.502714+0000","last_clean":"2024-09-12T18:33:03.502714+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:03.502714+0000","last_undegraded":"2024-09-12T18:33:03.502714+0000","last_fullsized":"2024-09-12T18:33:03.502714+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:10.681642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213252,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":722,"num_read_kb":33658,"num_write":1029,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'611","reported_seq":2377,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.306126+0000","last_change":"2024-09-12T17:35:42.897377+0000","last_active":"2024-09-12T18:31:28.306126+0000","last_peered":"2024-09-12T18:31:28.306126+0000","last_clean":"2024-09-12T18:31:28.306126+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:31:28.306126+0000","last_undegraded":"2024-09-12T18:31:28.306126+0000","last_fullsized":"2024-09-12T18:31:28.306126+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:35.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'258","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408847+0000","last_change":"2024-09-12T17:35:40.885644+0000","last_active":"2024-09-12T18:28:52.408847+0000","last_peered":"2024-09-12T18:28:52.408847+0000","last_clean":"2024-09-12T18:28:52.408847+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:28:52.408847+0000","last_undegraded":"2024-09-12T18:28:52.408847+0000","last_fullsized":"2024-09-12T18:28:52.408847+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:43.465385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833628,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":42765,"num_write":917,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'305","reported_seq":1678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.370580+0000","last_change":"2024-09-12T17:35:42.902985+0000","last_active":"2024-09-12T18:32:48.370580+0000","last_peered":"2024-09-12T18:32:48.370580+0000","last_clean":"2024-09-12T18:32:48.370580+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:32:48.370580+0000","last_undegraded":"2024-09-12T18:32:48.370580+0000","last_fullsized":"2024-09-12T18:32:48.370580+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:50.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'302","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704083+0000","last_change":"2024-09-12T17:35:40.901109+0000","last_active":"2024-09-12T18:30:52.704083+0000","last_peered":"2024-09-12T18:30:52.704083+0000","last_clean":"2024-09-12T18:30:52.704083+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:30:52.704083+0000","last_undegraded":"2024-09-12T18:30:52.704083+0000","last_fullsized":"2024-09-12T18:30:52.704083+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:19.735753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26499558,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":516,"num_read_kb":95722,"num_write":1065,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'128","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.236405+0000","last_change":"2024-09-12T17:35:50.911205+0000","last_active":"2024-09-12T18:31:29.236405+0000","last_peered":"2024-09-12T18:31:29.236405+0000","last_clean":"2024-09-12T18:31:29.236405+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:31:29.236405+0000","last_undegraded":"2024-09-12T18:31:29.236405+0000","last_fullsized":"2024-09-12T18:31:29.236405+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.073238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'773","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305568+0000","last_change":"2024-09-12T17:35:42.891760+0000","last_active":"2024-09-12T18:31:28.305568+0000","last_peered":"2024-09-12T18:31:28.305568+0000","last_clean":"2024-09-12T18:31:28.305568+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:31:28.305568+0000","last_undegraded":"2024-09-12T18:31:28.305568+0000","last_fullsized":"2024-09-12T18:31:28.305568+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:36.873441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'289","reported_seq":1055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.688797+0000","last_change":"2024-09-12T17:35:40.893979+0000","last_active":"2024-09-12T18:30:52.688797+0000","last_peered":"2024-09-12T18:30:52.688797+0000","last_clean":"2024-09-12T18:30:52.688797+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:30:52.688797+0000","last_undegraded":"2024-09-12T18:30:52.688797+0000","last_fullsized":"2024-09-12T18:30:52.688797+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:20.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144613,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":714,"num_read_kb":10754,"num_write":1074,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647106+0000","last_change":"2024-09-12T17:35:44.894904+0000","last_active":"2024-09-12T18:28:57.647106+0000","last_peered":"2024-09-12T18:28:57.647106+0000","last_clean":"2024-09-12T18:28:57.647106+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:28:57.647106+0000","last_undegraded":"2024-09-12T18:28:57.647106+0000","last_fullsized":"2024-09-12T18:28:57.647106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:49.733122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'337","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855854+0000","last_change":"2024-09-12T17:35:46.891705+0000","last_active":"2024-09-12T18:31:22.855854+0000","last_peered":"2024-09-12T18:31:22.855854+0000","last_clean":"2024-09-12T18:31:22.855854+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:31:22.855854+0000","last_undegraded":"2024-09-12T18:31:22.855854+0000","last_fullsized":"2024-09-12T18:31:22.855854+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:37.590312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59298,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1037,"num_write":432,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409035+0000","last_change":"2024-09-12T17:35:48.908793+0000","last_active":"2024-09-12T18:29:02.409035+0000","last_peered":"2024-09-12T18:29:02.409035+0000","last_clean":"2024-09-12T18:29:02.409035+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:29:02.409035+0000","last_undegraded":"2024-09-12T18:29:02.409035+0000","last_fullsized":"2024-09-12T18:29:02.409035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.844066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'159","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.215133+0000","last_change":"2024-09-12T17:35:50.921992+0000","last_active":"2024-09-12T18:32:48.215133+0000","last_peered":"2024-09-12T18:32:48.215133+0000","last_clean":"2024-09-12T18:32:48.215133+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:32:48.215133+0000","last_undegraded":"2024-09-12T18:32:48.215133+0000","last_fullsized":"2024-09-12T18:32:48.215133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:51.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'479","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440599+0000","last_change":"2024-09-12T17:35:42.890621+0000","last_active":"2024-09-12T18:30:15.440599+0000","last_peered":"2024-09-12T18:30:15.440599+0000","last_clean":"2024-09-12T18:30:15.440599+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:30:15.440599+0000","last_undegraded":"2024-09-12T18:30:15.440599+0000","last_fullsized":"2024-09-12T18:30:15.440599+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:54.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'346","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.454985+0000","last_change":"2024-09-12T17:35:40.889680+0000","last_active":"2024-09-12T18:29:38.454985+0000","last_peered":"2024-09-12T18:29:38.454985+0000","last_clean":"2024-09-12T18:29:38.454985+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:29:38.454985+0000","last_undegraded":"2024-09-12T18:29:38.454985+0000","last_fullsized":"2024-09-12T18:29:38.454985+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.317264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9114513,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":601,"num_read_kb":80570,"num_write":1218,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415429+0000","last_change":"2024-09-12T17:35:44.894677+0000","last_active":"2024-09-12T18:29:42.415429+0000","last_peered":"2024-09-12T18:29:42.415429+0000","last_clean":"2024-09-12T18:29:42.415429+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:29:42.415429+0000","last_undegraded":"2024-09-12T18:29:42.415429+0000","last_fullsized":"2024-09-12T18:29:42.415429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:39.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'89","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530565+0000","last_change":"2024-09-12T17:35:46.899363+0000","last_active":"2024-09-12T18:28:58.530565+0000","last_peered":"2024-09-12T18:28:58.530565+0000","last_clean":"2024-09-12T18:28:58.530565+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:28:58.530565+0000","last_undegraded":"2024-09-12T18:28:58.530565+0000","last_fullsized":"2024-09-12T18:28:58.530565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530549+0000","last_change":"2024-09-12T17:35:48.901307+0000","last_active":"2024-09-12T18:28:58.530549+0000","last_peered":"2024-09-12T18:28:58.530549+0000","last_clean":"2024-09-12T18:28:58.530549+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:28:58.530549+0000","last_undegraded":"2024-09-12T18:28:58.530549+0000","last_fullsized":"2024-09-12T18:28:58.530549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:46.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'172","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.558222+0000","last_change":"2024-09-12T17:35:50.916182+0000","last_active":"2024-09-12T18:29:58.558222+0000","last_peered":"2024-09-12T18:29:58.558222+0000","last_clean":"2024-09-12T18:29:58.558222+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:29:58.558222+0000","last_undegraded":"2024-09-12T18:29:58.558222+0000","last_fullsized":"2024-09-12T18:29:58.558222+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:31.805546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1211","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816008+0000","last_change":"2024-09-12T17:35:42.901505+0000","last_active":"2024-09-12T18:30:18.816008+0000","last_peered":"2024-09-12T18:30:18.816008+0000","last_clean":"2024-09-12T18:30:18.816008+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:30:18.816008+0000","last_undegraded":"2024-09-12T18:30:18.816008+0000","last_fullsized":"2024-09-12T18:30:18.816008+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:38.531579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'328","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:39.804067+0000","last_change":"2024-09-12T17:35:40.891281+0000","last_active":"2024-09-12T18:29:39.804067+0000","last_peered":"2024-09-12T18:29:39.804067+0000","last_clean":"2024-09-12T18:29:39.804067+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:29:39.804067+0000","last_undegraded":"2024-09-12T18:29:39.804067+0000","last_fullsized":"2024-09-12T18:29:39.804067+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:27.169879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9599526,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":483,"num_read_kb":8445,"num_write":1209,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409696+0000","last_change":"2024-09-12T17:35:44.891907+0000","last_active":"2024-09-12T18:28:57.409696+0000","last_peered":"2024-09-12T18:28:57.409696+0000","last_clean":"2024-09-12T18:28:57.409696+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:28:57.409696+0000","last_undegraded":"2024-09-12T18:28:57.409696+0000","last_fullsized":"2024-09-12T18:28:57.409696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:17.733659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'121","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.508338+0000","last_change":"2024-09-12T17:35:46.901224+0000","last_active":"2024-09-12T18:29:37.508338+0000","last_peered":"2024-09-12T18:29:37.508338+0000","last_clean":"2024-09-12T18:29:37.508338+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:29:37.508338+0000","last_undegraded":"2024-09-12T18:29:37.508338+0000","last_fullsized":"2024-09-12T18:29:37.508338+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:25.864997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'760","reported_seq":2574,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130833+0000","last_change":"2024-09-12T17:35:48.907483+0000","last_active":"2024-09-12T18:32:53.130833+0000","last_peered":"2024-09-12T18:32:53.130833+0000","last_clean":"2024-09-12T18:32:53.130833+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:32:53.130833+0000","last_undegraded":"2024-09-12T18:32:53.130833+0000","last_fullsized":"2024-09-12T18:32:53.130833+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.736753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'230","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.422075+0000","last_change":"2024-09-12T17:35:51.346696+0000","last_active":"2024-09-12T18:31:28.422075+0000","last_peered":"2024-09-12T18:31:28.422075+0000","last_clean":"2024-09-12T18:31:28.422075+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:31:28.422075+0000","last_undegraded":"2024-09-12T18:31:28.422075+0000","last_fullsized":"2024-09-12T18:31:28.422075+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:18.663124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'672","reported_seq":2084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.119270+0000","last_change":"2024-09-12T17:35:42.895732+0000","last_active":"2024-09-12T18:31:29.119270+0000","last_peered":"2024-09-12T18:31:29.119270+0000","last_clean":"2024-09-12T18:31:29.119270+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:31:29.119270+0000","last_undegraded":"2024-09-12T18:31:29.119270+0000","last_fullsized":"2024-09-12T18:31:29.119270+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:25.681124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'289","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.136009+0000","last_change":"2024-09-12T17:35:40.900095+0000","last_active":"2024-09-12T18:29:50.136009+0000","last_peered":"2024-09-12T18:29:50.136009+0000","last_clean":"2024-09-12T18:29:50.136009+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:29:50.136009+0000","last_undegraded":"2024-09-12T18:29:50.136009+0000","last_fullsized":"2024-09-12T18:29:50.136009+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:59.106406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4598709,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":510,"num_read_kb":57705,"num_write":1072,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647162+0000","last_change":"2024-09-12T17:35:44.893676+0000","last_active":"2024-09-12T18:28:57.647162+0000","last_peered":"2024-09-12T18:28:57.647162+0000","last_clean":"2024-09-12T18:28:57.647162+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:28:57.647162+0000","last_undegraded":"2024-09-12T18:28:57.647162+0000","last_fullsized":"2024-09-12T18:28:57.647162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:14.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'273","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.434279+0000","last_change":"2024-09-12T17:35:47.464920+0000","last_active":"2024-09-12T18:31:22.434279+0000","last_peered":"2024-09-12T18:31:22.434279+0000","last_clean":"2024-09-12T18:31:22.434279+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:31:22.434279+0000","last_undegraded":"2024-09-12T18:31:22.434279+0000","last_fullsized":"2024-09-12T18:31:22.434279+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:46.905458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56997,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":951,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'812","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131261+0000","last_change":"2024-09-12T17:35:48.899501+0000","last_active":"2024-09-12T18:32:53.131261+0000","last_peered":"2024-09-12T18:32:53.131261+0000","last_clean":"2024-09-12T18:32:53.131261+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:32:53.131261+0000","last_undegraded":"2024-09-12T18:32:53.131261+0000","last_fullsized":"2024-09-12T18:32:53.131261+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:00.483899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'541","reported_seq":2111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.407478+0000","last_change":"2024-09-12T17:35:42.891761+0000","last_active":"2024-09-12T18:30:50.407478+0000","last_peered":"2024-09-12T18:30:50.407478+0000","last_clean":"2024-09-12T18:30:50.407478+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:30:50.407478+0000","last_undegraded":"2024-09-12T18:30:50.407478+0000","last_fullsized":"2024-09-12T18:30:50.407478+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:30.116005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'330","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:40.955328+0000","last_change":"2024-09-12T17:36:16.048265+0000","last_active":"2024-09-12T18:32:40.955328+0000","last_peered":"2024-09-12T18:32:40.955328+0000","last_clean":"2024-09-12T18:32:40.955328+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:32:40.955328+0000","last_undegraded":"2024-09-12T18:32:40.955328+0000","last_fullsized":"2024-09-12T18:32:40.955328+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:28.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10990092,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":23815,"num_write":1174,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418824+0000","last_change":"2024-09-12T17:35:44.897503+0000","last_active":"2024-09-12T18:29:57.418824+0000","last_peered":"2024-09-12T18:29:57.418824+0000","last_clean":"2024-09-12T18:29:57.418824+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:29:57.418824+0000","last_undegraded":"2024-09-12T18:29:57.418824+0000","last_fullsized":"2024-09-12T18:29:57.418824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.732782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'360","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.676108+0000","last_change":"2024-09-12T17:35:47.466030+0000","last_active":"2024-09-12T18:32:12.676108+0000","last_peered":"2024-09-12T18:32:12.676108+0000","last_clean":"2024-09-12T18:32:12.676108+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:32:12.676108+0000","last_undegraded":"2024-09-12T18:32:12.676108+0000","last_fullsized":"2024-09-12T18:32:12.676108+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:23.136183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54972,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":1027,"num_write":448,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610510+0000","last_change":"2024-09-12T17:35:48.908512+0000","last_active":"2024-09-12T18:29:52.610510+0000","last_peered":"2024-09-12T18:29:52.610510+0000","last_clean":"2024-09-12T18:29:52.610510+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:29:52.610510+0000","last_undegraded":"2024-09-12T18:29:52.610510+0000","last_fullsized":"2024-09-12T18:29:52.610510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:43.347490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'584","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.244085+0000","last_change":"2024-09-12T17:35:50.922799+0000","last_active":"2024-09-12T18:32:50.244085+0000","last_peered":"2024-09-12T18:32:50.244085+0000","last_clean":"2024-09-12T18:32:50.244085+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:32:50.244085+0000","last_undegraded":"2024-09-12T18:32:50.244085+0000","last_fullsized":"2024-09-12T18:32:50.244085+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:24.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'543","reported_seq":2019,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812212+0000","last_change":"2024-09-12T17:35:42.902988+0000","last_active":"2024-09-12T18:30:18.812212+0000","last_peered":"2024-09-12T18:30:18.812212+0000","last_clean":"2024-09-12T18:30:18.812212+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:30:18.812212+0000","last_undegraded":"2024-09-12T18:30:18.812212+0000","last_fullsized":"2024-09-12T18:30:18.812212+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:13.896842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'334","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419879+0000","last_change":"2024-09-12T17:36:16.051846+0000","last_active":"2024-09-12T18:30:17.419879+0000","last_peered":"2024-09-12T18:30:17.419879+0000","last_clean":"2024-09-12T18:30:17.419879+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:30:17.419879+0000","last_undegraded":"2024-09-12T18:30:17.419879+0000","last_fullsized":"2024-09-12T18:30:17.419879+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.618855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057479,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":623,"num_read_kb":15946,"num_write":1172,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510551+0000","last_change":"2024-09-12T17:35:44.891784+0000","last_active":"2024-09-12T18:29:57.510551+0000","last_peered":"2024-09-12T18:29:57.510551+0000","last_clean":"2024-09-12T18:29:57.510551+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:29:57.510551+0000","last_undegraded":"2024-09-12T18:29:57.510551+0000","last_fullsized":"2024-09-12T18:29:57.510551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:27.255253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'268","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433730+0000","last_change":"2024-09-12T17:35:46.896008+0000","last_active":"2024-09-12T18:32:02.433730+0000","last_peered":"2024-09-12T18:32:02.433730+0000","last_clean":"2024-09-12T18:32:02.433730+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:32:02.433730+0000","last_undegraded":"2024-09-12T18:32:02.433730+0000","last_fullsized":"2024-09-12T18:32:02.433730+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:57.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":924,"num_write":360,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419734+0000","last_change":"2024-09-12T17:35:48.898203+0000","last_active":"2024-09-12T18:30:17.419734+0000","last_peered":"2024-09-12T18:30:17.419734+0000","last_clean":"2024-09-12T18:30:17.419734+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:30:17.419734+0000","last_undegraded":"2024-09-12T18:30:17.419734+0000","last_fullsized":"2024-09-12T18:30:17.419734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:47.877509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2398","reported_seq":4235,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:17.444594+0000","last_change":"2024-09-12T17:35:50.921094+0000","last_active":"2024-09-12T18:32:17.444594+0000","last_peered":"2024-09-12T18:32:17.444594+0000","last_clean":"2024-09-12T18:32:17.444594+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:32:17.444594+0000","last_undegraded":"2024-09-12T18:32:17.444594+0000","last_fullsized":"2024-09-12T18:32:17.444594+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.702558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1122","reported_seq":2583,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.526751+0000","last_change":"2024-09-12T17:35:42.900928+0000","last_active":"2024-09-12T18:30:04.526751+0000","last_peered":"2024-09-12T18:30:04.526751+0000","last_clean":"2024-09-12T18:30:04.526751+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:30:04.526751+0000","last_undegraded":"2024-09-12T18:30:04.526751+0000","last_fullsized":"2024-09-12T18:30:04.526751+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:07.706166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'273","reported_seq":943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513103+0000","last_change":"2024-09-12T17:36:16.050004+0000","last_active":"2024-09-12T18:30:17.513103+0000","last_peered":"2024-09-12T18:30:17.513103+0000","last_clean":"2024-09-12T18:30:17.513103+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:30:17.513103+0000","last_undegraded":"2024-09-12T18:30:17.513103+0000","last_fullsized":"2024-09-12T18:30:17.513103+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:23.922359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22753830,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":185869,"num_write":1087,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509529+0000","last_change":"2024-09-12T17:35:44.893925+0000","last_active":"2024-09-12T18:29:47.509529+0000","last_peered":"2024-09-12T18:29:47.509529+0000","last_clean":"2024-09-12T18:29:47.509529+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:29:47.509529+0000","last_undegraded":"2024-09-12T18:29:47.509529+0000","last_fullsized":"2024-09-12T18:29:47.509529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:20.847625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'319","reported_seq":900,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.442591+0000","last_change":"2024-09-12T17:35:46.899126+0000","last_active":"2024-09-12T18:32:07.442591+0000","last_peered":"2024-09-12T18:32:07.442591+0000","last_clean":"2024-09-12T18:32:07.442591+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:32:07.442591+0000","last_undegraded":"2024-09-12T18:32:07.442591+0000","last_fullsized":"2024-09-12T18:32:07.442591+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.188366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60888,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":1029,"num_write":422,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'787","reported_seq":4755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118750+0000","last_change":"2024-09-12T17:35:48.902303+0000","last_active":"2024-09-12T18:32:53.118750+0000","last_peered":"2024-09-12T18:32:53.118750+0000","last_clean":"2024-09-12T18:32:53.118750+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:32:53.118750+0000","last_undegraded":"2024-09-12T18:32:53.118750+0000","last_fullsized":"2024-09-12T18:32:53.118750+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:31.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'116","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.214430+0000","last_change":"2024-09-12T17:35:50.916330+0000","last_active":"2024-09-12T18:32:48.214430+0000","last_peered":"2024-09-12T18:32:48.214430+0000","last_clean":"2024-09-12T18:32:48.214430+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:32:48.214430+0000","last_undegraded":"2024-09-12T18:32:48.214430+0000","last_fullsized":"2024-09-12T18:32:48.214430+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.967026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'517","reported_seq":2158,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816091+0000","last_change":"2024-09-12T17:35:42.892720+0000","last_active":"2024-09-12T18:30:18.816091+0000","last_peered":"2024-09-12T18:30:18.816091+0000","last_clean":"2024-09-12T18:30:18.816091+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:30:18.816091+0000","last_undegraded":"2024-09-12T18:30:18.816091+0000","last_fullsized":"2024-09-12T18:30:18.816091+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:01.659398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'289","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.006585+0000","last_change":"2024-09-12T17:35:40.893097+0000","last_active":"2024-09-12T18:29:58.006585+0000","last_peered":"2024-09-12T18:29:58.006585+0000","last_clean":"2024-09-12T18:29:58.006585+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:29:58.006585+0000","last_undegraded":"2024-09-12T18:29:58.006585+0000","last_fullsized":"2024-09-12T18:29:58.006585+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:49.867087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713755,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":11855,"num_write":1164,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.511826+0000","last_change":"2024-09-12T17:35:44.893352+0000","last_active":"2024-09-12T18:30:07.511826+0000","last_peered":"2024-09-12T18:30:07.511826+0000","last_clean":"2024-09-12T18:30:07.511826+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:30:07.511826+0000","last_undegraded":"2024-09-12T18:30:07.511826+0000","last_fullsized":"2024-09-12T18:30:07.511826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:24.100202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'470","reported_seq":1094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.211076+0000","last_change":"2024-09-12T17:35:46.894868+0000","last_active":"2024-09-12T18:32:50.211076+0000","last_peered":"2024-09-12T18:32:50.211076+0000","last_clean":"2024-09-12T18:32:50.211076+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:32:50.211076+0000","last_undegraded":"2024-09-12T18:32:50.211076+0000","last_fullsized":"2024-09-12T18:32:50.211076+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:02.326426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122300,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":1816,"num_write":682,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.511164+0000","last_change":"2024-09-12T17:35:48.901213+0000","last_active":"2024-09-12T18:30:02.511164+0000","last_peered":"2024-09-12T18:30:02.511164+0000","last_clean":"2024-09-12T18:30:02.511164+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:30:02.511164+0000","last_undegraded":"2024-09-12T18:30:02.511164+0000","last_fullsized":"2024-09-12T18:30:02.511164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.829487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'162","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611795+0000","last_change":"2024-09-12T17:35:50.911833+0000","last_active":"2024-09-12T18:30:02.611795+0000","last_peered":"2024-09-12T18:30:02.611795+0000","last_clean":"2024-09-12T18:30:02.611795+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:30:02.611795+0000","last_undegraded":"2024-09-12T18:30:02.611795+0000","last_fullsized":"2024-09-12T18:30:02.611795+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:29.046424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'552","reported_seq":2191,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305005+0000","last_change":"2024-09-12T17:35:42.900912+0000","last_active":"2024-09-12T18:31:28.305005+0000","last_peered":"2024-09-12T18:31:28.305005+0000","last_clean":"2024-09-12T18:31:28.305005+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:31:28.305005+0000","last_undegraded":"2024-09-12T18:31:28.305005+0000","last_fullsized":"2024-09-12T18:31:28.305005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:06.952203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'325","reported_seq":1146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415392+0000","last_change":"2024-09-12T17:35:40.888502+0000","last_active":"2024-09-12T18:29:42.415392+0000","last_peered":"2024-09-12T18:29:42.415392+0000","last_clean":"2024-09-12T18:29:42.415392+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:29:42.415392+0000","last_undegraded":"2024-09-12T18:29:42.415392+0000","last_fullsized":"2024-09-12T18:29:42.415392+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70436,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":896,"num_read_kb":1817,"num_write":1187,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509559+0000","last_change":"2024-09-12T17:35:44.894374+0000","last_active":"2024-09-12T18:29:47.509559+0000","last_peered":"2024-09-12T18:29:47.509559+0000","last_clean":"2024-09-12T18:29:47.509559+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:29:47.509559+0000","last_undegraded":"2024-09-12T18:29:47.509559+0000","last_fullsized":"2024-09-12T18:29:47.509559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:37.315095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'288","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.212211+0000","last_change":"2024-09-12T17:35:46.899081+0000","last_active":"2024-09-12T18:32:50.212211+0000","last_peered":"2024-09-12T18:32:50.212211+0000","last_clean":"2024-09-12T18:32:50.212211+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:32:50.212211+0000","last_undegraded":"2024-09-12T18:32:50.212211+0000","last_fullsized":"2024-09-12T18:32:50.212211+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:12.067500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":956,"num_write":438,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846238+0000","last_change":"2024-09-12T17:35:48.902048+0000","last_active":"2024-09-12T18:29:57.846238+0000","last_peered":"2024-09-12T18:29:57.846238+0000","last_clean":"2024-09-12T18:29:57.846238+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:29:57.846238+0000","last_undegraded":"2024-09-12T18:29:57.846238+0000","last_fullsized":"2024-09-12T18:29:57.846238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:02.774589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'94","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.488770+0000","last_change":"2024-09-12T17:35:50.921798+0000","last_active":"2024-09-12T18:32:38.488770+0000","last_peered":"2024-09-12T18:32:38.488770+0000","last_clean":"2024-09-12T18:32:38.488770+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:32:38.488770+0000","last_undegraded":"2024-09-12T18:32:38.488770+0000","last_fullsized":"2024-09-12T18:32:38.488770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:56.715205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'569","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812211+0000","last_change":"2024-09-12T17:35:42.891518+0000","last_active":"2024-09-12T18:30:18.812211+0000","last_peered":"2024-09-12T18:30:18.812211+0000","last_clean":"2024-09-12T18:30:18.812211+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:30:18.812211+0000","last_undegraded":"2024-09-12T18:30:18.812211+0000","last_fullsized":"2024-09-12T18:30:18.812211+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.251539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'292","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419688+0000","last_change":"2024-09-12T17:35:40.894104+0000","last_active":"2024-09-12T18:30:02.419688+0000","last_peered":"2024-09-12T18:30:02.419688+0000","last_clean":"2024-09-12T18:30:02.419688+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:30:02.419688+0000","last_undegraded":"2024-09-12T18:30:02.419688+0000","last_fullsized":"2024-09-12T18:30:02.419688+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:58.765499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11543540,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":452,"num_read_kb":30147,"num_write":1073,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"36'5","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.360065+0000","last_change":"2024-09-12T17:35:44.898322+0000","last_active":"2024-09-12T18:32:49.360065+0000","last_peered":"2024-09-12T18:32:49.360065+0000","last_clean":"2024-09-12T18:32:49.360065+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:32:49.360065+0000","last_undegraded":"2024-09-12T18:32:49.360065+0000","last_fullsized":"2024-09-12T18:32:49.360065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:56.912777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'309","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.526103+0000","last_change":"2024-09-12T17:35:46.902352+0000","last_active":"2024-09-12T18:32:12.526103+0000","last_peered":"2024-09-12T18:32:12.526103+0000","last_clean":"2024-09-12T18:32:12.526103+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:32:12.526103+0000","last_undegraded":"2024-09-12T18:32:12.526103+0000","last_fullsized":"2024-09-12T18:32:12.526103+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:39.492378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":983,"num_write":406,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118910+0000","last_change":"2024-09-12T17:35:48.906082+0000","last_active":"2024-09-12T18:32:53.118910+0000","last_peered":"2024-09-12T18:32:53.118910+0000","last_clean":"2024-09-12T18:32:53.118910+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:32:53.118910+0000","last_undegraded":"2024-09-12T18:32:53.118910+0000","last_fullsized":"2024-09-12T18:32:53.118910+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:57.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'132","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.193519+0000","last_change":"2024-09-12T17:35:50.909941+0000","last_active":"2024-09-12T18:31:27.193519+0000","last_peered":"2024-09-12T18:31:27.193519+0000","last_clean":"2024-09-12T18:31:27.193519+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:31:27.193519+0000","last_undegraded":"2024-09-12T18:31:27.193519+0000","last_fullsized":"2024-09-12T18:31:27.193519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:20.080003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'391","reported_seq":1810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812238+0000","last_change":"2024-09-12T17:35:42.899041+0000","last_active":"2024-09-12T18:30:18.812238+0000","last_peered":"2024-09-12T18:30:18.812238+0000","last_clean":"2024-09-12T18:30:18.812238+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:30:18.812238+0000","last_undegraded":"2024-09-12T18:30:18.812238+0000","last_fullsized":"2024-09-12T18:30:18.812238+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:37.507108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'279","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.504928+0000","last_change":"2024-09-12T17:35:40.904599+0000","last_active":"2024-09-12T18:33:03.504928+0000","last_peered":"2024-09-12T18:33:03.504928+0000","last_clean":"2024-09-12T18:33:03.504928+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:03.504928+0000","last_undegraded":"2024-09-12T18:33:03.504928+0000","last_fullsized":"2024-09-12T18:33:03.504928+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.738624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769033,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":4238,"num_write":1089,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1442,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.371226+0000","last_change":"2024-09-12T17:35:44.898038+0000","last_active":"2024-09-12T18:32:49.371226+0000","last_peered":"2024-09-12T18:32:49.371226+0000","last_clean":"2024-09-12T18:32:49.371226+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:32:49.371226+0000","last_undegraded":"2024-09-12T18:32:49.371226+0000","last_fullsized":"2024-09-12T18:32:49.371226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:34.625148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'95","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416056+0000","last_change":"2024-09-12T17:35:47.464847+0000","last_active":"2024-09-12T18:29:47.416056+0000","last_peered":"2024-09-12T18:29:47.416056+0000","last_clean":"2024-09-12T18:29:47.416056+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:29:47.416056+0000","last_undegraded":"2024-09-12T18:29:47.416056+0000","last_fullsized":"2024-09-12T18:29:47.416056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:21.681360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'777","reported_seq":2599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130536+0000","last_change":"2024-09-12T17:35:48.904923+0000","last_active":"2024-09-12T18:32:53.130536+0000","last_peered":"2024-09-12T18:32:53.130536+0000","last_clean":"2024-09-12T18:32:53.130536+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:32:53.130536+0000","last_undegraded":"2024-09-12T18:32:53.130536+0000","last_fullsized":"2024-09-12T18:32:53.130536+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.107183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'108","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.539421+0000","last_change":"2024-09-12T17:35:50.910651+0000","last_active":"2024-09-12T18:30:03.539421+0000","last_peered":"2024-09-12T18:30:03.539421+0000","last_clean":"2024-09-12T18:30:03.539421+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:30:03.539421+0000","last_undegraded":"2024-09-12T18:30:03.539421+0000","last_fullsized":"2024-09-12T18:30:03.539421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'456","reported_seq":2050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.354919+0000","last_change":"2024-09-12T17:35:42.893296+0000","last_active":"2024-09-12T18:30:02.354919+0000","last_peered":"2024-09-12T18:30:02.354919+0000","last_clean":"2024-09-12T18:30:02.354919+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:30:02.354919+0000","last_undegraded":"2024-09-12T18:30:02.354919+0000","last_fullsized":"2024-09-12T18:30:02.354919+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.897104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'296","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.495418+0000","last_change":"2024-09-12T17:35:40.887751+0000","last_active":"2024-09-12T18:32:47.495418+0000","last_peered":"2024-09-12T18:32:47.495418+0000","last_clean":"2024-09-12T18:32:47.495418+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:32:47.495418+0000","last_undegraded":"2024-09-12T18:32:47.495418+0000","last_fullsized":"2024-09-12T18:32:47.495418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:38.884936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6630172,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":548,"num_read_kb":18792,"num_write":968,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:48.537562+0000","last_change":"2024-09-12T17:35:44.894399+0000","last_active":"2024-09-12T18:29:48.537562+0000","last_peered":"2024-09-12T18:29:48.537562+0000","last_clean":"2024-09-12T18:29:48.537562+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:29:48.537562+0000","last_undegraded":"2024-09-12T18:29:48.537562+0000","last_fullsized":"2024-09-12T18:29:48.537562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:44.105931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'346","reported_seq":949,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674692+0000","last_change":"2024-09-12T17:35:46.899125+0000","last_active":"2024-09-12T18:32:02.674692+0000","last_peered":"2024-09-12T18:32:02.674692+0000","last_clean":"2024-09-12T18:32:02.674692+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:32:02.674692+0000","last_undegraded":"2024-09-12T18:32:02.674692+0000","last_fullsized":"2024-09-12T18:32:02.674692+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:44.324703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61834,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":560,"num_read_kb":1050,"num_write":442,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417912+0000","last_change":"2024-09-12T17:35:48.906391+0000","last_active":"2024-09-12T18:29:52.417912+0000","last_peered":"2024-09-12T18:29:52.417912+0000","last_clean":"2024-09-12T18:29:52.417912+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:29:52.417912+0000","last_undegraded":"2024-09-12T18:29:52.417912+0000","last_fullsized":"2024-09-12T18:29:52.417912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.195528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'123","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.371706+0000","last_change":"2024-09-12T17:35:50.921659+0000","last_active":"2024-09-12T18:30:12.371706+0000","last_peered":"2024-09-12T18:30:12.371706+0000","last_clean":"2024-09-12T18:30:12.371706+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:30:12.371706+0000","last_undegraded":"2024-09-12T18:30:12.371706+0000","last_fullsized":"2024-09-12T18:30:12.371706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:51.201223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'925","reported_seq":2656,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440823+0000","last_change":"2024-09-12T17:35:42.902610+0000","last_active":"2024-09-12T18:30:15.440823+0000","last_peered":"2024-09-12T18:30:15.440823+0000","last_clean":"2024-09-12T18:30:15.440823+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:30:15.440823+0000","last_undegraded":"2024-09-12T18:30:15.440823+0000","last_fullsized":"2024-09-12T18:30:15.440823+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":900,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:15.705104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.414933+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T18:29:37.414933+0000","last_peered":"2024-09-12T18:29:37.414933+0000","last_clean":"2024-09-12T18:29:37.414933+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:29:37.414933+0000","last_undegraded":"2024-09-12T18:29:37.414933+0000","last_fullsized":"2024-09-12T18:29:37.414933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.654007+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T18:29:42.654007+0000","last_peered":"2024-09-12T18:29:42.654007+0000","last_clean":"2024-09-12T18:29:42.654007+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:29:42.654007+0000","last_undegraded":"2024-09-12T18:29:42.654007+0000","last_fullsized":"2024-09-12T18:29:42.654007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'257","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.416631+0000","last_change":"2024-09-12T17:35:40.885469+0000","last_active":"2024-09-12T18:29:52.416631+0000","last_peered":"2024-09-12T18:29:52.416631+0000","last_clean":"2024-09-12T18:29:52.416631+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:29:52.416631+0000","last_undegraded":"2024-09-12T18:29:52.416631+0000","last_fullsized":"2024-09-12T18:29:52.416631+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.530648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8332815,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":367,"num_read_kb":16539,"num_write":953,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418918+0000","last_change":"2024-09-12T17:35:44.896284+0000","last_active":"2024-09-12T18:29:57.418918+0000","last_peered":"2024-09-12T18:29:57.418918+0000","last_clean":"2024-09-12T18:29:57.418918+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:29:57.418918+0000","last_undegraded":"2024-09-12T18:29:57.418918+0000","last_fullsized":"2024-09-12T18:29:57.418918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.136280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'709","reported_seq":1394,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.229222+0000","last_change":"2024-09-12T17:35:46.902551+0000","last_active":"2024-09-12T18:32:50.229222+0000","last_peered":"2024-09-12T18:32:50.229222+0000","last_clean":"2024-09-12T18:32:50.229222+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:32:50.229222+0000","last_undegraded":"2024-09-12T18:32:50.229222+0000","last_fullsized":"2024-09-12T18:32:50.229222+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:53.419712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1383,"num_read_kb":2857,"num_write":1316,"num_write_kb":1178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846900+0000","last_change":"2024-09-12T17:35:48.901898+0000","last_active":"2024-09-12T18:30:02.846900+0000","last_peered":"2024-09-12T18:30:02.846900+0000","last_clean":"2024-09-12T18:30:02.846900+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:30:02.846900+0000","last_undegraded":"2024-09-12T18:30:02.846900+0000","last_fullsized":"2024-09-12T18:30:02.846900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'186","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.265154+0000","last_change":"2024-09-12T17:35:50.921223+0000","last_active":"2024-09-12T18:31:29.265154+0000","last_peered":"2024-09-12T18:31:29.265154+0000","last_clean":"2024-09-12T18:31:29.265154+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:31:29.265154+0000","last_undegraded":"2024-09-12T18:31:29.265154+0000","last_fullsized":"2024-09-12T18:31:29.265154+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.825503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'773","reported_seq":2219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978406+0000","last_change":"2024-09-12T17:35:42.900821+0000","last_active":"2024-09-12T18:30:25.978406+0000","last_peered":"2024-09-12T18:30:25.978406+0000","last_clean":"2024-09-12T18:30:25.978406+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:30:25.978406+0000","last_undegraded":"2024-09-12T18:30:25.978406+0000","last_fullsized":"2024-09-12T18:30:25.978406+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:57.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415813+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T18:29:42.415813+0000","last_peered":"2024-09-12T18:29:42.415813+0000","last_clean":"2024-09-12T18:29:42.415813+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:29:42.415813+0000","last_undegraded":"2024-09-12T18:29:42.415813+0000","last_fullsized":"2024-09-12T18:29:42.415813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'287","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845332+0000","last_change":"2024-09-12T17:35:40.899267+0000","last_active":"2024-09-12T18:29:52.845332+0000","last_peered":"2024-09-12T18:29:52.845332+0000","last_clean":"2024-09-12T18:29:52.845332+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:29:52.845332+0000","last_undegraded":"2024-09-12T18:29:52.845332+0000","last_fullsized":"2024-09-12T18:29:52.845332+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.692194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6086703,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":435,"num_read_kb":8966,"num_write":1060,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656378+0000","last_change":"2024-09-12T17:35:44.895852+0000","last_active":"2024-09-12T18:29:57.656378+0000","last_peered":"2024-09-12T18:29:57.656378+0000","last_clean":"2024-09-12T18:29:57.656378+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:29:57.656378+0000","last_undegraded":"2024-09-12T18:29:57.656378+0000","last_fullsized":"2024-09-12T18:29:57.656378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1288","reported_seq":2894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.112381+0000","last_change":"2024-09-12T17:35:46.899606+0000","last_active":"2024-09-12T18:32:53.112381+0000","last_peered":"2024-09-12T18:32:53.112381+0000","last_clean":"2024-09-12T18:32:53.112381+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:32:53.112381+0000","last_undegraded":"2024-09-12T18:32:53.112381+0000","last_fullsized":"2024-09-12T18:32:53.112381+0000","mapping_epoch":30,"log_start":"262'1200","ondisk_log_start":"262'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:45.048964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179822,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2027,"num_read_kb":3519,"num_write":1158,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.421442+0000","last_change":"2024-09-12T17:35:48.903717+0000","last_active":"2024-09-12T18:30:12.421442+0000","last_peered":"2024-09-12T18:30:12.421442+0000","last_clean":"2024-09-12T18:30:12.421442+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:30:12.421442+0000","last_undegraded":"2024-09-12T18:30:12.421442+0000","last_fullsized":"2024-09-12T18:30:12.421442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:26.731204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'253","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.259283+0000","last_change":"2024-09-12T17:35:51.345599+0000","last_active":"2024-09-12T18:31:29.259283+0000","last_peered":"2024-09-12T18:31:29.259283+0000","last_clean":"2024-09-12T18:31:29.259283+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:31:29.259283+0000","last_undegraded":"2024-09-12T18:31:29.259283+0000","last_fullsized":"2024-09-12T18:31:29.259283+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.606088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'489","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304547+0000","last_change":"2024-09-12T17:35:42.897417+0000","last_active":"2024-09-12T18:31:28.304547+0000","last_peered":"2024-09-12T18:31:28.304547+0000","last_clean":"2024-09-12T18:31:28.304547+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:31:28.304547+0000","last_undegraded":"2024-09-12T18:31:28.304547+0000","last_fullsized":"2024-09-12T18:31:28.304547+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:48.996327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.508930+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T18:29:42.508930+0000","last_peered":"2024-09-12T18:29:42.508930+0000","last_clean":"2024-09-12T18:29:42.508930+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:29:42.508930+0000","last_undegraded":"2024-09-12T18:29:42.508930+0000","last_fullsized":"2024-09-12T18:29:42.508930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'280","reported_seq":905,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.226667+0000","last_change":"2024-09-12T17:35:40.892528+0000","last_active":"2024-09-12T18:30:16.226667+0000","last_peered":"2024-09-12T18:30:16.226667+0000","last_clean":"2024-09-12T18:30:16.226667+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:30:16.226667+0000","last_undegraded":"2024-09-12T18:30:16.226667+0000","last_fullsized":"2024-09-12T18:30:16.226667+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:49.177521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9467039,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":442,"num_read_kb":5597,"num_write":1095,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510633+0000","last_change":"2024-09-12T17:35:44.894603+0000","last_active":"2024-09-12T18:29:57.510633+0000","last_peered":"2024-09-12T18:29:57.510633+0000","last_clean":"2024-09-12T18:29:57.510633+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:29:57.510633+0000","last_undegraded":"2024-09-12T18:29:57.510633+0000","last_fullsized":"2024-09-12T18:29:57.510633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:34.593008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'261","reported_seq":1487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.728475+0000","last_change":"2024-09-12T17:35:47.465906+0000","last_active":"2024-09-12T18:32:47.728475+0000","last_peered":"2024-09-12T18:32:47.728475+0000","last_clean":"2024-09-12T18:32:47.728475+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:32:47.728475+0000","last_undegraded":"2024-09-12T18:32:47.728475+0000","last_fullsized":"2024-09-12T18:32:47.728475+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:51.604150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846850+0000","last_change":"2024-09-12T17:35:48.900323+0000","last_active":"2024-09-12T18:30:02.846850+0000","last_peered":"2024-09-12T18:30:02.846850+0000","last_clean":"2024-09-12T18:30:02.846850+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:30:02.846850+0000","last_undegraded":"2024-09-12T18:30:02.846850+0000","last_fullsized":"2024-09-12T18:30:02.846850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:55.834585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'282","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.403339+0000","last_change":"2024-09-12T17:35:50.910605+0000","last_active":"2024-09-12T18:31:29.403339+0000","last_peered":"2024-09-12T18:31:29.403339+0000","last_clean":"2024-09-12T18:31:29.403339+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:31:29.403339+0000","last_undegraded":"2024-09-12T18:31:29.403339+0000","last_fullsized":"2024-09-12T18:31:29.403339+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:55.444849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'395","reported_seq":1861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610548+0000","last_change":"2024-09-12T17:35:42.888553+0000","last_active":"2024-09-12T18:29:52.610548+0000","last_peered":"2024-09-12T18:29:52.610548+0000","last_clean":"2024-09-12T18:29:52.610548+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:29:52.610548+0000","last_undegraded":"2024-09-12T18:29:52.610548+0000","last_fullsized":"2024-09-12T18:29:52.610548+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:41.651814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":523,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.653977+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T18:29:42.653977+0000","last_peered":"2024-09-12T18:29:42.653977+0000","last_clean":"2024-09-12T18:29:42.653977+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:29:42.653977+0000","last_undegraded":"2024-09-12T18:29:42.653977+0000","last_fullsized":"2024-09-12T18:29:42.653977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'265","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.535233+0000","last_change":"2024-09-12T17:35:40.895684+0000","last_active":"2024-09-12T18:33:03.535233+0000","last_peered":"2024-09-12T18:33:03.535233+0000","last_clean":"2024-09-12T18:33:03.535233+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:03.535233+0000","last_undegraded":"2024-09-12T18:33:03.535233+0000","last_fullsized":"2024-09-12T18:33:03.535233+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:57.907352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6124397,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":406,"num_read_kb":24675,"num_write":957,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846866+0000","last_change":"2024-09-12T17:35:44.894175+0000","last_active":"2024-09-12T18:30:02.846866+0000","last_peered":"2024-09-12T18:30:02.846866+0000","last_clean":"2024-09-12T18:30:02.846866+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:30:02.846866+0000","last_undegraded":"2024-09-12T18:30:02.846866+0000","last_fullsized":"2024-09-12T18:30:02.846866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:36.440643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'127","reported_seq":670,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.434575+0000","last_change":"2024-09-12T17:35:46.901548+0000","last_active":"2024-09-12T18:32:07.434575+0000","last_peered":"2024-09-12T18:32:07.434575+0000","last_clean":"2024-09-12T18:32:07.434575+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:32:07.434575+0000","last_undegraded":"2024-09-12T18:32:07.434575+0000","last_fullsized":"2024-09-12T18:32:07.434575+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.552114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419806+0000","last_change":"2024-09-12T17:35:48.903992+0000","last_active":"2024-09-12T18:30:02.419806+0000","last_peered":"2024-09-12T18:30:02.419806+0000","last_clean":"2024-09-12T18:30:02.419806+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:30:02.419806+0000","last_undegraded":"2024-09-12T18:30:02.419806+0000","last_fullsized":"2024-09-12T18:30:02.419806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.680834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.983301+0000","last_change":"2024-09-12T17:35:50.920568+0000","last_active":"2024-09-12T18:30:25.983301+0000","last_peered":"2024-09-12T18:30:25.983301+0000","last_clean":"2024-09-12T18:30:25.983301+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:30:25.983301+0000","last_undegraded":"2024-09-12T18:30:25.983301+0000","last_fullsized":"2024-09-12T18:30:25.983301+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.171883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'752","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.367704+0000","last_change":"2024-09-12T17:35:42.897300+0000","last_active":"2024-09-12T18:32:48.367704+0000","last_peered":"2024-09-12T18:32:48.367704+0000","last_clean":"2024-09-12T18:32:48.367704+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:32:48.367704+0000","last_undegraded":"2024-09-12T18:32:48.367704+0000","last_fullsized":"2024-09-12T18:32:48.367704+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:37.575175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'270","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656323+0000","last_change":"2024-09-12T17:35:40.898323+0000","last_active":"2024-09-12T18:29:57.656323+0000","last_peered":"2024-09-12T18:29:57.656323+0000","last_clean":"2024-09-12T18:29:57.656323+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:29:57.656323+0000","last_undegraded":"2024-09-12T18:29:57.656323+0000","last_fullsized":"2024-09-12T18:29:57.656323+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:02.559929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5573432,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":16635,"num_write":1056,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609344+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T18:29:42.609344+0000","last_peered":"2024-09-12T18:29:42.609344+0000","last_clean":"2024-09-12T18:29:42.609344+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:29:42.609344+0000","last_undegraded":"2024-09-12T18:29:42.609344+0000","last_fullsized":"2024-09-12T18:29:42.609344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846145+0000","last_change":"2024-09-12T17:35:44.897241+0000","last_active":"2024-09-12T18:29:57.846145+0000","last_peered":"2024-09-12T18:29:57.846145+0000","last_clean":"2024-09-12T18:29:57.846145+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:29:57.846145+0000","last_undegraded":"2024-09-12T18:29:57.846145+0000","last_fullsized":"2024-09-12T18:29:57.846145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:54.095785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'558","reported_seq":1218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.221233+0000","last_change":"2024-09-12T17:35:46.896066+0000","last_active":"2024-09-12T18:32:50.221233+0000","last_peered":"2024-09-12T18:32:50.221233+0000","last_clean":"2024-09-12T18:32:50.221233+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:32:50.221233+0000","last_undegraded":"2024-09-12T18:32:50.221233+0000","last_fullsized":"2024-09-12T18:32:50.221233+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.503068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110507,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1550,"num_read_kb":2487,"num_write":2030,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538876+0000","last_change":"2024-09-12T17:35:48.894684+0000","last_active":"2024-09-12T18:29:58.538876+0000","last_peered":"2024-09-12T18:29:58.538876+0000","last_clean":"2024-09-12T18:29:58.538876+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:29:58.538876+0000","last_undegraded":"2024-09-12T18:29:58.538876+0000","last_fullsized":"2024-09-12T18:29:58.538876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:49.417148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'108","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.266811+0000","last_change":"2024-09-12T17:35:51.346736+0000","last_active":"2024-09-12T18:31:26.266811+0000","last_peered":"2024-09-12T18:31:26.266811+0000","last_clean":"2024-09-12T18:31:26.266811+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:31:26.266811+0000","last_undegraded":"2024-09-12T18:31:26.266811+0000","last_fullsized":"2024-09-12T18:31:26.266811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:44.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1006","reported_seq":2568,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.696514+0000","last_change":"2024-09-12T17:35:42.894625+0000","last_active":"2024-09-12T18:30:18.696514+0000","last_peered":"2024-09-12T18:30:18.696514+0000","last_clean":"2024-09-12T18:30:18.696514+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:30:18.696514+0000","last_undegraded":"2024-09-12T18:30:18.696514+0000","last_fullsized":"2024-09-12T18:30:18.696514+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'310","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.763506+0000","last_change":"2024-09-12T17:35:40.893165+0000","last_active":"2024-09-12T18:30:03.763506+0000","last_peered":"2024-09-12T18:30:03.763506+0000","last_clean":"2024-09-12T18:30:03.763506+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:30:03.763506+0000","last_undegraded":"2024-09-12T18:30:03.763506+0000","last_fullsized":"2024-09-12T18:30:03.763506+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:35.842097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3551983,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":488,"num_read_kb":48347,"num_write":1107,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417867+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T18:29:52.417867+0000","last_peered":"2024-09-12T18:29:52.417867+0000","last_clean":"2024-09-12T18:29:52.417867+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:29:52.417867+0000","last_undegraded":"2024-09-12T18:29:52.417867+0000","last_fullsized":"2024-09-12T18:29:52.417867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418796+0000","last_change":"2024-09-12T17:35:44.893378+0000","last_active":"2024-09-12T18:29:57.418796+0000","last_peered":"2024-09-12T18:29:57.418796+0000","last_clean":"2024-09-12T18:29:57.418796+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:29:57.418796+0000","last_undegraded":"2024-09-12T18:29:57.418796+0000","last_fullsized":"2024-09-12T18:29:57.418796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:00.649691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'201","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.324384+0000","last_change":"2024-09-12T17:35:47.465022+0000","last_active":"2024-09-12T18:31:52.324384+0000","last_peered":"2024-09-12T18:31:52.324384+0000","last_clean":"2024-09-12T18:31:52.324384+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:31:52.324384+0000","last_undegraded":"2024-09-12T18:31:52.324384+0000","last_fullsized":"2024-09-12T18:31:52.324384+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:20.452871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'781","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131630+0000","last_change":"2024-09-12T17:35:48.905261+0000","last_active":"2024-09-12T18:32:53.131630+0000","last_peered":"2024-09-12T18:32:53.131630+0000","last_clean":"2024-09-12T18:32:53.131630+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:32:53.131630+0000","last_undegraded":"2024-09-12T18:32:53.131630+0000","last_fullsized":"2024-09-12T18:32:53.131630+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:47.769518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'442","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977350+0000","last_change":"2024-09-12T17:35:42.883869+0000","last_active":"2024-09-12T18:30:25.977350+0000","last_peered":"2024-09-12T18:30:25.977350+0000","last_clean":"2024-09-12T18:30:25.977350+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:30:25.977350+0000","last_undegraded":"2024-09-12T18:30:25.977350+0000","last_fullsized":"2024-09-12T18:30:25.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:13.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'282","reported_seq":933,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.856883+0000","last_change":"2024-09-12T17:35:40.889008+0000","last_active":"2024-09-12T18:32:41.856883+0000","last_peered":"2024-09-12T18:32:41.856883+0000","last_clean":"2024-09-12T18:32:41.856883+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:32:41.856883+0000","last_undegraded":"2024-09-12T18:32:41.856883+0000","last_fullsized":"2024-09-12T18:32:41.856883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:41.906990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16127089,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":454,"num_read_kb":50118,"num_write":999,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609379+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T18:29:42.609379+0000","last_peered":"2024-09-12T18:29:42.609379+0000","last_clean":"2024-09-12T18:29:42.609379+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:29:42.609379+0000","last_undegraded":"2024-09-12T18:29:42.609379+0000","last_fullsized":"2024-09-12T18:29:42.609379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538843+0000","last_change":"2024-09-12T17:35:44.889025+0000","last_active":"2024-09-12T18:29:58.538843+0000","last_peered":"2024-09-12T18:29:58.538843+0000","last_clean":"2024-09-12T18:29:58.538843+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:29:58.538843+0000","last_undegraded":"2024-09-12T18:29:58.538843+0000","last_fullsized":"2024-09-12T18:29:58.538843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:25.842079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'113","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538898+0000","last_change":"2024-09-12T17:35:46.896908+0000","last_active":"2024-09-12T18:29:58.538898+0000","last_peered":"2024-09-12T18:29:58.538898+0000","last_clean":"2024-09-12T18:29:58.538898+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:29:58.538898+0000","last_undegraded":"2024-09-12T18:29:58.538898+0000","last_fullsized":"2024-09-12T18:29:58.538898+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:22.911858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'812","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131172+0000","last_change":"2024-09-12T17:35:48.900105+0000","last_active":"2024-09-12T18:32:53.131172+0000","last_peered":"2024-09-12T18:32:53.131172+0000","last_clean":"2024-09-12T18:32:53.131172+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:32:53.131172+0000","last_undegraded":"2024-09-12T18:32:53.131172+0000","last_fullsized":"2024-09-12T18:32:53.131172+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:30.882725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'184","reported_seq":689,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845406+0000","last_change":"2024-09-12T17:35:50.910752+0000","last_active":"2024-09-12T18:29:52.845406+0000","last_peered":"2024-09-12T18:29:52.845406+0000","last_clean":"2024-09-12T18:29:52.845406+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:29:52.845406+0000","last_undegraded":"2024-09-12T18:29:52.845406+0000","last_fullsized":"2024-09-12T18:29:52.845406+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.734993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'538","reported_seq":2142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.549252+0000","last_change":"2024-09-12T17:35:42.895619+0000","last_active":"2024-09-12T18:29:58.549252+0000","last_peered":"2024-09-12T18:29:58.549252+0000","last_clean":"2024-09-12T18:29:58.549252+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:29:58.549252+0000","last_undegraded":"2024-09-12T18:29:58.549252+0000","last_fullsized":"2024-09-12T18:29:58.549252+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'252","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.861440+0000","last_change":"2024-09-12T17:35:40.896218+0000","last_active":"2024-09-12T18:32:02.861440+0000","last_peered":"2024-09-12T18:32:02.861440+0000","last_clean":"2024-09-12T18:32:02.861440+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:32:02.861440+0000","last_undegraded":"2024-09-12T18:32:02.861440+0000","last_fullsized":"2024-09-12T18:32:02.861440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:29.873178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8697643,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":403,"num_read_kb":18058,"num_write":1001,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415941+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T18:29:42.415941+0000","last_peered":"2024-09-12T18:29:42.415941+0000","last_clean":"2024-09-12T18:29:42.415941+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:29:42.415941+0000","last_undegraded":"2024-09-12T18:29:42.415941+0000","last_fullsized":"2024-09-12T18:29:42.415941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417831+0000","last_change":"2024-09-12T17:35:44.893144+0000","last_active":"2024-09-12T18:30:02.417831+0000","last_peered":"2024-09-12T18:30:02.417831+0000","last_clean":"2024-09-12T18:30:02.417831+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:30:02.417831+0000","last_undegraded":"2024-09-12T18:30:02.417831+0000","last_fullsized":"2024-09-12T18:30:02.417831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:31.642197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'704","reported_seq":1408,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.217041+0000","last_change":"2024-09-12T17:35:47.464888+0000","last_active":"2024-09-12T18:32:50.217041+0000","last_peered":"2024-09-12T18:32:50.217041+0000","last_clean":"2024-09-12T18:32:50.217041+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:32:50.217041+0000","last_undegraded":"2024-09-12T18:32:50.217041+0000","last_fullsized":"2024-09-12T18:32:50.217041+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1250,"num_read_kb":2682,"num_write":1026,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417876+0000","last_change":"2024-09-12T17:35:48.899057+0000","last_active":"2024-09-12T18:30:02.417876+0000","last_peered":"2024-09-12T18:30:02.417876+0000","last_clean":"2024-09-12T18:30:02.417876+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:30:02.417876+0000","last_undegraded":"2024-09-12T18:30:02.417876+0000","last_fullsized":"2024-09-12T18:30:02.417876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:39.593576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'129","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655594+0000","last_change":"2024-09-12T17:35:50.924579+0000","last_active":"2024-09-12T18:29:52.655594+0000","last_peered":"2024-09-12T18:29:52.655594+0000","last_clean":"2024-09-12T18:29:52.655594+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:29:52.655594+0000","last_undegraded":"2024-09-12T18:29:52.655594+0000","last_fullsized":"2024-09-12T18:29:52.655594+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:27.853643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.346697+0000","last_change":"2024-09-12T17:35:50.923096+0000","last_active":"2024-09-12T18:31:29.346697+0000","last_peered":"2024-09-12T18:31:29.346697+0000","last_clean":"2024-09-12T18:31:29.346697+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:31:29.346697+0000","last_undegraded":"2024-09-12T18:31:29.346697+0000","last_fullsized":"2024-09-12T18:31:29.346697+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:15.866908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'395","reported_seq":1898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812218+0000","last_change":"2024-09-12T17:35:42.898207+0000","last_active":"2024-09-12T18:30:18.812218+0000","last_peered":"2024-09-12T18:30:18.812218+0000","last_clean":"2024-09-12T18:30:18.812218+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:30:18.812218+0000","last_undegraded":"2024-09-12T18:30:18.812218+0000","last_fullsized":"2024-09-12T18:30:18.812218+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:18.941988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'266","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.417543+0000","last_change":"2024-09-12T17:35:40.904851+0000","last_active":"2024-09-12T18:33:03.417543+0000","last_peered":"2024-09-12T18:33:03.417543+0000","last_clean":"2024-09-12T18:33:03.417543+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:03.417543+0000","last_undegraded":"2024-09-12T18:33:03.417543+0000","last_fullsized":"2024-09-12T18:33:03.417543+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730295,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":458,"num_read_kb":63909,"num_write":944,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607639+0000","last_change":"2024-09-12T17:35:44.898123+0000","last_active":"2024-09-12T18:29:27.607639+0000","last_peered":"2024-09-12T18:29:27.607639+0000","last_clean":"2024-09-12T18:29:27.607639+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:29:27.607639+0000","last_undegraded":"2024-09-12T18:29:27.607639+0000","last_fullsized":"2024-09-12T18:29:27.607639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:45.043204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'257","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431678+0000","last_change":"2024-09-12T17:35:46.898039+0000","last_active":"2024-09-12T18:31:47.431678+0000","last_peered":"2024-09-12T18:31:47.431678+0000","last_clean":"2024-09-12T18:31:47.431678+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:31:47.431678+0000","last_undegraded":"2024-09-12T18:31:47.431678+0000","last_fullsized":"2024-09-12T18:31:47.431678+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.270815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":883,"num_write":350,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414122+0000","last_change":"2024-09-12T17:35:48.899309+0000","last_active":"2024-09-12T18:29:32.414122+0000","last_peered":"2024-09-12T18:29:32.414122+0000","last_clean":"2024-09-12T18:29:32.414122+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:29:32.414122+0000","last_undegraded":"2024-09-12T18:29:32.414122+0000","last_fullsized":"2024-09-12T18:29:32.414122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:50.941565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'974","reported_seq":2454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136707+0000","last_change":"2024-09-12T17:35:42.896669+0000","last_active":"2024-09-12T18:31:29.136707+0000","last_peered":"2024-09-12T18:31:29.136707+0000","last_clean":"2024-09-12T18:31:29.136707+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:31:29.136707+0000","last_undegraded":"2024-09-12T18:31:29.136707+0000","last_fullsized":"2024-09-12T18:31:29.136707+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'324","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.407043+0000","last_change":"2024-09-12T17:35:40.886913+0000","last_active":"2024-09-12T18:28:52.407043+0000","last_peered":"2024-09-12T18:28:52.407043+0000","last_clean":"2024-09-12T18:28:52.407043+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:28:52.407043+0000","last_undegraded":"2024-09-12T18:28:52.407043+0000","last_fullsized":"2024-09-12T18:28:52.407043+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330038,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":540,"num_read_kb":8296,"num_write":1065,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.361026+0000","last_change":"2024-09-12T17:35:44.893880+0000","last_active":"2024-09-12T18:32:49.361026+0000","last_peered":"2024-09-12T18:32:49.361026+0000","last_clean":"2024-09-12T18:32:49.361026+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:32:49.361026+0000","last_undegraded":"2024-09-12T18:32:49.361026+0000","last_fullsized":"2024-09-12T18:32:49.361026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:43.603787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'55","reported_seq":559,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842309+0000","last_change":"2024-09-12T17:35:46.898981+0000","last_active":"2024-09-12T18:29:27.842309+0000","last_peered":"2024-09-12T18:29:27.842309+0000","last_clean":"2024-09-12T18:29:27.842309+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:29:27.842309+0000","last_undegraded":"2024-09-12T18:29:27.842309+0000","last_fullsized":"2024-09-12T18:29:27.842309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414052+0000","last_change":"2024-09-12T17:35:48.906133+0000","last_active":"2024-09-12T18:29:32.414052+0000","last_peered":"2024-09-12T18:29:32.414052+0000","last_clean":"2024-09-12T18:29:32.414052+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:29:32.414052+0000","last_undegraded":"2024-09-12T18:29:32.414052+0000","last_fullsized":"2024-09-12T18:29:32.414052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:11.783795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'186","reported_seq":721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.272851+0000","last_change":"2024-09-12T17:35:50.911342+0000","last_active":"2024-09-12T18:31:28.272851+0000","last_peered":"2024-09-12T18:31:28.272851+0000","last_clean":"2024-09-12T18:31:28.272851+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:31:28.272851+0000","last_undegraded":"2024-09-12T18:31:28.272851+0000","last_fullsized":"2024-09-12T18:31:28.272851+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.588084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'555","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.135761+0000","last_change":"2024-09-12T17:35:42.894287+0000","last_active":"2024-09-12T18:31:29.135761+0000","last_peered":"2024-09-12T18:31:29.135761+0000","last_clean":"2024-09-12T18:31:29.135761+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:31:29.135761+0000","last_undegraded":"2024-09-12T18:31:29.135761+0000","last_fullsized":"2024-09-12T18:31:29.135761+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:58.138070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'310","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.887094+0000","last_change":"2024-09-12T17:35:40.895963+0000","last_active":"2024-09-12T18:30:11.887094+0000","last_peered":"2024-09-12T18:30:11.887094+0000","last_clean":"2024-09-12T18:30:11.887094+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:30:11.887094+0000","last_undegraded":"2024-09-12T18:30:11.887094+0000","last_fullsized":"2024-09-12T18:30:11.887094+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:58.280652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243102,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":616,"num_read_kb":8072,"num_write":1122,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413192+0000","last_change":"2024-09-12T17:35:44.899119+0000","last_active":"2024-09-12T18:29:27.413192+0000","last_peered":"2024-09-12T18:29:27.413192+0000","last_clean":"2024-09-12T18:29:27.413192+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:29:27.413192+0000","last_undegraded":"2024-09-12T18:29:27.413192+0000","last_fullsized":"2024-09-12T18:29:27.413192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.437374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'314","reported_seq":899,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431724+0000","last_change":"2024-09-12T17:35:46.899592+0000","last_active":"2024-09-12T18:31:47.431724+0000","last_peered":"2024-09-12T18:31:47.431724+0000","last_clean":"2024-09-12T18:31:47.431724+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:31:47.431724+0000","last_undegraded":"2024-09-12T18:31:47.431724+0000","last_fullsized":"2024-09-12T18:31:47.431724+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:41.130246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59724,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1059,"num_write":432,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414094+0000","last_change":"2024-09-12T17:35:48.904071+0000","last_active":"2024-09-12T18:29:32.414094+0000","last_peered":"2024-09-12T18:29:32.414094+0000","last_clean":"2024-09-12T18:29:32.414094+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:29:32.414094+0000","last_undegraded":"2024-09-12T18:29:32.414094+0000","last_fullsized":"2024-09-12T18:29:32.414094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.350511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'98","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642138+0000","last_change":"2024-09-12T17:35:50.921087+0000","last_active":"2024-09-12T18:28:22.642138+0000","last_peered":"2024-09-12T18:28:22.642138+0000","last_clean":"2024-09-12T18:28:22.642138+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:28:22.642138+0000","last_undegraded":"2024-09-12T18:28:22.642138+0000","last_fullsized":"2024-09-12T18:28:22.642138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:26.137184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1026","reported_seq":2665,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.546129+0000","last_change":"2024-09-12T17:35:42.891619+0000","last_active":"2024-09-12T18:29:58.546129+0000","last_peered":"2024-09-12T18:29:58.546129+0000","last_clean":"2024-09-12T18:29:58.546129+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:29:58.546129+0000","last_undegraded":"2024-09-12T18:29:58.546129+0000","last_fullsized":"2024-09-12T18:29:58.546129+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:44.416070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'299","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704736+0000","last_change":"2024-09-12T17:35:40.898320+0000","last_active":"2024-09-12T18:30:52.704736+0000","last_peered":"2024-09-12T18:30:52.704736+0000","last_clean":"2024-09-12T18:30:52.704736+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:30:52.704736+0000","last_undegraded":"2024-09-12T18:30:52.704736+0000","last_fullsized":"2024-09-12T18:30:52.704736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:44.296291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12671351,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":396,"num_read_kb":38177,"num_write":1010,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413134+0000","last_change":"2024-09-12T17:35:44.895748+0000","last_active":"2024-09-12T18:29:27.413134+0000","last_peered":"2024-09-12T18:29:27.413134+0000","last_clean":"2024-09-12T18:29:27.413134+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:29:27.413134+0000","last_undegraded":"2024-09-12T18:29:27.413134+0000","last_fullsized":"2024-09-12T18:29:27.413134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'271","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.439171+0000","last_change":"2024-09-12T17:35:46.899948+0000","last_active":"2024-09-12T18:31:47.439171+0000","last_peered":"2024-09-12T18:31:47.439171+0000","last_clean":"2024-09-12T18:31:47.439171+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:31:47.439171+0000","last_undegraded":"2024-09-12T18:31:47.439171+0000","last_fullsized":"2024-09-12T18:31:47.439171+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.546669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":906,"num_write":362,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.842896+0000","last_change":"2024-09-12T17:35:48.900909+0000","last_active":"2024-09-12T18:29:32.842896+0000","last_peered":"2024-09-12T18:29:32.842896+0000","last_clean":"2024-09-12T18:29:32.842896+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:29:32.842896+0000","last_undegraded":"2024-09-12T18:29:32.842896+0000","last_fullsized":"2024-09-12T18:29:32.842896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.781603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'860","reported_seq":2482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417988+0000","last_change":"2024-09-12T17:35:42.896175+0000","last_active":"2024-09-12T18:29:52.417988+0000","last_peered":"2024-09-12T18:29:52.417988+0000","last_clean":"2024-09-12T18:29:52.417988+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:29:52.417988+0000","last_undegraded":"2024-09-12T18:29:52.417988+0000","last_fullsized":"2024-09-12T18:29:52.417988+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:52.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'288","reported_seq":1015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408784+0000","last_change":"2024-09-12T17:35:40.884915+0000","last_active":"2024-09-12T18:28:52.408784+0000","last_peered":"2024-09-12T18:28:52.408784+0000","last_clean":"2024-09-12T18:28:52.408784+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:28:52.408784+0000","last_undegraded":"2024-09-12T18:28:52.408784+0000","last_fullsized":"2024-09-12T18:28:52.408784+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:51.644098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9465428,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":695,"num_read_kb":5768,"num_write":928,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845447+0000","last_change":"2024-09-12T17:35:44.897738+0000","last_active":"2024-09-12T18:29:52.845447+0000","last_peered":"2024-09-12T18:29:52.845447+0000","last_clean":"2024-09-12T18:29:52.845447+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:29:52.845447+0000","last_undegraded":"2024-09-12T18:29:52.845447+0000","last_fullsized":"2024-09-12T18:29:52.845447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:43.811251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'488","reported_seq":1108,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.213392+0000","last_change":"2024-09-12T17:35:46.899736+0000","last_active":"2024-09-12T18:32:50.213392+0000","last_peered":"2024-09-12T18:32:50.213392+0000","last_clean":"2024-09-12T18:32:50.213392+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:32:50.213392+0000","last_undegraded":"2024-09-12T18:32:50.213392+0000","last_fullsized":"2024-09-12T18:32:50.213392+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:36.496520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":849,"num_read_kb":1857,"num_write":740,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642155+0000","last_change":"2024-09-12T17:35:48.900061+0000","last_active":"2024-09-12T18:28:22.642155+0000","last_peered":"2024-09-12T18:28:22.642155+0000","last_clean":"2024-09-12T18:28:22.642155+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:28:22.642155+0000","last_undegraded":"2024-09-12T18:28:22.642155+0000","last_fullsized":"2024-09-12T18:28:22.642155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:58.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'164","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.297167+0000","last_change":"2024-09-12T17:35:51.347046+0000","last_active":"2024-09-12T18:31:28.297167+0000","last_peered":"2024-09-12T18:31:28.297167+0000","last_clean":"2024-09-12T18:31:28.297167+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:31:28.297167+0000","last_undegraded":"2024-09-12T18:31:28.297167+0000","last_fullsized":"2024-09-12T18:31:28.297167+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.856381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'775","reported_seq":2167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305413+0000","last_change":"2024-09-12T17:35:42.896418+0000","last_active":"2024-09-12T18:31:28.305413+0000","last_peered":"2024-09-12T18:31:28.305413+0000","last_clean":"2024-09-12T18:31:28.305413+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:31:28.305413+0000","last_undegraded":"2024-09-12T18:31:28.305413+0000","last_fullsized":"2024-09-12T18:31:28.305413+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.201642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'239","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.096421+0000","last_change":"2024-09-12T17:35:40.892252+0000","last_active":"2024-09-12T18:29:46.096421+0000","last_peered":"2024-09-12T18:29:46.096421+0000","last_clean":"2024-09-12T18:29:46.096421+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:29:46.096421+0000","last_undegraded":"2024-09-12T18:29:46.096421+0000","last_fullsized":"2024-09-12T18:29:46.096421+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:53.303511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8074671,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":379,"num_read_kb":28092,"num_write":930,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418873+0000","last_change":"2024-09-12T17:35:44.897834+0000","last_active":"2024-09-12T18:29:57.418873+0000","last_peered":"2024-09-12T18:29:57.418873+0000","last_clean":"2024-09-12T18:29:57.418873+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:29:57.418873+0000","last_undegraded":"2024-09-12T18:29:57.418873+0000","last_fullsized":"2024-09-12T18:29:57.418873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:52.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'321","reported_seq":898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:35:46.899505+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.056459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73750,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1098,"num_write":464,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.600262+0000","last_change":"2024-09-12T17:35:48.906992+0000","last_active":"2024-09-12T18:28:22.600262+0000","last_peered":"2024-09-12T18:28:22.600262+0000","last_clean":"2024-09-12T18:28:22.600262+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:28:22.600262+0000","last_undegraded":"2024-09-12T18:28:22.600262+0000","last_fullsized":"2024-09-12T18:28:22.600262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.979695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'197","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.615415+0000","last_change":"2024-09-12T17:35:50.916243+0000","last_active":"2024-09-12T18:31:26.615415+0000","last_peered":"2024-09-12T18:31:26.615415+0000","last_clean":"2024-09-12T18:31:26.615415+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:31:26.615415+0000","last_undegraded":"2024-09-12T18:31:26.615415+0000","last_fullsized":"2024-09-12T18:31:26.615415+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:37.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1293","reported_seq":2864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.360743+0000","last_change":"2024-09-12T17:35:42.890895+0000","last_active":"2024-09-12T18:32:48.360743+0000","last_peered":"2024-09-12T18:32:48.360743+0000","last_clean":"2024-09-12T18:32:48.360743+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:32:48.360743+0000","last_undegraded":"2024-09-12T18:32:48.360743+0000","last_fullsized":"2024-09-12T18:32:48.360743+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:52.254143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'251","reported_seq":859,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.491622+0000","last_change":"2024-09-12T17:35:40.904317+0000","last_active":"2024-09-12T18:33:03.491622+0000","last_peered":"2024-09-12T18:33:03.491622+0000","last_clean":"2024-09-12T18:33:03.491622+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:03.491622+0000","last_undegraded":"2024-09-12T18:33:03.491622+0000","last_fullsized":"2024-09-12T18:33:03.491622+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:35.506278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4527971,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":361,"num_read_kb":10892,"num_write":921,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525199+0000","last_change":"2024-09-12T17:35:44.893724+0000","last_active":"2024-09-12T18:28:18.525199+0000","last_peered":"2024-09-12T18:28:18.525199+0000","last_clean":"2024-09-12T18:28:18.525199+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:28:18.525199+0000","last_undegraded":"2024-09-12T18:28:18.525199+0000","last_fullsized":"2024-09-12T18:28:18.525199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:31.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'286","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433877+0000","last_change":"2024-09-12T17:35:47.464841+0000","last_active":"2024-09-12T18:32:02.433877+0000","last_peered":"2024-09-12T18:32:02.433877+0000","last_clean":"2024-09-12T18:32:02.433877+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:32:02.433877+0000","last_undegraded":"2024-09-12T18:32:02.433877+0000","last_fullsized":"2024-09-12T18:32:02.433877+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:30.514600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":965,"num_write":388,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.612492+0000","last_change":"2024-09-12T17:35:48.901108+0000","last_active":"2024-09-12T18:30:07.612492+0000","last_peered":"2024-09-12T18:30:07.612492+0000","last_clean":"2024-09-12T18:30:07.612492+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:30:07.612492+0000","last_undegraded":"2024-09-12T18:30:07.612492+0000","last_fullsized":"2024-09-12T18:30:07.612492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:24.864398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'134","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.243540+0000","last_change":"2024-09-12T17:35:50.924276+0000","last_active":"2024-09-12T18:32:50.243540+0000","last_peered":"2024-09-12T18:32:50.243540+0000","last_clean":"2024-09-12T18:32:50.243540+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:32:50.243540+0000","last_undegraded":"2024-09-12T18:32:50.243540+0000","last_fullsized":"2024-09-12T18:32:50.243540+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:54.892800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'547","reported_seq":2157,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.118099+0000","last_change":"2024-09-12T17:35:42.885892+0000","last_active":"2024-09-12T18:31:29.118099+0000","last_peered":"2024-09-12T18:31:29.118099+0000","last_clean":"2024-09-12T18:31:29.118099+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:31:29.118099+0000","last_undegraded":"2024-09-12T18:31:29.118099+0000","last_fullsized":"2024-09-12T18:31:29.118099+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:40.576868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'304","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832170+0000","last_change":"2024-09-12T17:35:40.890946+0000","last_active":"2024-09-12T18:28:12.832170+0000","last_peered":"2024-09-12T18:28:12.832170+0000","last_clean":"2024-09-12T18:28:12.832170+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:28:12.832170+0000","last_undegraded":"2024-09-12T18:28:12.832170+0000","last_fullsized":"2024-09-12T18:28:12.832170+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:09.696514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18138792,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":531,"num_read_kb":50516,"num_write":1159,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.599620+0000","last_change":"2024-09-12T17:35:44.898107+0000","last_active":"2024-09-12T18:28:17.599620+0000","last_peered":"2024-09-12T18:28:17.599620+0000","last_clean":"2024-09-12T18:28:17.599620+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:28:17.599620+0000","last_undegraded":"2024-09-12T18:28:17.599620+0000","last_fullsized":"2024-09-12T18:28:17.599620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:05.181659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'103","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538945+0000","last_change":"2024-09-12T17:35:47.464849+0000","last_active":"2024-09-12T18:29:58.538945+0000","last_peered":"2024-09-12T18:29:58.538945+0000","last_clean":"2024-09-12T18:29:58.538945+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:29:58.538945+0000","last_undegraded":"2024-09-12T18:29:58.538945+0000","last_fullsized":"2024-09-12T18:29:58.538945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:58.141528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'776","reported_seq":4138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130542+0000","last_change":"2024-09-12T17:35:48.900442+0000","last_active":"2024-09-12T18:32:53.130542+0000","last_peered":"2024-09-12T18:32:53.130542+0000","last_clean":"2024-09-12T18:32:53.130542+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:32:53.130542+0000","last_undegraded":"2024-09-12T18:32:53.130542+0000","last_fullsized":"2024-09-12T18:32:53.130542+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:15.114968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.761165+0000","last_change":"2024-09-12T17:35:50.922214+0000","last_active":"2024-09-12T18:29:46.761165+0000","last_peered":"2024-09-12T18:29:46.761165+0000","last_clean":"2024-09-12T18:29:46.761165+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:29:46.761165+0000","last_undegraded":"2024-09-12T18:29:46.761165+0000","last_fullsized":"2024-09-12T18:29:46.761165+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.526052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'765","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651768+0000","last_change":"2024-09-12T17:35:42.900581+0000","last_active":"2024-09-12T18:30:10.651768+0000","last_peered":"2024-09-12T18:30:10.651768+0000","last_clean":"2024-09-12T18:30:10.651768+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:30:10.651768+0000","last_undegraded":"2024-09-12T18:30:10.651768+0000","last_fullsized":"2024-09-12T18:30:10.651768+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:13.276710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'271","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.447105+0000","last_change":"2024-09-12T17:36:16.051163+0000","last_active":"2024-09-12T18:29:38.447105+0000","last_peered":"2024-09-12T18:29:38.447105+0000","last_clean":"2024-09-12T18:29:38.447105+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:29:38.447105+0000","last_undegraded":"2024-09-12T18:29:38.447105+0000","last_fullsized":"2024-09-12T18:29:38.447105+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:40.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13954640,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":50614,"num_write":1000,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400910+0000","last_change":"2024-09-12T17:35:44.899845+0000","last_active":"2024-09-12T18:28:17.400910+0000","last_peered":"2024-09-12T18:28:17.400910+0000","last_clean":"2024-09-12T18:28:17.400910+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:28:17.400910+0000","last_undegraded":"2024-09-12T18:28:17.400910+0000","last_fullsized":"2024-09-12T18:28:17.400910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:48.236755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'302","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.971777+0000","last_change":"2024-09-12T17:35:46.897904+0000","last_active":"2024-09-12T18:32:43.971777+0000","last_peered":"2024-09-12T18:32:43.971777+0000","last_clean":"2024-09-12T18:32:43.971777+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:32:43.971777+0000","last_undegraded":"2024-09-12T18:32:43.971777+0000","last_fullsized":"2024-09-12T18:32:43.971777+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:11.348372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56114,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":971,"num_write":408,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839380+0000","last_change":"2024-09-12T17:35:48.900397+0000","last_active":"2024-09-12T18:29:02.839380+0000","last_peered":"2024-09-12T18:29:02.839380+0000","last_clean":"2024-09-12T18:29:02.839380+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:29:02.839380+0000","last_undegraded":"2024-09-12T18:29:02.839380+0000","last_fullsized":"2024-09-12T18:29:02.839380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:17.530372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'122","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.269926+0000","last_change":"2024-09-12T17:35:50.921023+0000","last_active":"2024-09-12T18:31:26.269926+0000","last_peered":"2024-09-12T18:31:26.269926+0000","last_clean":"2024-09-12T18:31:26.269926+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:31:26.269926+0000","last_undegraded":"2024-09-12T18:31:26.269926+0000","last_fullsized":"2024-09-12T18:31:26.269926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:23.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'393","reported_seq":1990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977717+0000","last_change":"2024-09-12T17:35:42.899906+0000","last_active":"2024-09-12T18:30:25.977717+0000","last_peered":"2024-09-12T18:30:25.977717+0000","last_clean":"2024-09-12T18:30:25.977717+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:30:25.977717+0000","last_undegraded":"2024-09-12T18:30:25.977717+0000","last_fullsized":"2024-09-12T18:30:25.977717+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:41.974957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'280","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.442329+0000","last_change":"2024-09-12T17:35:40.902378+0000","last_active":"2024-09-12T18:30:50.442329+0000","last_peered":"2024-09-12T18:30:50.442329+0000","last_clean":"2024-09-12T18:30:50.442329+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:30:50.442329+0000","last_undegraded":"2024-09-12T18:30:50.442329+0000","last_fullsized":"2024-09-12T18:30:50.442329+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:21.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15276485,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":36010,"num_write":996,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641108+0000","last_change":"2024-09-12T17:35:44.895548+0000","last_active":"2024-09-12T18:28:17.641108+0000","last_peered":"2024-09-12T18:28:17.641108+0000","last_clean":"2024-09-12T18:28:17.641108+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:28:17.641108+0000","last_undegraded":"2024-09-12T18:28:17.641108+0000","last_fullsized":"2024-09-12T18:28:17.641108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.590737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'281","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855784+0000","last_change":"2024-09-12T17:35:46.894996+0000","last_active":"2024-09-12T18:31:22.855784+0000","last_peered":"2024-09-12T18:31:22.855784+0000","last_clean":"2024-09-12T18:31:22.855784+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:31:22.855784+0000","last_undegraded":"2024-09-12T18:31:22.855784+0000","last_fullsized":"2024-09-12T18:31:22.855784+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:53.303510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61214,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":949,"num_write":376,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410641+0000","last_change":"2024-09-12T17:35:48.901220+0000","last_active":"2024-09-12T18:29:12.410641+0000","last_peered":"2024-09-12T18:29:12.410641+0000","last_clean":"2024-09-12T18:29:12.410641+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:29:12.410641+0000","last_undegraded":"2024-09-12T18:29:12.410641+0000","last_fullsized":"2024-09-12T18:29:12.410641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:24.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.746414+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:28.746414+0000","last_peered":"2024-09-12T18:31:28.746414+0000","last_clean":"2024-09-12T18:31:28.746414+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:28.746414+0000","last_undegraded":"2024-09-12T18:31:28.746414+0000","last_fullsized":"2024-09-12T18:31:28.746414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:21.959973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'539","reported_seq":2090,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.693922+0000","last_change":"2024-09-12T17:35:42.886124+0000","last_active":"2024-09-12T18:30:18.693922+0000","last_peered":"2024-09-12T18:30:18.693922+0000","last_clean":"2024-09-12T18:30:18.693922+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:30:18.693922+0000","last_undegraded":"2024-09-12T18:30:18.693922+0000","last_fullsized":"2024-09-12T18:30:18.693922+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'306","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.234586+0000","last_change":"2024-09-12T17:36:16.051402+0000","last_active":"2024-09-12T18:30:16.234586+0000","last_peered":"2024-09-12T18:30:16.234586+0000","last_clean":"2024-09-12T18:30:16.234586+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:30:16.234586+0000","last_undegraded":"2024-09-12T18:30:16.234586+0000","last_fullsized":"2024-09-12T18:30:16.234586+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:10.073958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7871569,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":463,"num_read_kb":33965,"num_write":1040,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530433+0000","last_change":"2024-09-12T17:35:44.891585+0000","last_active":"2024-09-12T18:28:58.530433+0000","last_peered":"2024-09-12T18:28:58.530433+0000","last_clean":"2024-09-12T18:28:58.530433+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:28:58.530433+0000","last_undegraded":"2024-09-12T18:28:58.530433+0000","last_fullsized":"2024-09-12T18:28:58.530433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:53.135715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'265","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.423689+0000","last_change":"2024-09-12T17:35:46.899537+0000","last_active":"2024-09-12T18:30:47.423689+0000","last_peered":"2024-09-12T18:30:47.423689+0000","last_clean":"2024-09-12T18:30:47.423689+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:30:47.423689+0000","last_undegraded":"2024-09-12T18:30:47.423689+0000","last_fullsized":"2024-09-12T18:30:47.423689+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:08.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":1002,"num_write":386,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525166+0000","last_change":"2024-09-12T17:35:48.902756+0000","last_active":"2024-09-12T18:28:18.525166+0000","last_peered":"2024-09-12T18:28:18.525166+0000","last_clean":"2024-09-12T18:28:18.525166+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:28:18.525166+0000","last_undegraded":"2024-09-12T18:28:18.525166+0000","last_fullsized":"2024-09-12T18:28:18.525166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:23.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'144","reported_seq":1246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.225226+0000","last_change":"2024-09-12T17:35:50.916082+0000","last_active":"2024-09-12T18:31:26.225226+0000","last_peered":"2024-09-12T18:31:26.225226+0000","last_clean":"2024-09-12T18:31:26.225226+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:31:26.225226+0000","last_undegraded":"2024-09-12T18:31:26.225226+0000","last_fullsized":"2024-09-12T18:31:26.225226+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:10.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'492","reported_seq":2047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.110427+0000","last_change":"2024-09-12T17:35:42.899320+0000","last_active":"2024-09-12T18:31:29.110427+0000","last_peered":"2024-09-12T18:31:29.110427+0000","last_clean":"2024-09-12T18:31:29.110427+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:31:29.110427+0000","last_undegraded":"2024-09-12T18:31:29.110427+0000","last_fullsized":"2024-09-12T18:31:29.110427+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:24.186327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'301","reported_seq":960,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.878475+0000","last_change":"2024-09-12T17:35:40.900130+0000","last_active":"2024-09-12T18:30:11.878475+0000","last_peered":"2024-09-12T18:30:11.878475+0000","last_clean":"2024-09-12T18:30:11.878475+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:30:11.878475+0000","last_undegraded":"2024-09-12T18:30:11.878475+0000","last_fullsized":"2024-09-12T18:30:11.878475+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:06.988604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245874,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":491,"num_read_kb":31829,"num_write":1165,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.605775+0000","last_change":"2024-09-12T17:35:44.893851+0000","last_active":"2024-09-12T18:29:12.605775+0000","last_peered":"2024-09-12T18:29:12.605775+0000","last_clean":"2024-09-12T18:29:12.605775+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:29:12.605775+0000","last_undegraded":"2024-09-12T18:29:12.605775+0000","last_fullsized":"2024-09-12T18:29:12.605775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:10.822361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'302","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.237679+0000","last_change":"2024-09-12T17:35:46.902681+0000","last_active":"2024-09-12T18:32:50.237679+0000","last_peered":"2024-09-12T18:32:50.237679+0000","last_clean":"2024-09-12T18:32:50.237679+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:32:50.237679+0000","last_undegraded":"2024-09-12T18:32:50.237679+0000","last_fullsized":"2024-09-12T18:32:50.237679+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:12.683935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":969,"num_write":382,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.834803+0000","last_change":"2024-09-12T17:35:48.902815+0000","last_active":"2024-09-12T18:28:22.834803+0000","last_peered":"2024-09-12T18:28:22.834803+0000","last_clean":"2024-09-12T18:28:22.834803+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:28:22.834803+0000","last_undegraded":"2024-09-12T18:28:22.834803+0000","last_fullsized":"2024-09-12T18:28:22.834803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:32.377869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'125","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.358965+0000","last_change":"2024-09-12T17:35:50.912183+0000","last_active":"2024-09-12T18:32:48.358965+0000","last_peered":"2024-09-12T18:32:48.358965+0000","last_clean":"2024-09-12T18:32:48.358965+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:32:48.358965+0000","last_undegraded":"2024-09-12T18:32:48.358965+0000","last_fullsized":"2024-09-12T18:32:48.358965+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:21.503473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'468","reported_seq":2175,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610600+0000","last_change":"2024-09-12T17:35:42.897252+0000","last_active":"2024-09-12T18:29:52.610600+0000","last_peered":"2024-09-12T18:29:52.610600+0000","last_clean":"2024-09-12T18:29:52.610600+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:29:52.610600+0000","last_undegraded":"2024-09-12T18:29:52.610600+0000","last_fullsized":"2024-09-12T18:29:52.610600+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:51.073547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'311","reported_seq":950,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417749+0000","last_change":"2024-09-12T17:35:40.900262+0000","last_active":"2024-09-12T18:29:52.417749+0000","last_peered":"2024-09-12T18:29:52.417749+0000","last_clean":"2024-09-12T18:29:52.417749+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:29:52.417749+0000","last_undegraded":"2024-09-12T18:29:52.417749+0000","last_fullsized":"2024-09-12T18:29:52.417749+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404889,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":433,"num_read_kb":20625,"num_write":1193,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'529","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.362071+0000","last_change":"2024-09-12T17:35:42.902909+0000","last_active":"2024-09-12T18:32:48.362071+0000","last_peered":"2024-09-12T18:32:48.362071+0000","last_clean":"2024-09-12T18:32:48.362071+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:32:48.362071+0000","last_undegraded":"2024-09-12T18:32:48.362071+0000","last_fullsized":"2024-09-12T18:32:48.362071+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:11.016006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'347","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.510012+0000","last_change":"2024-09-12T17:35:40.886916+0000","last_active":"2024-09-12T18:29:52.510012+0000","last_peered":"2024-09-12T18:29:52.510012+0000","last_clean":"2024-09-12T18:29:52.510012+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:29:52.510012+0000","last_undegraded":"2024-09-12T18:29:52.510012+0000","last_fullsized":"2024-09-12T18:29:52.510012+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.356041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13626055,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":58919,"num_write":1220,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'934","reported_seq":2520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.365913+0000","last_change":"2024-09-12T17:35:42.892077+0000","last_active":"2024-09-12T18:30:12.365913+0000","last_peered":"2024-09-12T18:30:12.365913+0000","last_clean":"2024-09-12T18:30:12.365913+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:30:12.365913+0000","last_undegraded":"2024-09-12T18:30:12.365913+0000","last_fullsized":"2024-09-12T18:30:12.365913+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:05.128987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'308","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:13.878737+0000","last_change":"2024-09-12T17:35:40.887565+0000","last_active":"2024-09-12T18:30:13.878737+0000","last_peered":"2024-09-12T18:30:13.878737+0000","last_clean":"2024-09-12T18:30:13.878737+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:30:13.878737+0000","last_undegraded":"2024-09-12T18:30:13.878737+0000","last_fullsized":"2024-09-12T18:30:13.878737+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:10.621969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780501,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":483,"num_read_kb":34034,"num_write":1073,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'760","reported_seq":2329,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304375+0000","last_change":"2024-09-12T17:35:42.891207+0000","last_active":"2024-09-12T18:31:28.304375+0000","last_peered":"2024-09-12T18:31:28.304375+0000","last_clean":"2024-09-12T18:31:28.304375+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:31:28.304375+0000","last_undegraded":"2024-09-12T18:31:28.304375+0000","last_fullsized":"2024-09-12T18:31:28.304375+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:12.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'300","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.974943+0000","last_change":"2024-09-12T17:35:40.892755+0000","last_active":"2024-09-12T18:32:43.974943+0000","last_peered":"2024-09-12T18:32:43.974943+0000","last_clean":"2024-09-12T18:32:43.974943+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:32:43.974943+0000","last_undegraded":"2024-09-12T18:32:43.974943+0000","last_fullsized":"2024-09-12T18:32:43.974943+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.729813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8402036,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":430,"num_read_kb":12325,"num_write":1045,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.418508+0000","last_change":"2024-09-12T17:35:42.894174+0000","last_active":"2024-09-12T18:30:07.418508+0000","last_peered":"2024-09-12T18:30:07.418508+0000","last_clean":"2024-09-12T18:30:07.418508+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:30:07.418508+0000","last_undegraded":"2024-09-12T18:30:07.418508+0000","last_fullsized":"2024-09-12T18:30:07.418508+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.648231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'299","reported_seq":970,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.701823+0000","last_change":"2024-09-12T17:36:15.950449+0000","last_active":"2024-09-12T18:30:52.701823+0000","last_peered":"2024-09-12T18:30:52.701823+0000","last_clean":"2024-09-12T18:30:52.701823+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:30:52.701823+0000","last_undegraded":"2024-09-12T18:30:52.701823+0000","last_fullsized":"2024-09-12T18:30:52.701823+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:21.732603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21373827,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":430,"num_read_kb":50386,"num_write":994,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'479","reported_seq":2221,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136342+0000","last_change":"2024-09-12T17:35:42.897624+0000","last_active":"2024-09-12T18:31:29.136342+0000","last_peered":"2024-09-12T18:31:29.136342+0000","last_clean":"2024-09-12T18:31:29.136342+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:31:29.136342+0000","last_undegraded":"2024-09-12T18:31:29.136342+0000","last_fullsized":"2024-09-12T18:31:29.136342+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:22.096489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'263","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.773400+0000","last_change":"2024-09-12T17:35:40.893038+0000","last_active":"2024-09-12T18:30:03.773400+0000","last_peered":"2024-09-12T18:30:03.773400+0000","last_clean":"2024-09-12T18:30:03.773400+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:30:03.773400+0000","last_undegraded":"2024-09-12T18:30:03.773400+0000","last_fullsized":"2024-09-12T18:30:03.773400+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:11.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196839,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":482,"num_read_kb":70299,"num_write":944,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'478","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699290+0000","last_change":"2024-09-12T17:35:42.891672+0000","last_active":"2024-09-12T18:30:18.699290+0000","last_peered":"2024-09-12T18:30:18.699290+0000","last_clean":"2024-09-12T18:30:18.699290+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:30:18.699290+0000","last_undegraded":"2024-09-12T18:30:18.699290+0000","last_fullsized":"2024-09-12T18:30:18.699290+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:22.565304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'286","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417962+0000","last_change":"2024-09-12T17:35:40.902619+0000","last_active":"2024-09-12T18:29:52.417962+0000","last_peered":"2024-09-12T18:29:52.417962+0000","last_clean":"2024-09-12T18:29:52.417962+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:29:52.417962+0000","last_undegraded":"2024-09-12T18:29:52.417962+0000","last_fullsized":"2024-09-12T18:29:52.417962+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:31.350419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16083822,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":51065,"num_write":1064,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'540","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.375708+0000","last_change":"2024-09-12T17:35:42.897448+0000","last_active":"2024-09-12T18:32:48.375708+0000","last_peered":"2024-09-12T18:32:48.375708+0000","last_clean":"2024-09-12T18:32:48.375708+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:32:48.375708+0000","last_undegraded":"2024-09-12T18:32:48.375708+0000","last_fullsized":"2024-09-12T18:32:48.375708+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.748388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.163696+0000","last_change":"2024-09-12T17:35:40.883103+0000","last_active":"2024-09-12T18:30:10.163696+0000","last_peered":"2024-09-12T18:30:10.163696+0000","last_clean":"2024-09-12T18:30:10.163696+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:30:10.163696+0000","last_undegraded":"2024-09-12T18:30:10.163696+0000","last_fullsized":"2024-09-12T18:30:10.163696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.291106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831223,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":346,"num_read_kb":37897,"num_write":766,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'583","reported_seq":2406,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651201+0000","last_change":"2024-09-12T17:35:42.902435+0000","last_active":"2024-09-12T18:30:10.651201+0000","last_peered":"2024-09-12T18:30:10.651201+0000","last_clean":"2024-09-12T18:30:10.651201+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:30:10.651201+0000","last_undegraded":"2024-09-12T18:30:10.651201+0000","last_fullsized":"2024-09-12T18:30:10.651201+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.291333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'315","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656191+0000","last_change":"2024-09-12T17:35:40.904096+0000","last_active":"2024-09-12T18:29:57.656191+0000","last_peered":"2024-09-12T18:29:57.656191+0000","last_clean":"2024-09-12T18:29:57.656191+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:29:57.656191+0000","last_undegraded":"2024-09-12T18:29:57.656191+0000","last_fullsized":"2024-09-12T18:29:57.656191+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6648200,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":484,"num_read_kb":34144,"num_write":1082,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1179","reported_seq":2808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698955+0000","last_change":"2024-09-12T17:35:42.893016+0000","last_active":"2024-09-12T18:30:18.698955+0000","last_peered":"2024-09-12T18:30:18.698955+0000","last_clean":"2024-09-12T18:30:18.698955+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:30:18.698955+0000","last_undegraded":"2024-09-12T18:30:18.698955+0000","last_fullsized":"2024-09-12T18:30:18.698955+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:15.472517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'316","reported_seq":1018,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415330+0000","last_change":"2024-09-12T17:35:40.881782+0000","last_active":"2024-09-12T18:29:42.415330+0000","last_peered":"2024-09-12T18:29:42.415330+0000","last_clean":"2024-09-12T18:29:42.415330+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:29:42.415330+0000","last_undegraded":"2024-09-12T18:29:42.415330+0000","last_fullsized":"2024-09-12T18:29:42.415330+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:38.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4996478,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":677,"num_read_kb":17939,"num_write":1117,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'779","reported_seq":2264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527379+0000","last_change":"2024-09-12T17:35:42.898127+0000","last_active":"2024-09-12T18:30:04.527379+0000","last_peered":"2024-09-12T18:30:04.527379+0000","last_clean":"2024-09-12T18:30:04.527379+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:30:04.527379+0000","last_undegraded":"2024-09-12T18:30:04.527379+0000","last_fullsized":"2024-09-12T18:30:04.527379+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.391709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'447","reported_seq":1160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513053+0000","last_change":"2024-09-12T17:36:16.042288+0000","last_active":"2024-09-12T18:30:17.513053+0000","last_peered":"2024-09-12T18:30:17.513053+0000","last_clean":"2024-09-12T18:30:17.513053+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:30:17.513053+0000","last_undegraded":"2024-09-12T18:30:17.513053+0000","last_fullsized":"2024-09-12T18:30:17.513053+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.423582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587447,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":945,"num_read_kb":22424,"num_write":1564,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'507","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.363476+0000","last_change":"2024-09-12T17:35:42.901620+0000","last_active":"2024-09-12T18:32:48.363476+0000","last_peered":"2024-09-12T18:32:48.363476+0000","last_clean":"2024-09-12T18:32:48.363476+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:32:48.363476+0000","last_undegraded":"2024-09-12T18:32:48.363476+0000","last_fullsized":"2024-09-12T18:32:48.363476+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:37.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'259","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.068418+0000","last_change":"2024-09-12T17:35:40.893566+0000","last_active":"2024-09-12T18:30:07.068418+0000","last_peered":"2024-09-12T18:30:07.068418+0000","last_clean":"2024-09-12T18:30:07.068418+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:30:07.068418+0000","last_undegraded":"2024-09-12T18:30:07.068418+0000","last_fullsized":"2024-09-12T18:30:07.068418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.347084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11591057,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":8170,"num_write":933,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'783","reported_seq":2222,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.548109+0000","last_change":"2024-09-12T17:35:42.897318+0000","last_active":"2024-09-12T18:29:58.548109+0000","last_peered":"2024-09-12T18:29:58.548109+0000","last_clean":"2024-09-12T18:29:58.548109+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:29:58.548109+0000","last_undegraded":"2024-09-12T18:29:58.548109+0000","last_fullsized":"2024-09-12T18:29:58.548109+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:59.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'274","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:53.018074+0000","last_change":"2024-09-12T17:35:40.894257+0000","last_active":"2024-09-12T18:30:53.018074+0000","last_peered":"2024-09-12T18:30:53.018074+0000","last_clean":"2024-09-12T18:30:53.018074+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:30:53.018074+0000","last_undegraded":"2024-09-12T18:30:53.018074+0000","last_fullsized":"2024-09-12T18:30:53.018074+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:16.285766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021850,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":424,"num_read_kb":27896,"num_write":1039,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'568","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.439691+0000","last_change":"2024-09-12T17:35:42.900094+0000","last_active":"2024-09-12T18:30:15.439691+0000","last_peered":"2024-09-12T18:30:15.439691+0000","last_clean":"2024-09-12T18:30:15.439691+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:30:15.439691+0000","last_undegraded":"2024-09-12T18:30:15.439691+0000","last_fullsized":"2024-09-12T18:30:15.439691+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.607330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'233","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417896+0000","last_change":"2024-09-12T17:35:40.886954+0000","last_active":"2024-09-12T18:29:52.417896+0000","last_peered":"2024-09-12T18:29:52.417896+0000","last_clean":"2024-09-12T18:29:52.417896+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:29:52.417896+0000","last_undegraded":"2024-09-12T18:29:52.417896+0000","last_fullsized":"2024-09-12T18:29:52.417896+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:46.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315790,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":345,"num_read_kb":4463,"num_write":831,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'520","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.654360+0000","last_change":"2024-09-12T17:35:42.895055+0000","last_active":"2024-09-12T18:30:10.654360+0000","last_peered":"2024-09-12T18:30:10.654360+0000","last_clean":"2024-09-12T18:30:10.654360+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:30:10.654360+0000","last_undegraded":"2024-09-12T18:30:10.654360+0000","last_fullsized":"2024-09-12T18:30:10.654360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:39.969384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'257","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506759+0000","last_change":"2024-09-12T17:35:40.894178+0000","last_active":"2024-09-12T18:29:22.506759+0000","last_peered":"2024-09-12T18:29:22.506759+0000","last_clean":"2024-09-12T18:29:22.506759+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:29:22.506759+0000","last_undegraded":"2024-09-12T18:29:22.506759+0000","last_fullsized":"2024-09-12T18:29:22.506759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:59.754829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535001,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":371,"num_read_kb":27660,"num_write":1012,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'391","reported_seq":1866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.567235+0000","last_change":"2024-09-12T17:36:15.950421+0000","last_active":"2024-09-12T18:30:07.567235+0000","last_peered":"2024-09-12T18:30:07.567235+0000","last_clean":"2024-09-12T18:30:07.567235+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:30:07.567235+0000","last_undegraded":"2024-09-12T18:30:07.567235+0000","last_fullsized":"2024-09-12T18:30:07.567235+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:25.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'268","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.651048+0000","last_change":"2024-09-12T17:35:40.885615+0000","last_active":"2024-09-12T18:29:22.651048+0000","last_peered":"2024-09-12T18:29:22.651048+0000","last_clean":"2024-09-12T18:29:22.651048+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:29:22.651048+0000","last_undegraded":"2024-09-12T18:29:22.651048+0000","last_fullsized":"2024-09-12T18:29:22.651048+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.664147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12856238,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":418,"num_read_kb":34544,"num_write":986,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'307","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650964+0000","last_change":"2024-09-12T17:35:40.892904+0000","last_active":"2024-09-12T18:29:22.650964+0000","last_peered":"2024-09-12T18:29:22.650964+0000","last_clean":"2024-09-12T18:29:22.650964+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:29:22.650964+0000","last_undegraded":"2024-09-12T18:29:22.650964+0000","last_fullsized":"2024-09-12T18:29:22.650964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:46.084095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2677136,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":485,"num_read_kb":6964,"num_write":1060,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1470","reported_seq":2919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.368989+0000","last_change":"2024-09-12T17:35:42.902453+0000","last_active":"2024-09-12T18:32:48.368989+0000","last_peered":"2024-09-12T18:32:48.368989+0000","last_clean":"2024-09-12T18:32:48.368989+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:32:48.368989+0000","last_undegraded":"2024-09-12T18:32:48.368989+0000","last_fullsized":"2024-09-12T18:32:48.368989+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:29.174028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'243","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607000+0000","last_change":"2024-09-12T17:35:40.893486+0000","last_active":"2024-09-12T18:29:22.607000+0000","last_peered":"2024-09-12T18:29:22.607000+0000","last_clean":"2024-09-12T18:29:22.607000+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:29:22.607000+0000","last_undegraded":"2024-09-12T18:29:22.607000+0000","last_fullsized":"2024-09-12T18:29:22.607000+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.422582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7367506,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":395,"num_read_kb":8217,"num_write":916,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1011","reported_seq":2978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.115606+0000","last_change":"2024-09-12T17:35:42.894495+0000","last_active":"2024-09-12T18:31:29.115606+0000","last_peered":"2024-09-12T18:31:29.115606+0000","last_clean":"2024-09-12T18:31:29.115606+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:31:29.115606+0000","last_undegraded":"2024-09-12T18:31:29.115606+0000","last_fullsized":"2024-09-12T18:31:29.115606+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:16.817173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1921320,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17501,"num_read_kb":33196,"num_write":14845,"num_write_kb":11717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":2796682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2181,"ondisk_log_size":2181,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565932576,"num_objects":4458,"num_object_clones":0,"num_object_copies":17832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":32298,"num_read_kb":2030638,"num_write":68048,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812879872,"data_stored":812879872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4348,"ondisk_log_size":4348,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":71442205,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":184607,"num_write":161,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143941632,"data_stored":143932986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72490781,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":142,"num_read_kb":188613,"num_write":160,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144990208,"data_stored":144981562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575544,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244652,"kb_used_data":141276,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94127188,"statfs":{"total":96636764160,"available":96386240512,"internally_reserved":0,"allocated":144666624,"data_stored":142733770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575544,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453776,"kb_used_data":125504,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93918064,"statfs":{"total":96636764160,"available":96172097536,"internally_reserved":0,"allocated":128516096,"data_stored":126495147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":336132554},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575543,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400944,"kb_used_data":135136,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93970896,"statfs":{"total":96636764160,"available":96226197504,"internally_reserved":0,"allocated":138379264,"data_stored":136431474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":158812,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":162623488,"data_stored":160564207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575543,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438220,"kb_used_data":150204,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93933620,"statfs":{"total":96636764160,"available":96188026880,"internally_reserved":0,"allocated":153808896,"data_stored":151783628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575545,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226924,"kb_used_data":127708,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94144916,"statfs":{"total":96636764160,"available":96404393984,"internally_reserved":0,"allocated":130772992,"data_stored":128852011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575543,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315652,"kb_used_data":135988,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94056188,"statfs":{"total":96636764160,"available":96313536512,"internally_reserved":0,"allocated":139251712,"data_stored":137265995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575546,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414316,"kb_used_data":148508,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957524,"statfs":{"total":96636764160,"available":96212504576,"internally_reserved":0,"allocated":152072192,"data_stored":150043452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":108003328,"data_stored":108003328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103157760,"data_stored":103157760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79200256,"data_stored":79200256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":91176960,"data_stored":91176960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":107003904,"data_stored":107003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":117772288,"data_stored":117772288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":107646976,"data_stored":107646976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98918400,"data_stored":98918400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":337682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":131171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":493563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":86495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":588649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":250471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":518076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28368896,"data_stored":28368177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28344320,"data_stored":28343505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24207360,"data_stored":24203756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16769024,"data_stored":16769024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22073344,"data_stored":22072625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":5297435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10481664,"data_stored":10481664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18918705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33648640,"data_stored":33647106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17872155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18931712,"data_stored":18930897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18912539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:06.512 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:06.847 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:06.861 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:06.863 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1986,"stamp":"2024-09-12T18:33:05.561651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":712394457,"num_objects":4981,"num_object_clones":0,"num_object_copies":18878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4981,"num_whiteouts":0,"num_read":287425,"num_read_kb":2654355,"num_write":157295,"num_write_kb":2423504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14250,"ondisk_log_size":14250,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2792704,"kb_used_data":1123136,"kb_used_omap":12,"kb_used_meta":1669427,"kb_avail":752182016,"statfs":{"total":773094113280,"available":770234384384,"internally_reserved":0,"allocated":1150091264,"data_stored":1134169684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1709493808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2101562,"num_objects":-25,"num_object_clones":0,"num_object_copies":-98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005770"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.645460+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:28:47.645460+0000","last_peered":"2024-09-12T18:28:47.645460+0000","last_clean":"2024-09-12T18:28:47.645460+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:28:47.645460+0000","last_undegraded":"2024-09-12T18:28:47.645460+0000","last_fullsized":"2024-09-12T18:28:47.645460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641171+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:28:17.641171+0000","last_peered":"2024-09-12T18:28:17.641171+0000","last_clean":"2024-09-12T18:28:17.641171+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:28:17.641171+0000","last_undegraded":"2024-09-12T18:28:17.641171+0000","last_fullsized":"2024-09-12T18:28:17.641171+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:41.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.404279+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:28:12.404279+0000","last_peered":"2024-09-12T18:28:12.404279+0000","last_clean":"2024-09-12T18:28:12.404279+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:28:12.404279+0000","last_undegraded":"2024-09-12T18:28:12.404279+0000","last_fullsized":"2024-09-12T18:28:12.404279+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.080783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.503031+0000","last_change":"2024-09-12T18:08:44.184390+0000","last_active":"2024-09-12T18:28:47.503031+0000","last_peered":"2024-09-12T18:28:47.503031+0000","last_clean":"2024-09-12T18:28:47.503031+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:28:47.503031+0000","last_undegraded":"2024-09-12T18:28:47.503031+0000","last_fullsized":"2024-09-12T18:28:47.503031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:51.778841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525188+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:28:18.525188+0000","last_peered":"2024-09-12T18:28:18.525188+0000","last_clean":"2024-09-12T18:28:18.525188+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:28:18.525188+0000","last_undegraded":"2024-09-12T18:28:18.525188+0000","last_fullsized":"2024-09-12T18:28:18.525188+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:47.933301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'1","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.598765+0000","last_change":"2024-09-12T17:53:12.148575+0000","last_active":"2024-09-12T18:28:12.598765+0000","last_peered":"2024-09-12T18:28:12.598765+0000","last_clean":"2024-09-12T18:28:12.598765+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:28:12.598765+0000","last_undegraded":"2024-09-12T18:28:12.598765+0000","last_fullsized":"2024-09-12T18:28:12.598765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:30.531081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514184+0000","last_change":"2024-09-12T17:50:14.836684+0000","last_active":"2024-09-12T18:30:27.514184+0000","last_peered":"2024-09-12T18:30:27.514184+0000","last_clean":"2024-09-12T18:30:27.514184+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:30:27.514184+0000","last_undegraded":"2024-09-12T18:30:27.514184+0000","last_fullsized":"2024-09-12T18:30:27.514184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:16.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425027+0000","last_change":"2024-09-12T18:08:44.178158+0000","last_active":"2024-09-12T18:30:32.425027+0000","last_peered":"2024-09-12T18:30:32.425027+0000","last_clean":"2024-09-12T18:30:32.425027+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:30:32.425027+0000","last_undegraded":"2024-09-12T18:30:32.425027+0000","last_fullsized":"2024-09-12T18:30:32.425027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:48.796260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851978+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:30:47.851978+0000","last_peered":"2024-09-12T18:30:47.851978+0000","last_clean":"2024-09-12T18:30:47.851978+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:30:47.851978+0000","last_undegraded":"2024-09-12T18:30:47.851978+0000","last_fullsized":"2024-09-12T18:30:47.851978+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506777+0000","last_change":"2024-09-12T17:53:12.146240+0000","last_active":"2024-09-12T18:29:22.506777+0000","last_peered":"2024-09-12T18:29:22.506777+0000","last_clean":"2024-09-12T18:29:22.506777+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:29:22.506777+0000","last_undegraded":"2024-09-12T18:29:22.506777+0000","last_fullsized":"2024-09-12T18:29:22.506777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.969445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.848535+0000","last_change":"2024-09-12T17:50:14.830812+0000","last_active":"2024-09-12T18:30:17.848535+0000","last_peered":"2024-09-12T18:30:17.848535+0000","last_clean":"2024-09-12T18:30:17.848535+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:30:17.848535+0000","last_undegraded":"2024-09-12T18:30:17.848535+0000","last_fullsized":"2024-09-12T18:30:17.848535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:04.011300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413604+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:29:27.413604+0000","last_peered":"2024-09-12T18:29:27.413604+0000","last_clean":"2024-09-12T18:29:27.413604+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:29:27.413604+0000","last_undegraded":"2024-09-12T18:29:27.413604+0000","last_fullsized":"2024-09-12T18:29:27.413604+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:57.846394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":2101,"num_write":11,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:43.545564+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:30:43.545564+0000","last_peered":"2024-09-12T18:30:43.545564+0000","last_clean":"2024-09-12T18:30:43.545564+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:30:43.545564+0000","last_undegraded":"2024-09-12T18:30:43.545564+0000","last_fullsized":"2024-09-12T18:30:43.545564+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8188,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653099+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:29:37.653099+0000","last_peered":"2024-09-12T18:29:37.653099+0000","last_clean":"2024-09-12T18:29:37.653099+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:29:37.653099+0000","last_undegraded":"2024-09-12T18:29:37.653099+0000","last_fullsized":"2024-09-12T18:29:37.653099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842273+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:29:27.842273+0000","last_peered":"2024-09-12T18:29:27.842273+0000","last_clean":"2024-09-12T18:29:27.842273+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:29:27.842273+0000","last_undegraded":"2024-09-12T18:29:27.842273+0000","last_fullsized":"2024-09-12T18:29:27.842273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4114,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.608852+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:29:37.608852+0000","last_peered":"2024-09-12T18:29:37.608852+0000","last_clean":"2024-09-12T18:29:37.608852+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:29:37.608852+0000","last_undegraded":"2024-09-12T18:29:37.608852+0000","last_fullsized":"2024-09-12T18:29:37.608852+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.447117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'8","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414003+0000","last_change":"2024-09-12T17:53:15.163967+0000","last_active":"2024-09-12T18:29:32.414003+0000","last_peered":"2024-09-12T18:29:32.414003+0000","last_clean":"2024-09-12T18:29:32.414003+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:29:32.414003+0000","last_undegraded":"2024-09-12T18:29:32.414003+0000","last_fullsized":"2024-09-12T18:29:32.414003+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:21.391926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8424657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16462,"num_write":13,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.536175+0000","last_change":"2024-09-12T17:53:12.139099+0000","last_active":"2024-09-12T18:29:38.536175+0000","last_peered":"2024-09-12T18:29:38.536175+0000","last_clean":"2024-09-12T18:29:38.536175+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:29:38.536175+0000","last_undegraded":"2024-09-12T18:29:38.536175+0000","last_fullsized":"2024-09-12T18:29:38.536175+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:32.128312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13304,"num_write":13,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422211+0000","last_change":"2024-09-12T17:50:14.842952+0000","last_active":"2024-09-12T18:30:17.422211+0000","last_peered":"2024-09-12T18:30:17.422211+0000","last_clean":"2024-09-12T18:30:17.422211+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:30:17.422211+0000","last_undegraded":"2024-09-12T18:30:17.422211+0000","last_fullsized":"2024-09-12T18:30:17.422211+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:31.774447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406069+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:28:47.406069+0000","last_peered":"2024-09-12T18:28:47.406069+0000","last_clean":"2024-09-12T18:28:47.406069+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:28:47.406069+0000","last_undegraded":"2024-09-12T18:28:47.406069+0000","last_fullsized":"2024-09-12T18:28:47.406069+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:26.401744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400909+0000","last_change":"2024-09-12T17:53:15.159424+0000","last_active":"2024-09-12T18:28:17.400909+0000","last_peered":"2024-09-12T18:28:17.400909+0000","last_clean":"2024-09-12T18:28:17.400909+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:28:17.400909+0000","last_undegraded":"2024-09-12T18:28:17.400909+0000","last_fullsized":"2024-09-12T18:28:17.400909+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:39.982738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6178,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:13.524378+0000","last_change":"2024-09-12T17:53:12.146586+0000","last_active":"2024-09-12T18:28:13.524378+0000","last_peered":"2024-09-12T18:28:13.524378+0000","last_clean":"2024-09-12T18:28:13.524378+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:28:13.524378+0000","last_undegraded":"2024-09-12T18:28:13.524378+0000","last_fullsized":"2024-09-12T18:28:13.524378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:27.151552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839397+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:29:02.839397+0000","last_peered":"2024-09-12T18:29:02.839397+0000","last_clean":"2024-09-12T18:29:02.839397+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:29:02.839397+0000","last_undegraded":"2024-09-12T18:29:02.839397+0000","last_fullsized":"2024-09-12T18:29:02.839397+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:50.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406134+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:28:47.406134+0000","last_peered":"2024-09-12T18:28:47.406134+0000","last_clean":"2024-09-12T18:28:47.406134+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:28:47.406134+0000","last_undegraded":"2024-09-12T18:28:47.406134+0000","last_fullsized":"2024-09-12T18:28:47.406134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:07.255733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.404892+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:28:17.404892+0000","last_peered":"2024-09-12T18:28:17.404892+0000","last_clean":"2024-09-12T18:28:17.404892+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:28:17.404892+0000","last_undegraded":"2024-09-12T18:28:17.404892+0000","last_fullsized":"2024-09-12T18:28:17.404892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:55.589172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832136+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:28:12.832136+0000","last_peered":"2024-09-12T18:28:12.832136+0000","last_clean":"2024-09-12T18:28:12.832136+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:28:12.832136+0000","last_undegraded":"2024-09-12T18:28:12.832136+0000","last_fullsized":"2024-09-12T18:28:12.832136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:08.474574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":15356,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.604077+0000","last_change":"2024-09-12T17:50:14.841323+0000","last_active":"2024-09-12T18:28:57.604077+0000","last_peered":"2024-09-12T18:28:57.604077+0000","last_clean":"2024-09-12T18:28:57.604077+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:28:57.604077+0000","last_undegraded":"2024-09-12T18:28:57.604077+0000","last_fullsized":"2024-09-12T18:28:57.604077+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:41.858948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.609892+0000","last_change":"2024-09-12T18:08:44.184970+0000","last_active":"2024-09-12T18:29:47.609892+0000","last_peered":"2024-09-12T18:29:47.609892+0000","last_clean":"2024-09-12T18:29:47.609892+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:29:47.609892+0000","last_undegraded":"2024-09-12T18:29:47.609892+0000","last_fullsized":"2024-09-12T18:29:47.609892+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:13.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414229+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:29:32.414229+0000","last_peered":"2024-09-12T18:29:32.414229+0000","last_clean":"2024-09-12T18:29:32.414229+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:29:32.414229+0000","last_undegraded":"2024-09-12T18:29:32.414229+0000","last_fullsized":"2024-09-12T18:29:32.414229+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.661852+0000","last_change":"2024-09-12T17:53:12.143997+0000","last_active":"2024-09-12T18:30:37.661852+0000","last_peered":"2024-09-12T18:30:37.661852+0000","last_clean":"2024-09-12T18:30:37.661852+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:30:37.661852+0000","last_undegraded":"2024-09-12T18:30:37.661852+0000","last_fullsized":"2024-09-12T18:30:37.661852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:11.692360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":103,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.838922+0000","last_change":"2024-09-12T17:50:14.839525+0000","last_active":"2024-09-12T18:28:57.838922+0000","last_peered":"2024-09-12T18:28:57.838922+0000","last_clean":"2024-09-12T18:28:57.838922+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:28:57.838922+0000","last_undegraded":"2024-09-12T18:28:57.838922+0000","last_fullsized":"2024-09-12T18:28:57.838922+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:08.454207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509504+0000","last_change":"2024-09-12T18:08:44.184023+0000","last_active":"2024-09-12T18:29:47.509504+0000","last_peered":"2024-09-12T18:29:47.509504+0000","last_clean":"2024-09-12T18:29:47.509504+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:29:47.509504+0000","last_undegraded":"2024-09-12T18:29:47.509504+0000","last_fullsized":"2024-09-12T18:29:47.509504+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841144+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:29:17.841144+0000","last_peered":"2024-09-12T18:29:17.841144+0000","last_clean":"2024-09-12T18:29:17.841144+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:29:17.841144+0000","last_undegraded":"2024-09-12T18:29:17.841144+0000","last_fullsized":"2024-09-12T18:29:17.841144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409647+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:28:57.409647+0000","last_peered":"2024-09-12T18:28:57.409647+0000","last_clean":"2024-09-12T18:28:57.409647+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:28:57.409647+0000","last_undegraded":"2024-09-12T18:28:57.409647+0000","last_fullsized":"2024-09-12T18:28:57.409647+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:39.923261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414257+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:29:32.414257+0000","last_peered":"2024-09-12T18:29:32.414257+0000","last_clean":"2024-09-12T18:29:32.414257+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:29:32.414257+0000","last_undegraded":"2024-09-12T18:29:32.414257+0000","last_fullsized":"2024-09-12T18:29:32.414257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20478,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.507284+0000","last_change":"2024-09-12T17:53:12.144615+0000","last_active":"2024-09-12T18:29:27.507284+0000","last_peered":"2024-09-12T18:29:27.507284+0000","last_clean":"2024-09-12T18:29:27.507284+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:29:27.507284+0000","last_undegraded":"2024-09-12T18:29:27.507284+0000","last_fullsized":"2024-09-12T18:29:27.507284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:01.824724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4132,"num_write":3,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.504229+0000","last_change":"2024-09-12T17:50:14.845069+0000","last_active":"2024-09-12T18:28:57.504229+0000","last_peered":"2024-09-12T18:28:57.504229+0000","last_clean":"2024-09-12T18:28:57.504229+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:28:57.504229+0000","last_undegraded":"2024-09-12T18:28:57.504229+0000","last_fullsized":"2024-09-12T18:28:57.504229+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:11.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'68","reported_seq":308,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420555+0000","last_change":"2024-09-12T17:50:14.842178+0000","last_active":"2024-09-12T18:30:07.420555+0000","last_peered":"2024-09-12T18:30:07.420555+0000","last_clean":"2024-09-12T18:30:07.420555+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:30:07.420555+0000","last_undegraded":"2024-09-12T18:30:07.420555+0000","last_fullsized":"2024-09-12T18:30:07.420555+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:23.280624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615983+0000","last_change":"2024-09-12T17:53:15.160000+0000","last_active":"2024-09-12T18:30:37.615983+0000","last_peered":"2024-09-12T18:30:37.615983+0000","last_clean":"2024-09-12T18:30:37.615983+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:30:37.615983+0000","last_undegraded":"2024-09-12T18:30:37.615983+0000","last_fullsized":"2024-09-12T18:30:37.615983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:16.584362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:33.544028+0000","last_change":"2024-09-12T17:53:12.138225+0000","last_active":"2024-09-12T18:30:33.544028+0000","last_peered":"2024-09-12T18:30:33.544028+0000","last_clean":"2024-09-12T18:30:33.544028+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:30:33.544028+0000","last_undegraded":"2024-09-12T18:30:33.544028+0000","last_fullsized":"2024-09-12T18:30:33.544028+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":298,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418863+0000","last_change":"2024-09-12T17:50:14.839535+0000","last_active":"2024-09-12T18:29:57.418863+0000","last_peered":"2024-09-12T18:29:57.418863+0000","last_clean":"2024-09-12T18:29:57.418863+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:29:57.418863+0000","last_undegraded":"2024-09-12T18:29:57.418863+0000","last_fullsized":"2024-09-12T18:29:57.418863+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:47.803289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615945+0000","last_change":"2024-09-12T17:53:15.161893+0000","last_active":"2024-09-12T18:30:37.615945+0000","last_peered":"2024-09-12T18:30:37.615945+0000","last_clean":"2024-09-12T18:30:37.615945+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:30:37.615945+0000","last_undegraded":"2024-09-12T18:30:37.615945+0000","last_fullsized":"2024-09-12T18:30:37.615945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:04.296609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421756+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:30:32.421756+0000","last_peered":"2024-09-12T18:30:32.421756+0000","last_clean":"2024-09-12T18:30:32.421756+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:30:32.421756+0000","last_undegraded":"2024-09-12T18:30:32.421756+0000","last_fullsized":"2024-09-12T18:30:32.421756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846075+0000","last_change":"2024-09-12T17:50:14.840630+0000","last_active":"2024-09-12T18:29:57.846075+0000","last_peered":"2024-09-12T18:29:57.846075+0000","last_clean":"2024-09-12T18:29:57.846075+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:29:57.846075+0000","last_undegraded":"2024-09-12T18:29:57.846075+0000","last_fullsized":"2024-09-12T18:29:57.846075+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.197122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422364+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:30:37.422364+0000","last_peered":"2024-09-12T18:30:37.422364+0000","last_clean":"2024-09-12T18:30:37.422364+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:30:37.422364+0000","last_undegraded":"2024-09-12T18:30:37.422364+0000","last_fullsized":"2024-09-12T18:30:37.422364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425105+0000","last_change":"2024-09-12T17:53:12.148814+0000","last_active":"2024-09-12T18:30:32.425105+0000","last_peered":"2024-09-12T18:30:32.425105+0000","last_clean":"2024-09-12T18:30:32.425105+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:30:32.425105+0000","last_undegraded":"2024-09-12T18:30:32.425105+0000","last_fullsized":"2024-09-12T18:30:32.425105+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:08.076954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538860+0000","last_change":"2024-09-12T17:50:14.841498+0000","last_active":"2024-09-12T18:29:58.538860+0000","last_peered":"2024-09-12T18:29:58.538860+0000","last_clean":"2024-09-12T18:29:58.538860+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:29:58.538860+0000","last_undegraded":"2024-09-12T18:29:58.538860+0000","last_fullsized":"2024-09-12T18:29:58.538860+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.140268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.426002+0000","last_change":"2024-09-12T17:53:15.158874+0000","last_active":"2024-09-12T18:30:37.426002+0000","last_peered":"2024-09-12T18:30:37.426002+0000","last_clean":"2024-09-12T18:30:37.426002+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:30:37.426002+0000","last_undegraded":"2024-09-12T18:30:37.426002+0000","last_fullsized":"2024-09-12T18:30:37.426002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:50.215733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.661208+0000","last_change":"2024-09-12T17:53:12.146649+0000","last_active":"2024-09-12T18:30:32.661208+0000","last_peered":"2024-09-12T18:30:32.661208+0000","last_clean":"2024-09-12T18:30:32.661208+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:30:32.661208+0000","last_undegraded":"2024-09-12T18:30:32.661208+0000","last_fullsized":"2024-09-12T18:30:32.661208+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:57.575965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6140,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.515181+0000","last_change":"2024-09-12T18:08:44.180436+0000","last_active":"2024-09-12T18:30:37.515181+0000","last_peered":"2024-09-12T18:30:37.515181+0000","last_clean":"2024-09-12T18:30:37.515181+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:30:37.515181+0000","last_undegraded":"2024-09-12T18:30:37.515181+0000","last_fullsized":"2024-09-12T18:30:37.515181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:14.400883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412252+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:29:17.412252+0000","last_peered":"2024-09-12T18:29:17.412252+0000","last_clean":"2024-09-12T18:29:17.412252+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:29:17.412252+0000","last_undegraded":"2024-09-12T18:29:17.412252+0000","last_fullsized":"2024-09-12T18:29:17.412252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:02.994171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4210688,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8208,"num_write":10,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410711+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:29:12.410711+0000","last_peered":"2024-09-12T18:29:12.410711+0000","last_clean":"2024-09-12T18:29:12.410711+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:29:12.410711+0000","last_undegraded":"2024-09-12T18:29:12.410711+0000","last_fullsized":"2024-09-12T18:29:12.410711+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:44.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":50,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.408326+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:28:47.408326+0000","last_peered":"2024-09-12T18:28:47.408326+0000","last_clean":"2024-09-12T18:28:47.408326+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:28:47.408326+0000","last_undegraded":"2024-09-12T18:28:47.408326+0000","last_fullsized":"2024-09-12T18:28:47.408326+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.905410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408851+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:29:02.408851+0000","last_peered":"2024-09-12T18:29:02.408851+0000","last_clean":"2024-09-12T18:29:02.408851+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:29:02.408851+0000","last_undegraded":"2024-09-12T18:29:02.408851+0000","last_fullsized":"2024-09-12T18:29:02.408851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:26.810924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412214+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:29:17.412214+0000","last_peered":"2024-09-12T18:29:17.412214+0000","last_clean":"2024-09-12T18:29:17.412214+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:29:17.412214+0000","last_undegraded":"2024-09-12T18:29:17.412214+0000","last_fullsized":"2024-09-12T18:29:17.412214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.836700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.505743+0000","last_change":"2024-09-12T17:53:12.143791+0000","last_active":"2024-09-12T18:29:12.505743+0000","last_peered":"2024-09-12T18:29:12.505743+0000","last_clean":"2024-09-12T18:29:12.505743+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:29:12.505743+0000","last_undegraded":"2024-09-12T18:29:12.505743+0000","last_fullsized":"2024-09-12T18:29:12.505743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:50.203716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7180,"num_write":5,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663487+0000","last_change":"2024-09-12T17:50:14.842898+0000","last_active":"2024-09-12T18:30:47.663487+0000","last_peered":"2024-09-12T18:30:47.663487+0000","last_clean":"2024-09-12T18:30:47.663487+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:30:47.663487+0000","last_undegraded":"2024-09-12T18:30:47.663487+0000","last_fullsized":"2024-09-12T18:30:47.663487+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:36.700805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424139+0000","last_change":"2024-09-12T18:08:44.182811+0000","last_active":"2024-09-12T18:30:27.424139+0000","last_peered":"2024-09-12T18:30:27.424139+0000","last_clean":"2024-09-12T18:30:27.424139+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:30:27.424139+0000","last_undegraded":"2024-09-12T18:30:27.424139+0000","last_fullsized":"2024-09-12T18:30:27.424139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.055368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607709+0000","last_change":"2024-09-12T17:53:15.162967+0000","last_active":"2024-09-12T18:29:27.607709+0000","last_peered":"2024-09-12T18:29:27.607709+0000","last_clean":"2024-09-12T18:29:27.607709+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:29:27.607709+0000","last_undegraded":"2024-09-12T18:29:27.607709+0000","last_fullsized":"2024-09-12T18:29:27.607709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:00.026005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8190,"num_write":11,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'6","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.840579+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:29:12.840579+0000","last_peered":"2024-09-12T18:29:12.840579+0000","last_clean":"2024-09-12T18:29:12.840579+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:29:12.840579+0000","last_undegraded":"2024-09-12T18:29:12.840579+0000","last_fullsized":"2024-09-12T18:29:12.840579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:33.879161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":11,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:50:14.845493+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:34.662412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412282+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:29:17.412282+0000","last_peered":"2024-09-12T18:29:17.412282+0000","last_clean":"2024-09-12T18:29:17.412282+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:29:17.412282+0000","last_undegraded":"2024-09-12T18:29:17.412282+0000","last_fullsized":"2024-09-12T18:29:17.412282+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:25.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607128+0000","last_change":"2024-09-12T17:53:12.149630+0000","last_active":"2024-09-12T18:29:22.607128+0000","last_peered":"2024-09-12T18:29:22.607128+0000","last_clean":"2024-09-12T18:29:22.607128+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:29:22.607128+0000","last_undegraded":"2024-09-12T18:29:22.607128+0000","last_fullsized":"2024-09-12T18:29:22.607128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:16.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.516222+0000","last_change":"2024-09-12T17:50:14.840844+0000","last_active":"2024-09-12T18:30:47.516222+0000","last_peered":"2024-09-12T18:30:47.516222+0000","last_clean":"2024-09-12T18:30:47.516222+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:30:47.516222+0000","last_undegraded":"2024-09-12T18:30:47.516222+0000","last_fullsized":"2024-09-12T18:30:47.516222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:46.536171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.410294+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:29:02.410294+0000","last_peered":"2024-09-12T18:29:02.410294+0000","last_clean":"2024-09-12T18:29:02.410294+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:29:02.410294+0000","last_undegraded":"2024-09-12T18:29:02.410294+0000","last_fullsized":"2024-09-12T18:29:02.410294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.278214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846735+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:30:02.846735+0000","last_peered":"2024-09-12T18:30:02.846735+0000","last_clean":"2024-09-12T18:30:02.846735+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:30:02.846735+0000","last_undegraded":"2024-09-12T18:30:02.846735+0000","last_fullsized":"2024-09-12T18:30:02.846735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"259'83","reported_seq":352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851871+0000","last_change":"2024-09-12T17:50:14.839010+0000","last_active":"2024-09-12T18:30:47.851871+0000","last_peered":"2024-09-12T18:30:47.851871+0000","last_clean":"2024-09-12T18:30:47.851871+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:30:47.851871+0000","last_undegraded":"2024-09-12T18:30:47.851871+0000","last_fullsized":"2024-09-12T18:30:47.851871+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:25.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:07.409815+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:29:07.409815+0000","last_peered":"2024-09-12T18:29:07.409815+0000","last_clean":"2024-09-12T18:29:07.409815+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:29:07.409815+0000","last_undegraded":"2024-09-12T18:29:07.409815+0000","last_fullsized":"2024-09-12T18:29:07.409815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:47.977130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611696+0000","last_change":"2024-09-12T17:53:12.148669+0000","last_active":"2024-09-12T18:30:02.611696+0000","last_peered":"2024-09-12T18:30:02.611696+0000","last_clean":"2024-09-12T18:30:02.611696+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:30:02.611696+0000","last_undegraded":"2024-09-12T18:30:02.611696+0000","last_fullsized":"2024-09-12T18:30:02.611696+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:34.792507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2093,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":207,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413248+0000","last_change":"2024-09-12T17:50:14.841525+0000","last_active":"2024-09-12T18:29:27.413248+0000","last_peered":"2024-09-12T18:29:27.413248+0000","last_clean":"2024-09-12T18:29:27.413248+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:29:27.413248+0000","last_undegraded":"2024-09-12T18:29:27.413248+0000","last_fullsized":"2024-09-12T18:29:27.413248+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.064279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408899+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:29:02.408899+0000","last_peered":"2024-09-12T18:29:02.408899+0000","last_clean":"2024-09-12T18:29:02.408899+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:29:02.408899+0000","last_undegraded":"2024-09-12T18:29:02.408899+0000","last_fullsized":"2024-09-12T18:29:02.408899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.682875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.606374+0000","last_change":"2024-09-12T17:53:15.162122+0000","last_active":"2024-09-12T18:29:17.606374+0000","last_peered":"2024-09-12T18:29:17.606374+0000","last_clean":"2024-09-12T18:29:17.606374+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:29:17.606374+0000","last_undegraded":"2024-09-12T18:29:17.606374+0000","last_fullsized":"2024-09-12T18:29:17.606374+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412132+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:29:17.412132+0000","last_peered":"2024-09-12T18:29:17.412132+0000","last_clean":"2024-09-12T18:29:17.412132+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:29:17.412132+0000","last_undegraded":"2024-09-12T18:29:17.412132+0000","last_fullsized":"2024-09-12T18:29:17.412132+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:32.030251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839464+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:29:02.839464+0000","last_peered":"2024-09-12T18:29:02.839464+0000","last_clean":"2024-09-12T18:29:02.839464+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:29:02.839464+0000","last_undegraded":"2024-09-12T18:29:02.839464+0000","last_fullsized":"2024-09-12T18:29:02.839464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:21.136369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422237+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:30:17.422237+0000","last_peered":"2024-09-12T18:30:17.422237+0000","last_clean":"2024-09-12T18:30:17.422237+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:30:17.422237+0000","last_undegraded":"2024-09-12T18:30:17.422237+0000","last_fullsized":"2024-09-12T18:30:17.422237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":10,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:13.532493+0000","last_change":"2024-09-12T17:53:12.147444+0000","last_active":"2024-09-12T18:29:13.532493+0000","last_peered":"2024-09-12T18:29:13.532493+0000","last_clean":"2024-09-12T18:29:13.532493+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:29:13.532493+0000","last_undegraded":"2024-09-12T18:29:13.532493+0000","last_fullsized":"2024-09-12T18:29:13.532493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:33.139490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411513+0000","last_change":"2024-09-12T17:50:14.845091+0000","last_active":"2024-09-12T18:29:17.411513+0000","last_peered":"2024-09-12T18:29:17.411513+0000","last_clean":"2024-09-12T18:29:17.411513+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:29:17.411513+0000","last_undegraded":"2024-09-12T18:29:17.411513+0000","last_fullsized":"2024-09-12T18:29:17.411513+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:59.523739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.415011+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:29:37.415011+0000","last_peered":"2024-09-12T18:29:37.415011+0000","last_clean":"2024-09-12T18:29:37.415011+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:29:37.415011+0000","last_undegraded":"2024-09-12T18:29:37.415011+0000","last_fullsized":"2024-09-12T18:29:37.415011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:49.644621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.427023+0000","last_change":"2024-09-12T17:53:12.146834+0000","last_active":"2024-09-12T18:30:42.427023+0000","last_peered":"2024-09-12T18:30:42.427023+0000","last_clean":"2024-09-12T18:30:42.427023+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:30:42.427023+0000","last_undegraded":"2024-09-12T18:30:42.427023+0000","last_fullsized":"2024-09-12T18:30:42.427023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:24.998862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841210+0000","last_change":"2024-09-12T17:50:14.843252+0000","last_active":"2024-09-12T18:29:17.841210+0000","last_peered":"2024-09-12T18:29:17.841210+0000","last_clean":"2024-09-12T18:29:17.841210+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:29:17.841210+0000","last_undegraded":"2024-09-12T18:29:17.841210+0000","last_fullsized":"2024-09-12T18:29:17.841210+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.189495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653142+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:29:37.653142+0000","last_peered":"2024-09-12T18:29:37.653142+0000","last_clean":"2024-09-12T18:29:37.653142+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:29:37.653142+0000","last_undegraded":"2024-09-12T18:29:37.653142+0000","last_fullsized":"2024-09-12T18:29:37.653142+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:54.893645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.516737+0000","last_change":"2024-09-12T17:53:12.145287+0000","last_active":"2024-09-12T18:30:52.516737+0000","last_peered":"2024-09-12T18:30:52.516737+0000","last_clean":"2024-09-12T18:30:52.516737+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:30:52.516737+0000","last_undegraded":"2024-09-12T18:30:52.516737+0000","last_fullsized":"2024-09-12T18:30:52.516737+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411632+0000","last_change":"2024-09-12T17:50:14.845672+0000","last_active":"2024-09-12T18:29:17.411632+0000","last_peered":"2024-09-12T18:29:17.411632+0000","last_clean":"2024-09-12T18:29:17.411632+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:29:17.411632+0000","last_undegraded":"2024-09-12T18:29:17.411632+0000","last_fullsized":"2024-09-12T18:29:17.411632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:46.707631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617831+0000","last_change":"2024-09-12T18:08:44.180779+0000","last_active":"2024-09-12T18:30:52.617831+0000","last_peered":"2024-09-12T18:30:52.617831+0000","last_clean":"2024-09-12T18:30:52.617831+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:30:52.617831+0000","last_undegraded":"2024-09-12T18:30:52.617831+0000","last_fullsized":"2024-09-12T18:30:52.617831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:51.232292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.657166+0000","last_change":"2024-09-12T17:53:12.147578+0000","last_active":"2024-09-12T18:30:02.657166+0000","last_peered":"2024-09-12T18:30:02.657166+0000","last_clean":"2024-09-12T18:30:02.657166+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:30:02.657166+0000","last_undegraded":"2024-09-12T18:30:02.657166+0000","last_fullsized":"2024-09-12T18:30:02.657166+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.387228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12574720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20468,"num_write":9,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419760+0000","last_change":"2024-09-12T17:50:14.843005+0000","last_active":"2024-09-12T18:30:02.419760+0000","last_peered":"2024-09-12T18:30:02.419760+0000","last_clean":"2024-09-12T18:30:02.419760+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:30:02.419760+0000","last_undegraded":"2024-09-12T18:30:02.419760+0000","last_fullsized":"2024-09-12T18:30:02.419760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:21.412702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535480+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:29:33.535480+0000","last_peered":"2024-09-12T18:29:33.535480+0000","last_clean":"2024-09-12T18:29:33.535480+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:29:33.535480+0000","last_undegraded":"2024-09-12T18:29:33.535480+0000","last_fullsized":"2024-09-12T18:29:33.535480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:09.211455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:08.540387+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:30:08.540387+0000","last_peered":"2024-09-12T18:30:08.540387+0000","last_clean":"2024-09-12T18:30:08.540387+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:30:08.540387+0000","last_undegraded":"2024-09-12T18:30:08.540387+0000","last_fullsized":"2024-09-12T18:30:08.540387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610519+0000","last_change":"2024-09-12T17:50:14.843405+0000","last_active":"2024-09-12T18:29:52.610519+0000","last_peered":"2024-09-12T18:29:52.610519+0000","last_clean":"2024-09-12T18:29:52.610519+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:29:52.610519+0000","last_undegraded":"2024-09-12T18:29:52.610519+0000","last_fullsized":"2024-09-12T18:29:52.610519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.738965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514158+0000","last_change":"2024-09-12T18:08:44.185535+0000","last_active":"2024-09-12T18:30:27.514158+0000","last_peered":"2024-09-12T18:30:27.514158+0000","last_clean":"2024-09-12T18:30:27.514158+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:30:27.514158+0000","last_undegraded":"2024-09-12T18:30:27.514158+0000","last_fullsized":"2024-09-12T18:30:27.514158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:31.002329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.617257+0000","last_change":"2024-09-12T17:53:15.156207+0000","last_active":"2024-09-12T18:30:47.617257+0000","last_peered":"2024-09-12T18:30:47.617257+0000","last_clean":"2024-09-12T18:30:47.617257+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:30:47.617257+0000","last_undegraded":"2024-09-12T18:30:47.617257+0000","last_fullsized":"2024-09-12T18:30:47.617257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.717848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":21492,"num_write":12,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.412301+0000","last_change":"2024-09-12T17:53:12.148444+0000","last_active":"2024-09-12T18:29:22.412301+0000","last_peered":"2024-09-12T18:29:22.412301+0000","last_clean":"2024-09-12T18:29:22.412301+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:29:22.412301+0000","last_undegraded":"2024-09-12T18:29:22.412301+0000","last_fullsized":"2024-09-12T18:29:22.412301+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:25.525568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655558+0000","last_change":"2024-09-12T17:50:14.845855+0000","last_active":"2024-09-12T18:29:52.655558+0000","last_peered":"2024-09-12T18:29:52.655558+0000","last_clean":"2024-09-12T18:29:52.655558+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:29:52.655558+0000","last_undegraded":"2024-09-12T18:29:52.655558+0000","last_fullsized":"2024-09-12T18:29:52.655558+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.841767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650945+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:29:22.650945+0000","last_peered":"2024-09-12T18:29:22.650945+0000","last_clean":"2024-09-12T18:29:22.650945+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:29:22.650945+0000","last_undegraded":"2024-09-12T18:29:22.650945+0000","last_fullsized":"2024-09-12T18:29:22.650945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:54.256446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4240667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4192,"num_write":2,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426884+0000","last_change":"2024-09-12T17:53:12.141323+0000","last_active":"2024-09-12T18:30:42.426884+0000","last_peered":"2024-09-12T18:30:42.426884+0000","last_clean":"2024-09-12T18:30:42.426884+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:30:42.426884+0000","last_undegraded":"2024-09-12T18:30:42.426884+0000","last_fullsized":"2024-09-12T18:30:42.426884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:51.866615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:53.538225+0000","last_change":"2024-09-12T17:50:14.841037+0000","last_active":"2024-09-12T18:29:53.538225+0000","last_peered":"2024-09-12T18:29:53.538225+0000","last_clean":"2024-09-12T18:29:53.538225+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:29:53.538225+0000","last_undegraded":"2024-09-12T18:29:53.538225+0000","last_fullsized":"2024-09-12T18:29:53.538225+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:08.998454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.843448+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:29:37.843448+0000","last_peered":"2024-09-12T18:29:37.843448+0000","last_clean":"2024-09-12T18:29:37.843448+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:29:37.843448+0000","last_undegraded":"2024-09-12T18:29:37.843448+0000","last_fullsized":"2024-09-12T18:29:37.843448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:46.217476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427908+0000","last_change":"2024-09-12T17:53:15.167067+0000","last_active":"2024-09-12T18:30:47.427908+0000","last_peered":"2024-09-12T18:30:47.427908+0000","last_clean":"2024-09-12T18:30:47.427908+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:30:47.427908+0000","last_undegraded":"2024-09-12T18:30:47.427908+0000","last_fullsized":"2024-09-12T18:30:47.427908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:46.459018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.616631+0000","last_change":"2024-09-12T17:53:12.145714+0000","last_active":"2024-09-12T18:30:42.616631+0000","last_peered":"2024-09-12T18:30:42.616631+0000","last_clean":"2024-09-12T18:30:42.616631+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:30:42.616631+0000","last_undegraded":"2024-09-12T18:30:42.616631+0000","last_fullsized":"2024-09-12T18:30:42.616631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:38.676442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417826+0000","last_change":"2024-09-12T17:50:14.840332+0000","last_active":"2024-09-12T18:29:52.417826+0000","last_peered":"2024-09-12T18:29:52.417826+0000","last_clean":"2024-09-12T18:29:52.417826+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:29:52.417826+0000","last_undegraded":"2024-09-12T18:29:52.417826+0000","last_fullsized":"2024-09-12T18:29:52.417826+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415951+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:29:42.415951+0000","last_peered":"2024-09-12T18:29:42.415951+0000","last_clean":"2024-09-12T18:29:42.415951+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:29:42.415951+0000","last_undegraded":"2024-09-12T18:29:42.415951+0000","last_fullsized":"2024-09-12T18:29:42.415951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:51.046197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546288+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:30:48.546288+0000","last_peered":"2024-09-12T18:30:48.546288+0000","last_clean":"2024-09-12T18:30:48.546288+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:30:48.546288+0000","last_undegraded":"2024-09-12T18:30:48.546288+0000","last_fullsized":"2024-09-12T18:30:48.546288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426935+0000","last_change":"2024-09-12T17:53:12.143851+0000","last_active":"2024-09-12T18:30:42.426935+0000","last_peered":"2024-09-12T18:30:42.426935+0000","last_clean":"2024-09-12T18:30:42.426935+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:30:42.426935+0000","last_undegraded":"2024-09-12T18:30:42.426935+0000","last_fullsized":"2024-09-12T18:30:42.426935+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:28.807772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424131+0000","last_change":"2024-09-12T17:50:14.843604+0000","last_active":"2024-09-12T18:30:27.424131+0000","last_peered":"2024-09-12T18:30:27.424131+0000","last_clean":"2024-09-12T18:30:27.424131+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:30:27.424131+0000","last_undegraded":"2024-09-12T18:30:27.424131+0000","last_fullsized":"2024-09-12T18:30:27.424131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:57.939262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'291","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417950+0000","last_change":"2024-09-12T17:35:40.897067+0000","last_active":"2024-09-12T18:29:52.417950+0000","last_peered":"2024-09-12T18:29:52.417950+0000","last_clean":"2024-09-12T18:29:52.417950+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:29:52.417950+0000","last_undegraded":"2024-09-12T18:29:52.417950+0000","last_fullsized":"2024-09-12T18:29:52.417950+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:44.766786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3645575,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":537,"num_read_kb":13512,"num_write":1059,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'535","reported_seq":1946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698681+0000","last_change":"2024-09-12T17:35:42.890337+0000","last_active":"2024-09-12T18:30:18.698681+0000","last_peered":"2024-09-12T18:30:18.698681+0000","last_clean":"2024-09-12T18:30:18.698681+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:30:18.698681+0000","last_undegraded":"2024-09-12T18:30:18.698681+0000","last_fullsized":"2024-09-12T18:30:18.698681+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:56.529947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'333","reported_seq":1112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:55.497873+0000","last_change":"2024-09-12T17:35:40.895813+0000","last_active":"2024-09-12T18:29:55.497873+0000","last_peered":"2024-09-12T18:29:55.497873+0000","last_clean":"2024-09-12T18:29:55.497873+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:29:55.497873+0000","last_undegraded":"2024-09-12T18:29:55.497873+0000","last_fullsized":"2024-09-12T18:29:55.497873+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:08.595904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10473446,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":723,"num_read_kb":23031,"num_write":1260,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'484","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812590+0000","last_change":"2024-09-12T17:35:42.888061+0000","last_active":"2024-09-12T18:30:18.812590+0000","last_peered":"2024-09-12T18:30:18.812590+0000","last_clean":"2024-09-12T18:30:18.812590+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:30:18.812590+0000","last_undegraded":"2024-09-12T18:30:18.812590+0000","last_fullsized":"2024-09-12T18:30:18.812590+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:42.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'322","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.421200+0000","last_change":"2024-09-12T17:36:16.048276+0000","last_active":"2024-09-12T18:30:27.421200+0000","last_peered":"2024-09-12T18:30:27.421200+0000","last_clean":"2024-09-12T18:30:27.421200+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:30:27.421200+0000","last_undegraded":"2024-09-12T18:30:27.421200+0000","last_fullsized":"2024-09-12T18:30:27.421200+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:44.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699446,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":700,"num_read_kb":32762,"num_write":1141,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'419","reported_seq":1922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.442221+0000","last_change":"2024-09-12T17:35:42.892018+0000","last_active":"2024-09-12T18:30:15.442221+0000","last_peered":"2024-09-12T18:30:15.442221+0000","last_clean":"2024-09-12T18:30:15.442221+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:30:15.442221+0000","last_undegraded":"2024-09-12T18:30:15.442221+0000","last_fullsized":"2024-09-12T18:30:15.442221+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:47.496306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'281","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.127721+0000","last_change":"2024-09-12T17:35:40.878718+0000","last_active":"2024-09-12T18:29:50.127721+0000","last_peered":"2024-09-12T18:29:50.127721+0000","last_clean":"2024-09-12T18:29:50.127721+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:29:50.127721+0000","last_undegraded":"2024-09-12T18:29:50.127721+0000","last_fullsized":"2024-09-12T18:29:50.127721+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.836799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12627198,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":435,"num_read_kb":25007,"num_write":1013,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'459","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816024+0000","last_change":"2024-09-12T17:35:42.901523+0000","last_active":"2024-09-12T18:30:18.816024+0000","last_peered":"2024-09-12T18:30:18.816024+0000","last_clean":"2024-09-12T18:30:18.816024+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:30:18.816024+0000","last_undegraded":"2024-09-12T18:30:18.816024+0000","last_fullsized":"2024-09-12T18:30:18.816024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:21.733978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'267","reported_seq":981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:40.942677+0000","last_change":"2024-09-12T17:35:40.893806+0000","last_active":"2024-09-12T18:29:40.942677+0000","last_peered":"2024-09-12T18:29:40.942677+0000","last_clean":"2024-09-12T18:29:40.942677+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:29:40.942677+0000","last_undegraded":"2024-09-12T18:29:40.942677+0000","last_fullsized":"2024-09-12T18:29:40.942677+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:58.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640253,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":10932,"num_write":983,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'856","reported_seq":2380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978627+0000","last_change":"2024-09-12T17:35:42.896618+0000","last_active":"2024-09-12T18:30:25.978627+0000","last_peered":"2024-09-12T18:30:25.978627+0000","last_clean":"2024-09-12T18:30:25.978627+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:30:25.978627+0000","last_undegraded":"2024-09-12T18:30:25.978627+0000","last_fullsized":"2024-09-12T18:30:25.978627+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:28.451347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'290","reported_seq":1084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:23.396215+0000","last_change":"2024-09-12T17:35:40.882513+0000","last_active":"2024-09-12T18:29:23.396215+0000","last_peered":"2024-09-12T18:29:23.396215+0000","last_clean":"2024-09-12T18:29:23.396215+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:29:23.396215+0000","last_undegraded":"2024-09-12T18:29:23.396215+0000","last_fullsized":"2024-09-12T18:29:23.396215+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.278996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238044,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":42334,"num_write":1239,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2407,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136019+0000","last_change":"2024-09-12T17:35:42.892097+0000","last_active":"2024-09-12T18:31:29.136019+0000","last_peered":"2024-09-12T18:31:29.136019+0000","last_clean":"2024-09-12T18:31:29.136019+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:31:29.136019+0000","last_undegraded":"2024-09-12T18:31:29.136019+0000","last_fullsized":"2024-09-12T18:31:29.136019+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:35.311382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'300","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.871088+0000","last_change":"2024-09-12T17:35:40.894162+0000","last_active":"2024-09-12T18:32:38.871088+0000","last_peered":"2024-09-12T18:32:38.871088+0000","last_clean":"2024-09-12T18:32:38.871088+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:32:38.871088+0000","last_undegraded":"2024-09-12T18:32:38.871088+0000","last_fullsized":"2024-09-12T18:32:38.871088+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:33.543998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18336797,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":449,"num_read_kb":26409,"num_write":1112,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'465","reported_seq":1962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440637+0000","last_change":"2024-09-12T17:35:42.887897+0000","last_active":"2024-09-12T18:30:15.440637+0000","last_peered":"2024-09-12T18:30:15.440637+0000","last_clean":"2024-09-12T18:30:15.440637+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:30:15.440637+0000","last_undegraded":"2024-09-12T18:30:15.440637+0000","last_fullsized":"2024-09-12T18:30:15.440637+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.371385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'320","reported_seq":954,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.333736+0000","last_change":"2024-09-12T17:35:40.879524+0000","last_active":"2024-09-12T18:32:43.333736+0000","last_peered":"2024-09-12T18:32:43.333736+0000","last_clean":"2024-09-12T18:32:43.333736+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:32:43.333736+0000","last_undegraded":"2024-09-12T18:32:43.333736+0000","last_fullsized":"2024-09-12T18:32:43.333736+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:11.574981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6294073,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":445,"num_read_kb":10679,"num_write":1174,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'484","reported_seq":2063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304996+0000","last_change":"2024-09-12T17:35:42.889118+0000","last_active":"2024-09-12T18:31:28.304996+0000","last_peered":"2024-09-12T18:31:28.304996+0000","last_clean":"2024-09-12T18:31:28.304996+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:31:28.304996+0000","last_undegraded":"2024-09-12T18:31:28.304996+0000","last_fullsized":"2024-09-12T18:31:28.304996+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:50.990196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'759","reported_seq":2185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699100+0000","last_change":"2024-09-12T17:35:42.896662+0000","last_active":"2024-09-12T18:30:18.699100+0000","last_peered":"2024-09-12T18:30:18.699100+0000","last_clean":"2024-09-12T18:30:18.699100+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:30:18.699100+0000","last_undegraded":"2024-09-12T18:30:18.699100+0000","last_fullsized":"2024-09-12T18:30:18.699100+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:32.589294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'292","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409020+0000","last_change":"2024-09-12T17:35:40.895257+0000","last_active":"2024-09-12T18:29:02.409020+0000","last_peered":"2024-09-12T18:29:02.409020+0000","last_clean":"2024-09-12T18:29:02.409020+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:29:02.409020+0000","last_undegraded":"2024-09-12T18:29:02.409020+0000","last_fullsized":"2024-09-12T18:29:02.409020+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:16.477537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370512,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":487,"num_read_kb":71616,"num_write":1078,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'417","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392437+0000","last_change":"2024-09-12T17:36:16.050871+0000","last_active":"2024-09-12T18:32:48.392437+0000","last_peered":"2024-09-12T18:32:48.392437+0000","last_clean":"2024-09-12T18:32:48.392437+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:32:48.392437+0000","last_undegraded":"2024-09-12T18:32:48.392437+0000","last_fullsized":"2024-09-12T18:32:48.392437+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:59.500853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'259","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:10.596848+0000","last_change":"2024-09-12T17:35:40.901655+0000","last_active":"2024-09-12T18:29:10.596848+0000","last_peered":"2024-09-12T18:29:10.596848+0000","last_clean":"2024-09-12T18:29:10.596848+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:29:10.596848+0000","last_undegraded":"2024-09-12T18:29:10.596848+0000","last_fullsized":"2024-09-12T18:29:10.596848+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.400186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1427699,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":423,"num_read_kb":3270,"num_write":960,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'870","reported_seq":2483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392732+0000","last_change":"2024-09-12T17:35:42.888574+0000","last_active":"2024-09-12T18:32:48.392732+0000","last_peered":"2024-09-12T18:32:48.392732+0000","last_clean":"2024-09-12T18:32:48.392732+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:32:48.392732+0000","last_undegraded":"2024-09-12T18:32:48.392732+0000","last_fullsized":"2024-09-12T18:32:48.392732+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:49.201685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'307","reported_seq":953,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:16.582596+0000","last_change":"2024-09-12T17:35:40.899223+0000","last_active":"2024-09-12T18:29:16.582596+0000","last_peered":"2024-09-12T18:29:16.582596+0000","last_clean":"2024-09-12T18:29:16.582596+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:29:16.582596+0000","last_undegraded":"2024-09-12T18:29:16.582596+0000","last_fullsized":"2024-09-12T18:29:16.582596+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:10.653659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8860185,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":470,"num_read_kb":65942,"num_write":1184,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1104","reported_seq":2609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527373+0000","last_change":"2024-09-12T17:35:42.889897+0000","last_active":"2024-09-12T18:30:04.527373+0000","last_peered":"2024-09-12T18:30:04.527373+0000","last_clean":"2024-09-12T18:30:04.527373+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:30:04.527373+0000","last_undegraded":"2024-09-12T18:30:04.527373+0000","last_fullsized":"2024-09-12T18:30:04.527373+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:49.298029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'254","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.502714+0000","last_change":"2024-09-12T17:35:40.896331+0000","last_active":"2024-09-12T18:33:03.502714+0000","last_peered":"2024-09-12T18:33:03.502714+0000","last_clean":"2024-09-12T18:33:03.502714+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:03.502714+0000","last_undegraded":"2024-09-12T18:33:03.502714+0000","last_fullsized":"2024-09-12T18:33:03.502714+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:10.681642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213252,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":722,"num_read_kb":33658,"num_write":1029,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'611","reported_seq":2377,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.306126+0000","last_change":"2024-09-12T17:35:42.897377+0000","last_active":"2024-09-12T18:31:28.306126+0000","last_peered":"2024-09-12T18:31:28.306126+0000","last_clean":"2024-09-12T18:31:28.306126+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:31:28.306126+0000","last_undegraded":"2024-09-12T18:31:28.306126+0000","last_fullsized":"2024-09-12T18:31:28.306126+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:35.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'258","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408847+0000","last_change":"2024-09-12T17:35:40.885644+0000","last_active":"2024-09-12T18:28:52.408847+0000","last_peered":"2024-09-12T18:28:52.408847+0000","last_clean":"2024-09-12T18:28:52.408847+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:28:52.408847+0000","last_undegraded":"2024-09-12T18:28:52.408847+0000","last_fullsized":"2024-09-12T18:28:52.408847+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:43.465385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833628,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":42765,"num_write":917,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'305","reported_seq":1678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.370580+0000","last_change":"2024-09-12T17:35:42.902985+0000","last_active":"2024-09-12T18:32:48.370580+0000","last_peered":"2024-09-12T18:32:48.370580+0000","last_clean":"2024-09-12T18:32:48.370580+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:32:48.370580+0000","last_undegraded":"2024-09-12T18:32:48.370580+0000","last_fullsized":"2024-09-12T18:32:48.370580+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:50.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'302","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704083+0000","last_change":"2024-09-12T17:35:40.901109+0000","last_active":"2024-09-12T18:30:52.704083+0000","last_peered":"2024-09-12T18:30:52.704083+0000","last_clean":"2024-09-12T18:30:52.704083+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:30:52.704083+0000","last_undegraded":"2024-09-12T18:30:52.704083+0000","last_fullsized":"2024-09-12T18:30:52.704083+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:19.735753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26499558,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":516,"num_read_kb":95722,"num_write":1065,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'128","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.236405+0000","last_change":"2024-09-12T17:35:50.911205+0000","last_active":"2024-09-12T18:31:29.236405+0000","last_peered":"2024-09-12T18:31:29.236405+0000","last_clean":"2024-09-12T18:31:29.236405+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:31:29.236405+0000","last_undegraded":"2024-09-12T18:31:29.236405+0000","last_fullsized":"2024-09-12T18:31:29.236405+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.073238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'773","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305568+0000","last_change":"2024-09-12T17:35:42.891760+0000","last_active":"2024-09-12T18:31:28.305568+0000","last_peered":"2024-09-12T18:31:28.305568+0000","last_clean":"2024-09-12T18:31:28.305568+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:31:28.305568+0000","last_undegraded":"2024-09-12T18:31:28.305568+0000","last_fullsized":"2024-09-12T18:31:28.305568+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:36.873441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'289","reported_seq":1055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.688797+0000","last_change":"2024-09-12T17:35:40.893979+0000","last_active":"2024-09-12T18:30:52.688797+0000","last_peered":"2024-09-12T18:30:52.688797+0000","last_clean":"2024-09-12T18:30:52.688797+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:30:52.688797+0000","last_undegraded":"2024-09-12T18:30:52.688797+0000","last_fullsized":"2024-09-12T18:30:52.688797+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:20.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144613,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":714,"num_read_kb":10754,"num_write":1074,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647106+0000","last_change":"2024-09-12T17:35:44.894904+0000","last_active":"2024-09-12T18:28:57.647106+0000","last_peered":"2024-09-12T18:28:57.647106+0000","last_clean":"2024-09-12T18:28:57.647106+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:28:57.647106+0000","last_undegraded":"2024-09-12T18:28:57.647106+0000","last_fullsized":"2024-09-12T18:28:57.647106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:49.733122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'337","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855854+0000","last_change":"2024-09-12T17:35:46.891705+0000","last_active":"2024-09-12T18:31:22.855854+0000","last_peered":"2024-09-12T18:31:22.855854+0000","last_clean":"2024-09-12T18:31:22.855854+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:31:22.855854+0000","last_undegraded":"2024-09-12T18:31:22.855854+0000","last_fullsized":"2024-09-12T18:31:22.855854+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:37.590312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59298,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1037,"num_write":432,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409035+0000","last_change":"2024-09-12T17:35:48.908793+0000","last_active":"2024-09-12T18:29:02.409035+0000","last_peered":"2024-09-12T18:29:02.409035+0000","last_clean":"2024-09-12T18:29:02.409035+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:29:02.409035+0000","last_undegraded":"2024-09-12T18:29:02.409035+0000","last_fullsized":"2024-09-12T18:29:02.409035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.844066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'159","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.215133+0000","last_change":"2024-09-12T17:35:50.921992+0000","last_active":"2024-09-12T18:32:48.215133+0000","last_peered":"2024-09-12T18:32:48.215133+0000","last_clean":"2024-09-12T18:32:48.215133+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:32:48.215133+0000","last_undegraded":"2024-09-12T18:32:48.215133+0000","last_fullsized":"2024-09-12T18:32:48.215133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:51.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'479","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440599+0000","last_change":"2024-09-12T17:35:42.890621+0000","last_active":"2024-09-12T18:30:15.440599+0000","last_peered":"2024-09-12T18:30:15.440599+0000","last_clean":"2024-09-12T18:30:15.440599+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:30:15.440599+0000","last_undegraded":"2024-09-12T18:30:15.440599+0000","last_fullsized":"2024-09-12T18:30:15.440599+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:54.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'346","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.454985+0000","last_change":"2024-09-12T17:35:40.889680+0000","last_active":"2024-09-12T18:29:38.454985+0000","last_peered":"2024-09-12T18:29:38.454985+0000","last_clean":"2024-09-12T18:29:38.454985+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:29:38.454985+0000","last_undegraded":"2024-09-12T18:29:38.454985+0000","last_fullsized":"2024-09-12T18:29:38.454985+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.317264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9114513,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":601,"num_read_kb":80570,"num_write":1218,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415429+0000","last_change":"2024-09-12T17:35:44.894677+0000","last_active":"2024-09-12T18:29:42.415429+0000","last_peered":"2024-09-12T18:29:42.415429+0000","last_clean":"2024-09-12T18:29:42.415429+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:29:42.415429+0000","last_undegraded":"2024-09-12T18:29:42.415429+0000","last_fullsized":"2024-09-12T18:29:42.415429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:39.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'89","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530565+0000","last_change":"2024-09-12T17:35:46.899363+0000","last_active":"2024-09-12T18:28:58.530565+0000","last_peered":"2024-09-12T18:28:58.530565+0000","last_clean":"2024-09-12T18:28:58.530565+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:28:58.530565+0000","last_undegraded":"2024-09-12T18:28:58.530565+0000","last_fullsized":"2024-09-12T18:28:58.530565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530549+0000","last_change":"2024-09-12T17:35:48.901307+0000","last_active":"2024-09-12T18:28:58.530549+0000","last_peered":"2024-09-12T18:28:58.530549+0000","last_clean":"2024-09-12T18:28:58.530549+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:28:58.530549+0000","last_undegraded":"2024-09-12T18:28:58.530549+0000","last_fullsized":"2024-09-12T18:28:58.530549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:46.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'172","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.558222+0000","last_change":"2024-09-12T17:35:50.916182+0000","last_active":"2024-09-12T18:29:58.558222+0000","last_peered":"2024-09-12T18:29:58.558222+0000","last_clean":"2024-09-12T18:29:58.558222+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:29:58.558222+0000","last_undegraded":"2024-09-12T18:29:58.558222+0000","last_fullsized":"2024-09-12T18:29:58.558222+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:31.805546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1211","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816008+0000","last_change":"2024-09-12T17:35:42.901505+0000","last_active":"2024-09-12T18:30:18.816008+0000","last_peered":"2024-09-12T18:30:18.816008+0000","last_clean":"2024-09-12T18:30:18.816008+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:30:18.816008+0000","last_undegraded":"2024-09-12T18:30:18.816008+0000","last_fullsized":"2024-09-12T18:30:18.816008+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:38.531579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'328","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:39.804067+0000","last_change":"2024-09-12T17:35:40.891281+0000","last_active":"2024-09-12T18:29:39.804067+0000","last_peered":"2024-09-12T18:29:39.804067+0000","last_clean":"2024-09-12T18:29:39.804067+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:29:39.804067+0000","last_undegraded":"2024-09-12T18:29:39.804067+0000","last_fullsized":"2024-09-12T18:29:39.804067+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:27.169879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9599526,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":483,"num_read_kb":8445,"num_write":1209,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409696+0000","last_change":"2024-09-12T17:35:44.891907+0000","last_active":"2024-09-12T18:28:57.409696+0000","last_peered":"2024-09-12T18:28:57.409696+0000","last_clean":"2024-09-12T18:28:57.409696+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:28:57.409696+0000","last_undegraded":"2024-09-12T18:28:57.409696+0000","last_fullsized":"2024-09-12T18:28:57.409696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:17.733659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'121","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.508338+0000","last_change":"2024-09-12T17:35:46.901224+0000","last_active":"2024-09-12T18:29:37.508338+0000","last_peered":"2024-09-12T18:29:37.508338+0000","last_clean":"2024-09-12T18:29:37.508338+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:29:37.508338+0000","last_undegraded":"2024-09-12T18:29:37.508338+0000","last_fullsized":"2024-09-12T18:29:37.508338+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:25.864997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'760","reported_seq":2574,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130833+0000","last_change":"2024-09-12T17:35:48.907483+0000","last_active":"2024-09-12T18:32:53.130833+0000","last_peered":"2024-09-12T18:32:53.130833+0000","last_clean":"2024-09-12T18:32:53.130833+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:32:53.130833+0000","last_undegraded":"2024-09-12T18:32:53.130833+0000","last_fullsized":"2024-09-12T18:32:53.130833+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.736753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'230","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.422075+0000","last_change":"2024-09-12T17:35:51.346696+0000","last_active":"2024-09-12T18:31:28.422075+0000","last_peered":"2024-09-12T18:31:28.422075+0000","last_clean":"2024-09-12T18:31:28.422075+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:31:28.422075+0000","last_undegraded":"2024-09-12T18:31:28.422075+0000","last_fullsized":"2024-09-12T18:31:28.422075+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:18.663124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'672","reported_seq":2084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.119270+0000","last_change":"2024-09-12T17:35:42.895732+0000","last_active":"2024-09-12T18:31:29.119270+0000","last_peered":"2024-09-12T18:31:29.119270+0000","last_clean":"2024-09-12T18:31:29.119270+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:31:29.119270+0000","last_undegraded":"2024-09-12T18:31:29.119270+0000","last_fullsized":"2024-09-12T18:31:29.119270+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:25.681124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'289","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.136009+0000","last_change":"2024-09-12T17:35:40.900095+0000","last_active":"2024-09-12T18:29:50.136009+0000","last_peered":"2024-09-12T18:29:50.136009+0000","last_clean":"2024-09-12T18:29:50.136009+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:29:50.136009+0000","last_undegraded":"2024-09-12T18:29:50.136009+0000","last_fullsized":"2024-09-12T18:29:50.136009+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:59.106406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4598709,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":510,"num_read_kb":57705,"num_write":1072,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647162+0000","last_change":"2024-09-12T17:35:44.893676+0000","last_active":"2024-09-12T18:28:57.647162+0000","last_peered":"2024-09-12T18:28:57.647162+0000","last_clean":"2024-09-12T18:28:57.647162+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:28:57.647162+0000","last_undegraded":"2024-09-12T18:28:57.647162+0000","last_fullsized":"2024-09-12T18:28:57.647162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:14.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'273","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.434279+0000","last_change":"2024-09-12T17:35:47.464920+0000","last_active":"2024-09-12T18:31:22.434279+0000","last_peered":"2024-09-12T18:31:22.434279+0000","last_clean":"2024-09-12T18:31:22.434279+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:31:22.434279+0000","last_undegraded":"2024-09-12T18:31:22.434279+0000","last_fullsized":"2024-09-12T18:31:22.434279+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:46.905458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56997,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":951,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'812","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131261+0000","last_change":"2024-09-12T17:35:48.899501+0000","last_active":"2024-09-12T18:32:53.131261+0000","last_peered":"2024-09-12T18:32:53.131261+0000","last_clean":"2024-09-12T18:32:53.131261+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:32:53.131261+0000","last_undegraded":"2024-09-12T18:32:53.131261+0000","last_fullsized":"2024-09-12T18:32:53.131261+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:00.483899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'541","reported_seq":2111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.407478+0000","last_change":"2024-09-12T17:35:42.891761+0000","last_active":"2024-09-12T18:30:50.407478+0000","last_peered":"2024-09-12T18:30:50.407478+0000","last_clean":"2024-09-12T18:30:50.407478+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:30:50.407478+0000","last_undegraded":"2024-09-12T18:30:50.407478+0000","last_fullsized":"2024-09-12T18:30:50.407478+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:30.116005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'330","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:40.955328+0000","last_change":"2024-09-12T17:36:16.048265+0000","last_active":"2024-09-12T18:32:40.955328+0000","last_peered":"2024-09-12T18:32:40.955328+0000","last_clean":"2024-09-12T18:32:40.955328+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:32:40.955328+0000","last_undegraded":"2024-09-12T18:32:40.955328+0000","last_fullsized":"2024-09-12T18:32:40.955328+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:28.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10990092,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":23815,"num_write":1174,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418824+0000","last_change":"2024-09-12T17:35:44.897503+0000","last_active":"2024-09-12T18:29:57.418824+0000","last_peered":"2024-09-12T18:29:57.418824+0000","last_clean":"2024-09-12T18:29:57.418824+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:29:57.418824+0000","last_undegraded":"2024-09-12T18:29:57.418824+0000","last_fullsized":"2024-09-12T18:29:57.418824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.732782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'360","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.676108+0000","last_change":"2024-09-12T17:35:47.466030+0000","last_active":"2024-09-12T18:32:12.676108+0000","last_peered":"2024-09-12T18:32:12.676108+0000","last_clean":"2024-09-12T18:32:12.676108+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:32:12.676108+0000","last_undegraded":"2024-09-12T18:32:12.676108+0000","last_fullsized":"2024-09-12T18:32:12.676108+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:23.136183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54972,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":1027,"num_write":448,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610510+0000","last_change":"2024-09-12T17:35:48.908512+0000","last_active":"2024-09-12T18:29:52.610510+0000","last_peered":"2024-09-12T18:29:52.610510+0000","last_clean":"2024-09-12T18:29:52.610510+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:29:52.610510+0000","last_undegraded":"2024-09-12T18:29:52.610510+0000","last_fullsized":"2024-09-12T18:29:52.610510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:43.347490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'584","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.244085+0000","last_change":"2024-09-12T17:35:50.922799+0000","last_active":"2024-09-12T18:32:50.244085+0000","last_peered":"2024-09-12T18:32:50.244085+0000","last_clean":"2024-09-12T18:32:50.244085+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:32:50.244085+0000","last_undegraded":"2024-09-12T18:32:50.244085+0000","last_fullsized":"2024-09-12T18:32:50.244085+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:24.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'543","reported_seq":2019,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812212+0000","last_change":"2024-09-12T17:35:42.902988+0000","last_active":"2024-09-12T18:30:18.812212+0000","last_peered":"2024-09-12T18:30:18.812212+0000","last_clean":"2024-09-12T18:30:18.812212+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:30:18.812212+0000","last_undegraded":"2024-09-12T18:30:18.812212+0000","last_fullsized":"2024-09-12T18:30:18.812212+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:13.896842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'334","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419879+0000","last_change":"2024-09-12T17:36:16.051846+0000","last_active":"2024-09-12T18:30:17.419879+0000","last_peered":"2024-09-12T18:30:17.419879+0000","last_clean":"2024-09-12T18:30:17.419879+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:30:17.419879+0000","last_undegraded":"2024-09-12T18:30:17.419879+0000","last_fullsized":"2024-09-12T18:30:17.419879+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.618855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057479,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":623,"num_read_kb":15946,"num_write":1172,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510551+0000","last_change":"2024-09-12T17:35:44.891784+0000","last_active":"2024-09-12T18:29:57.510551+0000","last_peered":"2024-09-12T18:29:57.510551+0000","last_clean":"2024-09-12T18:29:57.510551+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:29:57.510551+0000","last_undegraded":"2024-09-12T18:29:57.510551+0000","last_fullsized":"2024-09-12T18:29:57.510551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:27.255253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'268","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433730+0000","last_change":"2024-09-12T17:35:46.896008+0000","last_active":"2024-09-12T18:32:02.433730+0000","last_peered":"2024-09-12T18:32:02.433730+0000","last_clean":"2024-09-12T18:32:02.433730+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:32:02.433730+0000","last_undegraded":"2024-09-12T18:32:02.433730+0000","last_fullsized":"2024-09-12T18:32:02.433730+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:57.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":924,"num_write":360,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419734+0000","last_change":"2024-09-12T17:35:48.898203+0000","last_active":"2024-09-12T18:30:17.419734+0000","last_peered":"2024-09-12T18:30:17.419734+0000","last_clean":"2024-09-12T18:30:17.419734+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:30:17.419734+0000","last_undegraded":"2024-09-12T18:30:17.419734+0000","last_fullsized":"2024-09-12T18:30:17.419734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:47.877509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2398","reported_seq":4235,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:17.444594+0000","last_change":"2024-09-12T17:35:50.921094+0000","last_active":"2024-09-12T18:32:17.444594+0000","last_peered":"2024-09-12T18:32:17.444594+0000","last_clean":"2024-09-12T18:32:17.444594+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:32:17.444594+0000","last_undegraded":"2024-09-12T18:32:17.444594+0000","last_fullsized":"2024-09-12T18:32:17.444594+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.702558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1122","reported_seq":2583,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.526751+0000","last_change":"2024-09-12T17:35:42.900928+0000","last_active":"2024-09-12T18:30:04.526751+0000","last_peered":"2024-09-12T18:30:04.526751+0000","last_clean":"2024-09-12T18:30:04.526751+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:30:04.526751+0000","last_undegraded":"2024-09-12T18:30:04.526751+0000","last_fullsized":"2024-09-12T18:30:04.526751+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:07.706166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'273","reported_seq":943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513103+0000","last_change":"2024-09-12T17:36:16.050004+0000","last_active":"2024-09-12T18:30:17.513103+0000","last_peered":"2024-09-12T18:30:17.513103+0000","last_clean":"2024-09-12T18:30:17.513103+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:30:17.513103+0000","last_undegraded":"2024-09-12T18:30:17.513103+0000","last_fullsized":"2024-09-12T18:30:17.513103+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:23.922359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22753830,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":185869,"num_write":1087,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509529+0000","last_change":"2024-09-12T17:35:44.893925+0000","last_active":"2024-09-12T18:29:47.509529+0000","last_peered":"2024-09-12T18:29:47.509529+0000","last_clean":"2024-09-12T18:29:47.509529+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:29:47.509529+0000","last_undegraded":"2024-09-12T18:29:47.509529+0000","last_fullsized":"2024-09-12T18:29:47.509529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:20.847625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'319","reported_seq":900,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.442591+0000","last_change":"2024-09-12T17:35:46.899126+0000","last_active":"2024-09-12T18:32:07.442591+0000","last_peered":"2024-09-12T18:32:07.442591+0000","last_clean":"2024-09-12T18:32:07.442591+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:32:07.442591+0000","last_undegraded":"2024-09-12T18:32:07.442591+0000","last_fullsized":"2024-09-12T18:32:07.442591+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.188366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60888,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":1029,"num_write":422,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'787","reported_seq":4755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118750+0000","last_change":"2024-09-12T17:35:48.902303+0000","last_active":"2024-09-12T18:32:53.118750+0000","last_peered":"2024-09-12T18:32:53.118750+0000","last_clean":"2024-09-12T18:32:53.118750+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:32:53.118750+0000","last_undegraded":"2024-09-12T18:32:53.118750+0000","last_fullsized":"2024-09-12T18:32:53.118750+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:31.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'116","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.214430+0000","last_change":"2024-09-12T17:35:50.916330+0000","last_active":"2024-09-12T18:32:48.214430+0000","last_peered":"2024-09-12T18:32:48.214430+0000","last_clean":"2024-09-12T18:32:48.214430+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:32:48.214430+0000","last_undegraded":"2024-09-12T18:32:48.214430+0000","last_fullsized":"2024-09-12T18:32:48.214430+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.967026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'517","reported_seq":2158,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816091+0000","last_change":"2024-09-12T17:35:42.892720+0000","last_active":"2024-09-12T18:30:18.816091+0000","last_peered":"2024-09-12T18:30:18.816091+0000","last_clean":"2024-09-12T18:30:18.816091+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:30:18.816091+0000","last_undegraded":"2024-09-12T18:30:18.816091+0000","last_fullsized":"2024-09-12T18:30:18.816091+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:01.659398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'289","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.006585+0000","last_change":"2024-09-12T17:35:40.893097+0000","last_active":"2024-09-12T18:29:58.006585+0000","last_peered":"2024-09-12T18:29:58.006585+0000","last_clean":"2024-09-12T18:29:58.006585+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:29:58.006585+0000","last_undegraded":"2024-09-12T18:29:58.006585+0000","last_fullsized":"2024-09-12T18:29:58.006585+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:49.867087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713755,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":11855,"num_write":1164,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.511826+0000","last_change":"2024-09-12T17:35:44.893352+0000","last_active":"2024-09-12T18:30:07.511826+0000","last_peered":"2024-09-12T18:30:07.511826+0000","last_clean":"2024-09-12T18:30:07.511826+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:30:07.511826+0000","last_undegraded":"2024-09-12T18:30:07.511826+0000","last_fullsized":"2024-09-12T18:30:07.511826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:24.100202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'470","reported_seq":1094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.211076+0000","last_change":"2024-09-12T17:35:46.894868+0000","last_active":"2024-09-12T18:32:50.211076+0000","last_peered":"2024-09-12T18:32:50.211076+0000","last_clean":"2024-09-12T18:32:50.211076+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:32:50.211076+0000","last_undegraded":"2024-09-12T18:32:50.211076+0000","last_fullsized":"2024-09-12T18:32:50.211076+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:02.326426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122300,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":1816,"num_write":682,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.511164+0000","last_change":"2024-09-12T17:35:48.901213+0000","last_active":"2024-09-12T18:30:02.511164+0000","last_peered":"2024-09-12T18:30:02.511164+0000","last_clean":"2024-09-12T18:30:02.511164+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:30:02.511164+0000","last_undegraded":"2024-09-12T18:30:02.511164+0000","last_fullsized":"2024-09-12T18:30:02.511164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.829487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'162","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611795+0000","last_change":"2024-09-12T17:35:50.911833+0000","last_active":"2024-09-12T18:30:02.611795+0000","last_peered":"2024-09-12T18:30:02.611795+0000","last_clean":"2024-09-12T18:30:02.611795+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:30:02.611795+0000","last_undegraded":"2024-09-12T18:30:02.611795+0000","last_fullsized":"2024-09-12T18:30:02.611795+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:29.046424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'552","reported_seq":2191,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305005+0000","last_change":"2024-09-12T17:35:42.900912+0000","last_active":"2024-09-12T18:31:28.305005+0000","last_peered":"2024-09-12T18:31:28.305005+0000","last_clean":"2024-09-12T18:31:28.305005+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:31:28.305005+0000","last_undegraded":"2024-09-12T18:31:28.305005+0000","last_fullsized":"2024-09-12T18:31:28.305005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:06.952203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'325","reported_seq":1146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415392+0000","last_change":"2024-09-12T17:35:40.888502+0000","last_active":"2024-09-12T18:29:42.415392+0000","last_peered":"2024-09-12T18:29:42.415392+0000","last_clean":"2024-09-12T18:29:42.415392+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:29:42.415392+0000","last_undegraded":"2024-09-12T18:29:42.415392+0000","last_fullsized":"2024-09-12T18:29:42.415392+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70436,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":896,"num_read_kb":1817,"num_write":1187,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509559+0000","last_change":"2024-09-12T17:35:44.894374+0000","last_active":"2024-09-12T18:29:47.509559+0000","last_peered":"2024-09-12T18:29:47.509559+0000","last_clean":"2024-09-12T18:29:47.509559+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:29:47.509559+0000","last_undegraded":"2024-09-12T18:29:47.509559+0000","last_fullsized":"2024-09-12T18:29:47.509559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:37.315095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'288","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.212211+0000","last_change":"2024-09-12T17:35:46.899081+0000","last_active":"2024-09-12T18:32:50.212211+0000","last_peered":"2024-09-12T18:32:50.212211+0000","last_clean":"2024-09-12T18:32:50.212211+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:32:50.212211+0000","last_undegraded":"2024-09-12T18:32:50.212211+0000","last_fullsized":"2024-09-12T18:32:50.212211+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:12.067500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":956,"num_write":438,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846238+0000","last_change":"2024-09-12T17:35:48.902048+0000","last_active":"2024-09-12T18:29:57.846238+0000","last_peered":"2024-09-12T18:29:57.846238+0000","last_clean":"2024-09-12T18:29:57.846238+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:29:57.846238+0000","last_undegraded":"2024-09-12T18:29:57.846238+0000","last_fullsized":"2024-09-12T18:29:57.846238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:02.774589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'94","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.488770+0000","last_change":"2024-09-12T17:35:50.921798+0000","last_active":"2024-09-12T18:32:38.488770+0000","last_peered":"2024-09-12T18:32:38.488770+0000","last_clean":"2024-09-12T18:32:38.488770+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:32:38.488770+0000","last_undegraded":"2024-09-12T18:32:38.488770+0000","last_fullsized":"2024-09-12T18:32:38.488770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:56.715205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'569","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812211+0000","last_change":"2024-09-12T17:35:42.891518+0000","last_active":"2024-09-12T18:30:18.812211+0000","last_peered":"2024-09-12T18:30:18.812211+0000","last_clean":"2024-09-12T18:30:18.812211+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:30:18.812211+0000","last_undegraded":"2024-09-12T18:30:18.812211+0000","last_fullsized":"2024-09-12T18:30:18.812211+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.251539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'292","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419688+0000","last_change":"2024-09-12T17:35:40.894104+0000","last_active":"2024-09-12T18:30:02.419688+0000","last_peered":"2024-09-12T18:30:02.419688+0000","last_clean":"2024-09-12T18:30:02.419688+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:30:02.419688+0000","last_undegraded":"2024-09-12T18:30:02.419688+0000","last_fullsized":"2024-09-12T18:30:02.419688+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:58.765499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11543540,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":452,"num_read_kb":30147,"num_write":1073,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"36'5","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.360065+0000","last_change":"2024-09-12T17:35:44.898322+0000","last_active":"2024-09-12T18:32:49.360065+0000","last_peered":"2024-09-12T18:32:49.360065+0000","last_clean":"2024-09-12T18:32:49.360065+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:32:49.360065+0000","last_undegraded":"2024-09-12T18:32:49.360065+0000","last_fullsized":"2024-09-12T18:32:49.360065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:56.912777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'309","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.526103+0000","last_change":"2024-09-12T17:35:46.902352+0000","last_active":"2024-09-12T18:32:12.526103+0000","last_peered":"2024-09-12T18:32:12.526103+0000","last_clean":"2024-09-12T18:32:12.526103+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:32:12.526103+0000","last_undegraded":"2024-09-12T18:32:12.526103+0000","last_fullsized":"2024-09-12T18:32:12.526103+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:39.492378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":983,"num_write":406,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118910+0000","last_change":"2024-09-12T17:35:48.906082+0000","last_active":"2024-09-12T18:32:53.118910+0000","last_peered":"2024-09-12T18:32:53.118910+0000","last_clean":"2024-09-12T18:32:53.118910+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:32:53.118910+0000","last_undegraded":"2024-09-12T18:32:53.118910+0000","last_fullsized":"2024-09-12T18:32:53.118910+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:57.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'132","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.193519+0000","last_change":"2024-09-12T17:35:50.909941+0000","last_active":"2024-09-12T18:31:27.193519+0000","last_peered":"2024-09-12T18:31:27.193519+0000","last_clean":"2024-09-12T18:31:27.193519+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:31:27.193519+0000","last_undegraded":"2024-09-12T18:31:27.193519+0000","last_fullsized":"2024-09-12T18:31:27.193519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:20.080003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'391","reported_seq":1810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812238+0000","last_change":"2024-09-12T17:35:42.899041+0000","last_active":"2024-09-12T18:30:18.812238+0000","last_peered":"2024-09-12T18:30:18.812238+0000","last_clean":"2024-09-12T18:30:18.812238+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:30:18.812238+0000","last_undegraded":"2024-09-12T18:30:18.812238+0000","last_fullsized":"2024-09-12T18:30:18.812238+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:37.507108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'279","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.504928+0000","last_change":"2024-09-12T17:35:40.904599+0000","last_active":"2024-09-12T18:33:03.504928+0000","last_peered":"2024-09-12T18:33:03.504928+0000","last_clean":"2024-09-12T18:33:03.504928+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:03.504928+0000","last_undegraded":"2024-09-12T18:33:03.504928+0000","last_fullsized":"2024-09-12T18:33:03.504928+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.738624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769033,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":4238,"num_write":1089,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1442,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.371226+0000","last_change":"2024-09-12T17:35:44.898038+0000","last_active":"2024-09-12T18:32:49.371226+0000","last_peered":"2024-09-12T18:32:49.371226+0000","last_clean":"2024-09-12T18:32:49.371226+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:32:49.371226+0000","last_undegraded":"2024-09-12T18:32:49.371226+0000","last_fullsized":"2024-09-12T18:32:49.371226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:34.625148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'95","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416056+0000","last_change":"2024-09-12T17:35:47.464847+0000","last_active":"2024-09-12T18:29:47.416056+0000","last_peered":"2024-09-12T18:29:47.416056+0000","last_clean":"2024-09-12T18:29:47.416056+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:29:47.416056+0000","last_undegraded":"2024-09-12T18:29:47.416056+0000","last_fullsized":"2024-09-12T18:29:47.416056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:21.681360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'777","reported_seq":2599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130536+0000","last_change":"2024-09-12T17:35:48.904923+0000","last_active":"2024-09-12T18:32:53.130536+0000","last_peered":"2024-09-12T18:32:53.130536+0000","last_clean":"2024-09-12T18:32:53.130536+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:32:53.130536+0000","last_undegraded":"2024-09-12T18:32:53.130536+0000","last_fullsized":"2024-09-12T18:32:53.130536+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.107183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'108","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.539421+0000","last_change":"2024-09-12T17:35:50.910651+0000","last_active":"2024-09-12T18:30:03.539421+0000","last_peered":"2024-09-12T18:30:03.539421+0000","last_clean":"2024-09-12T18:30:03.539421+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:30:03.539421+0000","last_undegraded":"2024-09-12T18:30:03.539421+0000","last_fullsized":"2024-09-12T18:30:03.539421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'456","reported_seq":2050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.354919+0000","last_change":"2024-09-12T17:35:42.893296+0000","last_active":"2024-09-12T18:30:02.354919+0000","last_peered":"2024-09-12T18:30:02.354919+0000","last_clean":"2024-09-12T18:30:02.354919+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:30:02.354919+0000","last_undegraded":"2024-09-12T18:30:02.354919+0000","last_fullsized":"2024-09-12T18:30:02.354919+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.897104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'296","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.495418+0000","last_change":"2024-09-12T17:35:40.887751+0000","last_active":"2024-09-12T18:32:47.495418+0000","last_peered":"2024-09-12T18:32:47.495418+0000","last_clean":"2024-09-12T18:32:47.495418+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:32:47.495418+0000","last_undegraded":"2024-09-12T18:32:47.495418+0000","last_fullsized":"2024-09-12T18:32:47.495418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:38.884936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6630172,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":548,"num_read_kb":18792,"num_write":968,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:48.537562+0000","last_change":"2024-09-12T17:35:44.894399+0000","last_active":"2024-09-12T18:29:48.537562+0000","last_peered":"2024-09-12T18:29:48.537562+0000","last_clean":"2024-09-12T18:29:48.537562+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:29:48.537562+0000","last_undegraded":"2024-09-12T18:29:48.537562+0000","last_fullsized":"2024-09-12T18:29:48.537562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:44.105931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'346","reported_seq":949,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674692+0000","last_change":"2024-09-12T17:35:46.899125+0000","last_active":"2024-09-12T18:32:02.674692+0000","last_peered":"2024-09-12T18:32:02.674692+0000","last_clean":"2024-09-12T18:32:02.674692+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:32:02.674692+0000","last_undegraded":"2024-09-12T18:32:02.674692+0000","last_fullsized":"2024-09-12T18:32:02.674692+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:44.324703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61834,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":560,"num_read_kb":1050,"num_write":442,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417912+0000","last_change":"2024-09-12T17:35:48.906391+0000","last_active":"2024-09-12T18:29:52.417912+0000","last_peered":"2024-09-12T18:29:52.417912+0000","last_clean":"2024-09-12T18:29:52.417912+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:29:52.417912+0000","last_undegraded":"2024-09-12T18:29:52.417912+0000","last_fullsized":"2024-09-12T18:29:52.417912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.195528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'123","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.371706+0000","last_change":"2024-09-12T17:35:50.921659+0000","last_active":"2024-09-12T18:30:12.371706+0000","last_peered":"2024-09-12T18:30:12.371706+0000","last_clean":"2024-09-12T18:30:12.371706+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:30:12.371706+0000","last_undegraded":"2024-09-12T18:30:12.371706+0000","last_fullsized":"2024-09-12T18:30:12.371706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:51.201223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'925","reported_seq":2656,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440823+0000","last_change":"2024-09-12T17:35:42.902610+0000","last_active":"2024-09-12T18:30:15.440823+0000","last_peered":"2024-09-12T18:30:15.440823+0000","last_clean":"2024-09-12T18:30:15.440823+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:30:15.440823+0000","last_undegraded":"2024-09-12T18:30:15.440823+0000","last_fullsized":"2024-09-12T18:30:15.440823+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":900,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:15.705104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.414933+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T18:29:37.414933+0000","last_peered":"2024-09-12T18:29:37.414933+0000","last_clean":"2024-09-12T18:29:37.414933+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:29:37.414933+0000","last_undegraded":"2024-09-12T18:29:37.414933+0000","last_fullsized":"2024-09-12T18:29:37.414933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.654007+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T18:29:42.654007+0000","last_peered":"2024-09-12T18:29:42.654007+0000","last_clean":"2024-09-12T18:29:42.654007+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:29:42.654007+0000","last_undegraded":"2024-09-12T18:29:42.654007+0000","last_fullsized":"2024-09-12T18:29:42.654007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'257","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.416631+0000","last_change":"2024-09-12T17:35:40.885469+0000","last_active":"2024-09-12T18:29:52.416631+0000","last_peered":"2024-09-12T18:29:52.416631+0000","last_clean":"2024-09-12T18:29:52.416631+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:29:52.416631+0000","last_undegraded":"2024-09-12T18:29:52.416631+0000","last_fullsized":"2024-09-12T18:29:52.416631+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.530648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8332815,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":367,"num_read_kb":16539,"num_write":953,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418918+0000","last_change":"2024-09-12T17:35:44.896284+0000","last_active":"2024-09-12T18:29:57.418918+0000","last_peered":"2024-09-12T18:29:57.418918+0000","last_clean":"2024-09-12T18:29:57.418918+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:29:57.418918+0000","last_undegraded":"2024-09-12T18:29:57.418918+0000","last_fullsized":"2024-09-12T18:29:57.418918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.136280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'709","reported_seq":1394,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.229222+0000","last_change":"2024-09-12T17:35:46.902551+0000","last_active":"2024-09-12T18:32:50.229222+0000","last_peered":"2024-09-12T18:32:50.229222+0000","last_clean":"2024-09-12T18:32:50.229222+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:32:50.229222+0000","last_undegraded":"2024-09-12T18:32:50.229222+0000","last_fullsized":"2024-09-12T18:32:50.229222+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:53.419712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1383,"num_read_kb":2857,"num_write":1316,"num_write_kb":1178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846900+0000","last_change":"2024-09-12T17:35:48.901898+0000","last_active":"2024-09-12T18:30:02.846900+0000","last_peered":"2024-09-12T18:30:02.846900+0000","last_clean":"2024-09-12T18:30:02.846900+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:30:02.846900+0000","last_undegraded":"2024-09-12T18:30:02.846900+0000","last_fullsized":"2024-09-12T18:30:02.846900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'186","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.265154+0000","last_change":"2024-09-12T17:35:50.921223+0000","last_active":"2024-09-12T18:31:29.265154+0000","last_peered":"2024-09-12T18:31:29.265154+0000","last_clean":"2024-09-12T18:31:29.265154+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:31:29.265154+0000","last_undegraded":"2024-09-12T18:31:29.265154+0000","last_fullsized":"2024-09-12T18:31:29.265154+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.825503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'773","reported_seq":2219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978406+0000","last_change":"2024-09-12T17:35:42.900821+0000","last_active":"2024-09-12T18:30:25.978406+0000","last_peered":"2024-09-12T18:30:25.978406+0000","last_clean":"2024-09-12T18:30:25.978406+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:30:25.978406+0000","last_undegraded":"2024-09-12T18:30:25.978406+0000","last_fullsized":"2024-09-12T18:30:25.978406+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:57.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415813+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T18:29:42.415813+0000","last_peered":"2024-09-12T18:29:42.415813+0000","last_clean":"2024-09-12T18:29:42.415813+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:29:42.415813+0000","last_undegraded":"2024-09-12T18:29:42.415813+0000","last_fullsized":"2024-09-12T18:29:42.415813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'287","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845332+0000","last_change":"2024-09-12T17:35:40.899267+0000","last_active":"2024-09-12T18:29:52.845332+0000","last_peered":"2024-09-12T18:29:52.845332+0000","last_clean":"2024-09-12T18:29:52.845332+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:29:52.845332+0000","last_undegraded":"2024-09-12T18:29:52.845332+0000","last_fullsized":"2024-09-12T18:29:52.845332+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.692194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6086703,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":435,"num_read_kb":8966,"num_write":1060,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656378+0000","last_change":"2024-09-12T17:35:44.895852+0000","last_active":"2024-09-12T18:29:57.656378+0000","last_peered":"2024-09-12T18:29:57.656378+0000","last_clean":"2024-09-12T18:29:57.656378+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:29:57.656378+0000","last_undegraded":"2024-09-12T18:29:57.656378+0000","last_fullsized":"2024-09-12T18:29:57.656378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1288","reported_seq":2894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.112381+0000","last_change":"2024-09-12T17:35:46.899606+0000","last_active":"2024-09-12T18:32:53.112381+0000","last_peered":"2024-09-12T18:32:53.112381+0000","last_clean":"2024-09-12T18:32:53.112381+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:32:53.112381+0000","last_undegraded":"2024-09-12T18:32:53.112381+0000","last_fullsized":"2024-09-12T18:32:53.112381+0000","mapping_epoch":30,"log_start":"262'1200","ondisk_log_start":"262'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:45.048964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179822,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2027,"num_read_kb":3519,"num_write":1158,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.421442+0000","last_change":"2024-09-12T17:35:48.903717+0000","last_active":"2024-09-12T18:30:12.421442+0000","last_peered":"2024-09-12T18:30:12.421442+0000","last_clean":"2024-09-12T18:30:12.421442+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:30:12.421442+0000","last_undegraded":"2024-09-12T18:30:12.421442+0000","last_fullsized":"2024-09-12T18:30:12.421442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:26.731204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'253","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.259283+0000","last_change":"2024-09-12T17:35:51.345599+0000","last_active":"2024-09-12T18:31:29.259283+0000","last_peered":"2024-09-12T18:31:29.259283+0000","last_clean":"2024-09-12T18:31:29.259283+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:31:29.259283+0000","last_undegraded":"2024-09-12T18:31:29.259283+0000","last_fullsized":"2024-09-12T18:31:29.259283+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.606088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'489","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304547+0000","last_change":"2024-09-12T17:35:42.897417+0000","last_active":"2024-09-12T18:31:28.304547+0000","last_peered":"2024-09-12T18:31:28.304547+0000","last_clean":"2024-09-12T18:31:28.304547+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:31:28.304547+0000","last_undegraded":"2024-09-12T18:31:28.304547+0000","last_fullsized":"2024-09-12T18:31:28.304547+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:48.996327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.508930+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T18:29:42.508930+0000","last_peered":"2024-09-12T18:29:42.508930+0000","last_clean":"2024-09-12T18:29:42.508930+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:29:42.508930+0000","last_undegraded":"2024-09-12T18:29:42.508930+0000","last_fullsized":"2024-09-12T18:29:42.508930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'280","reported_seq":905,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.226667+0000","last_change":"2024-09-12T17:35:40.892528+0000","last_active":"2024-09-12T18:30:16.226667+0000","last_peered":"2024-09-12T18:30:16.226667+0000","last_clean":"2024-09-12T18:30:16.226667+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:30:16.226667+0000","last_undegraded":"2024-09-12T18:30:16.226667+0000","last_fullsized":"2024-09-12T18:30:16.226667+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:49.177521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9467039,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":442,"num_read_kb":5597,"num_write":1095,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510633+0000","last_change":"2024-09-12T17:35:44.894603+0000","last_active":"2024-09-12T18:29:57.510633+0000","last_peered":"2024-09-12T18:29:57.510633+0000","last_clean":"2024-09-12T18:29:57.510633+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:29:57.510633+0000","last_undegraded":"2024-09-12T18:29:57.510633+0000","last_fullsized":"2024-09-12T18:29:57.510633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:34.593008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'261","reported_seq":1487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.728475+0000","last_change":"2024-09-12T17:35:47.465906+0000","last_active":"2024-09-12T18:32:47.728475+0000","last_peered":"2024-09-12T18:32:47.728475+0000","last_clean":"2024-09-12T18:32:47.728475+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:32:47.728475+0000","last_undegraded":"2024-09-12T18:32:47.728475+0000","last_fullsized":"2024-09-12T18:32:47.728475+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:51.604150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846850+0000","last_change":"2024-09-12T17:35:48.900323+0000","last_active":"2024-09-12T18:30:02.846850+0000","last_peered":"2024-09-12T18:30:02.846850+0000","last_clean":"2024-09-12T18:30:02.846850+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:30:02.846850+0000","last_undegraded":"2024-09-12T18:30:02.846850+0000","last_fullsized":"2024-09-12T18:30:02.846850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:55.834585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'282","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.403339+0000","last_change":"2024-09-12T17:35:50.910605+0000","last_active":"2024-09-12T18:31:29.403339+0000","last_peered":"2024-09-12T18:31:29.403339+0000","last_clean":"2024-09-12T18:31:29.403339+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:31:29.403339+0000","last_undegraded":"2024-09-12T18:31:29.403339+0000","last_fullsized":"2024-09-12T18:31:29.403339+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:55.444849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'395","reported_seq":1861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610548+0000","last_change":"2024-09-12T17:35:42.888553+0000","last_active":"2024-09-12T18:29:52.610548+0000","last_peered":"2024-09-12T18:29:52.610548+0000","last_clean":"2024-09-12T18:29:52.610548+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:29:52.610548+0000","last_undegraded":"2024-09-12T18:29:52.610548+0000","last_fullsized":"2024-09-12T18:29:52.610548+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:41.651814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":523,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.653977+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T18:29:42.653977+0000","last_peered":"2024-09-12T18:29:42.653977+0000","last_clean":"2024-09-12T18:29:42.653977+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:29:42.653977+0000","last_undegraded":"2024-09-12T18:29:42.653977+0000","last_fullsized":"2024-09-12T18:29:42.653977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'265","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.535233+0000","last_change":"2024-09-12T17:35:40.895684+0000","last_active":"2024-09-12T18:33:03.535233+0000","last_peered":"2024-09-12T18:33:03.535233+0000","last_clean":"2024-09-12T18:33:03.535233+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:03.535233+0000","last_undegraded":"2024-09-12T18:33:03.535233+0000","last_fullsized":"2024-09-12T18:33:03.535233+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:57.907352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6124397,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":406,"num_read_kb":24675,"num_write":957,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846866+0000","last_change":"2024-09-12T17:35:44.894175+0000","last_active":"2024-09-12T18:30:02.846866+0000","last_peered":"2024-09-12T18:30:02.846866+0000","last_clean":"2024-09-12T18:30:02.846866+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:30:02.846866+0000","last_undegraded":"2024-09-12T18:30:02.846866+0000","last_fullsized":"2024-09-12T18:30:02.846866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:36.440643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'127","reported_seq":670,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.434575+0000","last_change":"2024-09-12T17:35:46.901548+0000","last_active":"2024-09-12T18:32:07.434575+0000","last_peered":"2024-09-12T18:32:07.434575+0000","last_clean":"2024-09-12T18:32:07.434575+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:32:07.434575+0000","last_undegraded":"2024-09-12T18:32:07.434575+0000","last_fullsized":"2024-09-12T18:32:07.434575+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.552114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419806+0000","last_change":"2024-09-12T17:35:48.903992+0000","last_active":"2024-09-12T18:30:02.419806+0000","last_peered":"2024-09-12T18:30:02.419806+0000","last_clean":"2024-09-12T18:30:02.419806+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:30:02.419806+0000","last_undegraded":"2024-09-12T18:30:02.419806+0000","last_fullsized":"2024-09-12T18:30:02.419806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.680834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.983301+0000","last_change":"2024-09-12T17:35:50.920568+0000","last_active":"2024-09-12T18:30:25.983301+0000","last_peered":"2024-09-12T18:30:25.983301+0000","last_clean":"2024-09-12T18:30:25.983301+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:30:25.983301+0000","last_undegraded":"2024-09-12T18:30:25.983301+0000","last_fullsized":"2024-09-12T18:30:25.983301+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.171883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'752","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.367704+0000","last_change":"2024-09-12T17:35:42.897300+0000","last_active":"2024-09-12T18:32:48.367704+0000","last_peered":"2024-09-12T18:32:48.367704+0000","last_clean":"2024-09-12T18:32:48.367704+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:32:48.367704+0000","last_undegraded":"2024-09-12T18:32:48.367704+0000","last_fullsized":"2024-09-12T18:32:48.367704+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:37.575175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'270","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656323+0000","last_change":"2024-09-12T17:35:40.898323+0000","last_active":"2024-09-12T18:29:57.656323+0000","last_peered":"2024-09-12T18:29:57.656323+0000","last_clean":"2024-09-12T18:29:57.656323+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:29:57.656323+0000","last_undegraded":"2024-09-12T18:29:57.656323+0000","last_fullsized":"2024-09-12T18:29:57.656323+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:02.559929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5573432,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":16635,"num_write":1056,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609344+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T18:29:42.609344+0000","last_peered":"2024-09-12T18:29:42.609344+0000","last_clean":"2024-09-12T18:29:42.609344+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:29:42.609344+0000","last_undegraded":"2024-09-12T18:29:42.609344+0000","last_fullsized":"2024-09-12T18:29:42.609344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846145+0000","last_change":"2024-09-12T17:35:44.897241+0000","last_active":"2024-09-12T18:29:57.846145+0000","last_peered":"2024-09-12T18:29:57.846145+0000","last_clean":"2024-09-12T18:29:57.846145+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:29:57.846145+0000","last_undegraded":"2024-09-12T18:29:57.846145+0000","last_fullsized":"2024-09-12T18:29:57.846145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:54.095785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'558","reported_seq":1218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.221233+0000","last_change":"2024-09-12T17:35:46.896066+0000","last_active":"2024-09-12T18:32:50.221233+0000","last_peered":"2024-09-12T18:32:50.221233+0000","last_clean":"2024-09-12T18:32:50.221233+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:32:50.221233+0000","last_undegraded":"2024-09-12T18:32:50.221233+0000","last_fullsized":"2024-09-12T18:32:50.221233+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.503068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110507,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1550,"num_read_kb":2487,"num_write":2030,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538876+0000","last_change":"2024-09-12T17:35:48.894684+0000","last_active":"2024-09-12T18:29:58.538876+0000","last_peered":"2024-09-12T18:29:58.538876+0000","last_clean":"2024-09-12T18:29:58.538876+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:29:58.538876+0000","last_undegraded":"2024-09-12T18:29:58.538876+0000","last_fullsized":"2024-09-12T18:29:58.538876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:49.417148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'108","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.266811+0000","last_change":"2024-09-12T17:35:51.346736+0000","last_active":"2024-09-12T18:31:26.266811+0000","last_peered":"2024-09-12T18:31:26.266811+0000","last_clean":"2024-09-12T18:31:26.266811+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:31:26.266811+0000","last_undegraded":"2024-09-12T18:31:26.266811+0000","last_fullsized":"2024-09-12T18:31:26.266811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:44.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1006","reported_seq":2568,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.696514+0000","last_change":"2024-09-12T17:35:42.894625+0000","last_active":"2024-09-12T18:30:18.696514+0000","last_peered":"2024-09-12T18:30:18.696514+0000","last_clean":"2024-09-12T18:30:18.696514+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:30:18.696514+0000","last_undegraded":"2024-09-12T18:30:18.696514+0000","last_fullsized":"2024-09-12T18:30:18.696514+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'310","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.763506+0000","last_change":"2024-09-12T17:35:40.893165+0000","last_active":"2024-09-12T18:30:03.763506+0000","last_peered":"2024-09-12T18:30:03.763506+0000","last_clean":"2024-09-12T18:30:03.763506+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:30:03.763506+0000","last_undegraded":"2024-09-12T18:30:03.763506+0000","last_fullsized":"2024-09-12T18:30:03.763506+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:35.842097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3551983,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":488,"num_read_kb":48347,"num_write":1107,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417867+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T18:29:52.417867+0000","last_peered":"2024-09-12T18:29:52.417867+0000","last_clean":"2024-09-12T18:29:52.417867+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:29:52.417867+0000","last_undegraded":"2024-09-12T18:29:52.417867+0000","last_fullsized":"2024-09-12T18:29:52.417867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418796+0000","last_change":"2024-09-12T17:35:44.893378+0000","last_active":"2024-09-12T18:29:57.418796+0000","last_peered":"2024-09-12T18:29:57.418796+0000","last_clean":"2024-09-12T18:29:57.418796+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:29:57.418796+0000","last_undegraded":"2024-09-12T18:29:57.418796+0000","last_fullsized":"2024-09-12T18:29:57.418796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:00.649691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'201","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.324384+0000","last_change":"2024-09-12T17:35:47.465022+0000","last_active":"2024-09-12T18:31:52.324384+0000","last_peered":"2024-09-12T18:31:52.324384+0000","last_clean":"2024-09-12T18:31:52.324384+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:31:52.324384+0000","last_undegraded":"2024-09-12T18:31:52.324384+0000","last_fullsized":"2024-09-12T18:31:52.324384+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:20.452871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'781","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131630+0000","last_change":"2024-09-12T17:35:48.905261+0000","last_active":"2024-09-12T18:32:53.131630+0000","last_peered":"2024-09-12T18:32:53.131630+0000","last_clean":"2024-09-12T18:32:53.131630+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:32:53.131630+0000","last_undegraded":"2024-09-12T18:32:53.131630+0000","last_fullsized":"2024-09-12T18:32:53.131630+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:47.769518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'442","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977350+0000","last_change":"2024-09-12T17:35:42.883869+0000","last_active":"2024-09-12T18:30:25.977350+0000","last_peered":"2024-09-12T18:30:25.977350+0000","last_clean":"2024-09-12T18:30:25.977350+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:30:25.977350+0000","last_undegraded":"2024-09-12T18:30:25.977350+0000","last_fullsized":"2024-09-12T18:30:25.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:13.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'282","reported_seq":933,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.856883+0000","last_change":"2024-09-12T17:35:40.889008+0000","last_active":"2024-09-12T18:32:41.856883+0000","last_peered":"2024-09-12T18:32:41.856883+0000","last_clean":"2024-09-12T18:32:41.856883+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:32:41.856883+0000","last_undegraded":"2024-09-12T18:32:41.856883+0000","last_fullsized":"2024-09-12T18:32:41.856883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:41.906990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16127089,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":454,"num_read_kb":50118,"num_write":999,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609379+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T18:29:42.609379+0000","last_peered":"2024-09-12T18:29:42.609379+0000","last_clean":"2024-09-12T18:29:42.609379+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:29:42.609379+0000","last_undegraded":"2024-09-12T18:29:42.609379+0000","last_fullsized":"2024-09-12T18:29:42.609379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538843+0000","last_change":"2024-09-12T17:35:44.889025+0000","last_active":"2024-09-12T18:29:58.538843+0000","last_peered":"2024-09-12T18:29:58.538843+0000","last_clean":"2024-09-12T18:29:58.538843+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:29:58.538843+0000","last_undegraded":"2024-09-12T18:29:58.538843+0000","last_fullsized":"2024-09-12T18:29:58.538843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:25.842079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'113","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538898+0000","last_change":"2024-09-12T17:35:46.896908+0000","last_active":"2024-09-12T18:29:58.538898+0000","last_peered":"2024-09-12T18:29:58.538898+0000","last_clean":"2024-09-12T18:29:58.538898+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:29:58.538898+0000","last_undegraded":"2024-09-12T18:29:58.538898+0000","last_fullsized":"2024-09-12T18:29:58.538898+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:22.911858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'812","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131172+0000","last_change":"2024-09-12T17:35:48.900105+0000","last_active":"2024-09-12T18:32:53.131172+0000","last_peered":"2024-09-12T18:32:53.131172+0000","last_clean":"2024-09-12T18:32:53.131172+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:32:53.131172+0000","last_undegraded":"2024-09-12T18:32:53.131172+0000","last_fullsized":"2024-09-12T18:32:53.131172+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:30.882725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'184","reported_seq":689,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845406+0000","last_change":"2024-09-12T17:35:50.910752+0000","last_active":"2024-09-12T18:29:52.845406+0000","last_peered":"2024-09-12T18:29:52.845406+0000","last_clean":"2024-09-12T18:29:52.845406+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:29:52.845406+0000","last_undegraded":"2024-09-12T18:29:52.845406+0000","last_fullsized":"2024-09-12T18:29:52.845406+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.734993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'538","reported_seq":2142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.549252+0000","last_change":"2024-09-12T17:35:42.895619+0000","last_active":"2024-09-12T18:29:58.549252+0000","last_peered":"2024-09-12T18:29:58.549252+0000","last_clean":"2024-09-12T18:29:58.549252+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:29:58.549252+0000","last_undegraded":"2024-09-12T18:29:58.549252+0000","last_fullsized":"2024-09-12T18:29:58.549252+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'252","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.861440+0000","last_change":"2024-09-12T17:35:40.896218+0000","last_active":"2024-09-12T18:32:02.861440+0000","last_peered":"2024-09-12T18:32:02.861440+0000","last_clean":"2024-09-12T18:32:02.861440+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:32:02.861440+0000","last_undegraded":"2024-09-12T18:32:02.861440+0000","last_fullsized":"2024-09-12T18:32:02.861440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:29.873178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8697643,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":403,"num_read_kb":18058,"num_write":1001,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415941+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T18:29:42.415941+0000","last_peered":"2024-09-12T18:29:42.415941+0000","last_clean":"2024-09-12T18:29:42.415941+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:29:42.415941+0000","last_undegraded":"2024-09-12T18:29:42.415941+0000","last_fullsized":"2024-09-12T18:29:42.415941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417831+0000","last_change":"2024-09-12T17:35:44.893144+0000","last_active":"2024-09-12T18:30:02.417831+0000","last_peered":"2024-09-12T18:30:02.417831+0000","last_clean":"2024-09-12T18:30:02.417831+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:30:02.417831+0000","last_undegraded":"2024-09-12T18:30:02.417831+0000","last_fullsized":"2024-09-12T18:30:02.417831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:31.642197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'704","reported_seq":1408,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.217041+0000","last_change":"2024-09-12T17:35:47.464888+0000","last_active":"2024-09-12T18:32:50.217041+0000","last_peered":"2024-09-12T18:32:50.217041+0000","last_clean":"2024-09-12T18:32:50.217041+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:32:50.217041+0000","last_undegraded":"2024-09-12T18:32:50.217041+0000","last_fullsized":"2024-09-12T18:32:50.217041+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1250,"num_read_kb":2682,"num_write":1026,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417876+0000","last_change":"2024-09-12T17:35:48.899057+0000","last_active":"2024-09-12T18:30:02.417876+0000","last_peered":"2024-09-12T18:30:02.417876+0000","last_clean":"2024-09-12T18:30:02.417876+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:30:02.417876+0000","last_undegraded":"2024-09-12T18:30:02.417876+0000","last_fullsized":"2024-09-12T18:30:02.417876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:39.593576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'129","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655594+0000","last_change":"2024-09-12T17:35:50.924579+0000","last_active":"2024-09-12T18:29:52.655594+0000","last_peered":"2024-09-12T18:29:52.655594+0000","last_clean":"2024-09-12T18:29:52.655594+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:29:52.655594+0000","last_undegraded":"2024-09-12T18:29:52.655594+0000","last_fullsized":"2024-09-12T18:29:52.655594+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:27.853643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.346697+0000","last_change":"2024-09-12T17:35:50.923096+0000","last_active":"2024-09-12T18:31:29.346697+0000","last_peered":"2024-09-12T18:31:29.346697+0000","last_clean":"2024-09-12T18:31:29.346697+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:31:29.346697+0000","last_undegraded":"2024-09-12T18:31:29.346697+0000","last_fullsized":"2024-09-12T18:31:29.346697+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:15.866908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'395","reported_seq":1898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812218+0000","last_change":"2024-09-12T17:35:42.898207+0000","last_active":"2024-09-12T18:30:18.812218+0000","last_peered":"2024-09-12T18:30:18.812218+0000","last_clean":"2024-09-12T18:30:18.812218+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:30:18.812218+0000","last_undegraded":"2024-09-12T18:30:18.812218+0000","last_fullsized":"2024-09-12T18:30:18.812218+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:18.941988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'266","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.417543+0000","last_change":"2024-09-12T17:35:40.904851+0000","last_active":"2024-09-12T18:33:03.417543+0000","last_peered":"2024-09-12T18:33:03.417543+0000","last_clean":"2024-09-12T18:33:03.417543+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:03.417543+0000","last_undegraded":"2024-09-12T18:33:03.417543+0000","last_fullsized":"2024-09-12T18:33:03.417543+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730295,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":458,"num_read_kb":63909,"num_write":944,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607639+0000","last_change":"2024-09-12T17:35:44.898123+0000","last_active":"2024-09-12T18:29:27.607639+0000","last_peered":"2024-09-12T18:29:27.607639+0000","last_clean":"2024-09-12T18:29:27.607639+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:29:27.607639+0000","last_undegraded":"2024-09-12T18:29:27.607639+0000","last_fullsized":"2024-09-12T18:29:27.607639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:45.043204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'257","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431678+0000","last_change":"2024-09-12T17:35:46.898039+0000","last_active":"2024-09-12T18:31:47.431678+0000","last_peered":"2024-09-12T18:31:47.431678+0000","last_clean":"2024-09-12T18:31:47.431678+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:31:47.431678+0000","last_undegraded":"2024-09-12T18:31:47.431678+0000","last_fullsized":"2024-09-12T18:31:47.431678+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.270815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":883,"num_write":350,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414122+0000","last_change":"2024-09-12T17:35:48.899309+0000","last_active":"2024-09-12T18:29:32.414122+0000","last_peered":"2024-09-12T18:29:32.414122+0000","last_clean":"2024-09-12T18:29:32.414122+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:29:32.414122+0000","last_undegraded":"2024-09-12T18:29:32.414122+0000","last_fullsized":"2024-09-12T18:29:32.414122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:50.941565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'974","reported_seq":2454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136707+0000","last_change":"2024-09-12T17:35:42.896669+0000","last_active":"2024-09-12T18:31:29.136707+0000","last_peered":"2024-09-12T18:31:29.136707+0000","last_clean":"2024-09-12T18:31:29.136707+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:31:29.136707+0000","last_undegraded":"2024-09-12T18:31:29.136707+0000","last_fullsized":"2024-09-12T18:31:29.136707+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'324","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.407043+0000","last_change":"2024-09-12T17:35:40.886913+0000","last_active":"2024-09-12T18:28:52.407043+0000","last_peered":"2024-09-12T18:28:52.407043+0000","last_clean":"2024-09-12T18:28:52.407043+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:28:52.407043+0000","last_undegraded":"2024-09-12T18:28:52.407043+0000","last_fullsized":"2024-09-12T18:28:52.407043+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330038,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":540,"num_read_kb":8296,"num_write":1065,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.361026+0000","last_change":"2024-09-12T17:35:44.893880+0000","last_active":"2024-09-12T18:32:49.361026+0000","last_peered":"2024-09-12T18:32:49.361026+0000","last_clean":"2024-09-12T18:32:49.361026+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:32:49.361026+0000","last_undegraded":"2024-09-12T18:32:49.361026+0000","last_fullsized":"2024-09-12T18:32:49.361026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:43.603787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'55","reported_seq":559,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842309+0000","last_change":"2024-09-12T17:35:46.898981+0000","last_active":"2024-09-12T18:29:27.842309+0000","last_peered":"2024-09-12T18:29:27.842309+0000","last_clean":"2024-09-12T18:29:27.842309+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:29:27.842309+0000","last_undegraded":"2024-09-12T18:29:27.842309+0000","last_fullsized":"2024-09-12T18:29:27.842309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414052+0000","last_change":"2024-09-12T17:35:48.906133+0000","last_active":"2024-09-12T18:29:32.414052+0000","last_peered":"2024-09-12T18:29:32.414052+0000","last_clean":"2024-09-12T18:29:32.414052+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:29:32.414052+0000","last_undegraded":"2024-09-12T18:29:32.414052+0000","last_fullsized":"2024-09-12T18:29:32.414052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:11.783795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'186","reported_seq":721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.272851+0000","last_change":"2024-09-12T17:35:50.911342+0000","last_active":"2024-09-12T18:31:28.272851+0000","last_peered":"2024-09-12T18:31:28.272851+0000","last_clean":"2024-09-12T18:31:28.272851+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:31:28.272851+0000","last_undegraded":"2024-09-12T18:31:28.272851+0000","last_fullsized":"2024-09-12T18:31:28.272851+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.588084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'555","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.135761+0000","last_change":"2024-09-12T17:35:42.894287+0000","last_active":"2024-09-12T18:31:29.135761+0000","last_peered":"2024-09-12T18:31:29.135761+0000","last_clean":"2024-09-12T18:31:29.135761+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:31:29.135761+0000","last_undegraded":"2024-09-12T18:31:29.135761+0000","last_fullsized":"2024-09-12T18:31:29.135761+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:58.138070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'310","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.887094+0000","last_change":"2024-09-12T17:35:40.895963+0000","last_active":"2024-09-12T18:30:11.887094+0000","last_peered":"2024-09-12T18:30:11.887094+0000","last_clean":"2024-09-12T18:30:11.887094+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:30:11.887094+0000","last_undegraded":"2024-09-12T18:30:11.887094+0000","last_fullsized":"2024-09-12T18:30:11.887094+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:58.280652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243102,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":616,"num_read_kb":8072,"num_write":1122,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413192+0000","last_change":"2024-09-12T17:35:44.899119+0000","last_active":"2024-09-12T18:29:27.413192+0000","last_peered":"2024-09-12T18:29:27.413192+0000","last_clean":"2024-09-12T18:29:27.413192+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:29:27.413192+0000","last_undegraded":"2024-09-12T18:29:27.413192+0000","last_fullsized":"2024-09-12T18:29:27.413192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.437374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'314","reported_seq":899,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431724+0000","last_change":"2024-09-12T17:35:46.899592+0000","last_active":"2024-09-12T18:31:47.431724+0000","last_peered":"2024-09-12T18:31:47.431724+0000","last_clean":"2024-09-12T18:31:47.431724+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:31:47.431724+0000","last_undegraded":"2024-09-12T18:31:47.431724+0000","last_fullsized":"2024-09-12T18:31:47.431724+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:41.130246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59724,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1059,"num_write":432,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414094+0000","last_change":"2024-09-12T17:35:48.904071+0000","last_active":"2024-09-12T18:29:32.414094+0000","last_peered":"2024-09-12T18:29:32.414094+0000","last_clean":"2024-09-12T18:29:32.414094+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:29:32.414094+0000","last_undegraded":"2024-09-12T18:29:32.414094+0000","last_fullsized":"2024-09-12T18:29:32.414094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.350511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'98","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642138+0000","last_change":"2024-09-12T17:35:50.921087+0000","last_active":"2024-09-12T18:28:22.642138+0000","last_peered":"2024-09-12T18:28:22.642138+0000","last_clean":"2024-09-12T18:28:22.642138+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:28:22.642138+0000","last_undegraded":"2024-09-12T18:28:22.642138+0000","last_fullsized":"2024-09-12T18:28:22.642138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:26.137184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1026","reported_seq":2665,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.546129+0000","last_change":"2024-09-12T17:35:42.891619+0000","last_active":"2024-09-12T18:29:58.546129+0000","last_peered":"2024-09-12T18:29:58.546129+0000","last_clean":"2024-09-12T18:29:58.546129+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:29:58.546129+0000","last_undegraded":"2024-09-12T18:29:58.546129+0000","last_fullsized":"2024-09-12T18:29:58.546129+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:44.416070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'299","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704736+0000","last_change":"2024-09-12T17:35:40.898320+0000","last_active":"2024-09-12T18:30:52.704736+0000","last_peered":"2024-09-12T18:30:52.704736+0000","last_clean":"2024-09-12T18:30:52.704736+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:30:52.704736+0000","last_undegraded":"2024-09-12T18:30:52.704736+0000","last_fullsized":"2024-09-12T18:30:52.704736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:44.296291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12671351,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":396,"num_read_kb":38177,"num_write":1010,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413134+0000","last_change":"2024-09-12T17:35:44.895748+0000","last_active":"2024-09-12T18:29:27.413134+0000","last_peered":"2024-09-12T18:29:27.413134+0000","last_clean":"2024-09-12T18:29:27.413134+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:29:27.413134+0000","last_undegraded":"2024-09-12T18:29:27.413134+0000","last_fullsized":"2024-09-12T18:29:27.413134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'271","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.439171+0000","last_change":"2024-09-12T17:35:46.899948+0000","last_active":"2024-09-12T18:31:47.439171+0000","last_peered":"2024-09-12T18:31:47.439171+0000","last_clean":"2024-09-12T18:31:47.439171+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:31:47.439171+0000","last_undegraded":"2024-09-12T18:31:47.439171+0000","last_fullsized":"2024-09-12T18:31:47.439171+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.546669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":906,"num_write":362,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.842896+0000","last_change":"2024-09-12T17:35:48.900909+0000","last_active":"2024-09-12T18:29:32.842896+0000","last_peered":"2024-09-12T18:29:32.842896+0000","last_clean":"2024-09-12T18:29:32.842896+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:29:32.842896+0000","last_undegraded":"2024-09-12T18:29:32.842896+0000","last_fullsized":"2024-09-12T18:29:32.842896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.781603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'860","reported_seq":2482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417988+0000","last_change":"2024-09-12T17:35:42.896175+0000","last_active":"2024-09-12T18:29:52.417988+0000","last_peered":"2024-09-12T18:29:52.417988+0000","last_clean":"2024-09-12T18:29:52.417988+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:29:52.417988+0000","last_undegraded":"2024-09-12T18:29:52.417988+0000","last_fullsized":"2024-09-12T18:29:52.417988+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:52.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'288","reported_seq":1015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408784+0000","last_change":"2024-09-12T17:35:40.884915+0000","last_active":"2024-09-12T18:28:52.408784+0000","last_peered":"2024-09-12T18:28:52.408784+0000","last_clean":"2024-09-12T18:28:52.408784+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:28:52.408784+0000","last_undegraded":"2024-09-12T18:28:52.408784+0000","last_fullsized":"2024-09-12T18:28:52.408784+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:51.644098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9465428,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":695,"num_read_kb":5768,"num_write":928,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845447+0000","last_change":"2024-09-12T17:35:44.897738+0000","last_active":"2024-09-12T18:29:52.845447+0000","last_peered":"2024-09-12T18:29:52.845447+0000","last_clean":"2024-09-12T18:29:52.845447+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:29:52.845447+0000","last_undegraded":"2024-09-12T18:29:52.845447+0000","last_fullsized":"2024-09-12T18:29:52.845447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:43.811251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'488","reported_seq":1108,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.213392+0000","last_change":"2024-09-12T17:35:46.899736+0000","last_active":"2024-09-12T18:32:50.213392+0000","last_peered":"2024-09-12T18:32:50.213392+0000","last_clean":"2024-09-12T18:32:50.213392+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:32:50.213392+0000","last_undegraded":"2024-09-12T18:32:50.213392+0000","last_fullsized":"2024-09-12T18:32:50.213392+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:36.496520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":849,"num_read_kb":1857,"num_write":740,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642155+0000","last_change":"2024-09-12T17:35:48.900061+0000","last_active":"2024-09-12T18:28:22.642155+0000","last_peered":"2024-09-12T18:28:22.642155+0000","last_clean":"2024-09-12T18:28:22.642155+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:28:22.642155+0000","last_undegraded":"2024-09-12T18:28:22.642155+0000","last_fullsized":"2024-09-12T18:28:22.642155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:58.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'164","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.297167+0000","last_change":"2024-09-12T17:35:51.347046+0000","last_active":"2024-09-12T18:31:28.297167+0000","last_peered":"2024-09-12T18:31:28.297167+0000","last_clean":"2024-09-12T18:31:28.297167+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:31:28.297167+0000","last_undegraded":"2024-09-12T18:31:28.297167+0000","last_fullsized":"2024-09-12T18:31:28.297167+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.856381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'775","reported_seq":2167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305413+0000","last_change":"2024-09-12T17:35:42.896418+0000","last_active":"2024-09-12T18:31:28.305413+0000","last_peered":"2024-09-12T18:31:28.305413+0000","last_clean":"2024-09-12T18:31:28.305413+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:31:28.305413+0000","last_undegraded":"2024-09-12T18:31:28.305413+0000","last_fullsized":"2024-09-12T18:31:28.305413+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.201642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'239","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.096421+0000","last_change":"2024-09-12T17:35:40.892252+0000","last_active":"2024-09-12T18:29:46.096421+0000","last_peered":"2024-09-12T18:29:46.096421+0000","last_clean":"2024-09-12T18:29:46.096421+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:29:46.096421+0000","last_undegraded":"2024-09-12T18:29:46.096421+0000","last_fullsized":"2024-09-12T18:29:46.096421+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:53.303511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8074671,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":379,"num_read_kb":28092,"num_write":930,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418873+0000","last_change":"2024-09-12T17:35:44.897834+0000","last_active":"2024-09-12T18:29:57.418873+0000","last_peered":"2024-09-12T18:29:57.418873+0000","last_clean":"2024-09-12T18:29:57.418873+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:29:57.418873+0000","last_undegraded":"2024-09-12T18:29:57.418873+0000","last_fullsized":"2024-09-12T18:29:57.418873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:52.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'321","reported_seq":898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:35:46.899505+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.056459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73750,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1098,"num_write":464,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.600262+0000","last_change":"2024-09-12T17:35:48.906992+0000","last_active":"2024-09-12T18:28:22.600262+0000","last_peered":"2024-09-12T18:28:22.600262+0000","last_clean":"2024-09-12T18:28:22.600262+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:28:22.600262+0000","last_undegraded":"2024-09-12T18:28:22.600262+0000","last_fullsized":"2024-09-12T18:28:22.600262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.979695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'197","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.615415+0000","last_change":"2024-09-12T17:35:50.916243+0000","last_active":"2024-09-12T18:31:26.615415+0000","last_peered":"2024-09-12T18:31:26.615415+0000","last_clean":"2024-09-12T18:31:26.615415+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:31:26.615415+0000","last_undegraded":"2024-09-12T18:31:26.615415+0000","last_fullsized":"2024-09-12T18:31:26.615415+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:37.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1293","reported_seq":2864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.360743+0000","last_change":"2024-09-12T17:35:42.890895+0000","last_active":"2024-09-12T18:32:48.360743+0000","last_peered":"2024-09-12T18:32:48.360743+0000","last_clean":"2024-09-12T18:32:48.360743+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:32:48.360743+0000","last_undegraded":"2024-09-12T18:32:48.360743+0000","last_fullsized":"2024-09-12T18:32:48.360743+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:52.254143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'251","reported_seq":859,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.491622+0000","last_change":"2024-09-12T17:35:40.904317+0000","last_active":"2024-09-12T18:33:03.491622+0000","last_peered":"2024-09-12T18:33:03.491622+0000","last_clean":"2024-09-12T18:33:03.491622+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:03.491622+0000","last_undegraded":"2024-09-12T18:33:03.491622+0000","last_fullsized":"2024-09-12T18:33:03.491622+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:35.506278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4527971,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":361,"num_read_kb":10892,"num_write":921,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525199+0000","last_change":"2024-09-12T17:35:44.893724+0000","last_active":"2024-09-12T18:28:18.525199+0000","last_peered":"2024-09-12T18:28:18.525199+0000","last_clean":"2024-09-12T18:28:18.525199+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:28:18.525199+0000","last_undegraded":"2024-09-12T18:28:18.525199+0000","last_fullsized":"2024-09-12T18:28:18.525199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:31.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'286","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433877+0000","last_change":"2024-09-12T17:35:47.464841+0000","last_active":"2024-09-12T18:32:02.433877+0000","last_peered":"2024-09-12T18:32:02.433877+0000","last_clean":"2024-09-12T18:32:02.433877+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:32:02.433877+0000","last_undegraded":"2024-09-12T18:32:02.433877+0000","last_fullsized":"2024-09-12T18:32:02.433877+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:30.514600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":965,"num_write":388,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.612492+0000","last_change":"2024-09-12T17:35:48.901108+0000","last_active":"2024-09-12T18:30:07.612492+0000","last_peered":"2024-09-12T18:30:07.612492+0000","last_clean":"2024-09-12T18:30:07.612492+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:30:07.612492+0000","last_undegraded":"2024-09-12T18:30:07.612492+0000","last_fullsized":"2024-09-12T18:30:07.612492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:24.864398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'134","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.243540+0000","last_change":"2024-09-12T17:35:50.924276+0000","last_active":"2024-09-12T18:32:50.243540+0000","last_peered":"2024-09-12T18:32:50.243540+0000","last_clean":"2024-09-12T18:32:50.243540+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:32:50.243540+0000","last_undegraded":"2024-09-12T18:32:50.243540+0000","last_fullsized":"2024-09-12T18:32:50.243540+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:54.892800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'547","reported_seq":2157,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.118099+0000","last_change":"2024-09-12T17:35:42.885892+0000","last_active":"2024-09-12T18:31:29.118099+0000","last_peered":"2024-09-12T18:31:29.118099+0000","last_clean":"2024-09-12T18:31:29.118099+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:31:29.118099+0000","last_undegraded":"2024-09-12T18:31:29.118099+0000","last_fullsized":"2024-09-12T18:31:29.118099+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:40.576868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'304","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832170+0000","last_change":"2024-09-12T17:35:40.890946+0000","last_active":"2024-09-12T18:28:12.832170+0000","last_peered":"2024-09-12T18:28:12.832170+0000","last_clean":"2024-09-12T18:28:12.832170+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:28:12.832170+0000","last_undegraded":"2024-09-12T18:28:12.832170+0000","last_fullsized":"2024-09-12T18:28:12.832170+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:09.696514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18138792,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":531,"num_read_kb":50516,"num_write":1159,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.599620+0000","last_change":"2024-09-12T17:35:44.898107+0000","last_active":"2024-09-12T18:28:17.599620+0000","last_peered":"2024-09-12T18:28:17.599620+0000","last_clean":"2024-09-12T18:28:17.599620+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:28:17.599620+0000","last_undegraded":"2024-09-12T18:28:17.599620+0000","last_fullsized":"2024-09-12T18:28:17.599620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:05.181659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'103","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538945+0000","last_change":"2024-09-12T17:35:47.464849+0000","last_active":"2024-09-12T18:29:58.538945+0000","last_peered":"2024-09-12T18:29:58.538945+0000","last_clean":"2024-09-12T18:29:58.538945+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:29:58.538945+0000","last_undegraded":"2024-09-12T18:29:58.538945+0000","last_fullsized":"2024-09-12T18:29:58.538945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:58.141528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'776","reported_seq":4138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130542+0000","last_change":"2024-09-12T17:35:48.900442+0000","last_active":"2024-09-12T18:32:53.130542+0000","last_peered":"2024-09-12T18:32:53.130542+0000","last_clean":"2024-09-12T18:32:53.130542+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:32:53.130542+0000","last_undegraded":"2024-09-12T18:32:53.130542+0000","last_fullsized":"2024-09-12T18:32:53.130542+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:15.114968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.761165+0000","last_change":"2024-09-12T17:35:50.922214+0000","last_active":"2024-09-12T18:29:46.761165+0000","last_peered":"2024-09-12T18:29:46.761165+0000","last_clean":"2024-09-12T18:29:46.761165+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:29:46.761165+0000","last_undegraded":"2024-09-12T18:29:46.761165+0000","last_fullsized":"2024-09-12T18:29:46.761165+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.526052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'765","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651768+0000","last_change":"2024-09-12T17:35:42.900581+0000","last_active":"2024-09-12T18:30:10.651768+0000","last_peered":"2024-09-12T18:30:10.651768+0000","last_clean":"2024-09-12T18:30:10.651768+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:30:10.651768+0000","last_undegraded":"2024-09-12T18:30:10.651768+0000","last_fullsized":"2024-09-12T18:30:10.651768+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:13.276710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'271","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.447105+0000","last_change":"2024-09-12T17:36:16.051163+0000","last_active":"2024-09-12T18:29:38.447105+0000","last_peered":"2024-09-12T18:29:38.447105+0000","last_clean":"2024-09-12T18:29:38.447105+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:29:38.447105+0000","last_undegraded":"2024-09-12T18:29:38.447105+0000","last_fullsized":"2024-09-12T18:29:38.447105+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:40.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13954640,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":50614,"num_write":1000,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400910+0000","last_change":"2024-09-12T17:35:44.899845+0000","last_active":"2024-09-12T18:28:17.400910+0000","last_peered":"2024-09-12T18:28:17.400910+0000","last_clean":"2024-09-12T18:28:17.400910+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:28:17.400910+0000","last_undegraded":"2024-09-12T18:28:17.400910+0000","last_fullsized":"2024-09-12T18:28:17.400910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:48.236755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'302","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.971777+0000","last_change":"2024-09-12T17:35:46.897904+0000","last_active":"2024-09-12T18:32:43.971777+0000","last_peered":"2024-09-12T18:32:43.971777+0000","last_clean":"2024-09-12T18:32:43.971777+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:32:43.971777+0000","last_undegraded":"2024-09-12T18:32:43.971777+0000","last_fullsized":"2024-09-12T18:32:43.971777+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:11.348372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56114,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":971,"num_write":408,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839380+0000","last_change":"2024-09-12T17:35:48.900397+0000","last_active":"2024-09-12T18:29:02.839380+0000","last_peered":"2024-09-12T18:29:02.839380+0000","last_clean":"2024-09-12T18:29:02.839380+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:29:02.839380+0000","last_undegraded":"2024-09-12T18:29:02.839380+0000","last_fullsized":"2024-09-12T18:29:02.839380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:17.530372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'122","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.269926+0000","last_change":"2024-09-12T17:35:50.921023+0000","last_active":"2024-09-12T18:31:26.269926+0000","last_peered":"2024-09-12T18:31:26.269926+0000","last_clean":"2024-09-12T18:31:26.269926+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:31:26.269926+0000","last_undegraded":"2024-09-12T18:31:26.269926+0000","last_fullsized":"2024-09-12T18:31:26.269926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:23.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'393","reported_seq":1990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977717+0000","last_change":"2024-09-12T17:35:42.899906+0000","last_active":"2024-09-12T18:30:25.977717+0000","last_peered":"2024-09-12T18:30:25.977717+0000","last_clean":"2024-09-12T18:30:25.977717+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:30:25.977717+0000","last_undegraded":"2024-09-12T18:30:25.977717+0000","last_fullsized":"2024-09-12T18:30:25.977717+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:41.974957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'280","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.442329+0000","last_change":"2024-09-12T17:35:40.902378+0000","last_active":"2024-09-12T18:30:50.442329+0000","last_peered":"2024-09-12T18:30:50.442329+0000","last_clean":"2024-09-12T18:30:50.442329+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:30:50.442329+0000","last_undegraded":"2024-09-12T18:30:50.442329+0000","last_fullsized":"2024-09-12T18:30:50.442329+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:21.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15276485,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":36010,"num_write":996,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641108+0000","last_change":"2024-09-12T17:35:44.895548+0000","last_active":"2024-09-12T18:28:17.641108+0000","last_peered":"2024-09-12T18:28:17.641108+0000","last_clean":"2024-09-12T18:28:17.641108+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:28:17.641108+0000","last_undegraded":"2024-09-12T18:28:17.641108+0000","last_fullsized":"2024-09-12T18:28:17.641108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.590737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'281","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855784+0000","last_change":"2024-09-12T17:35:46.894996+0000","last_active":"2024-09-12T18:31:22.855784+0000","last_peered":"2024-09-12T18:31:22.855784+0000","last_clean":"2024-09-12T18:31:22.855784+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:31:22.855784+0000","last_undegraded":"2024-09-12T18:31:22.855784+0000","last_fullsized":"2024-09-12T18:31:22.855784+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:53.303510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61214,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":949,"num_write":376,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410641+0000","last_change":"2024-09-12T17:35:48.901220+0000","last_active":"2024-09-12T18:29:12.410641+0000","last_peered":"2024-09-12T18:29:12.410641+0000","last_clean":"2024-09-12T18:29:12.410641+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:29:12.410641+0000","last_undegraded":"2024-09-12T18:29:12.410641+0000","last_fullsized":"2024-09-12T18:29:12.410641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:24.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.746414+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:28.746414+0000","last_peered":"2024-09-12T18:31:28.746414+0000","last_clean":"2024-09-12T18:31:28.746414+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:28.746414+0000","last_undegraded":"2024-09-12T18:31:28.746414+0000","last_fullsized":"2024-09-12T18:31:28.746414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:21.959973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'539","reported_seq":2090,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.693922+0000","last_change":"2024-09-12T17:35:42.886124+0000","last_active":"2024-09-12T18:30:18.693922+0000","last_peered":"2024-09-12T18:30:18.693922+0000","last_clean":"2024-09-12T18:30:18.693922+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:30:18.693922+0000","last_undegraded":"2024-09-12T18:30:18.693922+0000","last_fullsized":"2024-09-12T18:30:18.693922+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'306","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.234586+0000","last_change":"2024-09-12T17:36:16.051402+0000","last_active":"2024-09-12T18:30:16.234586+0000","last_peered":"2024-09-12T18:30:16.234586+0000","last_clean":"2024-09-12T18:30:16.234586+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:30:16.234586+0000","last_undegraded":"2024-09-12T18:30:16.234586+0000","last_fullsized":"2024-09-12T18:30:16.234586+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:10.073958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7871569,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":463,"num_read_kb":33965,"num_write":1040,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530433+0000","last_change":"2024-09-12T17:35:44.891585+0000","last_active":"2024-09-12T18:28:58.530433+0000","last_peered":"2024-09-12T18:28:58.530433+0000","last_clean":"2024-09-12T18:28:58.530433+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:28:58.530433+0000","last_undegraded":"2024-09-12T18:28:58.530433+0000","last_fullsized":"2024-09-12T18:28:58.530433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:53.135715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'265","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.423689+0000","last_change":"2024-09-12T17:35:46.899537+0000","last_active":"2024-09-12T18:30:47.423689+0000","last_peered":"2024-09-12T18:30:47.423689+0000","last_clean":"2024-09-12T18:30:47.423689+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:30:47.423689+0000","last_undegraded":"2024-09-12T18:30:47.423689+0000","last_fullsized":"2024-09-12T18:30:47.423689+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:08.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":1002,"num_write":386,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525166+0000","last_change":"2024-09-12T17:35:48.902756+0000","last_active":"2024-09-12T18:28:18.525166+0000","last_peered":"2024-09-12T18:28:18.525166+0000","last_clean":"2024-09-12T18:28:18.525166+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:28:18.525166+0000","last_undegraded":"2024-09-12T18:28:18.525166+0000","last_fullsized":"2024-09-12T18:28:18.525166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:23.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'144","reported_seq":1246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.225226+0000","last_change":"2024-09-12T17:35:50.916082+0000","last_active":"2024-09-12T18:31:26.225226+0000","last_peered":"2024-09-12T18:31:26.225226+0000","last_clean":"2024-09-12T18:31:26.225226+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:31:26.225226+0000","last_undegraded":"2024-09-12T18:31:26.225226+0000","last_fullsized":"2024-09-12T18:31:26.225226+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:10.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'492","reported_seq":2047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.110427+0000","last_change":"2024-09-12T17:35:42.899320+0000","last_active":"2024-09-12T18:31:29.110427+0000","last_peered":"2024-09-12T18:31:29.110427+0000","last_clean":"2024-09-12T18:31:29.110427+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:31:29.110427+0000","last_undegraded":"2024-09-12T18:31:29.110427+0000","last_fullsized":"2024-09-12T18:31:29.110427+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:24.186327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'301","reported_seq":960,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.878475+0000","last_change":"2024-09-12T17:35:40.900130+0000","last_active":"2024-09-12T18:30:11.878475+0000","last_peered":"2024-09-12T18:30:11.878475+0000","last_clean":"2024-09-12T18:30:11.878475+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:30:11.878475+0000","last_undegraded":"2024-09-12T18:30:11.878475+0000","last_fullsized":"2024-09-12T18:30:11.878475+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:06.988604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245874,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":491,"num_read_kb":31829,"num_write":1165,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.605775+0000","last_change":"2024-09-12T17:35:44.893851+0000","last_active":"2024-09-12T18:29:12.605775+0000","last_peered":"2024-09-12T18:29:12.605775+0000","last_clean":"2024-09-12T18:29:12.605775+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:29:12.605775+0000","last_undegraded":"2024-09-12T18:29:12.605775+0000","last_fullsized":"2024-09-12T18:29:12.605775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:10.822361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'302","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.237679+0000","last_change":"2024-09-12T17:35:46.902681+0000","last_active":"2024-09-12T18:32:50.237679+0000","last_peered":"2024-09-12T18:32:50.237679+0000","last_clean":"2024-09-12T18:32:50.237679+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:32:50.237679+0000","last_undegraded":"2024-09-12T18:32:50.237679+0000","last_fullsized":"2024-09-12T18:32:50.237679+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:12.683935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":969,"num_write":382,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.834803+0000","last_change":"2024-09-12T17:35:48.902815+0000","last_active":"2024-09-12T18:28:22.834803+0000","last_peered":"2024-09-12T18:28:22.834803+0000","last_clean":"2024-09-12T18:28:22.834803+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:28:22.834803+0000","last_undegraded":"2024-09-12T18:28:22.834803+0000","last_fullsized":"2024-09-12T18:28:22.834803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:32.377869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'125","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.358965+0000","last_change":"2024-09-12T17:35:50.912183+0000","last_active":"2024-09-12T18:32:48.358965+0000","last_peered":"2024-09-12T18:32:48.358965+0000","last_clean":"2024-09-12T18:32:48.358965+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:32:48.358965+0000","last_undegraded":"2024-09-12T18:32:48.358965+0000","last_fullsized":"2024-09-12T18:32:48.358965+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:21.503473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'468","reported_seq":2175,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610600+0000","last_change":"2024-09-12T17:35:42.897252+0000","last_active":"2024-09-12T18:29:52.610600+0000","last_peered":"2024-09-12T18:29:52.610600+0000","last_clean":"2024-09-12T18:29:52.610600+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:29:52.610600+0000","last_undegraded":"2024-09-12T18:29:52.610600+0000","last_fullsized":"2024-09-12T18:29:52.610600+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:51.073547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'311","reported_seq":950,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417749+0000","last_change":"2024-09-12T17:35:40.900262+0000","last_active":"2024-09-12T18:29:52.417749+0000","last_peered":"2024-09-12T18:29:52.417749+0000","last_clean":"2024-09-12T18:29:52.417749+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:29:52.417749+0000","last_undegraded":"2024-09-12T18:29:52.417749+0000","last_fullsized":"2024-09-12T18:29:52.417749+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404889,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":433,"num_read_kb":20625,"num_write":1193,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'529","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.362071+0000","last_change":"2024-09-12T17:35:42.902909+0000","last_active":"2024-09-12T18:32:48.362071+0000","last_peered":"2024-09-12T18:32:48.362071+0000","last_clean":"2024-09-12T18:32:48.362071+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:32:48.362071+0000","last_undegraded":"2024-09-12T18:32:48.362071+0000","last_fullsized":"2024-09-12T18:32:48.362071+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:11.016006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'347","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.510012+0000","last_change":"2024-09-12T17:35:40.886916+0000","last_active":"2024-09-12T18:29:52.510012+0000","last_peered":"2024-09-12T18:29:52.510012+0000","last_clean":"2024-09-12T18:29:52.510012+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:29:52.510012+0000","last_undegraded":"2024-09-12T18:29:52.510012+0000","last_fullsized":"2024-09-12T18:29:52.510012+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.356041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13626055,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":58919,"num_write":1220,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'934","reported_seq":2520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.365913+0000","last_change":"2024-09-12T17:35:42.892077+0000","last_active":"2024-09-12T18:30:12.365913+0000","last_peered":"2024-09-12T18:30:12.365913+0000","last_clean":"2024-09-12T18:30:12.365913+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:30:12.365913+0000","last_undegraded":"2024-09-12T18:30:12.365913+0000","last_fullsized":"2024-09-12T18:30:12.365913+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:05.128987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'308","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:13.878737+0000","last_change":"2024-09-12T17:35:40.887565+0000","last_active":"2024-09-12T18:30:13.878737+0000","last_peered":"2024-09-12T18:30:13.878737+0000","last_clean":"2024-09-12T18:30:13.878737+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:30:13.878737+0000","last_undegraded":"2024-09-12T18:30:13.878737+0000","last_fullsized":"2024-09-12T18:30:13.878737+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:10.621969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780501,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":483,"num_read_kb":34034,"num_write":1073,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'760","reported_seq":2329,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304375+0000","last_change":"2024-09-12T17:35:42.891207+0000","last_active":"2024-09-12T18:31:28.304375+0000","last_peered":"2024-09-12T18:31:28.304375+0000","last_clean":"2024-09-12T18:31:28.304375+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:31:28.304375+0000","last_undegraded":"2024-09-12T18:31:28.304375+0000","last_fullsized":"2024-09-12T18:31:28.304375+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:12.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'300","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.974943+0000","last_change":"2024-09-12T17:35:40.892755+0000","last_active":"2024-09-12T18:32:43.974943+0000","last_peered":"2024-09-12T18:32:43.974943+0000","last_clean":"2024-09-12T18:32:43.974943+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:32:43.974943+0000","last_undegraded":"2024-09-12T18:32:43.974943+0000","last_fullsized":"2024-09-12T18:32:43.974943+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.729813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8402036,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":430,"num_read_kb":12325,"num_write":1045,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.418508+0000","last_change":"2024-09-12T17:35:42.894174+0000","last_active":"2024-09-12T18:30:07.418508+0000","last_peered":"2024-09-12T18:30:07.418508+0000","last_clean":"2024-09-12T18:30:07.418508+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:30:07.418508+0000","last_undegraded":"2024-09-12T18:30:07.418508+0000","last_fullsized":"2024-09-12T18:30:07.418508+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.648231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'299","reported_seq":970,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.701823+0000","last_change":"2024-09-12T17:36:15.950449+0000","last_active":"2024-09-12T18:30:52.701823+0000","last_peered":"2024-09-12T18:30:52.701823+0000","last_clean":"2024-09-12T18:30:52.701823+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:30:52.701823+0000","last_undegraded":"2024-09-12T18:30:52.701823+0000","last_fullsized":"2024-09-12T18:30:52.701823+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:21.732603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21373827,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":430,"num_read_kb":50386,"num_write":994,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'479","reported_seq":2221,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136342+0000","last_change":"2024-09-12T17:35:42.897624+0000","last_active":"2024-09-12T18:31:29.136342+0000","last_peered":"2024-09-12T18:31:29.136342+0000","last_clean":"2024-09-12T18:31:29.136342+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:31:29.136342+0000","last_undegraded":"2024-09-12T18:31:29.136342+0000","last_fullsized":"2024-09-12T18:31:29.136342+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:22.096489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'263","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.773400+0000","last_change":"2024-09-12T17:35:40.893038+0000","last_active":"2024-09-12T18:30:03.773400+0000","last_peered":"2024-09-12T18:30:03.773400+0000","last_clean":"2024-09-12T18:30:03.773400+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:30:03.773400+0000","last_undegraded":"2024-09-12T18:30:03.773400+0000","last_fullsized":"2024-09-12T18:30:03.773400+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:11.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196839,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":482,"num_read_kb":70299,"num_write":944,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'478","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699290+0000","last_change":"2024-09-12T17:35:42.891672+0000","last_active":"2024-09-12T18:30:18.699290+0000","last_peered":"2024-09-12T18:30:18.699290+0000","last_clean":"2024-09-12T18:30:18.699290+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:30:18.699290+0000","last_undegraded":"2024-09-12T18:30:18.699290+0000","last_fullsized":"2024-09-12T18:30:18.699290+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:22.565304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'286","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417962+0000","last_change":"2024-09-12T17:35:40.902619+0000","last_active":"2024-09-12T18:29:52.417962+0000","last_peered":"2024-09-12T18:29:52.417962+0000","last_clean":"2024-09-12T18:29:52.417962+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:29:52.417962+0000","last_undegraded":"2024-09-12T18:29:52.417962+0000","last_fullsized":"2024-09-12T18:29:52.417962+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:31.350419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16083822,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":51065,"num_write":1064,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'540","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.375708+0000","last_change":"2024-09-12T17:35:42.897448+0000","last_active":"2024-09-12T18:32:48.375708+0000","last_peered":"2024-09-12T18:32:48.375708+0000","last_clean":"2024-09-12T18:32:48.375708+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:32:48.375708+0000","last_undegraded":"2024-09-12T18:32:48.375708+0000","last_fullsized":"2024-09-12T18:32:48.375708+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.748388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.163696+0000","last_change":"2024-09-12T17:35:40.883103+0000","last_active":"2024-09-12T18:30:10.163696+0000","last_peered":"2024-09-12T18:30:10.163696+0000","last_clean":"2024-09-12T18:30:10.163696+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:30:10.163696+0000","last_undegraded":"2024-09-12T18:30:10.163696+0000","last_fullsized":"2024-09-12T18:30:10.163696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.291106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831223,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":346,"num_read_kb":37897,"num_write":766,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'583","reported_seq":2406,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651201+0000","last_change":"2024-09-12T17:35:42.902435+0000","last_active":"2024-09-12T18:30:10.651201+0000","last_peered":"2024-09-12T18:30:10.651201+0000","last_clean":"2024-09-12T18:30:10.651201+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:30:10.651201+0000","last_undegraded":"2024-09-12T18:30:10.651201+0000","last_fullsized":"2024-09-12T18:30:10.651201+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.291333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'315","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656191+0000","last_change":"2024-09-12T17:35:40.904096+0000","last_active":"2024-09-12T18:29:57.656191+0000","last_peered":"2024-09-12T18:29:57.656191+0000","last_clean":"2024-09-12T18:29:57.656191+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:29:57.656191+0000","last_undegraded":"2024-09-12T18:29:57.656191+0000","last_fullsized":"2024-09-12T18:29:57.656191+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6648200,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":484,"num_read_kb":34144,"num_write":1082,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1179","reported_seq":2808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698955+0000","last_change":"2024-09-12T17:35:42.893016+0000","last_active":"2024-09-12T18:30:18.698955+0000","last_peered":"2024-09-12T18:30:18.698955+0000","last_clean":"2024-09-12T18:30:18.698955+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:30:18.698955+0000","last_undegraded":"2024-09-12T18:30:18.698955+0000","last_fullsized":"2024-09-12T18:30:18.698955+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:15.472517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'316","reported_seq":1018,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415330+0000","last_change":"2024-09-12T17:35:40.881782+0000","last_active":"2024-09-12T18:29:42.415330+0000","last_peered":"2024-09-12T18:29:42.415330+0000","last_clean":"2024-09-12T18:29:42.415330+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:29:42.415330+0000","last_undegraded":"2024-09-12T18:29:42.415330+0000","last_fullsized":"2024-09-12T18:29:42.415330+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:38.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4996478,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":677,"num_read_kb":17939,"num_write":1117,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'779","reported_seq":2264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527379+0000","last_change":"2024-09-12T17:35:42.898127+0000","last_active":"2024-09-12T18:30:04.527379+0000","last_peered":"2024-09-12T18:30:04.527379+0000","last_clean":"2024-09-12T18:30:04.527379+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:30:04.527379+0000","last_undegraded":"2024-09-12T18:30:04.527379+0000","last_fullsized":"2024-09-12T18:30:04.527379+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.391709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'447","reported_seq":1160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513053+0000","last_change":"2024-09-12T17:36:16.042288+0000","last_active":"2024-09-12T18:30:17.513053+0000","last_peered":"2024-09-12T18:30:17.513053+0000","last_clean":"2024-09-12T18:30:17.513053+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:30:17.513053+0000","last_undegraded":"2024-09-12T18:30:17.513053+0000","last_fullsized":"2024-09-12T18:30:17.513053+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.423582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587447,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":945,"num_read_kb":22424,"num_write":1564,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'507","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.363476+0000","last_change":"2024-09-12T17:35:42.901620+0000","last_active":"2024-09-12T18:32:48.363476+0000","last_peered":"2024-09-12T18:32:48.363476+0000","last_clean":"2024-09-12T18:32:48.363476+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:32:48.363476+0000","last_undegraded":"2024-09-12T18:32:48.363476+0000","last_fullsized":"2024-09-12T18:32:48.363476+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:37.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'259","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.068418+0000","last_change":"2024-09-12T17:35:40.893566+0000","last_active":"2024-09-12T18:30:07.068418+0000","last_peered":"2024-09-12T18:30:07.068418+0000","last_clean":"2024-09-12T18:30:07.068418+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:30:07.068418+0000","last_undegraded":"2024-09-12T18:30:07.068418+0000","last_fullsized":"2024-09-12T18:30:07.068418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.347084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11591057,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":8170,"num_write":933,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'783","reported_seq":2222,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.548109+0000","last_change":"2024-09-12T17:35:42.897318+0000","last_active":"2024-09-12T18:29:58.548109+0000","last_peered":"2024-09-12T18:29:58.548109+0000","last_clean":"2024-09-12T18:29:58.548109+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:29:58.548109+0000","last_undegraded":"2024-09-12T18:29:58.548109+0000","last_fullsized":"2024-09-12T18:29:58.548109+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:59.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'274","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:53.018074+0000","last_change":"2024-09-12T17:35:40.894257+0000","last_active":"2024-09-12T18:30:53.018074+0000","last_peered":"2024-09-12T18:30:53.018074+0000","last_clean":"2024-09-12T18:30:53.018074+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:30:53.018074+0000","last_undegraded":"2024-09-12T18:30:53.018074+0000","last_fullsized":"2024-09-12T18:30:53.018074+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:16.285766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021850,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":424,"num_read_kb":27896,"num_write":1039,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'568","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.439691+0000","last_change":"2024-09-12T17:35:42.900094+0000","last_active":"2024-09-12T18:30:15.439691+0000","last_peered":"2024-09-12T18:30:15.439691+0000","last_clean":"2024-09-12T18:30:15.439691+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:30:15.439691+0000","last_undegraded":"2024-09-12T18:30:15.439691+0000","last_fullsized":"2024-09-12T18:30:15.439691+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.607330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'233","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417896+0000","last_change":"2024-09-12T17:35:40.886954+0000","last_active":"2024-09-12T18:29:52.417896+0000","last_peered":"2024-09-12T18:29:52.417896+0000","last_clean":"2024-09-12T18:29:52.417896+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:29:52.417896+0000","last_undegraded":"2024-09-12T18:29:52.417896+0000","last_fullsized":"2024-09-12T18:29:52.417896+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:46.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315790,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":345,"num_read_kb":4463,"num_write":831,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'520","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.654360+0000","last_change":"2024-09-12T17:35:42.895055+0000","last_active":"2024-09-12T18:30:10.654360+0000","last_peered":"2024-09-12T18:30:10.654360+0000","last_clean":"2024-09-12T18:30:10.654360+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:30:10.654360+0000","last_undegraded":"2024-09-12T18:30:10.654360+0000","last_fullsized":"2024-09-12T18:30:10.654360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:39.969384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'257","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506759+0000","last_change":"2024-09-12T17:35:40.894178+0000","last_active":"2024-09-12T18:29:22.506759+0000","last_peered":"2024-09-12T18:29:22.506759+0000","last_clean":"2024-09-12T18:29:22.506759+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:29:22.506759+0000","last_undegraded":"2024-09-12T18:29:22.506759+0000","last_fullsized":"2024-09-12T18:29:22.506759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:59.754829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535001,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":371,"num_read_kb":27660,"num_write":1012,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'391","reported_seq":1866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.567235+0000","last_change":"2024-09-12T17:36:15.950421+0000","last_active":"2024-09-12T18:30:07.567235+0000","last_peered":"2024-09-12T18:30:07.567235+0000","last_clean":"2024-09-12T18:30:07.567235+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:30:07.567235+0000","last_undegraded":"2024-09-12T18:30:07.567235+0000","last_fullsized":"2024-09-12T18:30:07.567235+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:25.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'268","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.651048+0000","last_change":"2024-09-12T17:35:40.885615+0000","last_active":"2024-09-12T18:29:22.651048+0000","last_peered":"2024-09-12T18:29:22.651048+0000","last_clean":"2024-09-12T18:29:22.651048+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:29:22.651048+0000","last_undegraded":"2024-09-12T18:29:22.651048+0000","last_fullsized":"2024-09-12T18:29:22.651048+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.664147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12856238,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":418,"num_read_kb":34544,"num_write":986,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'307","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650964+0000","last_change":"2024-09-12T17:35:40.892904+0000","last_active":"2024-09-12T18:29:22.650964+0000","last_peered":"2024-09-12T18:29:22.650964+0000","last_clean":"2024-09-12T18:29:22.650964+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:29:22.650964+0000","last_undegraded":"2024-09-12T18:29:22.650964+0000","last_fullsized":"2024-09-12T18:29:22.650964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:46.084095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2677136,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":485,"num_read_kb":6964,"num_write":1060,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1470","reported_seq":2919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.368989+0000","last_change":"2024-09-12T17:35:42.902453+0000","last_active":"2024-09-12T18:32:48.368989+0000","last_peered":"2024-09-12T18:32:48.368989+0000","last_clean":"2024-09-12T18:32:48.368989+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:32:48.368989+0000","last_undegraded":"2024-09-12T18:32:48.368989+0000","last_fullsized":"2024-09-12T18:32:48.368989+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:29.174028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'243","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607000+0000","last_change":"2024-09-12T17:35:40.893486+0000","last_active":"2024-09-12T18:29:22.607000+0000","last_peered":"2024-09-12T18:29:22.607000+0000","last_clean":"2024-09-12T18:29:22.607000+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:29:22.607000+0000","last_undegraded":"2024-09-12T18:29:22.607000+0000","last_fullsized":"2024-09-12T18:29:22.607000+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.422582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7367506,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":395,"num_read_kb":8217,"num_write":916,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1011","reported_seq":2978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.115606+0000","last_change":"2024-09-12T17:35:42.894495+0000","last_active":"2024-09-12T18:31:29.115606+0000","last_peered":"2024-09-12T18:31:29.115606+0000","last_clean":"2024-09-12T18:31:29.115606+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:31:29.115606+0000","last_undegraded":"2024-09-12T18:31:29.115606+0000","last_fullsized":"2024-09-12T18:31:29.115606+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:16.817173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1921320,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17501,"num_read_kb":33196,"num_write":14845,"num_write_kb":11717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":2796682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2181,"ondisk_log_size":2181,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565932576,"num_objects":4458,"num_object_clones":0,"num_object_copies":17832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":32298,"num_read_kb":2030638,"num_write":68048,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812879872,"data_stored":812879872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4348,"ondisk_log_size":4348,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":71442205,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":184607,"num_write":161,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143941632,"data_stored":143932986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72490781,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":142,"num_read_kb":188613,"num_write":160,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144990208,"data_stored":144981562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575544,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244652,"kb_used_data":141276,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94127188,"statfs":{"total":96636764160,"available":96386240512,"internally_reserved":0,"allocated":144666624,"data_stored":142733770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575544,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453776,"kb_used_data":125504,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93918064,"statfs":{"total":96636764160,"available":96172097536,"internally_reserved":0,"allocated":128516096,"data_stored":126495147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":336132554},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575543,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400944,"kb_used_data":135136,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93970896,"statfs":{"total":96636764160,"available":96226197504,"internally_reserved":0,"allocated":138379264,"data_stored":136431474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":158812,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":162623488,"data_stored":160564207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575543,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438220,"kb_used_data":150204,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93933620,"statfs":{"total":96636764160,"available":96188026880,"internally_reserved":0,"allocated":153808896,"data_stored":151783628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575545,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226924,"kb_used_data":127708,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94144916,"statfs":{"total":96636764160,"available":96404393984,"internally_reserved":0,"allocated":130772992,"data_stored":128852011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575543,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315652,"kb_used_data":135988,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94056188,"statfs":{"total":96636764160,"available":96313536512,"internally_reserved":0,"allocated":139251712,"data_stored":137265995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575546,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414316,"kb_used_data":148508,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957524,"statfs":{"total":96636764160,"available":96212504576,"internally_reserved":0,"allocated":152072192,"data_stored":150043452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":108003328,"data_stored":108003328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103157760,"data_stored":103157760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79200256,"data_stored":79200256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":91176960,"data_stored":91176960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":107003904,"data_stored":107003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":117772288,"data_stored":117772288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":107646976,"data_stored":107646976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98918400,"data_stored":98918400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":337682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":131171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":493563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":86495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":588649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":250471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":518076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28368896,"data_stored":28368177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28344320,"data_stored":28343505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24207360,"data_stored":24203756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16769024,"data_stored":16769024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22073344,"data_stored":22072625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":5297435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10481664,"data_stored":10481664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18918705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33648640,"data_stored":33647106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17872155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18931712,"data_stored":18930897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18912539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:06.879 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:33:06.880 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:07.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:07.213 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:07.216 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1986,"stamp":"2024-09-12T18:33:05.561651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":712394457,"num_objects":4981,"num_object_clones":0,"num_object_copies":18878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4981,"num_whiteouts":0,"num_read":287425,"num_read_kb":2654355,"num_write":157295,"num_write_kb":2423504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14250,"ondisk_log_size":14250,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2792704,"kb_used_data":1123136,"kb_used_omap":12,"kb_used_meta":1669427,"kb_avail":752182016,"statfs":{"total":773094113280,"available":770234384384,"internally_reserved":0,"allocated":1150091264,"data_stored":1134169684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1709493808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2101562,"num_objects":-25,"num_object_clones":0,"num_object_copies":-98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005770"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.645460+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:28:47.645460+0000","last_peered":"2024-09-12T18:28:47.645460+0000","last_clean":"2024-09-12T18:28:47.645460+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:28:47.645460+0000","last_undegraded":"2024-09-12T18:28:47.645460+0000","last_fullsized":"2024-09-12T18:28:47.645460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641171+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:28:17.641171+0000","last_peered":"2024-09-12T18:28:17.641171+0000","last_clean":"2024-09-12T18:28:17.641171+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:28:17.641171+0000","last_undegraded":"2024-09-12T18:28:17.641171+0000","last_fullsized":"2024-09-12T18:28:17.641171+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:41.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.404279+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:28:12.404279+0000","last_peered":"2024-09-12T18:28:12.404279+0000","last_clean":"2024-09-12T18:28:12.404279+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:28:12.404279+0000","last_undegraded":"2024-09-12T18:28:12.404279+0000","last_fullsized":"2024-09-12T18:28:12.404279+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.080783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.503031+0000","last_change":"2024-09-12T18:08:44.184390+0000","last_active":"2024-09-12T18:28:47.503031+0000","last_peered":"2024-09-12T18:28:47.503031+0000","last_clean":"2024-09-12T18:28:47.503031+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:28:47.503031+0000","last_undegraded":"2024-09-12T18:28:47.503031+0000","last_fullsized":"2024-09-12T18:28:47.503031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:51.778841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525188+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:28:18.525188+0000","last_peered":"2024-09-12T18:28:18.525188+0000","last_clean":"2024-09-12T18:28:18.525188+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:28:18.525188+0000","last_undegraded":"2024-09-12T18:28:18.525188+0000","last_fullsized":"2024-09-12T18:28:18.525188+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:47.933301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'1","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.598765+0000","last_change":"2024-09-12T17:53:12.148575+0000","last_active":"2024-09-12T18:28:12.598765+0000","last_peered":"2024-09-12T18:28:12.598765+0000","last_clean":"2024-09-12T18:28:12.598765+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:28:12.598765+0000","last_undegraded":"2024-09-12T18:28:12.598765+0000","last_fullsized":"2024-09-12T18:28:12.598765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:30.531081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514184+0000","last_change":"2024-09-12T17:50:14.836684+0000","last_active":"2024-09-12T18:30:27.514184+0000","last_peered":"2024-09-12T18:30:27.514184+0000","last_clean":"2024-09-12T18:30:27.514184+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:30:27.514184+0000","last_undegraded":"2024-09-12T18:30:27.514184+0000","last_fullsized":"2024-09-12T18:30:27.514184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:16.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425027+0000","last_change":"2024-09-12T18:08:44.178158+0000","last_active":"2024-09-12T18:30:32.425027+0000","last_peered":"2024-09-12T18:30:32.425027+0000","last_clean":"2024-09-12T18:30:32.425027+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:30:32.425027+0000","last_undegraded":"2024-09-12T18:30:32.425027+0000","last_fullsized":"2024-09-12T18:30:32.425027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:48.796260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851978+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:30:47.851978+0000","last_peered":"2024-09-12T18:30:47.851978+0000","last_clean":"2024-09-12T18:30:47.851978+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:30:47.851978+0000","last_undegraded":"2024-09-12T18:30:47.851978+0000","last_fullsized":"2024-09-12T18:30:47.851978+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506777+0000","last_change":"2024-09-12T17:53:12.146240+0000","last_active":"2024-09-12T18:29:22.506777+0000","last_peered":"2024-09-12T18:29:22.506777+0000","last_clean":"2024-09-12T18:29:22.506777+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:29:22.506777+0000","last_undegraded":"2024-09-12T18:29:22.506777+0000","last_fullsized":"2024-09-12T18:29:22.506777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.969445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.848535+0000","last_change":"2024-09-12T17:50:14.830812+0000","last_active":"2024-09-12T18:30:17.848535+0000","last_peered":"2024-09-12T18:30:17.848535+0000","last_clean":"2024-09-12T18:30:17.848535+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:30:17.848535+0000","last_undegraded":"2024-09-12T18:30:17.848535+0000","last_fullsized":"2024-09-12T18:30:17.848535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:04.011300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413604+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:29:27.413604+0000","last_peered":"2024-09-12T18:29:27.413604+0000","last_clean":"2024-09-12T18:29:27.413604+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:29:27.413604+0000","last_undegraded":"2024-09-12T18:29:27.413604+0000","last_fullsized":"2024-09-12T18:29:27.413604+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:57.846394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":2101,"num_write":11,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:43.545564+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:30:43.545564+0000","last_peered":"2024-09-12T18:30:43.545564+0000","last_clean":"2024-09-12T18:30:43.545564+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:30:43.545564+0000","last_undegraded":"2024-09-12T18:30:43.545564+0000","last_fullsized":"2024-09-12T18:30:43.545564+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8188,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653099+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:29:37.653099+0000","last_peered":"2024-09-12T18:29:37.653099+0000","last_clean":"2024-09-12T18:29:37.653099+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:29:37.653099+0000","last_undegraded":"2024-09-12T18:29:37.653099+0000","last_fullsized":"2024-09-12T18:29:37.653099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842273+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:29:27.842273+0000","last_peered":"2024-09-12T18:29:27.842273+0000","last_clean":"2024-09-12T18:29:27.842273+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:29:27.842273+0000","last_undegraded":"2024-09-12T18:29:27.842273+0000","last_fullsized":"2024-09-12T18:29:27.842273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4114,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.608852+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:29:37.608852+0000","last_peered":"2024-09-12T18:29:37.608852+0000","last_clean":"2024-09-12T18:29:37.608852+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:29:37.608852+0000","last_undegraded":"2024-09-12T18:29:37.608852+0000","last_fullsized":"2024-09-12T18:29:37.608852+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.447117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'8","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414003+0000","last_change":"2024-09-12T17:53:15.163967+0000","last_active":"2024-09-12T18:29:32.414003+0000","last_peered":"2024-09-12T18:29:32.414003+0000","last_clean":"2024-09-12T18:29:32.414003+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:29:32.414003+0000","last_undegraded":"2024-09-12T18:29:32.414003+0000","last_fullsized":"2024-09-12T18:29:32.414003+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:21.391926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8424657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16462,"num_write":13,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.536175+0000","last_change":"2024-09-12T17:53:12.139099+0000","last_active":"2024-09-12T18:29:38.536175+0000","last_peered":"2024-09-12T18:29:38.536175+0000","last_clean":"2024-09-12T18:29:38.536175+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:29:38.536175+0000","last_undegraded":"2024-09-12T18:29:38.536175+0000","last_fullsized":"2024-09-12T18:29:38.536175+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:32.128312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13304,"num_write":13,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422211+0000","last_change":"2024-09-12T17:50:14.842952+0000","last_active":"2024-09-12T18:30:17.422211+0000","last_peered":"2024-09-12T18:30:17.422211+0000","last_clean":"2024-09-12T18:30:17.422211+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:30:17.422211+0000","last_undegraded":"2024-09-12T18:30:17.422211+0000","last_fullsized":"2024-09-12T18:30:17.422211+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:31.774447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406069+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:28:47.406069+0000","last_peered":"2024-09-12T18:28:47.406069+0000","last_clean":"2024-09-12T18:28:47.406069+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:28:47.406069+0000","last_undegraded":"2024-09-12T18:28:47.406069+0000","last_fullsized":"2024-09-12T18:28:47.406069+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:26.401744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400909+0000","last_change":"2024-09-12T17:53:15.159424+0000","last_active":"2024-09-12T18:28:17.400909+0000","last_peered":"2024-09-12T18:28:17.400909+0000","last_clean":"2024-09-12T18:28:17.400909+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:28:17.400909+0000","last_undegraded":"2024-09-12T18:28:17.400909+0000","last_fullsized":"2024-09-12T18:28:17.400909+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:39.982738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6178,"num_write":5,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:13.524378+0000","last_change":"2024-09-12T17:53:12.146586+0000","last_active":"2024-09-12T18:28:13.524378+0000","last_peered":"2024-09-12T18:28:13.524378+0000","last_clean":"2024-09-12T18:28:13.524378+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:28:13.524378+0000","last_undegraded":"2024-09-12T18:28:13.524378+0000","last_fullsized":"2024-09-12T18:28:13.524378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:27.151552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839397+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:29:02.839397+0000","last_peered":"2024-09-12T18:29:02.839397+0000","last_clean":"2024-09-12T18:29:02.839397+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:29:02.839397+0000","last_undegraded":"2024-09-12T18:29:02.839397+0000","last_fullsized":"2024-09-12T18:29:02.839397+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:50.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406134+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:28:47.406134+0000","last_peered":"2024-09-12T18:28:47.406134+0000","last_clean":"2024-09-12T18:28:47.406134+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:28:47.406134+0000","last_undegraded":"2024-09-12T18:28:47.406134+0000","last_fullsized":"2024-09-12T18:28:47.406134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:07.255733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.404892+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:28:17.404892+0000","last_peered":"2024-09-12T18:28:17.404892+0000","last_clean":"2024-09-12T18:28:17.404892+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:28:17.404892+0000","last_undegraded":"2024-09-12T18:28:17.404892+0000","last_fullsized":"2024-09-12T18:28:17.404892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:55.589172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832136+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:28:12.832136+0000","last_peered":"2024-09-12T18:28:12.832136+0000","last_clean":"2024-09-12T18:28:12.832136+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:28:12.832136+0000","last_undegraded":"2024-09-12T18:28:12.832136+0000","last_fullsized":"2024-09-12T18:28:12.832136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:08.474574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":15356,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.604077+0000","last_change":"2024-09-12T17:50:14.841323+0000","last_active":"2024-09-12T18:28:57.604077+0000","last_peered":"2024-09-12T18:28:57.604077+0000","last_clean":"2024-09-12T18:28:57.604077+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:28:57.604077+0000","last_undegraded":"2024-09-12T18:28:57.604077+0000","last_fullsized":"2024-09-12T18:28:57.604077+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:41.858948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.609892+0000","last_change":"2024-09-12T18:08:44.184970+0000","last_active":"2024-09-12T18:29:47.609892+0000","last_peered":"2024-09-12T18:29:47.609892+0000","last_clean":"2024-09-12T18:29:47.609892+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:29:47.609892+0000","last_undegraded":"2024-09-12T18:29:47.609892+0000","last_fullsized":"2024-09-12T18:29:47.609892+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:13.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'1","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414229+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:29:32.414229+0000","last_peered":"2024-09-12T18:29:32.414229+0000","last_clean":"2024-09-12T18:29:32.414229+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:29:32.414229+0000","last_undegraded":"2024-09-12T18:29:32.414229+0000","last_fullsized":"2024-09-12T18:29:32.414229+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.661852+0000","last_change":"2024-09-12T17:53:12.143997+0000","last_active":"2024-09-12T18:30:37.661852+0000","last_peered":"2024-09-12T18:30:37.661852+0000","last_clean":"2024-09-12T18:30:37.661852+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:30:37.661852+0000","last_undegraded":"2024-09-12T18:30:37.661852+0000","last_fullsized":"2024-09-12T18:30:37.661852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:11.692360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":103,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.838922+0000","last_change":"2024-09-12T17:50:14.839525+0000","last_active":"2024-09-12T18:28:57.838922+0000","last_peered":"2024-09-12T18:28:57.838922+0000","last_clean":"2024-09-12T18:28:57.838922+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:28:57.838922+0000","last_undegraded":"2024-09-12T18:28:57.838922+0000","last_fullsized":"2024-09-12T18:28:57.838922+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:08.454207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509504+0000","last_change":"2024-09-12T18:08:44.184023+0000","last_active":"2024-09-12T18:29:47.509504+0000","last_peered":"2024-09-12T18:29:47.509504+0000","last_clean":"2024-09-12T18:29:47.509504+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:29:47.509504+0000","last_undegraded":"2024-09-12T18:29:47.509504+0000","last_fullsized":"2024-09-12T18:29:47.509504+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841144+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:29:17.841144+0000","last_peered":"2024-09-12T18:29:17.841144+0000","last_clean":"2024-09-12T18:29:17.841144+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:29:17.841144+0000","last_undegraded":"2024-09-12T18:29:17.841144+0000","last_fullsized":"2024-09-12T18:29:17.841144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409647+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:28:57.409647+0000","last_peered":"2024-09-12T18:28:57.409647+0000","last_clean":"2024-09-12T18:28:57.409647+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:28:57.409647+0000","last_undegraded":"2024-09-12T18:28:57.409647+0000","last_fullsized":"2024-09-12T18:28:57.409647+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:39.923261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414257+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:29:32.414257+0000","last_peered":"2024-09-12T18:29:32.414257+0000","last_clean":"2024-09-12T18:29:32.414257+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:29:32.414257+0000","last_undegraded":"2024-09-12T18:29:32.414257+0000","last_fullsized":"2024-09-12T18:29:32.414257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20478,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.507284+0000","last_change":"2024-09-12T17:53:12.144615+0000","last_active":"2024-09-12T18:29:27.507284+0000","last_peered":"2024-09-12T18:29:27.507284+0000","last_clean":"2024-09-12T18:29:27.507284+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:29:27.507284+0000","last_undegraded":"2024-09-12T18:29:27.507284+0000","last_fullsized":"2024-09-12T18:29:27.507284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:01.824724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4132,"num_write":3,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.504229+0000","last_change":"2024-09-12T17:50:14.845069+0000","last_active":"2024-09-12T18:28:57.504229+0000","last_peered":"2024-09-12T18:28:57.504229+0000","last_clean":"2024-09-12T18:28:57.504229+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:28:57.504229+0000","last_undegraded":"2024-09-12T18:28:57.504229+0000","last_fullsized":"2024-09-12T18:28:57.504229+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:11.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'68","reported_seq":308,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420555+0000","last_change":"2024-09-12T17:50:14.842178+0000","last_active":"2024-09-12T18:30:07.420555+0000","last_peered":"2024-09-12T18:30:07.420555+0000","last_clean":"2024-09-12T18:30:07.420555+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:30:07.420555+0000","last_undegraded":"2024-09-12T18:30:07.420555+0000","last_fullsized":"2024-09-12T18:30:07.420555+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:23.280624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615983+0000","last_change":"2024-09-12T17:53:15.160000+0000","last_active":"2024-09-12T18:30:37.615983+0000","last_peered":"2024-09-12T18:30:37.615983+0000","last_clean":"2024-09-12T18:30:37.615983+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:30:37.615983+0000","last_undegraded":"2024-09-12T18:30:37.615983+0000","last_fullsized":"2024-09-12T18:30:37.615983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:16.584362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:33.544028+0000","last_change":"2024-09-12T17:53:12.138225+0000","last_active":"2024-09-12T18:30:33.544028+0000","last_peered":"2024-09-12T18:30:33.544028+0000","last_clean":"2024-09-12T18:30:33.544028+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:30:33.544028+0000","last_undegraded":"2024-09-12T18:30:33.544028+0000","last_fullsized":"2024-09-12T18:30:33.544028+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":298,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418863+0000","last_change":"2024-09-12T17:50:14.839535+0000","last_active":"2024-09-12T18:29:57.418863+0000","last_peered":"2024-09-12T18:29:57.418863+0000","last_clean":"2024-09-12T18:29:57.418863+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:29:57.418863+0000","last_undegraded":"2024-09-12T18:29:57.418863+0000","last_fullsized":"2024-09-12T18:29:57.418863+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:47.803289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615945+0000","last_change":"2024-09-12T17:53:15.161893+0000","last_active":"2024-09-12T18:30:37.615945+0000","last_peered":"2024-09-12T18:30:37.615945+0000","last_clean":"2024-09-12T18:30:37.615945+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:30:37.615945+0000","last_undegraded":"2024-09-12T18:30:37.615945+0000","last_fullsized":"2024-09-12T18:30:37.615945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:04.296609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421756+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:30:32.421756+0000","last_peered":"2024-09-12T18:30:32.421756+0000","last_clean":"2024-09-12T18:30:32.421756+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:30:32.421756+0000","last_undegraded":"2024-09-12T18:30:32.421756+0000","last_fullsized":"2024-09-12T18:30:32.421756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846075+0000","last_change":"2024-09-12T17:50:14.840630+0000","last_active":"2024-09-12T18:29:57.846075+0000","last_peered":"2024-09-12T18:29:57.846075+0000","last_clean":"2024-09-12T18:29:57.846075+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:29:57.846075+0000","last_undegraded":"2024-09-12T18:29:57.846075+0000","last_fullsized":"2024-09-12T18:29:57.846075+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.197122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422364+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:30:37.422364+0000","last_peered":"2024-09-12T18:30:37.422364+0000","last_clean":"2024-09-12T18:30:37.422364+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:30:37.422364+0000","last_undegraded":"2024-09-12T18:30:37.422364+0000","last_fullsized":"2024-09-12T18:30:37.422364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425105+0000","last_change":"2024-09-12T17:53:12.148814+0000","last_active":"2024-09-12T18:30:32.425105+0000","last_peered":"2024-09-12T18:30:32.425105+0000","last_clean":"2024-09-12T18:30:32.425105+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:30:32.425105+0000","last_undegraded":"2024-09-12T18:30:32.425105+0000","last_fullsized":"2024-09-12T18:30:32.425105+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:08.076954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538860+0000","last_change":"2024-09-12T17:50:14.841498+0000","last_active":"2024-09-12T18:29:58.538860+0000","last_peered":"2024-09-12T18:29:58.538860+0000","last_clean":"2024-09-12T18:29:58.538860+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:29:58.538860+0000","last_undegraded":"2024-09-12T18:29:58.538860+0000","last_fullsized":"2024-09-12T18:29:58.538860+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.140268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.426002+0000","last_change":"2024-09-12T17:53:15.158874+0000","last_active":"2024-09-12T18:30:37.426002+0000","last_peered":"2024-09-12T18:30:37.426002+0000","last_clean":"2024-09-12T18:30:37.426002+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:30:37.426002+0000","last_undegraded":"2024-09-12T18:30:37.426002+0000","last_fullsized":"2024-09-12T18:30:37.426002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:50.215733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.661208+0000","last_change":"2024-09-12T17:53:12.146649+0000","last_active":"2024-09-12T18:30:32.661208+0000","last_peered":"2024-09-12T18:30:32.661208+0000","last_clean":"2024-09-12T18:30:32.661208+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:30:32.661208+0000","last_undegraded":"2024-09-12T18:30:32.661208+0000","last_fullsized":"2024-09-12T18:30:32.661208+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:57.575965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6140,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.515181+0000","last_change":"2024-09-12T18:08:44.180436+0000","last_active":"2024-09-12T18:30:37.515181+0000","last_peered":"2024-09-12T18:30:37.515181+0000","last_clean":"2024-09-12T18:30:37.515181+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:30:37.515181+0000","last_undegraded":"2024-09-12T18:30:37.515181+0000","last_fullsized":"2024-09-12T18:30:37.515181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:14.400883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412252+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:29:17.412252+0000","last_peered":"2024-09-12T18:29:17.412252+0000","last_clean":"2024-09-12T18:29:17.412252+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:29:17.412252+0000","last_undegraded":"2024-09-12T18:29:17.412252+0000","last_fullsized":"2024-09-12T18:29:17.412252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:02.994171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4210688,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8208,"num_write":10,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410711+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:29:12.410711+0000","last_peered":"2024-09-12T18:29:12.410711+0000","last_clean":"2024-09-12T18:29:12.410711+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:29:12.410711+0000","last_undegraded":"2024-09-12T18:29:12.410711+0000","last_fullsized":"2024-09-12T18:29:12.410711+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:44.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":50,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.408326+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:28:47.408326+0000","last_peered":"2024-09-12T18:28:47.408326+0000","last_clean":"2024-09-12T18:28:47.408326+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:28:47.408326+0000","last_undegraded":"2024-09-12T18:28:47.408326+0000","last_fullsized":"2024-09-12T18:28:47.408326+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.905410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408851+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:29:02.408851+0000","last_peered":"2024-09-12T18:29:02.408851+0000","last_clean":"2024-09-12T18:29:02.408851+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:29:02.408851+0000","last_undegraded":"2024-09-12T18:29:02.408851+0000","last_fullsized":"2024-09-12T18:29:02.408851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:26.810924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412214+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:29:17.412214+0000","last_peered":"2024-09-12T18:29:17.412214+0000","last_clean":"2024-09-12T18:29:17.412214+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:29:17.412214+0000","last_undegraded":"2024-09-12T18:29:17.412214+0000","last_fullsized":"2024-09-12T18:29:17.412214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.836700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.505743+0000","last_change":"2024-09-12T17:53:12.143791+0000","last_active":"2024-09-12T18:29:12.505743+0000","last_peered":"2024-09-12T18:29:12.505743+0000","last_clean":"2024-09-12T18:29:12.505743+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:29:12.505743+0000","last_undegraded":"2024-09-12T18:29:12.505743+0000","last_fullsized":"2024-09-12T18:29:12.505743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:50.203716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7180,"num_write":5,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663487+0000","last_change":"2024-09-12T17:50:14.842898+0000","last_active":"2024-09-12T18:30:47.663487+0000","last_peered":"2024-09-12T18:30:47.663487+0000","last_clean":"2024-09-12T18:30:47.663487+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:30:47.663487+0000","last_undegraded":"2024-09-12T18:30:47.663487+0000","last_fullsized":"2024-09-12T18:30:47.663487+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:36.700805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424139+0000","last_change":"2024-09-12T18:08:44.182811+0000","last_active":"2024-09-12T18:30:27.424139+0000","last_peered":"2024-09-12T18:30:27.424139+0000","last_clean":"2024-09-12T18:30:27.424139+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:30:27.424139+0000","last_undegraded":"2024-09-12T18:30:27.424139+0000","last_fullsized":"2024-09-12T18:30:27.424139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.055368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607709+0000","last_change":"2024-09-12T17:53:15.162967+0000","last_active":"2024-09-12T18:29:27.607709+0000","last_peered":"2024-09-12T18:29:27.607709+0000","last_clean":"2024-09-12T18:29:27.607709+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:29:27.607709+0000","last_undegraded":"2024-09-12T18:29:27.607709+0000","last_fullsized":"2024-09-12T18:29:27.607709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:00.026005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8190,"num_write":11,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'6","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.840579+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:29:12.840579+0000","last_peered":"2024-09-12T18:29:12.840579+0000","last_clean":"2024-09-12T18:29:12.840579+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:29:12.840579+0000","last_undegraded":"2024-09-12T18:29:12.840579+0000","last_fullsized":"2024-09-12T18:29:12.840579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:33.879161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48433,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":11,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:50:14.845493+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:34.662412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412282+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:29:17.412282+0000","last_peered":"2024-09-12T18:29:17.412282+0000","last_clean":"2024-09-12T18:29:17.412282+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:29:17.412282+0000","last_undegraded":"2024-09-12T18:29:17.412282+0000","last_fullsized":"2024-09-12T18:29:17.412282+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:25.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607128+0000","last_change":"2024-09-12T17:53:12.149630+0000","last_active":"2024-09-12T18:29:22.607128+0000","last_peered":"2024-09-12T18:29:22.607128+0000","last_clean":"2024-09-12T18:29:22.607128+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:29:22.607128+0000","last_undegraded":"2024-09-12T18:29:22.607128+0000","last_fullsized":"2024-09-12T18:29:22.607128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:16.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.516222+0000","last_change":"2024-09-12T17:50:14.840844+0000","last_active":"2024-09-12T18:30:47.516222+0000","last_peered":"2024-09-12T18:30:47.516222+0000","last_clean":"2024-09-12T18:30:47.516222+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:30:47.516222+0000","last_undegraded":"2024-09-12T18:30:47.516222+0000","last_fullsized":"2024-09-12T18:30:47.516222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:46.536171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.410294+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:29:02.410294+0000","last_peered":"2024-09-12T18:29:02.410294+0000","last_clean":"2024-09-12T18:29:02.410294+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:29:02.410294+0000","last_undegraded":"2024-09-12T18:29:02.410294+0000","last_fullsized":"2024-09-12T18:29:02.410294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.278214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846735+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:30:02.846735+0000","last_peered":"2024-09-12T18:30:02.846735+0000","last_clean":"2024-09-12T18:30:02.846735+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:30:02.846735+0000","last_undegraded":"2024-09-12T18:30:02.846735+0000","last_fullsized":"2024-09-12T18:30:02.846735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"259'83","reported_seq":352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851871+0000","last_change":"2024-09-12T17:50:14.839010+0000","last_active":"2024-09-12T18:30:47.851871+0000","last_peered":"2024-09-12T18:30:47.851871+0000","last_clean":"2024-09-12T18:30:47.851871+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:30:47.851871+0000","last_undegraded":"2024-09-12T18:30:47.851871+0000","last_fullsized":"2024-09-12T18:30:47.851871+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:25.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:07.409815+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:29:07.409815+0000","last_peered":"2024-09-12T18:29:07.409815+0000","last_clean":"2024-09-12T18:29:07.409815+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:29:07.409815+0000","last_undegraded":"2024-09-12T18:29:07.409815+0000","last_fullsized":"2024-09-12T18:29:07.409815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:47.977130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611696+0000","last_change":"2024-09-12T17:53:12.148669+0000","last_active":"2024-09-12T18:30:02.611696+0000","last_peered":"2024-09-12T18:30:02.611696+0000","last_clean":"2024-09-12T18:30:02.611696+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:30:02.611696+0000","last_undegraded":"2024-09-12T18:30:02.611696+0000","last_fullsized":"2024-09-12T18:30:02.611696+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:34.792507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2093,"num_write":3,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":207,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413248+0000","last_change":"2024-09-12T17:50:14.841525+0000","last_active":"2024-09-12T18:29:27.413248+0000","last_peered":"2024-09-12T18:29:27.413248+0000","last_clean":"2024-09-12T18:29:27.413248+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:29:27.413248+0000","last_undegraded":"2024-09-12T18:29:27.413248+0000","last_fullsized":"2024-09-12T18:29:27.413248+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.064279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408899+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:29:02.408899+0000","last_peered":"2024-09-12T18:29:02.408899+0000","last_clean":"2024-09-12T18:29:02.408899+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:29:02.408899+0000","last_undegraded":"2024-09-12T18:29:02.408899+0000","last_fullsized":"2024-09-12T18:29:02.408899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.682875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.606374+0000","last_change":"2024-09-12T17:53:15.162122+0000","last_active":"2024-09-12T18:29:17.606374+0000","last_peered":"2024-09-12T18:29:17.606374+0000","last_clean":"2024-09-12T18:29:17.606374+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:29:17.606374+0000","last_undegraded":"2024-09-12T18:29:17.606374+0000","last_fullsized":"2024-09-12T18:29:17.606374+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412132+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:29:17.412132+0000","last_peered":"2024-09-12T18:29:17.412132+0000","last_clean":"2024-09-12T18:29:17.412132+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:29:17.412132+0000","last_undegraded":"2024-09-12T18:29:17.412132+0000","last_fullsized":"2024-09-12T18:29:17.412132+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:32.030251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839464+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:29:02.839464+0000","last_peered":"2024-09-12T18:29:02.839464+0000","last_clean":"2024-09-12T18:29:02.839464+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:29:02.839464+0000","last_undegraded":"2024-09-12T18:29:02.839464+0000","last_fullsized":"2024-09-12T18:29:02.839464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:21.136369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422237+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:30:17.422237+0000","last_peered":"2024-09-12T18:30:17.422237+0000","last_clean":"2024-09-12T18:30:17.422237+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:30:17.422237+0000","last_undegraded":"2024-09-12T18:30:17.422237+0000","last_fullsized":"2024-09-12T18:30:17.422237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":10,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:13.532493+0000","last_change":"2024-09-12T17:53:12.147444+0000","last_active":"2024-09-12T18:29:13.532493+0000","last_peered":"2024-09-12T18:29:13.532493+0000","last_clean":"2024-09-12T18:29:13.532493+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:29:13.532493+0000","last_undegraded":"2024-09-12T18:29:13.532493+0000","last_fullsized":"2024-09-12T18:29:13.532493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:33.139490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411513+0000","last_change":"2024-09-12T17:50:14.845091+0000","last_active":"2024-09-12T18:29:17.411513+0000","last_peered":"2024-09-12T18:29:17.411513+0000","last_clean":"2024-09-12T18:29:17.411513+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:29:17.411513+0000","last_undegraded":"2024-09-12T18:29:17.411513+0000","last_fullsized":"2024-09-12T18:29:17.411513+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:59.523739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.415011+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:29:37.415011+0000","last_peered":"2024-09-12T18:29:37.415011+0000","last_clean":"2024-09-12T18:29:37.415011+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:29:37.415011+0000","last_undegraded":"2024-09-12T18:29:37.415011+0000","last_fullsized":"2024-09-12T18:29:37.415011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:49.644621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.427023+0000","last_change":"2024-09-12T17:53:12.146834+0000","last_active":"2024-09-12T18:30:42.427023+0000","last_peered":"2024-09-12T18:30:42.427023+0000","last_clean":"2024-09-12T18:30:42.427023+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:30:42.427023+0000","last_undegraded":"2024-09-12T18:30:42.427023+0000","last_fullsized":"2024-09-12T18:30:42.427023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:24.998862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841210+0000","last_change":"2024-09-12T17:50:14.843252+0000","last_active":"2024-09-12T18:29:17.841210+0000","last_peered":"2024-09-12T18:29:17.841210+0000","last_clean":"2024-09-12T18:29:17.841210+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:29:17.841210+0000","last_undegraded":"2024-09-12T18:29:17.841210+0000","last_fullsized":"2024-09-12T18:29:17.841210+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.189495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653142+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:29:37.653142+0000","last_peered":"2024-09-12T18:29:37.653142+0000","last_clean":"2024-09-12T18:29:37.653142+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:29:37.653142+0000","last_undegraded":"2024-09-12T18:29:37.653142+0000","last_fullsized":"2024-09-12T18:29:37.653142+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:54.893645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.516737+0000","last_change":"2024-09-12T17:53:12.145287+0000","last_active":"2024-09-12T18:30:52.516737+0000","last_peered":"2024-09-12T18:30:52.516737+0000","last_clean":"2024-09-12T18:30:52.516737+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:30:52.516737+0000","last_undegraded":"2024-09-12T18:30:52.516737+0000","last_fullsized":"2024-09-12T18:30:52.516737+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411632+0000","last_change":"2024-09-12T17:50:14.845672+0000","last_active":"2024-09-12T18:29:17.411632+0000","last_peered":"2024-09-12T18:29:17.411632+0000","last_clean":"2024-09-12T18:29:17.411632+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:29:17.411632+0000","last_undegraded":"2024-09-12T18:29:17.411632+0000","last_fullsized":"2024-09-12T18:29:17.411632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:46.707631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617831+0000","last_change":"2024-09-12T18:08:44.180779+0000","last_active":"2024-09-12T18:30:52.617831+0000","last_peered":"2024-09-12T18:30:52.617831+0000","last_clean":"2024-09-12T18:30:52.617831+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:30:52.617831+0000","last_undegraded":"2024-09-12T18:30:52.617831+0000","last_fullsized":"2024-09-12T18:30:52.617831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:51.232292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.657166+0000","last_change":"2024-09-12T17:53:12.147578+0000","last_active":"2024-09-12T18:30:02.657166+0000","last_peered":"2024-09-12T18:30:02.657166+0000","last_clean":"2024-09-12T18:30:02.657166+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:30:02.657166+0000","last_undegraded":"2024-09-12T18:30:02.657166+0000","last_fullsized":"2024-09-12T18:30:02.657166+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.387228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12574720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20468,"num_write":9,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419760+0000","last_change":"2024-09-12T17:50:14.843005+0000","last_active":"2024-09-12T18:30:02.419760+0000","last_peered":"2024-09-12T18:30:02.419760+0000","last_clean":"2024-09-12T18:30:02.419760+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:30:02.419760+0000","last_undegraded":"2024-09-12T18:30:02.419760+0000","last_fullsized":"2024-09-12T18:30:02.419760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:21.412702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535480+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:29:33.535480+0000","last_peered":"2024-09-12T18:29:33.535480+0000","last_clean":"2024-09-12T18:29:33.535480+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:29:33.535480+0000","last_undegraded":"2024-09-12T18:29:33.535480+0000","last_fullsized":"2024-09-12T18:29:33.535480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:09.211455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:08.540387+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:30:08.540387+0000","last_peered":"2024-09-12T18:30:08.540387+0000","last_clean":"2024-09-12T18:30:08.540387+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:30:08.540387+0000","last_undegraded":"2024-09-12T18:30:08.540387+0000","last_fullsized":"2024-09-12T18:30:08.540387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610519+0000","last_change":"2024-09-12T17:50:14.843405+0000","last_active":"2024-09-12T18:29:52.610519+0000","last_peered":"2024-09-12T18:29:52.610519+0000","last_clean":"2024-09-12T18:29:52.610519+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:29:52.610519+0000","last_undegraded":"2024-09-12T18:29:52.610519+0000","last_fullsized":"2024-09-12T18:29:52.610519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.738965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514158+0000","last_change":"2024-09-12T18:08:44.185535+0000","last_active":"2024-09-12T18:30:27.514158+0000","last_peered":"2024-09-12T18:30:27.514158+0000","last_clean":"2024-09-12T18:30:27.514158+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:30:27.514158+0000","last_undegraded":"2024-09-12T18:30:27.514158+0000","last_fullsized":"2024-09-12T18:30:27.514158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:31.002329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.617257+0000","last_change":"2024-09-12T17:53:15.156207+0000","last_active":"2024-09-12T18:30:47.617257+0000","last_peered":"2024-09-12T18:30:47.617257+0000","last_clean":"2024-09-12T18:30:47.617257+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:30:47.617257+0000","last_undegraded":"2024-09-12T18:30:47.617257+0000","last_fullsized":"2024-09-12T18:30:47.617257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.717848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":21492,"num_write":12,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.412301+0000","last_change":"2024-09-12T17:53:12.148444+0000","last_active":"2024-09-12T18:29:22.412301+0000","last_peered":"2024-09-12T18:29:22.412301+0000","last_clean":"2024-09-12T18:29:22.412301+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:29:22.412301+0000","last_undegraded":"2024-09-12T18:29:22.412301+0000","last_fullsized":"2024-09-12T18:29:22.412301+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:25.525568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655558+0000","last_change":"2024-09-12T17:50:14.845855+0000","last_active":"2024-09-12T18:29:52.655558+0000","last_peered":"2024-09-12T18:29:52.655558+0000","last_clean":"2024-09-12T18:29:52.655558+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:29:52.655558+0000","last_undegraded":"2024-09-12T18:29:52.655558+0000","last_fullsized":"2024-09-12T18:29:52.655558+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.841767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650945+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:29:22.650945+0000","last_peered":"2024-09-12T18:29:22.650945+0000","last_clean":"2024-09-12T18:29:22.650945+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:29:22.650945+0000","last_undegraded":"2024-09-12T18:29:22.650945+0000","last_fullsized":"2024-09-12T18:29:22.650945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:54.256446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4240667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4192,"num_write":2,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426884+0000","last_change":"2024-09-12T17:53:12.141323+0000","last_active":"2024-09-12T18:30:42.426884+0000","last_peered":"2024-09-12T18:30:42.426884+0000","last_clean":"2024-09-12T18:30:42.426884+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:30:42.426884+0000","last_undegraded":"2024-09-12T18:30:42.426884+0000","last_fullsized":"2024-09-12T18:30:42.426884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:51.866615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:53.538225+0000","last_change":"2024-09-12T17:50:14.841037+0000","last_active":"2024-09-12T18:29:53.538225+0000","last_peered":"2024-09-12T18:29:53.538225+0000","last_clean":"2024-09-12T18:29:53.538225+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:29:53.538225+0000","last_undegraded":"2024-09-12T18:29:53.538225+0000","last_fullsized":"2024-09-12T18:29:53.538225+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:08.998454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.843448+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:29:37.843448+0000","last_peered":"2024-09-12T18:29:37.843448+0000","last_clean":"2024-09-12T18:29:37.843448+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:29:37.843448+0000","last_undegraded":"2024-09-12T18:29:37.843448+0000","last_fullsized":"2024-09-12T18:29:37.843448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:46.217476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427908+0000","last_change":"2024-09-12T17:53:15.167067+0000","last_active":"2024-09-12T18:30:47.427908+0000","last_peered":"2024-09-12T18:30:47.427908+0000","last_clean":"2024-09-12T18:30:47.427908+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:30:47.427908+0000","last_undegraded":"2024-09-12T18:30:47.427908+0000","last_fullsized":"2024-09-12T18:30:47.427908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:46.459018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.616631+0000","last_change":"2024-09-12T17:53:12.145714+0000","last_active":"2024-09-12T18:30:42.616631+0000","last_peered":"2024-09-12T18:30:42.616631+0000","last_clean":"2024-09-12T18:30:42.616631+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:30:42.616631+0000","last_undegraded":"2024-09-12T18:30:42.616631+0000","last_fullsized":"2024-09-12T18:30:42.616631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:38.676442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417826+0000","last_change":"2024-09-12T17:50:14.840332+0000","last_active":"2024-09-12T18:29:52.417826+0000","last_peered":"2024-09-12T18:29:52.417826+0000","last_clean":"2024-09-12T18:29:52.417826+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:29:52.417826+0000","last_undegraded":"2024-09-12T18:29:52.417826+0000","last_fullsized":"2024-09-12T18:29:52.417826+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415951+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:29:42.415951+0000","last_peered":"2024-09-12T18:29:42.415951+0000","last_clean":"2024-09-12T18:29:42.415951+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:29:42.415951+0000","last_undegraded":"2024-09-12T18:29:42.415951+0000","last_fullsized":"2024-09-12T18:29:42.415951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:51.046197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546288+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:30:48.546288+0000","last_peered":"2024-09-12T18:30:48.546288+0000","last_clean":"2024-09-12T18:30:48.546288+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:30:48.546288+0000","last_undegraded":"2024-09-12T18:30:48.546288+0000","last_fullsized":"2024-09-12T18:30:48.546288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'1","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.426935+0000","last_change":"2024-09-12T17:53:12.143851+0000","last_active":"2024-09-12T18:30:42.426935+0000","last_peered":"2024-09-12T18:30:42.426935+0000","last_clean":"2024-09-12T18:30:42.426935+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:30:42.426935+0000","last_undegraded":"2024-09-12T18:30:42.426935+0000","last_fullsized":"2024-09-12T18:30:42.426935+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:28.807772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424131+0000","last_change":"2024-09-12T17:50:14.843604+0000","last_active":"2024-09-12T18:30:27.424131+0000","last_peered":"2024-09-12T18:30:27.424131+0000","last_clean":"2024-09-12T18:30:27.424131+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:30:27.424131+0000","last_undegraded":"2024-09-12T18:30:27.424131+0000","last_fullsized":"2024-09-12T18:30:27.424131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:57.939262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'291","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417950+0000","last_change":"2024-09-12T17:35:40.897067+0000","last_active":"2024-09-12T18:29:52.417950+0000","last_peered":"2024-09-12T18:29:52.417950+0000","last_clean":"2024-09-12T18:29:52.417950+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:29:52.417950+0000","last_undegraded":"2024-09-12T18:29:52.417950+0000","last_fullsized":"2024-09-12T18:29:52.417950+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:44.766786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3645575,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":537,"num_read_kb":13512,"num_write":1059,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'535","reported_seq":1946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698681+0000","last_change":"2024-09-12T17:35:42.890337+0000","last_active":"2024-09-12T18:30:18.698681+0000","last_peered":"2024-09-12T18:30:18.698681+0000","last_clean":"2024-09-12T18:30:18.698681+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:30:18.698681+0000","last_undegraded":"2024-09-12T18:30:18.698681+0000","last_fullsized":"2024-09-12T18:30:18.698681+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:56.529947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'333","reported_seq":1112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:55.497873+0000","last_change":"2024-09-12T17:35:40.895813+0000","last_active":"2024-09-12T18:29:55.497873+0000","last_peered":"2024-09-12T18:29:55.497873+0000","last_clean":"2024-09-12T18:29:55.497873+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:29:55.497873+0000","last_undegraded":"2024-09-12T18:29:55.497873+0000","last_fullsized":"2024-09-12T18:29:55.497873+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:08.595904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10473446,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":723,"num_read_kb":23031,"num_write":1260,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'484","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812590+0000","last_change":"2024-09-12T17:35:42.888061+0000","last_active":"2024-09-12T18:30:18.812590+0000","last_peered":"2024-09-12T18:30:18.812590+0000","last_clean":"2024-09-12T18:30:18.812590+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:30:18.812590+0000","last_undegraded":"2024-09-12T18:30:18.812590+0000","last_fullsized":"2024-09-12T18:30:18.812590+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:42.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'322","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.421200+0000","last_change":"2024-09-12T17:36:16.048276+0000","last_active":"2024-09-12T18:30:27.421200+0000","last_peered":"2024-09-12T18:30:27.421200+0000","last_clean":"2024-09-12T18:30:27.421200+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:30:27.421200+0000","last_undegraded":"2024-09-12T18:30:27.421200+0000","last_fullsized":"2024-09-12T18:30:27.421200+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:44.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699446,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":700,"num_read_kb":32762,"num_write":1141,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'419","reported_seq":1922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.442221+0000","last_change":"2024-09-12T17:35:42.892018+0000","last_active":"2024-09-12T18:30:15.442221+0000","last_peered":"2024-09-12T18:30:15.442221+0000","last_clean":"2024-09-12T18:30:15.442221+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:30:15.442221+0000","last_undegraded":"2024-09-12T18:30:15.442221+0000","last_fullsized":"2024-09-12T18:30:15.442221+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:47.496306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'281","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.127721+0000","last_change":"2024-09-12T17:35:40.878718+0000","last_active":"2024-09-12T18:29:50.127721+0000","last_peered":"2024-09-12T18:29:50.127721+0000","last_clean":"2024-09-12T18:29:50.127721+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:29:50.127721+0000","last_undegraded":"2024-09-12T18:29:50.127721+0000","last_fullsized":"2024-09-12T18:29:50.127721+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.836799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12627198,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":435,"num_read_kb":25007,"num_write":1013,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'459","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816024+0000","last_change":"2024-09-12T17:35:42.901523+0000","last_active":"2024-09-12T18:30:18.816024+0000","last_peered":"2024-09-12T18:30:18.816024+0000","last_clean":"2024-09-12T18:30:18.816024+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:30:18.816024+0000","last_undegraded":"2024-09-12T18:30:18.816024+0000","last_fullsized":"2024-09-12T18:30:18.816024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:21.733978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'267","reported_seq":981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:40.942677+0000","last_change":"2024-09-12T17:35:40.893806+0000","last_active":"2024-09-12T18:29:40.942677+0000","last_peered":"2024-09-12T18:29:40.942677+0000","last_clean":"2024-09-12T18:29:40.942677+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:29:40.942677+0000","last_undegraded":"2024-09-12T18:29:40.942677+0000","last_fullsized":"2024-09-12T18:29:40.942677+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:58.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640253,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":10932,"num_write":983,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'856","reported_seq":2380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978627+0000","last_change":"2024-09-12T17:35:42.896618+0000","last_active":"2024-09-12T18:30:25.978627+0000","last_peered":"2024-09-12T18:30:25.978627+0000","last_clean":"2024-09-12T18:30:25.978627+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:30:25.978627+0000","last_undegraded":"2024-09-12T18:30:25.978627+0000","last_fullsized":"2024-09-12T18:30:25.978627+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:28.451347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'290","reported_seq":1084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:23.396215+0000","last_change":"2024-09-12T17:35:40.882513+0000","last_active":"2024-09-12T18:29:23.396215+0000","last_peered":"2024-09-12T18:29:23.396215+0000","last_clean":"2024-09-12T18:29:23.396215+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:29:23.396215+0000","last_undegraded":"2024-09-12T18:29:23.396215+0000","last_fullsized":"2024-09-12T18:29:23.396215+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.278996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238044,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":42334,"num_write":1239,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2407,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136019+0000","last_change":"2024-09-12T17:35:42.892097+0000","last_active":"2024-09-12T18:31:29.136019+0000","last_peered":"2024-09-12T18:31:29.136019+0000","last_clean":"2024-09-12T18:31:29.136019+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:31:29.136019+0000","last_undegraded":"2024-09-12T18:31:29.136019+0000","last_fullsized":"2024-09-12T18:31:29.136019+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:35.311382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'300","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.871088+0000","last_change":"2024-09-12T17:35:40.894162+0000","last_active":"2024-09-12T18:32:38.871088+0000","last_peered":"2024-09-12T18:32:38.871088+0000","last_clean":"2024-09-12T18:32:38.871088+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:32:38.871088+0000","last_undegraded":"2024-09-12T18:32:38.871088+0000","last_fullsized":"2024-09-12T18:32:38.871088+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:33.543998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18336797,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":449,"num_read_kb":26409,"num_write":1112,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'465","reported_seq":1962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440637+0000","last_change":"2024-09-12T17:35:42.887897+0000","last_active":"2024-09-12T18:30:15.440637+0000","last_peered":"2024-09-12T18:30:15.440637+0000","last_clean":"2024-09-12T18:30:15.440637+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:30:15.440637+0000","last_undegraded":"2024-09-12T18:30:15.440637+0000","last_fullsized":"2024-09-12T18:30:15.440637+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.371385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'320","reported_seq":954,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.333736+0000","last_change":"2024-09-12T17:35:40.879524+0000","last_active":"2024-09-12T18:32:43.333736+0000","last_peered":"2024-09-12T18:32:43.333736+0000","last_clean":"2024-09-12T18:32:43.333736+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:32:43.333736+0000","last_undegraded":"2024-09-12T18:32:43.333736+0000","last_fullsized":"2024-09-12T18:32:43.333736+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:11.574981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6294073,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":445,"num_read_kb":10679,"num_write":1174,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'484","reported_seq":2063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304996+0000","last_change":"2024-09-12T17:35:42.889118+0000","last_active":"2024-09-12T18:31:28.304996+0000","last_peered":"2024-09-12T18:31:28.304996+0000","last_clean":"2024-09-12T18:31:28.304996+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:31:28.304996+0000","last_undegraded":"2024-09-12T18:31:28.304996+0000","last_fullsized":"2024-09-12T18:31:28.304996+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:50.990196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'759","reported_seq":2185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699100+0000","last_change":"2024-09-12T17:35:42.896662+0000","last_active":"2024-09-12T18:30:18.699100+0000","last_peered":"2024-09-12T18:30:18.699100+0000","last_clean":"2024-09-12T18:30:18.699100+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:30:18.699100+0000","last_undegraded":"2024-09-12T18:30:18.699100+0000","last_fullsized":"2024-09-12T18:30:18.699100+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:32.589294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'292","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409020+0000","last_change":"2024-09-12T17:35:40.895257+0000","last_active":"2024-09-12T18:29:02.409020+0000","last_peered":"2024-09-12T18:29:02.409020+0000","last_clean":"2024-09-12T18:29:02.409020+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:29:02.409020+0000","last_undegraded":"2024-09-12T18:29:02.409020+0000","last_fullsized":"2024-09-12T18:29:02.409020+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:16.477537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370512,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":487,"num_read_kb":71616,"num_write":1078,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'417","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392437+0000","last_change":"2024-09-12T17:36:16.050871+0000","last_active":"2024-09-12T18:32:48.392437+0000","last_peered":"2024-09-12T18:32:48.392437+0000","last_clean":"2024-09-12T18:32:48.392437+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:32:48.392437+0000","last_undegraded":"2024-09-12T18:32:48.392437+0000","last_fullsized":"2024-09-12T18:32:48.392437+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:59.500853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'259","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:10.596848+0000","last_change":"2024-09-12T17:35:40.901655+0000","last_active":"2024-09-12T18:29:10.596848+0000","last_peered":"2024-09-12T18:29:10.596848+0000","last_clean":"2024-09-12T18:29:10.596848+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:29:10.596848+0000","last_undegraded":"2024-09-12T18:29:10.596848+0000","last_fullsized":"2024-09-12T18:29:10.596848+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.400186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1427699,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":423,"num_read_kb":3270,"num_write":960,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'870","reported_seq":2483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392732+0000","last_change":"2024-09-12T17:35:42.888574+0000","last_active":"2024-09-12T18:32:48.392732+0000","last_peered":"2024-09-12T18:32:48.392732+0000","last_clean":"2024-09-12T18:32:48.392732+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:32:48.392732+0000","last_undegraded":"2024-09-12T18:32:48.392732+0000","last_fullsized":"2024-09-12T18:32:48.392732+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:49.201685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'307","reported_seq":953,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:16.582596+0000","last_change":"2024-09-12T17:35:40.899223+0000","last_active":"2024-09-12T18:29:16.582596+0000","last_peered":"2024-09-12T18:29:16.582596+0000","last_clean":"2024-09-12T18:29:16.582596+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:29:16.582596+0000","last_undegraded":"2024-09-12T18:29:16.582596+0000","last_fullsized":"2024-09-12T18:29:16.582596+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:10.653659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8860185,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":470,"num_read_kb":65942,"num_write":1184,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1104","reported_seq":2609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527373+0000","last_change":"2024-09-12T17:35:42.889897+0000","last_active":"2024-09-12T18:30:04.527373+0000","last_peered":"2024-09-12T18:30:04.527373+0000","last_clean":"2024-09-12T18:30:04.527373+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:30:04.527373+0000","last_undegraded":"2024-09-12T18:30:04.527373+0000","last_fullsized":"2024-09-12T18:30:04.527373+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:49.298029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'254","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.502714+0000","last_change":"2024-09-12T17:35:40.896331+0000","last_active":"2024-09-12T18:33:03.502714+0000","last_peered":"2024-09-12T18:33:03.502714+0000","last_clean":"2024-09-12T18:33:03.502714+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:03.502714+0000","last_undegraded":"2024-09-12T18:33:03.502714+0000","last_fullsized":"2024-09-12T18:33:03.502714+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:10.681642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213252,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":722,"num_read_kb":33658,"num_write":1029,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'611","reported_seq":2377,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.306126+0000","last_change":"2024-09-12T17:35:42.897377+0000","last_active":"2024-09-12T18:31:28.306126+0000","last_peered":"2024-09-12T18:31:28.306126+0000","last_clean":"2024-09-12T18:31:28.306126+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:31:28.306126+0000","last_undegraded":"2024-09-12T18:31:28.306126+0000","last_fullsized":"2024-09-12T18:31:28.306126+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:35.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'258","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408847+0000","last_change":"2024-09-12T17:35:40.885644+0000","last_active":"2024-09-12T18:28:52.408847+0000","last_peered":"2024-09-12T18:28:52.408847+0000","last_clean":"2024-09-12T18:28:52.408847+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:28:52.408847+0000","last_undegraded":"2024-09-12T18:28:52.408847+0000","last_fullsized":"2024-09-12T18:28:52.408847+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:43.465385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833628,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":42765,"num_write":917,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'305","reported_seq":1678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.370580+0000","last_change":"2024-09-12T17:35:42.902985+0000","last_active":"2024-09-12T18:32:48.370580+0000","last_peered":"2024-09-12T18:32:48.370580+0000","last_clean":"2024-09-12T18:32:48.370580+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:32:48.370580+0000","last_undegraded":"2024-09-12T18:32:48.370580+0000","last_fullsized":"2024-09-12T18:32:48.370580+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:50.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'302","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704083+0000","last_change":"2024-09-12T17:35:40.901109+0000","last_active":"2024-09-12T18:30:52.704083+0000","last_peered":"2024-09-12T18:30:52.704083+0000","last_clean":"2024-09-12T18:30:52.704083+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:30:52.704083+0000","last_undegraded":"2024-09-12T18:30:52.704083+0000","last_fullsized":"2024-09-12T18:30:52.704083+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:19.735753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26499558,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":516,"num_read_kb":95722,"num_write":1065,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'128","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.236405+0000","last_change":"2024-09-12T17:35:50.911205+0000","last_active":"2024-09-12T18:31:29.236405+0000","last_peered":"2024-09-12T18:31:29.236405+0000","last_clean":"2024-09-12T18:31:29.236405+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:31:29.236405+0000","last_undegraded":"2024-09-12T18:31:29.236405+0000","last_fullsized":"2024-09-12T18:31:29.236405+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.073238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'773","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305568+0000","last_change":"2024-09-12T17:35:42.891760+0000","last_active":"2024-09-12T18:31:28.305568+0000","last_peered":"2024-09-12T18:31:28.305568+0000","last_clean":"2024-09-12T18:31:28.305568+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:31:28.305568+0000","last_undegraded":"2024-09-12T18:31:28.305568+0000","last_fullsized":"2024-09-12T18:31:28.305568+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:36.873441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'289","reported_seq":1055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.688797+0000","last_change":"2024-09-12T17:35:40.893979+0000","last_active":"2024-09-12T18:30:52.688797+0000","last_peered":"2024-09-12T18:30:52.688797+0000","last_clean":"2024-09-12T18:30:52.688797+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:30:52.688797+0000","last_undegraded":"2024-09-12T18:30:52.688797+0000","last_fullsized":"2024-09-12T18:30:52.688797+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:20.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144613,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":714,"num_read_kb":10754,"num_write":1074,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647106+0000","last_change":"2024-09-12T17:35:44.894904+0000","last_active":"2024-09-12T18:28:57.647106+0000","last_peered":"2024-09-12T18:28:57.647106+0000","last_clean":"2024-09-12T18:28:57.647106+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:28:57.647106+0000","last_undegraded":"2024-09-12T18:28:57.647106+0000","last_fullsized":"2024-09-12T18:28:57.647106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:49.733122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'337","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855854+0000","last_change":"2024-09-12T17:35:46.891705+0000","last_active":"2024-09-12T18:31:22.855854+0000","last_peered":"2024-09-12T18:31:22.855854+0000","last_clean":"2024-09-12T18:31:22.855854+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:31:22.855854+0000","last_undegraded":"2024-09-12T18:31:22.855854+0000","last_fullsized":"2024-09-12T18:31:22.855854+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:37.590312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59298,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1037,"num_write":432,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409035+0000","last_change":"2024-09-12T17:35:48.908793+0000","last_active":"2024-09-12T18:29:02.409035+0000","last_peered":"2024-09-12T18:29:02.409035+0000","last_clean":"2024-09-12T18:29:02.409035+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:29:02.409035+0000","last_undegraded":"2024-09-12T18:29:02.409035+0000","last_fullsized":"2024-09-12T18:29:02.409035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.844066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'159","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.215133+0000","last_change":"2024-09-12T17:35:50.921992+0000","last_active":"2024-09-12T18:32:48.215133+0000","last_peered":"2024-09-12T18:32:48.215133+0000","last_clean":"2024-09-12T18:32:48.215133+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:32:48.215133+0000","last_undegraded":"2024-09-12T18:32:48.215133+0000","last_fullsized":"2024-09-12T18:32:48.215133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:51.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'479","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440599+0000","last_change":"2024-09-12T17:35:42.890621+0000","last_active":"2024-09-12T18:30:15.440599+0000","last_peered":"2024-09-12T18:30:15.440599+0000","last_clean":"2024-09-12T18:30:15.440599+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:30:15.440599+0000","last_undegraded":"2024-09-12T18:30:15.440599+0000","last_fullsized":"2024-09-12T18:30:15.440599+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:54.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'346","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.454985+0000","last_change":"2024-09-12T17:35:40.889680+0000","last_active":"2024-09-12T18:29:38.454985+0000","last_peered":"2024-09-12T18:29:38.454985+0000","last_clean":"2024-09-12T18:29:38.454985+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:29:38.454985+0000","last_undegraded":"2024-09-12T18:29:38.454985+0000","last_fullsized":"2024-09-12T18:29:38.454985+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.317264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9114513,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":601,"num_read_kb":80570,"num_write":1218,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415429+0000","last_change":"2024-09-12T17:35:44.894677+0000","last_active":"2024-09-12T18:29:42.415429+0000","last_peered":"2024-09-12T18:29:42.415429+0000","last_clean":"2024-09-12T18:29:42.415429+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:29:42.415429+0000","last_undegraded":"2024-09-12T18:29:42.415429+0000","last_fullsized":"2024-09-12T18:29:42.415429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:39.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'89","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530565+0000","last_change":"2024-09-12T17:35:46.899363+0000","last_active":"2024-09-12T18:28:58.530565+0000","last_peered":"2024-09-12T18:28:58.530565+0000","last_clean":"2024-09-12T18:28:58.530565+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:28:58.530565+0000","last_undegraded":"2024-09-12T18:28:58.530565+0000","last_fullsized":"2024-09-12T18:28:58.530565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530549+0000","last_change":"2024-09-12T17:35:48.901307+0000","last_active":"2024-09-12T18:28:58.530549+0000","last_peered":"2024-09-12T18:28:58.530549+0000","last_clean":"2024-09-12T18:28:58.530549+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:28:58.530549+0000","last_undegraded":"2024-09-12T18:28:58.530549+0000","last_fullsized":"2024-09-12T18:28:58.530549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:46.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'172","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.558222+0000","last_change":"2024-09-12T17:35:50.916182+0000","last_active":"2024-09-12T18:29:58.558222+0000","last_peered":"2024-09-12T18:29:58.558222+0000","last_clean":"2024-09-12T18:29:58.558222+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:29:58.558222+0000","last_undegraded":"2024-09-12T18:29:58.558222+0000","last_fullsized":"2024-09-12T18:29:58.558222+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:31.805546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1211","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816008+0000","last_change":"2024-09-12T17:35:42.901505+0000","last_active":"2024-09-12T18:30:18.816008+0000","last_peered":"2024-09-12T18:30:18.816008+0000","last_clean":"2024-09-12T18:30:18.816008+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:30:18.816008+0000","last_undegraded":"2024-09-12T18:30:18.816008+0000","last_fullsized":"2024-09-12T18:30:18.816008+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:38.531579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'328","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:39.804067+0000","last_change":"2024-09-12T17:35:40.891281+0000","last_active":"2024-09-12T18:29:39.804067+0000","last_peered":"2024-09-12T18:29:39.804067+0000","last_clean":"2024-09-12T18:29:39.804067+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:29:39.804067+0000","last_undegraded":"2024-09-12T18:29:39.804067+0000","last_fullsized":"2024-09-12T18:29:39.804067+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:27.169879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9599526,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":483,"num_read_kb":8445,"num_write":1209,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409696+0000","last_change":"2024-09-12T17:35:44.891907+0000","last_active":"2024-09-12T18:28:57.409696+0000","last_peered":"2024-09-12T18:28:57.409696+0000","last_clean":"2024-09-12T18:28:57.409696+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:28:57.409696+0000","last_undegraded":"2024-09-12T18:28:57.409696+0000","last_fullsized":"2024-09-12T18:28:57.409696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:17.733659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'121","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.508338+0000","last_change":"2024-09-12T17:35:46.901224+0000","last_active":"2024-09-12T18:29:37.508338+0000","last_peered":"2024-09-12T18:29:37.508338+0000","last_clean":"2024-09-12T18:29:37.508338+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:29:37.508338+0000","last_undegraded":"2024-09-12T18:29:37.508338+0000","last_fullsized":"2024-09-12T18:29:37.508338+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:25.864997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'760","reported_seq":2574,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130833+0000","last_change":"2024-09-12T17:35:48.907483+0000","last_active":"2024-09-12T18:32:53.130833+0000","last_peered":"2024-09-12T18:32:53.130833+0000","last_clean":"2024-09-12T18:32:53.130833+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:32:53.130833+0000","last_undegraded":"2024-09-12T18:32:53.130833+0000","last_fullsized":"2024-09-12T18:32:53.130833+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.736753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'230","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.422075+0000","last_change":"2024-09-12T17:35:51.346696+0000","last_active":"2024-09-12T18:31:28.422075+0000","last_peered":"2024-09-12T18:31:28.422075+0000","last_clean":"2024-09-12T18:31:28.422075+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:31:28.422075+0000","last_undegraded":"2024-09-12T18:31:28.422075+0000","last_fullsized":"2024-09-12T18:31:28.422075+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:18.663124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'672","reported_seq":2084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.119270+0000","last_change":"2024-09-12T17:35:42.895732+0000","last_active":"2024-09-12T18:31:29.119270+0000","last_peered":"2024-09-12T18:31:29.119270+0000","last_clean":"2024-09-12T18:31:29.119270+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:31:29.119270+0000","last_undegraded":"2024-09-12T18:31:29.119270+0000","last_fullsized":"2024-09-12T18:31:29.119270+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:25.681124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'289","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:50.136009+0000","last_change":"2024-09-12T17:35:40.900095+0000","last_active":"2024-09-12T18:29:50.136009+0000","last_peered":"2024-09-12T18:29:50.136009+0000","last_clean":"2024-09-12T18:29:50.136009+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:29:50.136009+0000","last_undegraded":"2024-09-12T18:29:50.136009+0000","last_fullsized":"2024-09-12T18:29:50.136009+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:59.106406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4598709,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":510,"num_read_kb":57705,"num_write":1072,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647162+0000","last_change":"2024-09-12T17:35:44.893676+0000","last_active":"2024-09-12T18:28:57.647162+0000","last_peered":"2024-09-12T18:28:57.647162+0000","last_clean":"2024-09-12T18:28:57.647162+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:28:57.647162+0000","last_undegraded":"2024-09-12T18:28:57.647162+0000","last_fullsized":"2024-09-12T18:28:57.647162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:14.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'273","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.434279+0000","last_change":"2024-09-12T17:35:47.464920+0000","last_active":"2024-09-12T18:31:22.434279+0000","last_peered":"2024-09-12T18:31:22.434279+0000","last_clean":"2024-09-12T18:31:22.434279+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:31:22.434279+0000","last_undegraded":"2024-09-12T18:31:22.434279+0000","last_fullsized":"2024-09-12T18:31:22.434279+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:46.905458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56997,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":951,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'812","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131261+0000","last_change":"2024-09-12T17:35:48.899501+0000","last_active":"2024-09-12T18:32:53.131261+0000","last_peered":"2024-09-12T18:32:53.131261+0000","last_clean":"2024-09-12T18:32:53.131261+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:32:53.131261+0000","last_undegraded":"2024-09-12T18:32:53.131261+0000","last_fullsized":"2024-09-12T18:32:53.131261+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:00.483899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'541","reported_seq":2111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.407478+0000","last_change":"2024-09-12T17:35:42.891761+0000","last_active":"2024-09-12T18:30:50.407478+0000","last_peered":"2024-09-12T18:30:50.407478+0000","last_clean":"2024-09-12T18:30:50.407478+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:30:50.407478+0000","last_undegraded":"2024-09-12T18:30:50.407478+0000","last_fullsized":"2024-09-12T18:30:50.407478+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:30.116005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'330","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:40.955328+0000","last_change":"2024-09-12T17:36:16.048265+0000","last_active":"2024-09-12T18:32:40.955328+0000","last_peered":"2024-09-12T18:32:40.955328+0000","last_clean":"2024-09-12T18:32:40.955328+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:32:40.955328+0000","last_undegraded":"2024-09-12T18:32:40.955328+0000","last_fullsized":"2024-09-12T18:32:40.955328+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:28.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10990092,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":23815,"num_write":1174,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418824+0000","last_change":"2024-09-12T17:35:44.897503+0000","last_active":"2024-09-12T18:29:57.418824+0000","last_peered":"2024-09-12T18:29:57.418824+0000","last_clean":"2024-09-12T18:29:57.418824+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:29:57.418824+0000","last_undegraded":"2024-09-12T18:29:57.418824+0000","last_fullsized":"2024-09-12T18:29:57.418824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.732782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'360","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.676108+0000","last_change":"2024-09-12T17:35:47.466030+0000","last_active":"2024-09-12T18:32:12.676108+0000","last_peered":"2024-09-12T18:32:12.676108+0000","last_clean":"2024-09-12T18:32:12.676108+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:32:12.676108+0000","last_undegraded":"2024-09-12T18:32:12.676108+0000","last_fullsized":"2024-09-12T18:32:12.676108+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:23.136183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54972,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":1027,"num_write":448,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610510+0000","last_change":"2024-09-12T17:35:48.908512+0000","last_active":"2024-09-12T18:29:52.610510+0000","last_peered":"2024-09-12T18:29:52.610510+0000","last_clean":"2024-09-12T18:29:52.610510+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:29:52.610510+0000","last_undegraded":"2024-09-12T18:29:52.610510+0000","last_fullsized":"2024-09-12T18:29:52.610510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:43.347490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'584","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.244085+0000","last_change":"2024-09-12T17:35:50.922799+0000","last_active":"2024-09-12T18:32:50.244085+0000","last_peered":"2024-09-12T18:32:50.244085+0000","last_clean":"2024-09-12T18:32:50.244085+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:32:50.244085+0000","last_undegraded":"2024-09-12T18:32:50.244085+0000","last_fullsized":"2024-09-12T18:32:50.244085+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:24.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'543","reported_seq":2019,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812212+0000","last_change":"2024-09-12T17:35:42.902988+0000","last_active":"2024-09-12T18:30:18.812212+0000","last_peered":"2024-09-12T18:30:18.812212+0000","last_clean":"2024-09-12T18:30:18.812212+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:30:18.812212+0000","last_undegraded":"2024-09-12T18:30:18.812212+0000","last_fullsized":"2024-09-12T18:30:18.812212+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:13.896842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'334","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419879+0000","last_change":"2024-09-12T17:36:16.051846+0000","last_active":"2024-09-12T18:30:17.419879+0000","last_peered":"2024-09-12T18:30:17.419879+0000","last_clean":"2024-09-12T18:30:17.419879+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:30:17.419879+0000","last_undegraded":"2024-09-12T18:30:17.419879+0000","last_fullsized":"2024-09-12T18:30:17.419879+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.618855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057479,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":623,"num_read_kb":15946,"num_write":1172,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510551+0000","last_change":"2024-09-12T17:35:44.891784+0000","last_active":"2024-09-12T18:29:57.510551+0000","last_peered":"2024-09-12T18:29:57.510551+0000","last_clean":"2024-09-12T18:29:57.510551+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:29:57.510551+0000","last_undegraded":"2024-09-12T18:29:57.510551+0000","last_fullsized":"2024-09-12T18:29:57.510551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:27.255253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'268","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433730+0000","last_change":"2024-09-12T17:35:46.896008+0000","last_active":"2024-09-12T18:32:02.433730+0000","last_peered":"2024-09-12T18:32:02.433730+0000","last_clean":"2024-09-12T18:32:02.433730+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:32:02.433730+0000","last_undegraded":"2024-09-12T18:32:02.433730+0000","last_fullsized":"2024-09-12T18:32:02.433730+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:57.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":924,"num_write":360,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419734+0000","last_change":"2024-09-12T17:35:48.898203+0000","last_active":"2024-09-12T18:30:17.419734+0000","last_peered":"2024-09-12T18:30:17.419734+0000","last_clean":"2024-09-12T18:30:17.419734+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:30:17.419734+0000","last_undegraded":"2024-09-12T18:30:17.419734+0000","last_fullsized":"2024-09-12T18:30:17.419734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:47.877509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2398","reported_seq":4235,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:17.444594+0000","last_change":"2024-09-12T17:35:50.921094+0000","last_active":"2024-09-12T18:32:17.444594+0000","last_peered":"2024-09-12T18:32:17.444594+0000","last_clean":"2024-09-12T18:32:17.444594+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:32:17.444594+0000","last_undegraded":"2024-09-12T18:32:17.444594+0000","last_fullsized":"2024-09-12T18:32:17.444594+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.702558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1122","reported_seq":2583,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.526751+0000","last_change":"2024-09-12T17:35:42.900928+0000","last_active":"2024-09-12T18:30:04.526751+0000","last_peered":"2024-09-12T18:30:04.526751+0000","last_clean":"2024-09-12T18:30:04.526751+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:30:04.526751+0000","last_undegraded":"2024-09-12T18:30:04.526751+0000","last_fullsized":"2024-09-12T18:30:04.526751+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:07.706166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'273","reported_seq":943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513103+0000","last_change":"2024-09-12T17:36:16.050004+0000","last_active":"2024-09-12T18:30:17.513103+0000","last_peered":"2024-09-12T18:30:17.513103+0000","last_clean":"2024-09-12T18:30:17.513103+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:30:17.513103+0000","last_undegraded":"2024-09-12T18:30:17.513103+0000","last_fullsized":"2024-09-12T18:30:17.513103+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:23.922359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22753830,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":185869,"num_write":1087,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509529+0000","last_change":"2024-09-12T17:35:44.893925+0000","last_active":"2024-09-12T18:29:47.509529+0000","last_peered":"2024-09-12T18:29:47.509529+0000","last_clean":"2024-09-12T18:29:47.509529+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:29:47.509529+0000","last_undegraded":"2024-09-12T18:29:47.509529+0000","last_fullsized":"2024-09-12T18:29:47.509529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:20.847625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'319","reported_seq":900,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.442591+0000","last_change":"2024-09-12T17:35:46.899126+0000","last_active":"2024-09-12T18:32:07.442591+0000","last_peered":"2024-09-12T18:32:07.442591+0000","last_clean":"2024-09-12T18:32:07.442591+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:32:07.442591+0000","last_undegraded":"2024-09-12T18:32:07.442591+0000","last_fullsized":"2024-09-12T18:32:07.442591+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.188366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60888,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":1029,"num_write":422,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'787","reported_seq":4755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118750+0000","last_change":"2024-09-12T17:35:48.902303+0000","last_active":"2024-09-12T18:32:53.118750+0000","last_peered":"2024-09-12T18:32:53.118750+0000","last_clean":"2024-09-12T18:32:53.118750+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:32:53.118750+0000","last_undegraded":"2024-09-12T18:32:53.118750+0000","last_fullsized":"2024-09-12T18:32:53.118750+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:31.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'116","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.214430+0000","last_change":"2024-09-12T17:35:50.916330+0000","last_active":"2024-09-12T18:32:48.214430+0000","last_peered":"2024-09-12T18:32:48.214430+0000","last_clean":"2024-09-12T18:32:48.214430+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:32:48.214430+0000","last_undegraded":"2024-09-12T18:32:48.214430+0000","last_fullsized":"2024-09-12T18:32:48.214430+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.967026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'517","reported_seq":2158,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816091+0000","last_change":"2024-09-12T17:35:42.892720+0000","last_active":"2024-09-12T18:30:18.816091+0000","last_peered":"2024-09-12T18:30:18.816091+0000","last_clean":"2024-09-12T18:30:18.816091+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:30:18.816091+0000","last_undegraded":"2024-09-12T18:30:18.816091+0000","last_fullsized":"2024-09-12T18:30:18.816091+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:01.659398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'289","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.006585+0000","last_change":"2024-09-12T17:35:40.893097+0000","last_active":"2024-09-12T18:29:58.006585+0000","last_peered":"2024-09-12T18:29:58.006585+0000","last_clean":"2024-09-12T18:29:58.006585+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:29:58.006585+0000","last_undegraded":"2024-09-12T18:29:58.006585+0000","last_fullsized":"2024-09-12T18:29:58.006585+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:49.867087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713755,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":588,"num_read_kb":11855,"num_write":1164,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.511826+0000","last_change":"2024-09-12T17:35:44.893352+0000","last_active":"2024-09-12T18:30:07.511826+0000","last_peered":"2024-09-12T18:30:07.511826+0000","last_clean":"2024-09-12T18:30:07.511826+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:30:07.511826+0000","last_undegraded":"2024-09-12T18:30:07.511826+0000","last_fullsized":"2024-09-12T18:30:07.511826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:24.100202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'470","reported_seq":1094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.211076+0000","last_change":"2024-09-12T17:35:46.894868+0000","last_active":"2024-09-12T18:32:50.211076+0000","last_peered":"2024-09-12T18:32:50.211076+0000","last_clean":"2024-09-12T18:32:50.211076+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:32:50.211076+0000","last_undegraded":"2024-09-12T18:32:50.211076+0000","last_fullsized":"2024-09-12T18:32:50.211076+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:02.326426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122300,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":1816,"num_write":682,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.511164+0000","last_change":"2024-09-12T17:35:48.901213+0000","last_active":"2024-09-12T18:30:02.511164+0000","last_peered":"2024-09-12T18:30:02.511164+0000","last_clean":"2024-09-12T18:30:02.511164+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:30:02.511164+0000","last_undegraded":"2024-09-12T18:30:02.511164+0000","last_fullsized":"2024-09-12T18:30:02.511164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.829487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'162","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611795+0000","last_change":"2024-09-12T17:35:50.911833+0000","last_active":"2024-09-12T18:30:02.611795+0000","last_peered":"2024-09-12T18:30:02.611795+0000","last_clean":"2024-09-12T18:30:02.611795+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:30:02.611795+0000","last_undegraded":"2024-09-12T18:30:02.611795+0000","last_fullsized":"2024-09-12T18:30:02.611795+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:29.046424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'552","reported_seq":2191,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305005+0000","last_change":"2024-09-12T17:35:42.900912+0000","last_active":"2024-09-12T18:31:28.305005+0000","last_peered":"2024-09-12T18:31:28.305005+0000","last_clean":"2024-09-12T18:31:28.305005+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:31:28.305005+0000","last_undegraded":"2024-09-12T18:31:28.305005+0000","last_fullsized":"2024-09-12T18:31:28.305005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:06.952203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'325","reported_seq":1146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415392+0000","last_change":"2024-09-12T17:35:40.888502+0000","last_active":"2024-09-12T18:29:42.415392+0000","last_peered":"2024-09-12T18:29:42.415392+0000","last_clean":"2024-09-12T18:29:42.415392+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:29:42.415392+0000","last_undegraded":"2024-09-12T18:29:42.415392+0000","last_fullsized":"2024-09-12T18:29:42.415392+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70436,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":896,"num_read_kb":1817,"num_write":1187,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509559+0000","last_change":"2024-09-12T17:35:44.894374+0000","last_active":"2024-09-12T18:29:47.509559+0000","last_peered":"2024-09-12T18:29:47.509559+0000","last_clean":"2024-09-12T18:29:47.509559+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:29:47.509559+0000","last_undegraded":"2024-09-12T18:29:47.509559+0000","last_fullsized":"2024-09-12T18:29:47.509559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:37.315095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'288","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.212211+0000","last_change":"2024-09-12T17:35:46.899081+0000","last_active":"2024-09-12T18:32:50.212211+0000","last_peered":"2024-09-12T18:32:50.212211+0000","last_clean":"2024-09-12T18:32:50.212211+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:32:50.212211+0000","last_undegraded":"2024-09-12T18:32:50.212211+0000","last_fullsized":"2024-09-12T18:32:50.212211+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:12.067500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":956,"num_write":438,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846238+0000","last_change":"2024-09-12T17:35:48.902048+0000","last_active":"2024-09-12T18:29:57.846238+0000","last_peered":"2024-09-12T18:29:57.846238+0000","last_clean":"2024-09-12T18:29:57.846238+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:29:57.846238+0000","last_undegraded":"2024-09-12T18:29:57.846238+0000","last_fullsized":"2024-09-12T18:29:57.846238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:02.774589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'94","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.488770+0000","last_change":"2024-09-12T17:35:50.921798+0000","last_active":"2024-09-12T18:32:38.488770+0000","last_peered":"2024-09-12T18:32:38.488770+0000","last_clean":"2024-09-12T18:32:38.488770+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:32:38.488770+0000","last_undegraded":"2024-09-12T18:32:38.488770+0000","last_fullsized":"2024-09-12T18:32:38.488770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:56.715205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'569","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812211+0000","last_change":"2024-09-12T17:35:42.891518+0000","last_active":"2024-09-12T18:30:18.812211+0000","last_peered":"2024-09-12T18:30:18.812211+0000","last_clean":"2024-09-12T18:30:18.812211+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:30:18.812211+0000","last_undegraded":"2024-09-12T18:30:18.812211+0000","last_fullsized":"2024-09-12T18:30:18.812211+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.251539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'292","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419688+0000","last_change":"2024-09-12T17:35:40.894104+0000","last_active":"2024-09-12T18:30:02.419688+0000","last_peered":"2024-09-12T18:30:02.419688+0000","last_clean":"2024-09-12T18:30:02.419688+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:30:02.419688+0000","last_undegraded":"2024-09-12T18:30:02.419688+0000","last_fullsized":"2024-09-12T18:30:02.419688+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:58.765499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11543540,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":452,"num_read_kb":30147,"num_write":1073,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"36'5","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.360065+0000","last_change":"2024-09-12T17:35:44.898322+0000","last_active":"2024-09-12T18:32:49.360065+0000","last_peered":"2024-09-12T18:32:49.360065+0000","last_clean":"2024-09-12T18:32:49.360065+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:32:49.360065+0000","last_undegraded":"2024-09-12T18:32:49.360065+0000","last_fullsized":"2024-09-12T18:32:49.360065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:56.912777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'309","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.526103+0000","last_change":"2024-09-12T17:35:46.902352+0000","last_active":"2024-09-12T18:32:12.526103+0000","last_peered":"2024-09-12T18:32:12.526103+0000","last_clean":"2024-09-12T18:32:12.526103+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:32:12.526103+0000","last_undegraded":"2024-09-12T18:32:12.526103+0000","last_fullsized":"2024-09-12T18:32:12.526103+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:39.492378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":983,"num_write":406,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.118910+0000","last_change":"2024-09-12T17:35:48.906082+0000","last_active":"2024-09-12T18:32:53.118910+0000","last_peered":"2024-09-12T18:32:53.118910+0000","last_clean":"2024-09-12T18:32:53.118910+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:32:53.118910+0000","last_undegraded":"2024-09-12T18:32:53.118910+0000","last_fullsized":"2024-09-12T18:32:53.118910+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:57.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'132","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.193519+0000","last_change":"2024-09-12T17:35:50.909941+0000","last_active":"2024-09-12T18:31:27.193519+0000","last_peered":"2024-09-12T18:31:27.193519+0000","last_clean":"2024-09-12T18:31:27.193519+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:31:27.193519+0000","last_undegraded":"2024-09-12T18:31:27.193519+0000","last_fullsized":"2024-09-12T18:31:27.193519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:20.080003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'391","reported_seq":1810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812238+0000","last_change":"2024-09-12T17:35:42.899041+0000","last_active":"2024-09-12T18:30:18.812238+0000","last_peered":"2024-09-12T18:30:18.812238+0000","last_clean":"2024-09-12T18:30:18.812238+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:30:18.812238+0000","last_undegraded":"2024-09-12T18:30:18.812238+0000","last_fullsized":"2024-09-12T18:30:18.812238+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:37.507108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'279","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.504928+0000","last_change":"2024-09-12T17:35:40.904599+0000","last_active":"2024-09-12T18:33:03.504928+0000","last_peered":"2024-09-12T18:33:03.504928+0000","last_clean":"2024-09-12T18:33:03.504928+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:03.504928+0000","last_undegraded":"2024-09-12T18:33:03.504928+0000","last_fullsized":"2024-09-12T18:33:03.504928+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.738624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769033,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":4238,"num_write":1089,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1442,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.371226+0000","last_change":"2024-09-12T17:35:44.898038+0000","last_active":"2024-09-12T18:32:49.371226+0000","last_peered":"2024-09-12T18:32:49.371226+0000","last_clean":"2024-09-12T18:32:49.371226+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:32:49.371226+0000","last_undegraded":"2024-09-12T18:32:49.371226+0000","last_fullsized":"2024-09-12T18:32:49.371226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:34.625148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'95","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416056+0000","last_change":"2024-09-12T17:35:47.464847+0000","last_active":"2024-09-12T18:29:47.416056+0000","last_peered":"2024-09-12T18:29:47.416056+0000","last_clean":"2024-09-12T18:29:47.416056+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:29:47.416056+0000","last_undegraded":"2024-09-12T18:29:47.416056+0000","last_fullsized":"2024-09-12T18:29:47.416056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:21.681360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'777","reported_seq":2599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130536+0000","last_change":"2024-09-12T17:35:48.904923+0000","last_active":"2024-09-12T18:32:53.130536+0000","last_peered":"2024-09-12T18:32:53.130536+0000","last_clean":"2024-09-12T18:32:53.130536+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:32:53.130536+0000","last_undegraded":"2024-09-12T18:32:53.130536+0000","last_fullsized":"2024-09-12T18:32:53.130536+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.107183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'108","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.539421+0000","last_change":"2024-09-12T17:35:50.910651+0000","last_active":"2024-09-12T18:30:03.539421+0000","last_peered":"2024-09-12T18:30:03.539421+0000","last_clean":"2024-09-12T18:30:03.539421+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:30:03.539421+0000","last_undegraded":"2024-09-12T18:30:03.539421+0000","last_fullsized":"2024-09-12T18:30:03.539421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'456","reported_seq":2050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.354919+0000","last_change":"2024-09-12T17:35:42.893296+0000","last_active":"2024-09-12T18:30:02.354919+0000","last_peered":"2024-09-12T18:30:02.354919+0000","last_clean":"2024-09-12T18:30:02.354919+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:30:02.354919+0000","last_undegraded":"2024-09-12T18:30:02.354919+0000","last_fullsized":"2024-09-12T18:30:02.354919+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.897104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'296","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.495418+0000","last_change":"2024-09-12T17:35:40.887751+0000","last_active":"2024-09-12T18:32:47.495418+0000","last_peered":"2024-09-12T18:32:47.495418+0000","last_clean":"2024-09-12T18:32:47.495418+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:32:47.495418+0000","last_undegraded":"2024-09-12T18:32:47.495418+0000","last_fullsized":"2024-09-12T18:32:47.495418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:38.884936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6630172,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":548,"num_read_kb":18792,"num_write":968,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:48.537562+0000","last_change":"2024-09-12T17:35:44.894399+0000","last_active":"2024-09-12T18:29:48.537562+0000","last_peered":"2024-09-12T18:29:48.537562+0000","last_clean":"2024-09-12T18:29:48.537562+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:29:48.537562+0000","last_undegraded":"2024-09-12T18:29:48.537562+0000","last_fullsized":"2024-09-12T18:29:48.537562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:44.105931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'346","reported_seq":949,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674692+0000","last_change":"2024-09-12T17:35:46.899125+0000","last_active":"2024-09-12T18:32:02.674692+0000","last_peered":"2024-09-12T18:32:02.674692+0000","last_clean":"2024-09-12T18:32:02.674692+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:32:02.674692+0000","last_undegraded":"2024-09-12T18:32:02.674692+0000","last_fullsized":"2024-09-12T18:32:02.674692+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:44.324703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61834,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":560,"num_read_kb":1050,"num_write":442,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417912+0000","last_change":"2024-09-12T17:35:48.906391+0000","last_active":"2024-09-12T18:29:52.417912+0000","last_peered":"2024-09-12T18:29:52.417912+0000","last_clean":"2024-09-12T18:29:52.417912+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:29:52.417912+0000","last_undegraded":"2024-09-12T18:29:52.417912+0000","last_fullsized":"2024-09-12T18:29:52.417912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.195528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'123","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.371706+0000","last_change":"2024-09-12T17:35:50.921659+0000","last_active":"2024-09-12T18:30:12.371706+0000","last_peered":"2024-09-12T18:30:12.371706+0000","last_clean":"2024-09-12T18:30:12.371706+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:30:12.371706+0000","last_undegraded":"2024-09-12T18:30:12.371706+0000","last_fullsized":"2024-09-12T18:30:12.371706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:51.201223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'925","reported_seq":2656,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440823+0000","last_change":"2024-09-12T17:35:42.902610+0000","last_active":"2024-09-12T18:30:15.440823+0000","last_peered":"2024-09-12T18:30:15.440823+0000","last_clean":"2024-09-12T18:30:15.440823+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:30:15.440823+0000","last_undegraded":"2024-09-12T18:30:15.440823+0000","last_fullsized":"2024-09-12T18:30:15.440823+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":900,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:15.705104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.414933+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T18:29:37.414933+0000","last_peered":"2024-09-12T18:29:37.414933+0000","last_clean":"2024-09-12T18:29:37.414933+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:29:37.414933+0000","last_undegraded":"2024-09-12T18:29:37.414933+0000","last_fullsized":"2024-09-12T18:29:37.414933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.654007+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T18:29:42.654007+0000","last_peered":"2024-09-12T18:29:42.654007+0000","last_clean":"2024-09-12T18:29:42.654007+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:29:42.654007+0000","last_undegraded":"2024-09-12T18:29:42.654007+0000","last_fullsized":"2024-09-12T18:29:42.654007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'257","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.416631+0000","last_change":"2024-09-12T17:35:40.885469+0000","last_active":"2024-09-12T18:29:52.416631+0000","last_peered":"2024-09-12T18:29:52.416631+0000","last_clean":"2024-09-12T18:29:52.416631+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:29:52.416631+0000","last_undegraded":"2024-09-12T18:29:52.416631+0000","last_fullsized":"2024-09-12T18:29:52.416631+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.530648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8332815,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":367,"num_read_kb":16539,"num_write":953,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418918+0000","last_change":"2024-09-12T17:35:44.896284+0000","last_active":"2024-09-12T18:29:57.418918+0000","last_peered":"2024-09-12T18:29:57.418918+0000","last_clean":"2024-09-12T18:29:57.418918+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:29:57.418918+0000","last_undegraded":"2024-09-12T18:29:57.418918+0000","last_fullsized":"2024-09-12T18:29:57.418918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.136280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'709","reported_seq":1394,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.229222+0000","last_change":"2024-09-12T17:35:46.902551+0000","last_active":"2024-09-12T18:32:50.229222+0000","last_peered":"2024-09-12T18:32:50.229222+0000","last_clean":"2024-09-12T18:32:50.229222+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:32:50.229222+0000","last_undegraded":"2024-09-12T18:32:50.229222+0000","last_fullsized":"2024-09-12T18:32:50.229222+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:53.419712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1383,"num_read_kb":2857,"num_write":1316,"num_write_kb":1178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846900+0000","last_change":"2024-09-12T17:35:48.901898+0000","last_active":"2024-09-12T18:30:02.846900+0000","last_peered":"2024-09-12T18:30:02.846900+0000","last_clean":"2024-09-12T18:30:02.846900+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:30:02.846900+0000","last_undegraded":"2024-09-12T18:30:02.846900+0000","last_fullsized":"2024-09-12T18:30:02.846900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'186","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.265154+0000","last_change":"2024-09-12T17:35:50.921223+0000","last_active":"2024-09-12T18:31:29.265154+0000","last_peered":"2024-09-12T18:31:29.265154+0000","last_clean":"2024-09-12T18:31:29.265154+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:31:29.265154+0000","last_undegraded":"2024-09-12T18:31:29.265154+0000","last_fullsized":"2024-09-12T18:31:29.265154+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.825503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'773","reported_seq":2219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978406+0000","last_change":"2024-09-12T17:35:42.900821+0000","last_active":"2024-09-12T18:30:25.978406+0000","last_peered":"2024-09-12T18:30:25.978406+0000","last_clean":"2024-09-12T18:30:25.978406+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:30:25.978406+0000","last_undegraded":"2024-09-12T18:30:25.978406+0000","last_fullsized":"2024-09-12T18:30:25.978406+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:57.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415813+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T18:29:42.415813+0000","last_peered":"2024-09-12T18:29:42.415813+0000","last_clean":"2024-09-12T18:29:42.415813+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:29:42.415813+0000","last_undegraded":"2024-09-12T18:29:42.415813+0000","last_fullsized":"2024-09-12T18:29:42.415813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'287","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845332+0000","last_change":"2024-09-12T17:35:40.899267+0000","last_active":"2024-09-12T18:29:52.845332+0000","last_peered":"2024-09-12T18:29:52.845332+0000","last_clean":"2024-09-12T18:29:52.845332+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:29:52.845332+0000","last_undegraded":"2024-09-12T18:29:52.845332+0000","last_fullsized":"2024-09-12T18:29:52.845332+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.692194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6086703,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":435,"num_read_kb":8966,"num_write":1060,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656378+0000","last_change":"2024-09-12T17:35:44.895852+0000","last_active":"2024-09-12T18:29:57.656378+0000","last_peered":"2024-09-12T18:29:57.656378+0000","last_clean":"2024-09-12T18:29:57.656378+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:29:57.656378+0000","last_undegraded":"2024-09-12T18:29:57.656378+0000","last_fullsized":"2024-09-12T18:29:57.656378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1288","reported_seq":2894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.112381+0000","last_change":"2024-09-12T17:35:46.899606+0000","last_active":"2024-09-12T18:32:53.112381+0000","last_peered":"2024-09-12T18:32:53.112381+0000","last_clean":"2024-09-12T18:32:53.112381+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:32:53.112381+0000","last_undegraded":"2024-09-12T18:32:53.112381+0000","last_fullsized":"2024-09-12T18:32:53.112381+0000","mapping_epoch":30,"log_start":"262'1200","ondisk_log_start":"262'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:45.048964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179822,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2027,"num_read_kb":3519,"num_write":1158,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.421442+0000","last_change":"2024-09-12T17:35:48.903717+0000","last_active":"2024-09-12T18:30:12.421442+0000","last_peered":"2024-09-12T18:30:12.421442+0000","last_clean":"2024-09-12T18:30:12.421442+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:30:12.421442+0000","last_undegraded":"2024-09-12T18:30:12.421442+0000","last_fullsized":"2024-09-12T18:30:12.421442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:26.731204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'253","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.259283+0000","last_change":"2024-09-12T17:35:51.345599+0000","last_active":"2024-09-12T18:31:29.259283+0000","last_peered":"2024-09-12T18:31:29.259283+0000","last_clean":"2024-09-12T18:31:29.259283+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:31:29.259283+0000","last_undegraded":"2024-09-12T18:31:29.259283+0000","last_fullsized":"2024-09-12T18:31:29.259283+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.606088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'489","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304547+0000","last_change":"2024-09-12T17:35:42.897417+0000","last_active":"2024-09-12T18:31:28.304547+0000","last_peered":"2024-09-12T18:31:28.304547+0000","last_clean":"2024-09-12T18:31:28.304547+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:31:28.304547+0000","last_undegraded":"2024-09-12T18:31:28.304547+0000","last_fullsized":"2024-09-12T18:31:28.304547+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:48.996327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.508930+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T18:29:42.508930+0000","last_peered":"2024-09-12T18:29:42.508930+0000","last_clean":"2024-09-12T18:29:42.508930+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:29:42.508930+0000","last_undegraded":"2024-09-12T18:29:42.508930+0000","last_fullsized":"2024-09-12T18:29:42.508930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'280","reported_seq":905,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.226667+0000","last_change":"2024-09-12T17:35:40.892528+0000","last_active":"2024-09-12T18:30:16.226667+0000","last_peered":"2024-09-12T18:30:16.226667+0000","last_clean":"2024-09-12T18:30:16.226667+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:30:16.226667+0000","last_undegraded":"2024-09-12T18:30:16.226667+0000","last_fullsized":"2024-09-12T18:30:16.226667+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:49.177521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9467039,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":442,"num_read_kb":5597,"num_write":1095,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510633+0000","last_change":"2024-09-12T17:35:44.894603+0000","last_active":"2024-09-12T18:29:57.510633+0000","last_peered":"2024-09-12T18:29:57.510633+0000","last_clean":"2024-09-12T18:29:57.510633+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:29:57.510633+0000","last_undegraded":"2024-09-12T18:29:57.510633+0000","last_fullsized":"2024-09-12T18:29:57.510633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:34.593008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'261","reported_seq":1487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.728475+0000","last_change":"2024-09-12T17:35:47.465906+0000","last_active":"2024-09-12T18:32:47.728475+0000","last_peered":"2024-09-12T18:32:47.728475+0000","last_clean":"2024-09-12T18:32:47.728475+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:32:47.728475+0000","last_undegraded":"2024-09-12T18:32:47.728475+0000","last_fullsized":"2024-09-12T18:32:47.728475+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:51.604150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846850+0000","last_change":"2024-09-12T17:35:48.900323+0000","last_active":"2024-09-12T18:30:02.846850+0000","last_peered":"2024-09-12T18:30:02.846850+0000","last_clean":"2024-09-12T18:30:02.846850+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:30:02.846850+0000","last_undegraded":"2024-09-12T18:30:02.846850+0000","last_fullsized":"2024-09-12T18:30:02.846850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:55.834585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'282","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.403339+0000","last_change":"2024-09-12T17:35:50.910605+0000","last_active":"2024-09-12T18:31:29.403339+0000","last_peered":"2024-09-12T18:31:29.403339+0000","last_clean":"2024-09-12T18:31:29.403339+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:31:29.403339+0000","last_undegraded":"2024-09-12T18:31:29.403339+0000","last_fullsized":"2024-09-12T18:31:29.403339+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:55.444849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'395","reported_seq":1861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610548+0000","last_change":"2024-09-12T17:35:42.888553+0000","last_active":"2024-09-12T18:29:52.610548+0000","last_peered":"2024-09-12T18:29:52.610548+0000","last_clean":"2024-09-12T18:29:52.610548+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:29:52.610548+0000","last_undegraded":"2024-09-12T18:29:52.610548+0000","last_fullsized":"2024-09-12T18:29:52.610548+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:41.651814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":523,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.653977+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T18:29:42.653977+0000","last_peered":"2024-09-12T18:29:42.653977+0000","last_clean":"2024-09-12T18:29:42.653977+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:29:42.653977+0000","last_undegraded":"2024-09-12T18:29:42.653977+0000","last_fullsized":"2024-09-12T18:29:42.653977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'265","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.535233+0000","last_change":"2024-09-12T17:35:40.895684+0000","last_active":"2024-09-12T18:33:03.535233+0000","last_peered":"2024-09-12T18:33:03.535233+0000","last_clean":"2024-09-12T18:33:03.535233+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:03.535233+0000","last_undegraded":"2024-09-12T18:33:03.535233+0000","last_fullsized":"2024-09-12T18:33:03.535233+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:57.907352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6124397,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":406,"num_read_kb":24675,"num_write":957,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846866+0000","last_change":"2024-09-12T17:35:44.894175+0000","last_active":"2024-09-12T18:30:02.846866+0000","last_peered":"2024-09-12T18:30:02.846866+0000","last_clean":"2024-09-12T18:30:02.846866+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:30:02.846866+0000","last_undegraded":"2024-09-12T18:30:02.846866+0000","last_fullsized":"2024-09-12T18:30:02.846866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:36.440643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'127","reported_seq":670,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.434575+0000","last_change":"2024-09-12T17:35:46.901548+0000","last_active":"2024-09-12T18:32:07.434575+0000","last_peered":"2024-09-12T18:32:07.434575+0000","last_clean":"2024-09-12T18:32:07.434575+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:32:07.434575+0000","last_undegraded":"2024-09-12T18:32:07.434575+0000","last_fullsized":"2024-09-12T18:32:07.434575+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.552114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419806+0000","last_change":"2024-09-12T17:35:48.903992+0000","last_active":"2024-09-12T18:30:02.419806+0000","last_peered":"2024-09-12T18:30:02.419806+0000","last_clean":"2024-09-12T18:30:02.419806+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:30:02.419806+0000","last_undegraded":"2024-09-12T18:30:02.419806+0000","last_fullsized":"2024-09-12T18:30:02.419806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.680834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.983301+0000","last_change":"2024-09-12T17:35:50.920568+0000","last_active":"2024-09-12T18:30:25.983301+0000","last_peered":"2024-09-12T18:30:25.983301+0000","last_clean":"2024-09-12T18:30:25.983301+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:30:25.983301+0000","last_undegraded":"2024-09-12T18:30:25.983301+0000","last_fullsized":"2024-09-12T18:30:25.983301+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.171883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'752","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.367704+0000","last_change":"2024-09-12T17:35:42.897300+0000","last_active":"2024-09-12T18:32:48.367704+0000","last_peered":"2024-09-12T18:32:48.367704+0000","last_clean":"2024-09-12T18:32:48.367704+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:32:48.367704+0000","last_undegraded":"2024-09-12T18:32:48.367704+0000","last_fullsized":"2024-09-12T18:32:48.367704+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:37.575175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'270","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656323+0000","last_change":"2024-09-12T17:35:40.898323+0000","last_active":"2024-09-12T18:29:57.656323+0000","last_peered":"2024-09-12T18:29:57.656323+0000","last_clean":"2024-09-12T18:29:57.656323+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:29:57.656323+0000","last_undegraded":"2024-09-12T18:29:57.656323+0000","last_fullsized":"2024-09-12T18:29:57.656323+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:02.559929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5573432,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":16635,"num_write":1056,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609344+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T18:29:42.609344+0000","last_peered":"2024-09-12T18:29:42.609344+0000","last_clean":"2024-09-12T18:29:42.609344+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:29:42.609344+0000","last_undegraded":"2024-09-12T18:29:42.609344+0000","last_fullsized":"2024-09-12T18:29:42.609344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846145+0000","last_change":"2024-09-12T17:35:44.897241+0000","last_active":"2024-09-12T18:29:57.846145+0000","last_peered":"2024-09-12T18:29:57.846145+0000","last_clean":"2024-09-12T18:29:57.846145+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:29:57.846145+0000","last_undegraded":"2024-09-12T18:29:57.846145+0000","last_fullsized":"2024-09-12T18:29:57.846145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:54.095785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'558","reported_seq":1218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.221233+0000","last_change":"2024-09-12T17:35:46.896066+0000","last_active":"2024-09-12T18:32:50.221233+0000","last_peered":"2024-09-12T18:32:50.221233+0000","last_clean":"2024-09-12T18:32:50.221233+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:32:50.221233+0000","last_undegraded":"2024-09-12T18:32:50.221233+0000","last_fullsized":"2024-09-12T18:32:50.221233+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.503068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110507,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1550,"num_read_kb":2487,"num_write":2030,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538876+0000","last_change":"2024-09-12T17:35:48.894684+0000","last_active":"2024-09-12T18:29:58.538876+0000","last_peered":"2024-09-12T18:29:58.538876+0000","last_clean":"2024-09-12T18:29:58.538876+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:29:58.538876+0000","last_undegraded":"2024-09-12T18:29:58.538876+0000","last_fullsized":"2024-09-12T18:29:58.538876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:49.417148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'108","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.266811+0000","last_change":"2024-09-12T17:35:51.346736+0000","last_active":"2024-09-12T18:31:26.266811+0000","last_peered":"2024-09-12T18:31:26.266811+0000","last_clean":"2024-09-12T18:31:26.266811+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:31:26.266811+0000","last_undegraded":"2024-09-12T18:31:26.266811+0000","last_fullsized":"2024-09-12T18:31:26.266811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:44.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1006","reported_seq":2568,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.696514+0000","last_change":"2024-09-12T17:35:42.894625+0000","last_active":"2024-09-12T18:30:18.696514+0000","last_peered":"2024-09-12T18:30:18.696514+0000","last_clean":"2024-09-12T18:30:18.696514+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:30:18.696514+0000","last_undegraded":"2024-09-12T18:30:18.696514+0000","last_fullsized":"2024-09-12T18:30:18.696514+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'310","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.763506+0000","last_change":"2024-09-12T17:35:40.893165+0000","last_active":"2024-09-12T18:30:03.763506+0000","last_peered":"2024-09-12T18:30:03.763506+0000","last_clean":"2024-09-12T18:30:03.763506+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:30:03.763506+0000","last_undegraded":"2024-09-12T18:30:03.763506+0000","last_fullsized":"2024-09-12T18:30:03.763506+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:35.842097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3551983,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":488,"num_read_kb":48347,"num_write":1107,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417867+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T18:29:52.417867+0000","last_peered":"2024-09-12T18:29:52.417867+0000","last_clean":"2024-09-12T18:29:52.417867+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:29:52.417867+0000","last_undegraded":"2024-09-12T18:29:52.417867+0000","last_fullsized":"2024-09-12T18:29:52.417867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418796+0000","last_change":"2024-09-12T17:35:44.893378+0000","last_active":"2024-09-12T18:29:57.418796+0000","last_peered":"2024-09-12T18:29:57.418796+0000","last_clean":"2024-09-12T18:29:57.418796+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:29:57.418796+0000","last_undegraded":"2024-09-12T18:29:57.418796+0000","last_fullsized":"2024-09-12T18:29:57.418796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:00.649691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'201","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.324384+0000","last_change":"2024-09-12T17:35:47.465022+0000","last_active":"2024-09-12T18:31:52.324384+0000","last_peered":"2024-09-12T18:31:52.324384+0000","last_clean":"2024-09-12T18:31:52.324384+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:31:52.324384+0000","last_undegraded":"2024-09-12T18:31:52.324384+0000","last_fullsized":"2024-09-12T18:31:52.324384+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:20.452871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'781","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131630+0000","last_change":"2024-09-12T17:35:48.905261+0000","last_active":"2024-09-12T18:32:53.131630+0000","last_peered":"2024-09-12T18:32:53.131630+0000","last_clean":"2024-09-12T18:32:53.131630+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:32:53.131630+0000","last_undegraded":"2024-09-12T18:32:53.131630+0000","last_fullsized":"2024-09-12T18:32:53.131630+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:47.769518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'442","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977350+0000","last_change":"2024-09-12T17:35:42.883869+0000","last_active":"2024-09-12T18:30:25.977350+0000","last_peered":"2024-09-12T18:30:25.977350+0000","last_clean":"2024-09-12T18:30:25.977350+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:30:25.977350+0000","last_undegraded":"2024-09-12T18:30:25.977350+0000","last_fullsized":"2024-09-12T18:30:25.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:13.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'282","reported_seq":933,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.856883+0000","last_change":"2024-09-12T17:35:40.889008+0000","last_active":"2024-09-12T18:32:41.856883+0000","last_peered":"2024-09-12T18:32:41.856883+0000","last_clean":"2024-09-12T18:32:41.856883+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:32:41.856883+0000","last_undegraded":"2024-09-12T18:32:41.856883+0000","last_fullsized":"2024-09-12T18:32:41.856883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:41.906990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16127089,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":454,"num_read_kb":50118,"num_write":999,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609379+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T18:29:42.609379+0000","last_peered":"2024-09-12T18:29:42.609379+0000","last_clean":"2024-09-12T18:29:42.609379+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:29:42.609379+0000","last_undegraded":"2024-09-12T18:29:42.609379+0000","last_fullsized":"2024-09-12T18:29:42.609379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538843+0000","last_change":"2024-09-12T17:35:44.889025+0000","last_active":"2024-09-12T18:29:58.538843+0000","last_peered":"2024-09-12T18:29:58.538843+0000","last_clean":"2024-09-12T18:29:58.538843+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:29:58.538843+0000","last_undegraded":"2024-09-12T18:29:58.538843+0000","last_fullsized":"2024-09-12T18:29:58.538843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:25.842079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'113","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538898+0000","last_change":"2024-09-12T17:35:46.896908+0000","last_active":"2024-09-12T18:29:58.538898+0000","last_peered":"2024-09-12T18:29:58.538898+0000","last_clean":"2024-09-12T18:29:58.538898+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:29:58.538898+0000","last_undegraded":"2024-09-12T18:29:58.538898+0000","last_fullsized":"2024-09-12T18:29:58.538898+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:22.911858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'812","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.131172+0000","last_change":"2024-09-12T17:35:48.900105+0000","last_active":"2024-09-12T18:32:53.131172+0000","last_peered":"2024-09-12T18:32:53.131172+0000","last_clean":"2024-09-12T18:32:53.131172+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:32:53.131172+0000","last_undegraded":"2024-09-12T18:32:53.131172+0000","last_fullsized":"2024-09-12T18:32:53.131172+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:30.882725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'184","reported_seq":689,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845406+0000","last_change":"2024-09-12T17:35:50.910752+0000","last_active":"2024-09-12T18:29:52.845406+0000","last_peered":"2024-09-12T18:29:52.845406+0000","last_clean":"2024-09-12T18:29:52.845406+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:29:52.845406+0000","last_undegraded":"2024-09-12T18:29:52.845406+0000","last_fullsized":"2024-09-12T18:29:52.845406+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.734993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'538","reported_seq":2142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.549252+0000","last_change":"2024-09-12T17:35:42.895619+0000","last_active":"2024-09-12T18:29:58.549252+0000","last_peered":"2024-09-12T18:29:58.549252+0000","last_clean":"2024-09-12T18:29:58.549252+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:29:58.549252+0000","last_undegraded":"2024-09-12T18:29:58.549252+0000","last_fullsized":"2024-09-12T18:29:58.549252+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'252","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.861440+0000","last_change":"2024-09-12T17:35:40.896218+0000","last_active":"2024-09-12T18:32:02.861440+0000","last_peered":"2024-09-12T18:32:02.861440+0000","last_clean":"2024-09-12T18:32:02.861440+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:32:02.861440+0000","last_undegraded":"2024-09-12T18:32:02.861440+0000","last_fullsized":"2024-09-12T18:32:02.861440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:29.873178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8697643,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":403,"num_read_kb":18058,"num_write":1001,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415941+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T18:29:42.415941+0000","last_peered":"2024-09-12T18:29:42.415941+0000","last_clean":"2024-09-12T18:29:42.415941+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:29:42.415941+0000","last_undegraded":"2024-09-12T18:29:42.415941+0000","last_fullsized":"2024-09-12T18:29:42.415941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417831+0000","last_change":"2024-09-12T17:35:44.893144+0000","last_active":"2024-09-12T18:30:02.417831+0000","last_peered":"2024-09-12T18:30:02.417831+0000","last_clean":"2024-09-12T18:30:02.417831+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:30:02.417831+0000","last_undegraded":"2024-09-12T18:30:02.417831+0000","last_fullsized":"2024-09-12T18:30:02.417831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:31.642197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'704","reported_seq":1408,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.217041+0000","last_change":"2024-09-12T17:35:47.464888+0000","last_active":"2024-09-12T18:32:50.217041+0000","last_peered":"2024-09-12T18:32:50.217041+0000","last_clean":"2024-09-12T18:32:50.217041+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:32:50.217041+0000","last_undegraded":"2024-09-12T18:32:50.217041+0000","last_fullsized":"2024-09-12T18:32:50.217041+0000","mapping_epoch":30,"log_start":"262'600","ondisk_log_start":"262'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1250,"num_read_kb":2682,"num_write":1026,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417876+0000","last_change":"2024-09-12T17:35:48.899057+0000","last_active":"2024-09-12T18:30:02.417876+0000","last_peered":"2024-09-12T18:30:02.417876+0000","last_clean":"2024-09-12T18:30:02.417876+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:30:02.417876+0000","last_undegraded":"2024-09-12T18:30:02.417876+0000","last_fullsized":"2024-09-12T18:30:02.417876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:39.593576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'129","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655594+0000","last_change":"2024-09-12T17:35:50.924579+0000","last_active":"2024-09-12T18:29:52.655594+0000","last_peered":"2024-09-12T18:29:52.655594+0000","last_clean":"2024-09-12T18:29:52.655594+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:29:52.655594+0000","last_undegraded":"2024-09-12T18:29:52.655594+0000","last_fullsized":"2024-09-12T18:29:52.655594+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:27.853643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.346697+0000","last_change":"2024-09-12T17:35:50.923096+0000","last_active":"2024-09-12T18:31:29.346697+0000","last_peered":"2024-09-12T18:31:29.346697+0000","last_clean":"2024-09-12T18:31:29.346697+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:31:29.346697+0000","last_undegraded":"2024-09-12T18:31:29.346697+0000","last_fullsized":"2024-09-12T18:31:29.346697+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:15.866908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'395","reported_seq":1898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812218+0000","last_change":"2024-09-12T17:35:42.898207+0000","last_active":"2024-09-12T18:30:18.812218+0000","last_peered":"2024-09-12T18:30:18.812218+0000","last_clean":"2024-09-12T18:30:18.812218+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:30:18.812218+0000","last_undegraded":"2024-09-12T18:30:18.812218+0000","last_fullsized":"2024-09-12T18:30:18.812218+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:18.941988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'266","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.417543+0000","last_change":"2024-09-12T17:35:40.904851+0000","last_active":"2024-09-12T18:33:03.417543+0000","last_peered":"2024-09-12T18:33:03.417543+0000","last_clean":"2024-09-12T18:33:03.417543+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:03.417543+0000","last_undegraded":"2024-09-12T18:33:03.417543+0000","last_fullsized":"2024-09-12T18:33:03.417543+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730295,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":458,"num_read_kb":63909,"num_write":944,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607639+0000","last_change":"2024-09-12T17:35:44.898123+0000","last_active":"2024-09-12T18:29:27.607639+0000","last_peered":"2024-09-12T18:29:27.607639+0000","last_clean":"2024-09-12T18:29:27.607639+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:29:27.607639+0000","last_undegraded":"2024-09-12T18:29:27.607639+0000","last_fullsized":"2024-09-12T18:29:27.607639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:45.043204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'257","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431678+0000","last_change":"2024-09-12T17:35:46.898039+0000","last_active":"2024-09-12T18:31:47.431678+0000","last_peered":"2024-09-12T18:31:47.431678+0000","last_clean":"2024-09-12T18:31:47.431678+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:31:47.431678+0000","last_undegraded":"2024-09-12T18:31:47.431678+0000","last_fullsized":"2024-09-12T18:31:47.431678+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.270815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":883,"num_write":350,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414122+0000","last_change":"2024-09-12T17:35:48.899309+0000","last_active":"2024-09-12T18:29:32.414122+0000","last_peered":"2024-09-12T18:29:32.414122+0000","last_clean":"2024-09-12T18:29:32.414122+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:29:32.414122+0000","last_undegraded":"2024-09-12T18:29:32.414122+0000","last_fullsized":"2024-09-12T18:29:32.414122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:50.941565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'974","reported_seq":2454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136707+0000","last_change":"2024-09-12T17:35:42.896669+0000","last_active":"2024-09-12T18:31:29.136707+0000","last_peered":"2024-09-12T18:31:29.136707+0000","last_clean":"2024-09-12T18:31:29.136707+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:31:29.136707+0000","last_undegraded":"2024-09-12T18:31:29.136707+0000","last_fullsized":"2024-09-12T18:31:29.136707+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'324","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.407043+0000","last_change":"2024-09-12T17:35:40.886913+0000","last_active":"2024-09-12T18:28:52.407043+0000","last_peered":"2024-09-12T18:28:52.407043+0000","last_clean":"2024-09-12T18:28:52.407043+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:28:52.407043+0000","last_undegraded":"2024-09-12T18:28:52.407043+0000","last_fullsized":"2024-09-12T18:28:52.407043+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330038,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":540,"num_read_kb":8296,"num_write":1065,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.361026+0000","last_change":"2024-09-12T17:35:44.893880+0000","last_active":"2024-09-12T18:32:49.361026+0000","last_peered":"2024-09-12T18:32:49.361026+0000","last_clean":"2024-09-12T18:32:49.361026+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:32:49.361026+0000","last_undegraded":"2024-09-12T18:32:49.361026+0000","last_fullsized":"2024-09-12T18:32:49.361026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:43.603787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'55","reported_seq":559,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842309+0000","last_change":"2024-09-12T17:35:46.898981+0000","last_active":"2024-09-12T18:29:27.842309+0000","last_peered":"2024-09-12T18:29:27.842309+0000","last_clean":"2024-09-12T18:29:27.842309+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:29:27.842309+0000","last_undegraded":"2024-09-12T18:29:27.842309+0000","last_fullsized":"2024-09-12T18:29:27.842309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414052+0000","last_change":"2024-09-12T17:35:48.906133+0000","last_active":"2024-09-12T18:29:32.414052+0000","last_peered":"2024-09-12T18:29:32.414052+0000","last_clean":"2024-09-12T18:29:32.414052+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:29:32.414052+0000","last_undegraded":"2024-09-12T18:29:32.414052+0000","last_fullsized":"2024-09-12T18:29:32.414052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:11.783795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'186","reported_seq":721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.272851+0000","last_change":"2024-09-12T17:35:50.911342+0000","last_active":"2024-09-12T18:31:28.272851+0000","last_peered":"2024-09-12T18:31:28.272851+0000","last_clean":"2024-09-12T18:31:28.272851+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:31:28.272851+0000","last_undegraded":"2024-09-12T18:31:28.272851+0000","last_fullsized":"2024-09-12T18:31:28.272851+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.588084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'555","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.135761+0000","last_change":"2024-09-12T17:35:42.894287+0000","last_active":"2024-09-12T18:31:29.135761+0000","last_peered":"2024-09-12T18:31:29.135761+0000","last_clean":"2024-09-12T18:31:29.135761+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:31:29.135761+0000","last_undegraded":"2024-09-12T18:31:29.135761+0000","last_fullsized":"2024-09-12T18:31:29.135761+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:58.138070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'310","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.887094+0000","last_change":"2024-09-12T17:35:40.895963+0000","last_active":"2024-09-12T18:30:11.887094+0000","last_peered":"2024-09-12T18:30:11.887094+0000","last_clean":"2024-09-12T18:30:11.887094+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:30:11.887094+0000","last_undegraded":"2024-09-12T18:30:11.887094+0000","last_fullsized":"2024-09-12T18:30:11.887094+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:58.280652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243102,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":616,"num_read_kb":8072,"num_write":1122,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413192+0000","last_change":"2024-09-12T17:35:44.899119+0000","last_active":"2024-09-12T18:29:27.413192+0000","last_peered":"2024-09-12T18:29:27.413192+0000","last_clean":"2024-09-12T18:29:27.413192+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:29:27.413192+0000","last_undegraded":"2024-09-12T18:29:27.413192+0000","last_fullsized":"2024-09-12T18:29:27.413192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.437374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'314","reported_seq":899,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.431724+0000","last_change":"2024-09-12T17:35:46.899592+0000","last_active":"2024-09-12T18:31:47.431724+0000","last_peered":"2024-09-12T18:31:47.431724+0000","last_clean":"2024-09-12T18:31:47.431724+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:31:47.431724+0000","last_undegraded":"2024-09-12T18:31:47.431724+0000","last_fullsized":"2024-09-12T18:31:47.431724+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:41.130246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59724,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1059,"num_write":432,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414094+0000","last_change":"2024-09-12T17:35:48.904071+0000","last_active":"2024-09-12T18:29:32.414094+0000","last_peered":"2024-09-12T18:29:32.414094+0000","last_clean":"2024-09-12T18:29:32.414094+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:29:32.414094+0000","last_undegraded":"2024-09-12T18:29:32.414094+0000","last_fullsized":"2024-09-12T18:29:32.414094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.350511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'98","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642138+0000","last_change":"2024-09-12T17:35:50.921087+0000","last_active":"2024-09-12T18:28:22.642138+0000","last_peered":"2024-09-12T18:28:22.642138+0000","last_clean":"2024-09-12T18:28:22.642138+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:28:22.642138+0000","last_undegraded":"2024-09-12T18:28:22.642138+0000","last_fullsized":"2024-09-12T18:28:22.642138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:26.137184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1026","reported_seq":2665,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.546129+0000","last_change":"2024-09-12T17:35:42.891619+0000","last_active":"2024-09-12T18:29:58.546129+0000","last_peered":"2024-09-12T18:29:58.546129+0000","last_clean":"2024-09-12T18:29:58.546129+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:29:58.546129+0000","last_undegraded":"2024-09-12T18:29:58.546129+0000","last_fullsized":"2024-09-12T18:29:58.546129+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:44.416070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'299","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.704736+0000","last_change":"2024-09-12T17:35:40.898320+0000","last_active":"2024-09-12T18:30:52.704736+0000","last_peered":"2024-09-12T18:30:52.704736+0000","last_clean":"2024-09-12T18:30:52.704736+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:30:52.704736+0000","last_undegraded":"2024-09-12T18:30:52.704736+0000","last_fullsized":"2024-09-12T18:30:52.704736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:44.296291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12671351,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":396,"num_read_kb":38177,"num_write":1010,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413134+0000","last_change":"2024-09-12T17:35:44.895748+0000","last_active":"2024-09-12T18:29:27.413134+0000","last_peered":"2024-09-12T18:29:27.413134+0000","last_clean":"2024-09-12T18:29:27.413134+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:29:27.413134+0000","last_undegraded":"2024-09-12T18:29:27.413134+0000","last_fullsized":"2024-09-12T18:29:27.413134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'271","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.439171+0000","last_change":"2024-09-12T17:35:46.899948+0000","last_active":"2024-09-12T18:31:47.439171+0000","last_peered":"2024-09-12T18:31:47.439171+0000","last_clean":"2024-09-12T18:31:47.439171+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:31:47.439171+0000","last_undegraded":"2024-09-12T18:31:47.439171+0000","last_fullsized":"2024-09-12T18:31:47.439171+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.546669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":906,"num_write":362,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.842896+0000","last_change":"2024-09-12T17:35:48.900909+0000","last_active":"2024-09-12T18:29:32.842896+0000","last_peered":"2024-09-12T18:29:32.842896+0000","last_clean":"2024-09-12T18:29:32.842896+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:29:32.842896+0000","last_undegraded":"2024-09-12T18:29:32.842896+0000","last_fullsized":"2024-09-12T18:29:32.842896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.781603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'860","reported_seq":2482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417988+0000","last_change":"2024-09-12T17:35:42.896175+0000","last_active":"2024-09-12T18:29:52.417988+0000","last_peered":"2024-09-12T18:29:52.417988+0000","last_clean":"2024-09-12T18:29:52.417988+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:29:52.417988+0000","last_undegraded":"2024-09-12T18:29:52.417988+0000","last_fullsized":"2024-09-12T18:29:52.417988+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:52.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'288","reported_seq":1015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:52.408784+0000","last_change":"2024-09-12T17:35:40.884915+0000","last_active":"2024-09-12T18:28:52.408784+0000","last_peered":"2024-09-12T18:28:52.408784+0000","last_clean":"2024-09-12T18:28:52.408784+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:28:52.408784+0000","last_undegraded":"2024-09-12T18:28:52.408784+0000","last_fullsized":"2024-09-12T18:28:52.408784+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:51.644098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9465428,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":695,"num_read_kb":5768,"num_write":928,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845447+0000","last_change":"2024-09-12T17:35:44.897738+0000","last_active":"2024-09-12T18:29:52.845447+0000","last_peered":"2024-09-12T18:29:52.845447+0000","last_clean":"2024-09-12T18:29:52.845447+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:29:52.845447+0000","last_undegraded":"2024-09-12T18:29:52.845447+0000","last_fullsized":"2024-09-12T18:29:52.845447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:43.811251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'488","reported_seq":1108,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.213392+0000","last_change":"2024-09-12T17:35:46.899736+0000","last_active":"2024-09-12T18:32:50.213392+0000","last_peered":"2024-09-12T18:32:50.213392+0000","last_clean":"2024-09-12T18:32:50.213392+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:32:50.213392+0000","last_undegraded":"2024-09-12T18:32:50.213392+0000","last_fullsized":"2024-09-12T18:32:50.213392+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:36.496520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127972,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":849,"num_read_kb":1857,"num_write":740,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642155+0000","last_change":"2024-09-12T17:35:48.900061+0000","last_active":"2024-09-12T18:28:22.642155+0000","last_peered":"2024-09-12T18:28:22.642155+0000","last_clean":"2024-09-12T18:28:22.642155+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:28:22.642155+0000","last_undegraded":"2024-09-12T18:28:22.642155+0000","last_fullsized":"2024-09-12T18:28:22.642155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:58.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'164","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.297167+0000","last_change":"2024-09-12T17:35:51.347046+0000","last_active":"2024-09-12T18:31:28.297167+0000","last_peered":"2024-09-12T18:31:28.297167+0000","last_clean":"2024-09-12T18:31:28.297167+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:31:28.297167+0000","last_undegraded":"2024-09-12T18:31:28.297167+0000","last_fullsized":"2024-09-12T18:31:28.297167+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.856381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'775","reported_seq":2167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305413+0000","last_change":"2024-09-12T17:35:42.896418+0000","last_active":"2024-09-12T18:31:28.305413+0000","last_peered":"2024-09-12T18:31:28.305413+0000","last_clean":"2024-09-12T18:31:28.305413+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:31:28.305413+0000","last_undegraded":"2024-09-12T18:31:28.305413+0000","last_fullsized":"2024-09-12T18:31:28.305413+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.201642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'239","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.096421+0000","last_change":"2024-09-12T17:35:40.892252+0000","last_active":"2024-09-12T18:29:46.096421+0000","last_peered":"2024-09-12T18:29:46.096421+0000","last_clean":"2024-09-12T18:29:46.096421+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:29:46.096421+0000","last_undegraded":"2024-09-12T18:29:46.096421+0000","last_fullsized":"2024-09-12T18:29:46.096421+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:53.303511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8074671,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":379,"num_read_kb":28092,"num_write":930,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418873+0000","last_change":"2024-09-12T17:35:44.897834+0000","last_active":"2024-09-12T18:29:57.418873+0000","last_peered":"2024-09-12T18:29:57.418873+0000","last_clean":"2024-09-12T18:29:57.418873+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:29:57.418873+0000","last_undegraded":"2024-09-12T18:29:57.418873+0000","last_fullsized":"2024-09-12T18:29:57.418873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:52.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'321","reported_seq":898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:35:46.899505+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.056459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73750,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1098,"num_write":464,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.600262+0000","last_change":"2024-09-12T17:35:48.906992+0000","last_active":"2024-09-12T18:28:22.600262+0000","last_peered":"2024-09-12T18:28:22.600262+0000","last_clean":"2024-09-12T18:28:22.600262+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:28:22.600262+0000","last_undegraded":"2024-09-12T18:28:22.600262+0000","last_fullsized":"2024-09-12T18:28:22.600262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.979695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'197","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.615415+0000","last_change":"2024-09-12T17:35:50.916243+0000","last_active":"2024-09-12T18:31:26.615415+0000","last_peered":"2024-09-12T18:31:26.615415+0000","last_clean":"2024-09-12T18:31:26.615415+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:31:26.615415+0000","last_undegraded":"2024-09-12T18:31:26.615415+0000","last_fullsized":"2024-09-12T18:31:26.615415+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:37.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1293","reported_seq":2864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.360743+0000","last_change":"2024-09-12T17:35:42.890895+0000","last_active":"2024-09-12T18:32:48.360743+0000","last_peered":"2024-09-12T18:32:48.360743+0000","last_clean":"2024-09-12T18:32:48.360743+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:32:48.360743+0000","last_undegraded":"2024-09-12T18:32:48.360743+0000","last_fullsized":"2024-09-12T18:32:48.360743+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:52.254143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'251","reported_seq":859,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.491622+0000","last_change":"2024-09-12T17:35:40.904317+0000","last_active":"2024-09-12T18:33:03.491622+0000","last_peered":"2024-09-12T18:33:03.491622+0000","last_clean":"2024-09-12T18:33:03.491622+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:03.491622+0000","last_undegraded":"2024-09-12T18:33:03.491622+0000","last_fullsized":"2024-09-12T18:33:03.491622+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:35.506278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4527971,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":361,"num_read_kb":10892,"num_write":921,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525199+0000","last_change":"2024-09-12T17:35:44.893724+0000","last_active":"2024-09-12T18:28:18.525199+0000","last_peered":"2024-09-12T18:28:18.525199+0000","last_clean":"2024-09-12T18:28:18.525199+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:28:18.525199+0000","last_undegraded":"2024-09-12T18:28:18.525199+0000","last_fullsized":"2024-09-12T18:28:18.525199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:31.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'286","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.433877+0000","last_change":"2024-09-12T17:35:47.464841+0000","last_active":"2024-09-12T18:32:02.433877+0000","last_peered":"2024-09-12T18:32:02.433877+0000","last_clean":"2024-09-12T18:32:02.433877+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:32:02.433877+0000","last_undegraded":"2024-09-12T18:32:02.433877+0000","last_fullsized":"2024-09-12T18:32:02.433877+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:30.514600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":965,"num_write":388,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.612492+0000","last_change":"2024-09-12T17:35:48.901108+0000","last_active":"2024-09-12T18:30:07.612492+0000","last_peered":"2024-09-12T18:30:07.612492+0000","last_clean":"2024-09-12T18:30:07.612492+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:30:07.612492+0000","last_undegraded":"2024-09-12T18:30:07.612492+0000","last_fullsized":"2024-09-12T18:30:07.612492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:24.864398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'134","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.243540+0000","last_change":"2024-09-12T17:35:50.924276+0000","last_active":"2024-09-12T18:32:50.243540+0000","last_peered":"2024-09-12T18:32:50.243540+0000","last_clean":"2024-09-12T18:32:50.243540+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:32:50.243540+0000","last_undegraded":"2024-09-12T18:32:50.243540+0000","last_fullsized":"2024-09-12T18:32:50.243540+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:54.892800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'547","reported_seq":2157,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.118099+0000","last_change":"2024-09-12T17:35:42.885892+0000","last_active":"2024-09-12T18:31:29.118099+0000","last_peered":"2024-09-12T18:31:29.118099+0000","last_clean":"2024-09-12T18:31:29.118099+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:31:29.118099+0000","last_undegraded":"2024-09-12T18:31:29.118099+0000","last_fullsized":"2024-09-12T18:31:29.118099+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:40.576868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'304","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:12.832170+0000","last_change":"2024-09-12T17:35:40.890946+0000","last_active":"2024-09-12T18:28:12.832170+0000","last_peered":"2024-09-12T18:28:12.832170+0000","last_clean":"2024-09-12T18:28:12.832170+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:28:12.832170+0000","last_undegraded":"2024-09-12T18:28:12.832170+0000","last_fullsized":"2024-09-12T18:28:12.832170+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:09.696514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18138792,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":531,"num_read_kb":50516,"num_write":1159,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.599620+0000","last_change":"2024-09-12T17:35:44.898107+0000","last_active":"2024-09-12T18:28:17.599620+0000","last_peered":"2024-09-12T18:28:17.599620+0000","last_clean":"2024-09-12T18:28:17.599620+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:28:17.599620+0000","last_undegraded":"2024-09-12T18:28:17.599620+0000","last_fullsized":"2024-09-12T18:28:17.599620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:05.181659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'103","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538945+0000","last_change":"2024-09-12T17:35:47.464849+0000","last_active":"2024-09-12T18:29:58.538945+0000","last_peered":"2024-09-12T18:29:58.538945+0000","last_clean":"2024-09-12T18:29:58.538945+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:29:58.538945+0000","last_undegraded":"2024-09-12T18:29:58.538945+0000","last_fullsized":"2024-09-12T18:29:58.538945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:58.141528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'776","reported_seq":4138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.130542+0000","last_change":"2024-09-12T17:35:48.900442+0000","last_active":"2024-09-12T18:32:53.130542+0000","last_peered":"2024-09-12T18:32:53.130542+0000","last_clean":"2024-09-12T18:32:53.130542+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:32:53.130542+0000","last_undegraded":"2024-09-12T18:32:53.130542+0000","last_fullsized":"2024-09-12T18:32:53.130542+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:15.114968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.761165+0000","last_change":"2024-09-12T17:35:50.922214+0000","last_active":"2024-09-12T18:29:46.761165+0000","last_peered":"2024-09-12T18:29:46.761165+0000","last_clean":"2024-09-12T18:29:46.761165+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:29:46.761165+0000","last_undegraded":"2024-09-12T18:29:46.761165+0000","last_fullsized":"2024-09-12T18:29:46.761165+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.526052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'765","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651768+0000","last_change":"2024-09-12T17:35:42.900581+0000","last_active":"2024-09-12T18:30:10.651768+0000","last_peered":"2024-09-12T18:30:10.651768+0000","last_clean":"2024-09-12T18:30:10.651768+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:30:10.651768+0000","last_undegraded":"2024-09-12T18:30:10.651768+0000","last_fullsized":"2024-09-12T18:30:10.651768+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:13.276710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'271","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:38.447105+0000","last_change":"2024-09-12T17:36:16.051163+0000","last_active":"2024-09-12T18:29:38.447105+0000","last_peered":"2024-09-12T18:29:38.447105+0000","last_clean":"2024-09-12T18:29:38.447105+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:29:38.447105+0000","last_undegraded":"2024-09-12T18:29:38.447105+0000","last_fullsized":"2024-09-12T18:29:38.447105+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:40.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13954640,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":50614,"num_write":1000,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400910+0000","last_change":"2024-09-12T17:35:44.899845+0000","last_active":"2024-09-12T18:28:17.400910+0000","last_peered":"2024-09-12T18:28:17.400910+0000","last_clean":"2024-09-12T18:28:17.400910+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:28:17.400910+0000","last_undegraded":"2024-09-12T18:28:17.400910+0000","last_fullsized":"2024-09-12T18:28:17.400910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:48.236755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'302","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.971777+0000","last_change":"2024-09-12T17:35:46.897904+0000","last_active":"2024-09-12T18:32:43.971777+0000","last_peered":"2024-09-12T18:32:43.971777+0000","last_clean":"2024-09-12T18:32:43.971777+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:32:43.971777+0000","last_undegraded":"2024-09-12T18:32:43.971777+0000","last_fullsized":"2024-09-12T18:32:43.971777+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:11.348372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56114,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":971,"num_write":408,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839380+0000","last_change":"2024-09-12T17:35:48.900397+0000","last_active":"2024-09-12T18:29:02.839380+0000","last_peered":"2024-09-12T18:29:02.839380+0000","last_clean":"2024-09-12T18:29:02.839380+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:29:02.839380+0000","last_undegraded":"2024-09-12T18:29:02.839380+0000","last_fullsized":"2024-09-12T18:29:02.839380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:17.530372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'122","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.269926+0000","last_change":"2024-09-12T17:35:50.921023+0000","last_active":"2024-09-12T18:31:26.269926+0000","last_peered":"2024-09-12T18:31:26.269926+0000","last_clean":"2024-09-12T18:31:26.269926+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:31:26.269926+0000","last_undegraded":"2024-09-12T18:31:26.269926+0000","last_fullsized":"2024-09-12T18:31:26.269926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:23.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'393","reported_seq":1990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977717+0000","last_change":"2024-09-12T17:35:42.899906+0000","last_active":"2024-09-12T18:30:25.977717+0000","last_peered":"2024-09-12T18:30:25.977717+0000","last_clean":"2024-09-12T18:30:25.977717+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:30:25.977717+0000","last_undegraded":"2024-09-12T18:30:25.977717+0000","last_fullsized":"2024-09-12T18:30:25.977717+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:41.974957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'280","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.442329+0000","last_change":"2024-09-12T17:35:40.902378+0000","last_active":"2024-09-12T18:30:50.442329+0000","last_peered":"2024-09-12T18:30:50.442329+0000","last_clean":"2024-09-12T18:30:50.442329+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:30:50.442329+0000","last_undegraded":"2024-09-12T18:30:50.442329+0000","last_fullsized":"2024-09-12T18:30:50.442329+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:21.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15276485,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":36010,"num_write":996,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641108+0000","last_change":"2024-09-12T17:35:44.895548+0000","last_active":"2024-09-12T18:28:17.641108+0000","last_peered":"2024-09-12T18:28:17.641108+0000","last_clean":"2024-09-12T18:28:17.641108+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:28:17.641108+0000","last_undegraded":"2024-09-12T18:28:17.641108+0000","last_fullsized":"2024-09-12T18:28:17.641108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.590737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'281","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.855784+0000","last_change":"2024-09-12T17:35:46.894996+0000","last_active":"2024-09-12T18:31:22.855784+0000","last_peered":"2024-09-12T18:31:22.855784+0000","last_clean":"2024-09-12T18:31:22.855784+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:31:22.855784+0000","last_undegraded":"2024-09-12T18:31:22.855784+0000","last_fullsized":"2024-09-12T18:31:22.855784+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:53.303510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61214,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":949,"num_write":376,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410641+0000","last_change":"2024-09-12T17:35:48.901220+0000","last_active":"2024-09-12T18:29:12.410641+0000","last_peered":"2024-09-12T18:29:12.410641+0000","last_clean":"2024-09-12T18:29:12.410641+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:29:12.410641+0000","last_undegraded":"2024-09-12T18:29:12.410641+0000","last_fullsized":"2024-09-12T18:29:12.410641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:24.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.746414+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:28.746414+0000","last_peered":"2024-09-12T18:31:28.746414+0000","last_clean":"2024-09-12T18:31:28.746414+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:28.746414+0000","last_undegraded":"2024-09-12T18:31:28.746414+0000","last_fullsized":"2024-09-12T18:31:28.746414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:21.959973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'539","reported_seq":2090,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.693922+0000","last_change":"2024-09-12T17:35:42.886124+0000","last_active":"2024-09-12T18:30:18.693922+0000","last_peered":"2024-09-12T18:30:18.693922+0000","last_clean":"2024-09-12T18:30:18.693922+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:30:18.693922+0000","last_undegraded":"2024-09-12T18:30:18.693922+0000","last_fullsized":"2024-09-12T18:30:18.693922+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'306","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:16.234586+0000","last_change":"2024-09-12T17:36:16.051402+0000","last_active":"2024-09-12T18:30:16.234586+0000","last_peered":"2024-09-12T18:30:16.234586+0000","last_clean":"2024-09-12T18:30:16.234586+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:30:16.234586+0000","last_undegraded":"2024-09-12T18:30:16.234586+0000","last_fullsized":"2024-09-12T18:30:16.234586+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:10.073958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7871569,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":463,"num_read_kb":33965,"num_write":1040,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530433+0000","last_change":"2024-09-12T17:35:44.891585+0000","last_active":"2024-09-12T18:28:58.530433+0000","last_peered":"2024-09-12T18:28:58.530433+0000","last_clean":"2024-09-12T18:28:58.530433+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:28:58.530433+0000","last_undegraded":"2024-09-12T18:28:58.530433+0000","last_fullsized":"2024-09-12T18:28:58.530433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:53.135715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'265","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.423689+0000","last_change":"2024-09-12T17:35:46.899537+0000","last_active":"2024-09-12T18:30:47.423689+0000","last_peered":"2024-09-12T18:30:47.423689+0000","last_clean":"2024-09-12T18:30:47.423689+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:30:47.423689+0000","last_undegraded":"2024-09-12T18:30:47.423689+0000","last_fullsized":"2024-09-12T18:30:47.423689+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:08.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":1002,"num_write":386,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525166+0000","last_change":"2024-09-12T17:35:48.902756+0000","last_active":"2024-09-12T18:28:18.525166+0000","last_peered":"2024-09-12T18:28:18.525166+0000","last_clean":"2024-09-12T18:28:18.525166+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:28:18.525166+0000","last_undegraded":"2024-09-12T18:28:18.525166+0000","last_fullsized":"2024-09-12T18:28:18.525166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:23.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'144","reported_seq":1246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.225226+0000","last_change":"2024-09-12T17:35:50.916082+0000","last_active":"2024-09-12T18:31:26.225226+0000","last_peered":"2024-09-12T18:31:26.225226+0000","last_clean":"2024-09-12T18:31:26.225226+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:31:26.225226+0000","last_undegraded":"2024-09-12T18:31:26.225226+0000","last_fullsized":"2024-09-12T18:31:26.225226+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:10.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'492","reported_seq":2047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.110427+0000","last_change":"2024-09-12T17:35:42.899320+0000","last_active":"2024-09-12T18:31:29.110427+0000","last_peered":"2024-09-12T18:31:29.110427+0000","last_clean":"2024-09-12T18:31:29.110427+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:31:29.110427+0000","last_undegraded":"2024-09-12T18:31:29.110427+0000","last_fullsized":"2024-09-12T18:31:29.110427+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:24.186327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'301","reported_seq":960,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:11.878475+0000","last_change":"2024-09-12T17:35:40.900130+0000","last_active":"2024-09-12T18:30:11.878475+0000","last_peered":"2024-09-12T18:30:11.878475+0000","last_clean":"2024-09-12T18:30:11.878475+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:30:11.878475+0000","last_undegraded":"2024-09-12T18:30:11.878475+0000","last_fullsized":"2024-09-12T18:30:11.878475+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:06.988604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245874,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":491,"num_read_kb":31829,"num_write":1165,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.605775+0000","last_change":"2024-09-12T17:35:44.893851+0000","last_active":"2024-09-12T18:29:12.605775+0000","last_peered":"2024-09-12T18:29:12.605775+0000","last_clean":"2024-09-12T18:29:12.605775+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:29:12.605775+0000","last_undegraded":"2024-09-12T18:29:12.605775+0000","last_fullsized":"2024-09-12T18:29:12.605775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:10.822361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'302","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.237679+0000","last_change":"2024-09-12T17:35:46.902681+0000","last_active":"2024-09-12T18:32:50.237679+0000","last_peered":"2024-09-12T18:32:50.237679+0000","last_clean":"2024-09-12T18:32:50.237679+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:32:50.237679+0000","last_undegraded":"2024-09-12T18:32:50.237679+0000","last_fullsized":"2024-09-12T18:32:50.237679+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:12.683935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":969,"num_write":382,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.834803+0000","last_change":"2024-09-12T17:35:48.902815+0000","last_active":"2024-09-12T18:28:22.834803+0000","last_peered":"2024-09-12T18:28:22.834803+0000","last_clean":"2024-09-12T18:28:22.834803+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:28:22.834803+0000","last_undegraded":"2024-09-12T18:28:22.834803+0000","last_fullsized":"2024-09-12T18:28:22.834803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:32.377869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'125","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.358965+0000","last_change":"2024-09-12T17:35:50.912183+0000","last_active":"2024-09-12T18:32:48.358965+0000","last_peered":"2024-09-12T18:32:48.358965+0000","last_clean":"2024-09-12T18:32:48.358965+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:32:48.358965+0000","last_undegraded":"2024-09-12T18:32:48.358965+0000","last_fullsized":"2024-09-12T18:32:48.358965+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:21.503473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'468","reported_seq":2175,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610600+0000","last_change":"2024-09-12T17:35:42.897252+0000","last_active":"2024-09-12T18:29:52.610600+0000","last_peered":"2024-09-12T18:29:52.610600+0000","last_clean":"2024-09-12T18:29:52.610600+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:29:52.610600+0000","last_undegraded":"2024-09-12T18:29:52.610600+0000","last_fullsized":"2024-09-12T18:29:52.610600+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:51.073547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'311","reported_seq":950,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417749+0000","last_change":"2024-09-12T17:35:40.900262+0000","last_active":"2024-09-12T18:29:52.417749+0000","last_peered":"2024-09-12T18:29:52.417749+0000","last_clean":"2024-09-12T18:29:52.417749+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:29:52.417749+0000","last_undegraded":"2024-09-12T18:29:52.417749+0000","last_fullsized":"2024-09-12T18:29:52.417749+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404889,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":433,"num_read_kb":20625,"num_write":1193,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'529","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.362071+0000","last_change":"2024-09-12T17:35:42.902909+0000","last_active":"2024-09-12T18:32:48.362071+0000","last_peered":"2024-09-12T18:32:48.362071+0000","last_clean":"2024-09-12T18:32:48.362071+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:32:48.362071+0000","last_undegraded":"2024-09-12T18:32:48.362071+0000","last_fullsized":"2024-09-12T18:32:48.362071+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:11.016006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'347","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.510012+0000","last_change":"2024-09-12T17:35:40.886916+0000","last_active":"2024-09-12T18:29:52.510012+0000","last_peered":"2024-09-12T18:29:52.510012+0000","last_clean":"2024-09-12T18:29:52.510012+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:29:52.510012+0000","last_undegraded":"2024-09-12T18:29:52.510012+0000","last_fullsized":"2024-09-12T18:29:52.510012+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.356041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13626055,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":58919,"num_write":1220,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'934","reported_seq":2520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.365913+0000","last_change":"2024-09-12T17:35:42.892077+0000","last_active":"2024-09-12T18:30:12.365913+0000","last_peered":"2024-09-12T18:30:12.365913+0000","last_clean":"2024-09-12T18:30:12.365913+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:30:12.365913+0000","last_undegraded":"2024-09-12T18:30:12.365913+0000","last_fullsized":"2024-09-12T18:30:12.365913+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:05.128987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'308","reported_seq":968,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:13.878737+0000","last_change":"2024-09-12T17:35:40.887565+0000","last_active":"2024-09-12T18:30:13.878737+0000","last_peered":"2024-09-12T18:30:13.878737+0000","last_clean":"2024-09-12T18:30:13.878737+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:30:13.878737+0000","last_undegraded":"2024-09-12T18:30:13.878737+0000","last_fullsized":"2024-09-12T18:30:13.878737+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:10.621969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780501,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":483,"num_read_kb":34034,"num_write":1073,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'760","reported_seq":2329,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304375+0000","last_change":"2024-09-12T17:35:42.891207+0000","last_active":"2024-09-12T18:31:28.304375+0000","last_peered":"2024-09-12T18:31:28.304375+0000","last_clean":"2024-09-12T18:31:28.304375+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:31:28.304375+0000","last_undegraded":"2024-09-12T18:31:28.304375+0000","last_fullsized":"2024-09-12T18:31:28.304375+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:12.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'300","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:43.974943+0000","last_change":"2024-09-12T17:35:40.892755+0000","last_active":"2024-09-12T18:32:43.974943+0000","last_peered":"2024-09-12T18:32:43.974943+0000","last_clean":"2024-09-12T18:32:43.974943+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:32:43.974943+0000","last_undegraded":"2024-09-12T18:32:43.974943+0000","last_fullsized":"2024-09-12T18:32:43.974943+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.729813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8402036,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":430,"num_read_kb":12325,"num_write":1045,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.418508+0000","last_change":"2024-09-12T17:35:42.894174+0000","last_active":"2024-09-12T18:30:07.418508+0000","last_peered":"2024-09-12T18:30:07.418508+0000","last_clean":"2024-09-12T18:30:07.418508+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:30:07.418508+0000","last_undegraded":"2024-09-12T18:30:07.418508+0000","last_fullsized":"2024-09-12T18:30:07.418508+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.648231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'299","reported_seq":970,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.701823+0000","last_change":"2024-09-12T17:36:15.950449+0000","last_active":"2024-09-12T18:30:52.701823+0000","last_peered":"2024-09-12T18:30:52.701823+0000","last_clean":"2024-09-12T18:30:52.701823+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:30:52.701823+0000","last_undegraded":"2024-09-12T18:30:52.701823+0000","last_fullsized":"2024-09-12T18:30:52.701823+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:21.732603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21373827,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":430,"num_read_kb":50386,"num_write":994,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'479","reported_seq":2221,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136342+0000","last_change":"2024-09-12T17:35:42.897624+0000","last_active":"2024-09-12T18:31:29.136342+0000","last_peered":"2024-09-12T18:31:29.136342+0000","last_clean":"2024-09-12T18:31:29.136342+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:31:29.136342+0000","last_undegraded":"2024-09-12T18:31:29.136342+0000","last_fullsized":"2024-09-12T18:31:29.136342+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:22.096489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'263","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.773400+0000","last_change":"2024-09-12T17:35:40.893038+0000","last_active":"2024-09-12T18:30:03.773400+0000","last_peered":"2024-09-12T18:30:03.773400+0000","last_clean":"2024-09-12T18:30:03.773400+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:30:03.773400+0000","last_undegraded":"2024-09-12T18:30:03.773400+0000","last_fullsized":"2024-09-12T18:30:03.773400+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:11.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196839,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":482,"num_read_kb":70299,"num_write":944,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'478","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699290+0000","last_change":"2024-09-12T17:35:42.891672+0000","last_active":"2024-09-12T18:30:18.699290+0000","last_peered":"2024-09-12T18:30:18.699290+0000","last_clean":"2024-09-12T18:30:18.699290+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:30:18.699290+0000","last_undegraded":"2024-09-12T18:30:18.699290+0000","last_fullsized":"2024-09-12T18:30:18.699290+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:22.565304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'286","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417962+0000","last_change":"2024-09-12T17:35:40.902619+0000","last_active":"2024-09-12T18:29:52.417962+0000","last_peered":"2024-09-12T18:29:52.417962+0000","last_clean":"2024-09-12T18:29:52.417962+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:29:52.417962+0000","last_undegraded":"2024-09-12T18:29:52.417962+0000","last_fullsized":"2024-09-12T18:29:52.417962+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:31.350419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16083822,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":465,"num_read_kb":51065,"num_write":1064,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'540","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.375708+0000","last_change":"2024-09-12T17:35:42.897448+0000","last_active":"2024-09-12T18:32:48.375708+0000","last_peered":"2024-09-12T18:32:48.375708+0000","last_clean":"2024-09-12T18:32:48.375708+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:32:48.375708+0000","last_undegraded":"2024-09-12T18:32:48.375708+0000","last_fullsized":"2024-09-12T18:32:48.375708+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.748388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.163696+0000","last_change":"2024-09-12T17:35:40.883103+0000","last_active":"2024-09-12T18:30:10.163696+0000","last_peered":"2024-09-12T18:30:10.163696+0000","last_clean":"2024-09-12T18:30:10.163696+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:30:10.163696+0000","last_undegraded":"2024-09-12T18:30:10.163696+0000","last_fullsized":"2024-09-12T18:30:10.163696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.291106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831223,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":346,"num_read_kb":37897,"num_write":766,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'583","reported_seq":2406,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651201+0000","last_change":"2024-09-12T17:35:42.902435+0000","last_active":"2024-09-12T18:30:10.651201+0000","last_peered":"2024-09-12T18:30:10.651201+0000","last_clean":"2024-09-12T18:30:10.651201+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:30:10.651201+0000","last_undegraded":"2024-09-12T18:30:10.651201+0000","last_fullsized":"2024-09-12T18:30:10.651201+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.291333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'315","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656191+0000","last_change":"2024-09-12T17:35:40.904096+0000","last_active":"2024-09-12T18:29:57.656191+0000","last_peered":"2024-09-12T18:29:57.656191+0000","last_clean":"2024-09-12T18:29:57.656191+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:29:57.656191+0000","last_undegraded":"2024-09-12T18:29:57.656191+0000","last_fullsized":"2024-09-12T18:29:57.656191+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6648200,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":484,"num_read_kb":34144,"num_write":1082,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1179","reported_seq":2808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698955+0000","last_change":"2024-09-12T17:35:42.893016+0000","last_active":"2024-09-12T18:30:18.698955+0000","last_peered":"2024-09-12T18:30:18.698955+0000","last_clean":"2024-09-12T18:30:18.698955+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:30:18.698955+0000","last_undegraded":"2024-09-12T18:30:18.698955+0000","last_fullsized":"2024-09-12T18:30:18.698955+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:15.472517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'316","reported_seq":1018,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415330+0000","last_change":"2024-09-12T17:35:40.881782+0000","last_active":"2024-09-12T18:29:42.415330+0000","last_peered":"2024-09-12T18:29:42.415330+0000","last_clean":"2024-09-12T18:29:42.415330+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:29:42.415330+0000","last_undegraded":"2024-09-12T18:29:42.415330+0000","last_fullsized":"2024-09-12T18:29:42.415330+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:38.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4996478,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":677,"num_read_kb":17939,"num_write":1117,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'779","reported_seq":2264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527379+0000","last_change":"2024-09-12T17:35:42.898127+0000","last_active":"2024-09-12T18:30:04.527379+0000","last_peered":"2024-09-12T18:30:04.527379+0000","last_clean":"2024-09-12T18:30:04.527379+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:30:04.527379+0000","last_undegraded":"2024-09-12T18:30:04.527379+0000","last_fullsized":"2024-09-12T18:30:04.527379+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.391709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'447","reported_seq":1160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.513053+0000","last_change":"2024-09-12T17:36:16.042288+0000","last_active":"2024-09-12T18:30:17.513053+0000","last_peered":"2024-09-12T18:30:17.513053+0000","last_clean":"2024-09-12T18:30:17.513053+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:30:17.513053+0000","last_undegraded":"2024-09-12T18:30:17.513053+0000","last_fullsized":"2024-09-12T18:30:17.513053+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.423582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587447,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":945,"num_read_kb":22424,"num_write":1564,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'507","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.363476+0000","last_change":"2024-09-12T17:35:42.901620+0000","last_active":"2024-09-12T18:32:48.363476+0000","last_peered":"2024-09-12T18:32:48.363476+0000","last_clean":"2024-09-12T18:32:48.363476+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:32:48.363476+0000","last_undegraded":"2024-09-12T18:32:48.363476+0000","last_fullsized":"2024-09-12T18:32:48.363476+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:37.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'259","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.068418+0000","last_change":"2024-09-12T17:35:40.893566+0000","last_active":"2024-09-12T18:30:07.068418+0000","last_peered":"2024-09-12T18:30:07.068418+0000","last_clean":"2024-09-12T18:30:07.068418+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:30:07.068418+0000","last_undegraded":"2024-09-12T18:30:07.068418+0000","last_fullsized":"2024-09-12T18:30:07.068418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.347084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11591057,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":8170,"num_write":933,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'783","reported_seq":2222,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.548109+0000","last_change":"2024-09-12T17:35:42.897318+0000","last_active":"2024-09-12T18:29:58.548109+0000","last_peered":"2024-09-12T18:29:58.548109+0000","last_clean":"2024-09-12T18:29:58.548109+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:29:58.548109+0000","last_undegraded":"2024-09-12T18:29:58.548109+0000","last_fullsized":"2024-09-12T18:29:58.548109+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:59.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'274","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:53.018074+0000","last_change":"2024-09-12T17:35:40.894257+0000","last_active":"2024-09-12T18:30:53.018074+0000","last_peered":"2024-09-12T18:30:53.018074+0000","last_clean":"2024-09-12T18:30:53.018074+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:30:53.018074+0000","last_undegraded":"2024-09-12T18:30:53.018074+0000","last_fullsized":"2024-09-12T18:30:53.018074+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:16.285766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021850,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":424,"num_read_kb":27896,"num_write":1039,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'568","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.439691+0000","last_change":"2024-09-12T17:35:42.900094+0000","last_active":"2024-09-12T18:30:15.439691+0000","last_peered":"2024-09-12T18:30:15.439691+0000","last_clean":"2024-09-12T18:30:15.439691+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:30:15.439691+0000","last_undegraded":"2024-09-12T18:30:15.439691+0000","last_fullsized":"2024-09-12T18:30:15.439691+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.607330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'233","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417896+0000","last_change":"2024-09-12T17:35:40.886954+0000","last_active":"2024-09-12T18:29:52.417896+0000","last_peered":"2024-09-12T18:29:52.417896+0000","last_clean":"2024-09-12T18:29:52.417896+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:29:52.417896+0000","last_undegraded":"2024-09-12T18:29:52.417896+0000","last_fullsized":"2024-09-12T18:29:52.417896+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:46.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315790,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":345,"num_read_kb":4463,"num_write":831,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'520","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.654360+0000","last_change":"2024-09-12T17:35:42.895055+0000","last_active":"2024-09-12T18:30:10.654360+0000","last_peered":"2024-09-12T18:30:10.654360+0000","last_clean":"2024-09-12T18:30:10.654360+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:30:10.654360+0000","last_undegraded":"2024-09-12T18:30:10.654360+0000","last_fullsized":"2024-09-12T18:30:10.654360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:39.969384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'257","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506759+0000","last_change":"2024-09-12T17:35:40.894178+0000","last_active":"2024-09-12T18:29:22.506759+0000","last_peered":"2024-09-12T18:29:22.506759+0000","last_clean":"2024-09-12T18:29:22.506759+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:29:22.506759+0000","last_undegraded":"2024-09-12T18:29:22.506759+0000","last_fullsized":"2024-09-12T18:29:22.506759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:59.754829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5535001,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":371,"num_read_kb":27660,"num_write":1012,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'391","reported_seq":1866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.567235+0000","last_change":"2024-09-12T17:36:15.950421+0000","last_active":"2024-09-12T18:30:07.567235+0000","last_peered":"2024-09-12T18:30:07.567235+0000","last_clean":"2024-09-12T18:30:07.567235+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:30:07.567235+0000","last_undegraded":"2024-09-12T18:30:07.567235+0000","last_fullsized":"2024-09-12T18:30:07.567235+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:25.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'268","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.651048+0000","last_change":"2024-09-12T17:35:40.885615+0000","last_active":"2024-09-12T18:29:22.651048+0000","last_peered":"2024-09-12T18:29:22.651048+0000","last_clean":"2024-09-12T18:29:22.651048+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:29:22.651048+0000","last_undegraded":"2024-09-12T18:29:22.651048+0000","last_fullsized":"2024-09-12T18:29:22.651048+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.664147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12856238,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":418,"num_read_kb":34544,"num_write":986,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'307","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.650964+0000","last_change":"2024-09-12T17:35:40.892904+0000","last_active":"2024-09-12T18:29:22.650964+0000","last_peered":"2024-09-12T18:29:22.650964+0000","last_clean":"2024-09-12T18:29:22.650964+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:29:22.650964+0000","last_undegraded":"2024-09-12T18:29:22.650964+0000","last_fullsized":"2024-09-12T18:29:22.650964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:46.084095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2677136,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":485,"num_read_kb":6964,"num_write":1060,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1470","reported_seq":2919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.368989+0000","last_change":"2024-09-12T17:35:42.902453+0000","last_active":"2024-09-12T18:32:48.368989+0000","last_peered":"2024-09-12T18:32:48.368989+0000","last_clean":"2024-09-12T18:32:48.368989+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:32:48.368989+0000","last_undegraded":"2024-09-12T18:32:48.368989+0000","last_fullsized":"2024-09-12T18:32:48.368989+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:29.174028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'243","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607000+0000","last_change":"2024-09-12T17:35:40.893486+0000","last_active":"2024-09-12T18:29:22.607000+0000","last_peered":"2024-09-12T18:29:22.607000+0000","last_clean":"2024-09-12T18:29:22.607000+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:29:22.607000+0000","last_undegraded":"2024-09-12T18:29:22.607000+0000","last_fullsized":"2024-09-12T18:29:22.607000+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.422582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7367506,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":395,"num_read_kb":8217,"num_write":916,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1011","reported_seq":2978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.115606+0000","last_change":"2024-09-12T17:35:42.894495+0000","last_active":"2024-09-12T18:31:29.115606+0000","last_peered":"2024-09-12T18:31:29.115606+0000","last_clean":"2024-09-12T18:31:29.115606+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:31:29.115606+0000","last_undegraded":"2024-09-12T18:31:29.115606+0000","last_fullsized":"2024-09-12T18:31:29.115606+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:16.817173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1921320,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17501,"num_read_kb":33196,"num_write":14845,"num_write_kb":11717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3342336,"data_stored":2796682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2181,"ondisk_log_size":2181,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565932576,"num_objects":4458,"num_object_clones":0,"num_object_copies":17832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":32298,"num_read_kb":2030638,"num_write":68048,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812879872,"data_stored":812879872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4348,"ondisk_log_size":4348,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":71442205,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":184607,"num_write":161,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143941632,"data_stored":143932986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72490781,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":142,"num_read_kb":188613,"num_write":160,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144990208,"data_stored":144981562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575544,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244652,"kb_used_data":141276,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94127188,"statfs":{"total":96636764160,"available":96386240512,"internally_reserved":0,"allocated":144666624,"data_stored":142733770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575544,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453776,"kb_used_data":125504,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93918064,"statfs":{"total":96636764160,"available":96172097536,"internally_reserved":0,"allocated":128516096,"data_stored":126495147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":336132554},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575543,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400944,"kb_used_data":135136,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93970896,"statfs":{"total":96636764160,"available":96226197504,"internally_reserved":0,"allocated":138379264,"data_stored":136431474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":158812,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":162623488,"data_stored":160564207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575543,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438220,"kb_used_data":150204,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93933620,"statfs":{"total":96636764160,"available":96188026880,"internally_reserved":0,"allocated":153808896,"data_stored":151783628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575545,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226924,"kb_used_data":127708,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94144916,"statfs":{"total":96636764160,"available":96404393984,"internally_reserved":0,"allocated":130772992,"data_stored":128852011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575543,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315652,"kb_used_data":135988,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94056188,"statfs":{"total":96636764160,"available":96313536512,"internally_reserved":0,"allocated":139251712,"data_stored":137265995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575546,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414316,"kb_used_data":148508,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957524,"statfs":{"total":96636764160,"available":96212504576,"internally_reserved":0,"allocated":152072192,"data_stored":150043452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":108003328,"data_stored":108003328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103157760,"data_stored":103157760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79200256,"data_stored":79200256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":91176960,"data_stored":91176960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":107003904,"data_stored":107003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":117772288,"data_stored":117772288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":107646976,"data_stored":107646976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98918400,"data_stored":98918400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":337682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":131171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":493563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":86495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":588649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":250471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":518076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28368896,"data_stored":28368177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28344320,"data_stored":28343505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24207360,"data_stored":24203756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16769024,"data_stored":16769024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22073344,"data_stored":22072625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":5297435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10481664,"data_stored":10481664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18918705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33648640,"data_stored":33647106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17872155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18931712,"data_stored":18930897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18912539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:07.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:33:07.549 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:07.549 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":262,"fsid":"f8cf509b-ba8a-4799-b42b-c125c378387b","created":"2024-09-12T17:35:10.048720+0000","modified":"2024-09-12T18:08:45.164451+0000","last_up_change":"2024-09-12T17:35:21.675775+0000","last_in_change":"2024-09-12T17:35:12.444964+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:35:22.323712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:35:28.364410+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:35:38.858428+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:35:41.206173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:35:43.098357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:35:44.948865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:35:46.906227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:35:48.968206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:50:12.851492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"251","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:53:10.726916+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:53:13.828869+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T18:08:42.681868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ee79d60-a692-4955-9765-8849f7ff1653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6827","nonce":311581689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6829","nonce":311581689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6833","nonce":311581689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":311581689},{"type":"v1","addr":"172.21.15.94:6831","nonce":311581689}]},"public_addr":"172.21.15.94:6827/311581689","cluster_addr":"172.21.15.94:6829/311581689","heartbeat_back_addr":"172.21.15.94:6833/311581689","heartbeat_front_addr":"172.21.15.94:6831/311581689","state":["exists","up"]},{"osd":1,"uuid":"5ae19867-7d69-4987-9259-1f62a425eb80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6801","nonce":316134373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6803","nonce":316134373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6807","nonce":316134373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":316134373},{"type":"v1","addr":"172.21.15.94:6805","nonce":316134373}]},"public_addr":"172.21.15.94:6801/316134373","cluster_addr":"172.21.15.94:6803/316134373","heartbeat_back_addr":"172.21.15.94:6807/316134373","heartbeat_front_addr":"172.21.15.94:6805/316134373","state":["exists","up"]},{"osd":2,"uuid":"66724fdc-f8d7-4ab6-bd1c-27252c73aa5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6817","nonce":4230056768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6819","nonce":4230056768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6823","nonce":4230056768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":4230056768},{"type":"v1","addr":"172.21.15.94:6821","nonce":4230056768}]},"public_addr":"172.21.15.94:6817/4230056768","cluster_addr":"172.21.15.94:6819/4230056768","heartbeat_back_addr":"172.21.15.94:6823/4230056768","heartbeat_front_addr":"172.21.15.94:6821/4230056768","state":["exists","up"]},{"osd":3,"uuid":"e8acc5da-50b8-40f9-9b18-5a77d1b4f72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6809","nonce":627469579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6811","nonce":627469579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6815","nonce":627469579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":627469579},{"type":"v1","addr":"172.21.15.94:6813","nonce":627469579}]},"public_addr":"172.21.15.94:6809/627469579","cluster_addr":"172.21.15.94:6811/627469579","heartbeat_back_addr":"172.21.15.94:6815/627469579","heartbeat_front_addr":"172.21.15.94:6813/627469579","state":["exists","up"]},{"osd":4,"uuid":"c0934950-f721-4a4e-a6fc-25a6d968acb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6817","nonce":3161618081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6819","nonce":3161618081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6823","nonce":3161618081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3161618081},{"type":"v1","addr":"172.21.15.204:6821","nonce":3161618081}]},"public_addr":"172.21.15.204:6817/3161618081","cluster_addr":"172.21.15.204:6819/3161618081","heartbeat_back_addr":"172.21.15.204:6823/3161618081","heartbeat_front_addr":"172.21.15.204:6821/3161618081","state":["exists","up"]},{"osd":5,"uuid":"c722e3f9-4961-49e8-b23a-6edcde42c8de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6825","nonce":1176062071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6827","nonce":1176062071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6831","nonce":1176062071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1176062071},{"type":"v1","addr":"172.21.15.204:6829","nonce":1176062071}]},"public_addr":"172.21.15.204:6825/1176062071","cluster_addr":"172.21.15.204:6827/1176062071","heartbeat_back_addr":"172.21.15.204:6831/1176062071","heartbeat_front_addr":"172.21.15.204:6829/1176062071","state":["exists","up"]},{"osd":6,"uuid":"d21a8e91-c896-4394-b333-f0af456ce142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6801","nonce":31982016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6803","nonce":31982016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6807","nonce":31982016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":31982016},{"type":"v1","addr":"172.21.15.204:6805","nonce":31982016}]},"public_addr":"172.21.15.204:6801/31982016","cluster_addr":"172.21.15.204:6803/31982016","heartbeat_back_addr":"172.21.15.204:6807/31982016","heartbeat_front_addr":"172.21.15.204:6805/31982016","state":["exists","up"]},{"osd":7,"uuid":"501824f8-2677-4593-9d88-513dce53e3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6809","nonce":287274657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6811","nonce":287274657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6815","nonce":287274657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":287274657},{"type":"v1","addr":"172.21.15.204:6813","nonce":287274657}]},"public_addr":"172.21.15.204:6809/287274657","cluster_addr":"172.21.15.204:6811/287274657","heartbeat_back_addr":"172.21.15.204:6815/287274657","heartbeat_front_addr":"172.21.15.204:6813/287274657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.296544+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.460153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.994886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.065250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.188045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.755739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:18.781285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:35:19.261708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":3}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":6,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3d","mappings":[{"from":0,"to":3}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:33:08.563 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:33:08.563 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:08.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T18:33:08.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:33:08.890+0000 7f056ffff640 0 --2- 172.21.15.94:0/1059705801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05700b74a0 0x7f05701d9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:33:08.909 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:08.909 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:08.909 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:08.920 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:33:09.219 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:33:09.233 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:33:09.233 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:09.370 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:09.370 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:09.381 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:33:09.701 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:33:09.715 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:33:09.715 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:09.853 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:09.853 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:09.853 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:09.863 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:33:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:33:10.173 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:33:10.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:10.310 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:10.311 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:10.311 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:10.321 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:33:10.619 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:33:10.634 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:33:10.634 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:10.771 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:10.772 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:10.772 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:10.782 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:33:11.084 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:33:11.097 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:33:11.098 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:11.236 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:11.236 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:11.236 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:11.247 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:33:11.550 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:33:11.563 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:33:11.563 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:11.704 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:11.704 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:11.714 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:33:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:33:12.027 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:33:12.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:33:12.167 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-12T18:33:12.168 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:33:12.168 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-12T18:33:12.179 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:33:12.481 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:33:12.494 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:12.821 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:12.832 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:12.834 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1989,"stamp":"2024-09-12T18:33:11.564148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70768882,"num_objects":845,"num_object_clones":0,"num_object_copies":2444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":845,"num_whiteouts":0,"num_read":292045,"num_read_kb":2658521,"num_write":161680,"num_write_kb":2423567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13739,"ondisk_log_size":13739,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1875884,"kb_used_data":125744,"kb_used_omap":12,"kb_used_meta":1748531,"kb_avail":753098836,"statfs":{"total":773094113280,"available":771173208064,"internally_reserved":0,"allocated":128761856,"data_stored":113132098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1790496304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-643727137,"num_objects":-4161,"num_object_clones":0,"num_object_copies":-16532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4161,"num_whiteouts":0,"num_read":4645,"num_read_kb":4166,"num_write":4410,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005320"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.645460+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:28:47.645460+0000","last_peered":"2024-09-12T18:28:47.645460+0000","last_clean":"2024-09-12T18:28:47.645460+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:28:47.645460+0000","last_undegraded":"2024-09-12T18:28:47.645460+0000","last_fullsized":"2024-09-12T18:28:47.645460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.052185+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:33:04.052185+0000","last_peered":"2024-09-12T18:33:04.052185+0000","last_clean":"2024-09-12T18:33:04.052185+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:33:04.052185+0000","last_undegraded":"2024-09-12T18:33:04.052185+0000","last_fullsized":"2024-09-12T18:33:04.052185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:41.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.423058+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:30:42.423058+0000","last_peered":"2024-09-12T18:30:42.423058+0000","last_clean":"2024-09-12T18:30:42.423058+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:30:42.423058+0000","last_undegraded":"2024-09-12T18:30:42.423058+0000","last_fullsized":"2024-09-12T18:30:42.423058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.080783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.503031+0000","last_change":"2024-09-12T18:08:44.184390+0000","last_active":"2024-09-12T18:28:47.503031+0000","last_peered":"2024-09-12T18:28:47.503031+0000","last_clean":"2024-09-12T18:28:47.503031+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:28:47.503031+0000","last_undegraded":"2024-09-12T18:28:47.503031+0000","last_fullsized":"2024-09-12T18:28:47.503031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:51.778841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525188+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:28:18.525188+0000","last_peered":"2024-09-12T18:28:18.525188+0000","last_clean":"2024-09-12T18:28:18.525188+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:28:18.525188+0000","last_undegraded":"2024-09-12T18:28:18.525188+0000","last_fullsized":"2024-09-12T18:28:18.525188+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:47.933301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.616690+0000","last_change":"2024-09-12T17:53:12.148575+0000","last_active":"2024-09-12T18:30:42.616690+0000","last_peered":"2024-09-12T18:30:42.616690+0000","last_clean":"2024-09-12T18:30:42.616690+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:30:42.616690+0000","last_undegraded":"2024-09-12T18:30:42.616690+0000","last_fullsized":"2024-09-12T18:30:42.616690+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:30.531081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514184+0000","last_change":"2024-09-12T17:50:14.836684+0000","last_active":"2024-09-12T18:30:27.514184+0000","last_peered":"2024-09-12T18:30:27.514184+0000","last_clean":"2024-09-12T18:30:27.514184+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:30:27.514184+0000","last_undegraded":"2024-09-12T18:30:27.514184+0000","last_fullsized":"2024-09-12T18:30:27.514184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:16.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425027+0000","last_change":"2024-09-12T18:08:44.178158+0000","last_active":"2024-09-12T18:30:32.425027+0000","last_peered":"2024-09-12T18:30:32.425027+0000","last_clean":"2024-09-12T18:30:32.425027+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:30:32.425027+0000","last_undegraded":"2024-09-12T18:30:32.425027+0000","last_fullsized":"2024-09-12T18:30:32.425027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:48.796260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:52.868027+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:32:52.868027+0000","last_peered":"2024-09-12T18:32:52.868027+0000","last_clean":"2024-09-12T18:32:52.868027+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:32:52.868027+0000","last_undegraded":"2024-09-12T18:32:52.868027+0000","last_fullsized":"2024-09-12T18:32:52.868027+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.506777+0000","last_change":"2024-09-12T17:53:12.146240+0000","last_active":"2024-09-12T18:29:22.506777+0000","last_peered":"2024-09-12T18:29:22.506777+0000","last_clean":"2024-09-12T18:29:22.506777+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:29:22.506777+0000","last_undegraded":"2024-09-12T18:29:22.506777+0000","last_fullsized":"2024-09-12T18:29:22.506777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.969445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.848535+0000","last_change":"2024-09-12T17:50:14.830812+0000","last_active":"2024-09-12T18:30:17.848535+0000","last_peered":"2024-09-12T18:30:17.848535+0000","last_clean":"2024-09-12T18:30:17.848535+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:30:17.848535+0000","last_undegraded":"2024-09-12T18:30:17.848535+0000","last_fullsized":"2024-09-12T18:30:17.848535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:04.011300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.428523+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:31:27.428523+0000","last_peered":"2024-09-12T18:31:27.428523+0000","last_clean":"2024-09-12T18:31:27.428523+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:31:27.428523+0000","last_undegraded":"2024-09-12T18:31:27.428523+0000","last_fullsized":"2024-09-12T18:31:27.428523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:57.846394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2101,"num_write":12,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.563840+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:32:48.563840+0000","last_peered":"2024-09-12T18:32:48.563840+0000","last_clean":"2024-09-12T18:32:48.563840+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:32:48.563840+0000","last_undegraded":"2024-09-12T18:32:48.563840+0000","last_fullsized":"2024-09-12T18:32:48.563840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674609+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:32:02.674609+0000","last_peered":"2024-09-12T18:32:02.674609+0000","last_clean":"2024-09-12T18:32:02.674609+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:32:02.674609+0000","last_undegraded":"2024-09-12T18:32:02.674609+0000","last_fullsized":"2024-09-12T18:32:02.674609+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'7","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.859981+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:31:52.859981+0000","last_peered":"2024-09-12T18:31:52.859981+0000","last_clean":"2024-09-12T18:31:52.859981+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:31:52.859981+0000","last_undegraded":"2024-09-12T18:31:52.859981+0000","last_fullsized":"2024-09-12T18:31:52.859981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4114,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.608852+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:29:37.608852+0000","last_peered":"2024-09-12T18:29:37.608852+0000","last_clean":"2024-09-12T18:29:37.608852+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:29:37.608852+0000","last_undegraded":"2024-09-12T18:29:37.608852+0000","last_fullsized":"2024-09-12T18:29:37.608852+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.447117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'11","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.054093+0000","last_change":"2024-09-12T17:53:15.163967+0000","last_active":"2024-09-12T18:33:04.054093+0000","last_peered":"2024-09-12T18:33:04.054093+0000","last_clean":"2024-09-12T18:33:04.054093+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:33:04.054093+0000","last_undegraded":"2024-09-12T18:33:04.054093+0000","last_fullsized":"2024-09-12T18:33:04.054093+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:21.391926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16462,"num_write":16,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'9","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:03.557382+0000","last_change":"2024-09-12T17:53:12.139099+0000","last_active":"2024-09-12T18:32:03.557382+0000","last_peered":"2024-09-12T18:32:03.557382+0000","last_clean":"2024-09-12T18:32:03.557382+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:32:03.557382+0000","last_undegraded":"2024-09-12T18:32:03.557382+0000","last_fullsized":"2024-09-12T18:32:03.557382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:32.128312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13304,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422211+0000","last_change":"2024-09-12T17:50:14.842952+0000","last_active":"2024-09-12T18:30:17.422211+0000","last_peered":"2024-09-12T18:30:17.422211+0000","last_clean":"2024-09-12T18:30:17.422211+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:30:17.422211+0000","last_undegraded":"2024-09-12T18:30:17.422211+0000","last_fullsized":"2024-09-12T18:30:17.422211+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:31.774447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406069+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:28:47.406069+0000","last_peered":"2024-09-12T18:28:47.406069+0000","last_clean":"2024-09-12T18:28:47.406069+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:28:47.406069+0000","last_undegraded":"2024-09-12T18:28:47.406069+0000","last_fullsized":"2024-09-12T18:28:47.406069+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:26.401744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427944+0000","last_change":"2024-09-12T17:53:15.159424+0000","last_active":"2024-09-12T18:30:47.427944+0000","last_peered":"2024-09-12T18:30:47.427944+0000","last_clean":"2024-09-12T18:30:47.427944+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:30:47.427944+0000","last_undegraded":"2024-09-12T18:30:47.427944+0000","last_fullsized":"2024-09-12T18:30:47.427944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:39.982738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6178,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:13.524378+0000","last_change":"2024-09-12T17:53:12.146586+0000","last_active":"2024-09-12T18:28:13.524378+0000","last_peered":"2024-09-12T18:28:13.524378+0000","last_clean":"2024-09-12T18:28:13.524378+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:28:13.524378+0000","last_undegraded":"2024-09-12T18:28:13.524378+0000","last_fullsized":"2024-09-12T18:28:13.524378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:27.151552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839397+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:29:02.839397+0000","last_peered":"2024-09-12T18:29:02.839397+0000","last_clean":"2024-09-12T18:29:02.839397+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:29:02.839397+0000","last_undegraded":"2024-09-12T18:29:02.839397+0000","last_fullsized":"2024-09-12T18:29:02.839397+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:50.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406134+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:28:47.406134+0000","last_peered":"2024-09-12T18:28:47.406134+0000","last_clean":"2024-09-12T18:28:47.406134+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:28:47.406134+0000","last_undegraded":"2024-09-12T18:28:47.406134+0000","last_fullsized":"2024-09-12T18:28:47.406134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:07.255733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.404892+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:28:17.404892+0000","last_peered":"2024-09-12T18:28:17.404892+0000","last_clean":"2024-09-12T18:28:17.404892+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:28:17.404892+0000","last_undegraded":"2024-09-12T18:28:17.404892+0000","last_fullsized":"2024-09-12T18:28:17.404892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:55.589172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'8","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.530582+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:33:05.530582+0000","last_peered":"2024-09-12T18:33:05.530582+0000","last_clean":"2024-09-12T18:33:05.530582+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:33:05.530582+0000","last_undegraded":"2024-09-12T18:33:05.530582+0000","last_fullsized":"2024-09-12T18:33:05.530582+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:08.474574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15356,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.604077+0000","last_change":"2024-09-12T17:50:14.841323+0000","last_active":"2024-09-12T18:28:57.604077+0000","last_peered":"2024-09-12T18:28:57.604077+0000","last_clean":"2024-09-12T18:28:57.604077+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:28:57.604077+0000","last_undegraded":"2024-09-12T18:28:57.604077+0000","last_fullsized":"2024-09-12T18:28:57.604077+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:41.858948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.609892+0000","last_change":"2024-09-12T18:08:44.184970+0000","last_active":"2024-09-12T18:29:47.609892+0000","last_peered":"2024-09-12T18:29:47.609892+0000","last_clean":"2024-09-12T18:29:47.609892+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:29:47.609892+0000","last_undegraded":"2024-09-12T18:29:47.609892+0000","last_fullsized":"2024-09-12T18:29:47.609892+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:13.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433041+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:31:57.433041+0000","last_peered":"2024-09-12T18:31:57.433041+0000","last_clean":"2024-09-12T18:31:57.433041+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:31:57.433041+0000","last_undegraded":"2024-09-12T18:31:57.433041+0000","last_fullsized":"2024-09-12T18:31:57.433041+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.661852+0000","last_change":"2024-09-12T17:53:12.143997+0000","last_active":"2024-09-12T18:30:37.661852+0000","last_peered":"2024-09-12T18:30:37.661852+0000","last_clean":"2024-09-12T18:30:37.661852+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:30:37.661852+0000","last_undegraded":"2024-09-12T18:30:37.661852+0000","last_fullsized":"2024-09-12T18:30:37.661852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:11.692360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":103,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.838922+0000","last_change":"2024-09-12T17:50:14.839525+0000","last_active":"2024-09-12T18:28:57.838922+0000","last_peered":"2024-09-12T18:28:57.838922+0000","last_clean":"2024-09-12T18:28:57.838922+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:28:57.838922+0000","last_undegraded":"2024-09-12T18:28:57.838922+0000","last_fullsized":"2024-09-12T18:28:57.838922+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:08.454207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509504+0000","last_change":"2024-09-12T18:08:44.184023+0000","last_active":"2024-09-12T18:29:47.509504+0000","last_peered":"2024-09-12T18:29:47.509504+0000","last_clean":"2024-09-12T18:29:47.509504+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:29:47.509504+0000","last_undegraded":"2024-09-12T18:29:47.509504+0000","last_fullsized":"2024-09-12T18:29:47.509504+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.561269+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:33:03.561269+0000","last_peered":"2024-09-12T18:33:03.561269+0000","last_clean":"2024-09-12T18:33:03.561269+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:33:03.561269+0000","last_undegraded":"2024-09-12T18:33:03.561269+0000","last_fullsized":"2024-09-12T18:33:03.561269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409647+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:28:57.409647+0000","last_peered":"2024-09-12T18:28:57.409647+0000","last_clean":"2024-09-12T18:28:57.409647+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:28:57.409647+0000","last_undegraded":"2024-09-12T18:28:57.409647+0000","last_fullsized":"2024-09-12T18:28:57.409647+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:39.923261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'7","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433088+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:31:57.433088+0000","last_peered":"2024-09-12T18:31:57.433088+0000","last_clean":"2024-09-12T18:31:57.433088+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:31:57.433088+0000","last_undegraded":"2024-09-12T18:31:57.433088+0000","last_fullsized":"2024-09-12T18:31:57.433088+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20478,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.523626+0000","last_change":"2024-09-12T17:53:12.144615+0000","last_active":"2024-09-12T18:31:52.523626+0000","last_peered":"2024-09-12T18:31:52.523626+0000","last_clean":"2024-09-12T18:31:52.523626+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:31:52.523626+0000","last_undegraded":"2024-09-12T18:31:52.523626+0000","last_fullsized":"2024-09-12T18:31:52.523626+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:01.824724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4132,"num_write":4,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.504229+0000","last_change":"2024-09-12T17:50:14.845069+0000","last_active":"2024-09-12T18:28:57.504229+0000","last_peered":"2024-09-12T18:28:57.504229+0000","last_clean":"2024-09-12T18:28:57.504229+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:28:57.504229+0000","last_undegraded":"2024-09-12T18:28:57.504229+0000","last_fullsized":"2024-09-12T18:28:57.504229+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:11.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'68","reported_seq":308,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420555+0000","last_change":"2024-09-12T17:50:14.842178+0000","last_active":"2024-09-12T18:30:07.420555+0000","last_peered":"2024-09-12T18:30:07.420555+0000","last_clean":"2024-09-12T18:30:07.420555+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:30:07.420555+0000","last_undegraded":"2024-09-12T18:30:07.420555+0000","last_fullsized":"2024-09-12T18:30:07.420555+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:23.280624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615983+0000","last_change":"2024-09-12T17:53:15.160000+0000","last_active":"2024-09-12T18:30:37.615983+0000","last_peered":"2024-09-12T18:30:37.615983+0000","last_clean":"2024-09-12T18:30:37.615983+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:30:37.615983+0000","last_undegraded":"2024-09-12T18:30:37.615983+0000","last_fullsized":"2024-09-12T18:30:37.615983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:16.584362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:33.544028+0000","last_change":"2024-09-12T17:53:12.138225+0000","last_active":"2024-09-12T18:30:33.544028+0000","last_peered":"2024-09-12T18:30:33.544028+0000","last_clean":"2024-09-12T18:30:33.544028+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:30:33.544028+0000","last_undegraded":"2024-09-12T18:30:33.544028+0000","last_fullsized":"2024-09-12T18:30:33.544028+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":298,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418863+0000","last_change":"2024-09-12T17:50:14.839535+0000","last_active":"2024-09-12T18:29:57.418863+0000","last_peered":"2024-09-12T18:29:57.418863+0000","last_clean":"2024-09-12T18:29:57.418863+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:29:57.418863+0000","last_undegraded":"2024-09-12T18:29:57.418863+0000","last_fullsized":"2024-09-12T18:29:57.418863+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:47.803289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615945+0000","last_change":"2024-09-12T17:53:15.161893+0000","last_active":"2024-09-12T18:30:37.615945+0000","last_peered":"2024-09-12T18:30:37.615945+0000","last_clean":"2024-09-12T18:30:37.615945+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:30:37.615945+0000","last_undegraded":"2024-09-12T18:30:37.615945+0000","last_fullsized":"2024-09-12T18:30:37.615945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:04.296609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.134151+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:33:04.134151+0000","last_peered":"2024-09-12T18:33:04.134151+0000","last_clean":"2024-09-12T18:33:04.134151+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:33:04.134151+0000","last_undegraded":"2024-09-12T18:33:04.134151+0000","last_fullsized":"2024-09-12T18:33:04.134151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846075+0000","last_change":"2024-09-12T17:50:14.840630+0000","last_active":"2024-09-12T18:29:57.846075+0000","last_peered":"2024-09-12T18:29:57.846075+0000","last_clean":"2024-09-12T18:29:57.846075+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:29:57.846075+0000","last_undegraded":"2024-09-12T18:29:57.846075+0000","last_fullsized":"2024-09-12T18:29:57.846075+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.197122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:57.441586+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:32:57.441586+0000","last_peered":"2024-09-12T18:32:57.441586+0000","last_clean":"2024-09-12T18:32:57.441586+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:32:57.441586+0000","last_undegraded":"2024-09-12T18:32:57.441586+0000","last_fullsized":"2024-09-12T18:32:57.441586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'6","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:52.450627+0000","last_change":"2024-09-12T17:53:12.148814+0000","last_active":"2024-09-12T18:32:52.450627+0000","last_peered":"2024-09-12T18:32:52.450627+0000","last_clean":"2024-09-12T18:32:52.450627+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:32:52.450627+0000","last_undegraded":"2024-09-12T18:32:52.450627+0000","last_fullsized":"2024-09-12T18:32:52.450627+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:08.076954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16370,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538860+0000","last_change":"2024-09-12T17:50:14.841498+0000","last_active":"2024-09-12T18:29:58.538860+0000","last_peered":"2024-09-12T18:29:58.538860+0000","last_clean":"2024-09-12T18:29:58.538860+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:29:58.538860+0000","last_undegraded":"2024-09-12T18:29:58.538860+0000","last_fullsized":"2024-09-12T18:29:58.538860+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.140268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.426002+0000","last_change":"2024-09-12T17:53:15.158874+0000","last_active":"2024-09-12T18:30:37.426002+0000","last_peered":"2024-09-12T18:30:37.426002+0000","last_clean":"2024-09-12T18:30:37.426002+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:30:37.426002+0000","last_undegraded":"2024-09-12T18:30:37.426002+0000","last_fullsized":"2024-09-12T18:30:37.426002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:50.215733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.651959+0000","last_change":"2024-09-12T17:53:12.146649+0000","last_active":"2024-09-12T18:33:03.651959+0000","last_peered":"2024-09-12T18:33:03.651959+0000","last_clean":"2024-09-12T18:33:03.651959+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:33:03.651959+0000","last_undegraded":"2024-09-12T18:33:03.651959+0000","last_fullsized":"2024-09-12T18:33:03.651959+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:57.575965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.515181+0000","last_change":"2024-09-12T18:08:44.180436+0000","last_active":"2024-09-12T18:30:37.515181+0000","last_peered":"2024-09-12T18:30:37.515181+0000","last_clean":"2024-09-12T18:30:37.515181+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:30:37.515181+0000","last_undegraded":"2024-09-12T18:30:37.515181+0000","last_fullsized":"2024-09-12T18:30:37.515181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:14.400883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'7","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.441583+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:33:04.441583+0000","last_peered":"2024-09-12T18:33:04.441583+0000","last_clean":"2024-09-12T18:33:04.441583+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:33:04.441583+0000","last_undegraded":"2024-09-12T18:33:04.441583+0000","last_fullsized":"2024-09-12T18:33:04.441583+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:02.994171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.435261+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:31:27.435261+0000","last_peered":"2024-09-12T18:31:27.435261+0000","last_clean":"2024-09-12T18:31:27.435261+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:31:27.435261+0000","last_undegraded":"2024-09-12T18:31:27.435261+0000","last_fullsized":"2024-09-12T18:31:27.435261+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:44.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.408326+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:28:47.408326+0000","last_peered":"2024-09-12T18:28:47.408326+0000","last_clean":"2024-09-12T18:28:47.408326+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:28:47.408326+0000","last_undegraded":"2024-09-12T18:28:47.408326+0000","last_fullsized":"2024-09-12T18:28:47.408326+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:01.905410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408851+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:29:02.408851+0000","last_peered":"2024-09-12T18:29:02.408851+0000","last_clean":"2024-09-12T18:29:02.408851+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:29:02.408851+0000","last_undegraded":"2024-09-12T18:29:02.408851+0000","last_fullsized":"2024-09-12T18:29:02.408851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:26.810924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412214+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:29:17.412214+0000","last_peered":"2024-09-12T18:29:17.412214+0000","last_clean":"2024-09-12T18:29:17.412214+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:29:17.412214+0000","last_undegraded":"2024-09-12T18:29:17.412214+0000","last_fullsized":"2024-09-12T18:29:17.412214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.836700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.520279+0000","last_change":"2024-09-12T17:53:12.143791+0000","last_active":"2024-09-12T18:31:27.520279+0000","last_peered":"2024-09-12T18:31:27.520279+0000","last_clean":"2024-09-12T18:31:27.520279+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:31:27.520279+0000","last_undegraded":"2024-09-12T18:31:27.520279+0000","last_fullsized":"2024-09-12T18:31:27.520279+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:50.203716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7180,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663487+0000","last_change":"2024-09-12T17:50:14.842898+0000","last_active":"2024-09-12T18:30:47.663487+0000","last_peered":"2024-09-12T18:30:47.663487+0000","last_clean":"2024-09-12T18:30:47.663487+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:30:47.663487+0000","last_undegraded":"2024-09-12T18:30:47.663487+0000","last_fullsized":"2024-09-12T18:30:47.663487+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:36.700805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424139+0000","last_change":"2024-09-12T18:08:44.182811+0000","last_active":"2024-09-12T18:30:27.424139+0000","last_peered":"2024-09-12T18:30:27.424139+0000","last_clean":"2024-09-12T18:30:27.424139+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:30:27.424139+0000","last_undegraded":"2024-09-12T18:30:27.424139+0000","last_fullsized":"2024-09-12T18:30:27.424139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.055368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.624296+0000","last_change":"2024-09-12T17:53:15.162967+0000","last_active":"2024-09-12T18:31:42.624296+0000","last_peered":"2024-09-12T18:31:42.624296+0000","last_clean":"2024-09-12T18:31:42.624296+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:31:42.624296+0000","last_undegraded":"2024-09-12T18:31:42.624296+0000","last_fullsized":"2024-09-12T18:31:42.624296+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:00.026005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8190,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.856483+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:31:27.856483+0000","last_peered":"2024-09-12T18:31:27.856483+0000","last_clean":"2024-09-12T18:31:27.856483+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:31:27.856483+0000","last_undegraded":"2024-09-12T18:31:27.856483+0000","last_fullsized":"2024-09-12T18:31:27.856483+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:33.879161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":12,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:50:14.845493+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:34.662412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:32.429503+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:31:32.429503+0000","last_peered":"2024-09-12T18:31:32.429503+0000","last_clean":"2024-09-12T18:31:32.429503+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:31:32.429503+0000","last_undegraded":"2024-09-12T18:31:32.429503+0000","last_fullsized":"2024-09-12T18:31:32.429503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:25.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607128+0000","last_change":"2024-09-12T17:53:12.149630+0000","last_active":"2024-09-12T18:29:22.607128+0000","last_peered":"2024-09-12T18:29:22.607128+0000","last_clean":"2024-09-12T18:29:22.607128+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:29:22.607128+0000","last_undegraded":"2024-09-12T18:29:22.607128+0000","last_fullsized":"2024-09-12T18:29:22.607128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:16.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.516222+0000","last_change":"2024-09-12T17:50:14.840844+0000","last_active":"2024-09-12T18:30:47.516222+0000","last_peered":"2024-09-12T18:30:47.516222+0000","last_clean":"2024-09-12T18:30:47.516222+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:30:47.516222+0000","last_undegraded":"2024-09-12T18:30:47.516222+0000","last_fullsized":"2024-09-12T18:30:47.516222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:46.536171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.410294+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:29:02.410294+0000","last_peered":"2024-09-12T18:29:02.410294+0000","last_clean":"2024-09-12T18:29:02.410294+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:29:02.410294+0000","last_undegraded":"2024-09-12T18:29:02.410294+0000","last_fullsized":"2024-09-12T18:29:02.410294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.278214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.862842+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:32:12.862842+0000","last_peered":"2024-09-12T18:32:12.862842+0000","last_clean":"2024-09-12T18:32:12.862842+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:32:12.862842+0000","last_undegraded":"2024-09-12T18:32:12.862842+0000","last_fullsized":"2024-09-12T18:32:12.862842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"259'83","reported_seq":352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851871+0000","last_change":"2024-09-12T17:50:14.839010+0000","last_active":"2024-09-12T18:30:47.851871+0000","last_peered":"2024-09-12T18:30:47.851871+0000","last_clean":"2024-09-12T18:30:47.851871+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:30:47.851871+0000","last_undegraded":"2024-09-12T18:30:47.851871+0000","last_fullsized":"2024-09-12T18:30:47.851871+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:25.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:07.409815+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:29:07.409815+0000","last_peered":"2024-09-12T18:29:07.409815+0000","last_clean":"2024-09-12T18:29:07.409815+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:29:07.409815+0000","last_undegraded":"2024-09-12T18:29:07.409815+0000","last_fullsized":"2024-09-12T18:29:07.409815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:47.977130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.628398+0000","last_change":"2024-09-12T17:53:12.148669+0000","last_active":"2024-09-12T18:32:12.628398+0000","last_peered":"2024-09-12T18:32:12.628398+0000","last_clean":"2024-09-12T18:32:12.628398+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:32:12.628398+0000","last_undegraded":"2024-09-12T18:32:12.628398+0000","last_fullsized":"2024-09-12T18:32:12.628398+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:34.792507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2093,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":207,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413248+0000","last_change":"2024-09-12T17:50:14.841525+0000","last_active":"2024-09-12T18:29:27.413248+0000","last_peered":"2024-09-12T18:29:27.413248+0000","last_clean":"2024-09-12T18:29:27.413248+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:29:27.413248+0000","last_undegraded":"2024-09-12T18:29:27.413248+0000","last_fullsized":"2024-09-12T18:29:27.413248+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.064279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408899+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:29:02.408899+0000","last_peered":"2024-09-12T18:29:02.408899+0000","last_clean":"2024-09-12T18:29:02.408899+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:29:02.408899+0000","last_undegraded":"2024-09-12T18:29:02.408899+0000","last_fullsized":"2024-09-12T18:29:02.408899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.682875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'3","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:32.622593+0000","last_change":"2024-09-12T17:53:15.162122+0000","last_active":"2024-09-12T18:31:32.622593+0000","last_peered":"2024-09-12T18:31:32.622593+0000","last_clean":"2024-09-12T18:31:32.622593+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:31:32.622593+0000","last_undegraded":"2024-09-12T18:31:32.622593+0000","last_fullsized":"2024-09-12T18:31:32.622593+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412132+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:29:17.412132+0000","last_peered":"2024-09-12T18:29:17.412132+0000","last_clean":"2024-09-12T18:29:17.412132+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:29:17.412132+0000","last_undegraded":"2024-09-12T18:29:17.412132+0000","last_fullsized":"2024-09-12T18:29:17.412132+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:32.030251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839464+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:29:02.839464+0000","last_peered":"2024-09-12T18:29:02.839464+0000","last_clean":"2024-09-12T18:29:02.839464+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:29:02.839464+0000","last_undegraded":"2024-09-12T18:29:02.839464+0000","last_fullsized":"2024-09-12T18:29:02.839464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:21.136369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'7","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.749815+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:33:04.749815+0000","last_peered":"2024-09-12T18:33:04.749815+0000","last_clean":"2024-09-12T18:33:04.749815+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:33:04.749815+0000","last_undegraded":"2024-09-12T18:33:04.749815+0000","last_fullsized":"2024-09-12T18:33:04.749815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":12,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:13.532493+0000","last_change":"2024-09-12T17:53:12.147444+0000","last_active":"2024-09-12T18:29:13.532493+0000","last_peered":"2024-09-12T18:29:13.532493+0000","last_clean":"2024-09-12T18:29:13.532493+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:29:13.532493+0000","last_undegraded":"2024-09-12T18:29:13.532493+0000","last_fullsized":"2024-09-12T18:29:13.532493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:33.139490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411513+0000","last_change":"2024-09-12T17:50:14.845091+0000","last_active":"2024-09-12T18:29:17.411513+0000","last_peered":"2024-09-12T18:29:17.411513+0000","last_clean":"2024-09-12T18:29:17.411513+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:29:17.411513+0000","last_undegraded":"2024-09-12T18:29:17.411513+0000","last_fullsized":"2024-09-12T18:29:17.411513+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:59.523739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.415011+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:29:37.415011+0000","last_peered":"2024-09-12T18:29:37.415011+0000","last_clean":"2024-09-12T18:29:37.415011+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:29:37.415011+0000","last_undegraded":"2024-09-12T18:29:37.415011+0000","last_fullsized":"2024-09-12T18:29:37.415011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:49.644621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.427023+0000","last_change":"2024-09-12T17:53:12.146834+0000","last_active":"2024-09-12T18:30:42.427023+0000","last_peered":"2024-09-12T18:30:42.427023+0000","last_clean":"2024-09-12T18:30:42.427023+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:30:42.427023+0000","last_undegraded":"2024-09-12T18:30:42.427023+0000","last_fullsized":"2024-09-12T18:30:42.427023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:24.998862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841210+0000","last_change":"2024-09-12T17:50:14.843252+0000","last_active":"2024-09-12T18:29:17.841210+0000","last_peered":"2024-09-12T18:29:17.841210+0000","last_clean":"2024-09-12T18:29:17.841210+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:29:17.841210+0000","last_undegraded":"2024-09-12T18:29:17.841210+0000","last_fullsized":"2024-09-12T18:29:17.841210+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.189495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653142+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:29:37.653142+0000","last_peered":"2024-09-12T18:29:37.653142+0000","last_clean":"2024-09-12T18:29:37.653142+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:29:37.653142+0000","last_undegraded":"2024-09-12T18:29:37.653142+0000","last_fullsized":"2024-09-12T18:29:37.653142+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:54.893645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.134037+0000","last_change":"2024-09-12T17:53:12.145287+0000","last_active":"2024-09-12T18:33:04.134037+0000","last_peered":"2024-09-12T18:33:04.134037+0000","last_clean":"2024-09-12T18:33:04.134037+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:33:04.134037+0000","last_undegraded":"2024-09-12T18:33:04.134037+0000","last_fullsized":"2024-09-12T18:33:04.134037+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411632+0000","last_change":"2024-09-12T17:50:14.845672+0000","last_active":"2024-09-12T18:29:17.411632+0000","last_peered":"2024-09-12T18:29:17.411632+0000","last_clean":"2024-09-12T18:29:17.411632+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:29:17.411632+0000","last_undegraded":"2024-09-12T18:29:17.411632+0000","last_fullsized":"2024-09-12T18:29:17.411632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:46.707631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617831+0000","last_change":"2024-09-12T18:08:44.180779+0000","last_active":"2024-09-12T18:30:52.617831+0000","last_peered":"2024-09-12T18:30:52.617831+0000","last_clean":"2024-09-12T18:30:52.617831+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:30:52.617831+0000","last_undegraded":"2024-09-12T18:30:52.617831+0000","last_fullsized":"2024-09-12T18:30:52.617831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:51.232292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'7","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.447080+0000","last_change":"2024-09-12T17:53:12.147578+0000","last_active":"2024-09-12T18:33:05.447080+0000","last_peered":"2024-09-12T18:33:05.447080+0000","last_clean":"2024-09-12T18:33:05.447080+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:33:05.447080+0000","last_undegraded":"2024-09-12T18:33:05.447080+0000","last_fullsized":"2024-09-12T18:33:05.447080+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.387228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419760+0000","last_change":"2024-09-12T17:50:14.843005+0000","last_active":"2024-09-12T18:30:02.419760+0000","last_peered":"2024-09-12T18:30:02.419760+0000","last_clean":"2024-09-12T18:30:02.419760+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:30:02.419760+0000","last_undegraded":"2024-09-12T18:30:02.419760+0000","last_fullsized":"2024-09-12T18:30:02.419760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:21.412702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535480+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:29:33.535480+0000","last_peered":"2024-09-12T18:29:33.535480+0000","last_clean":"2024-09-12T18:29:33.535480+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:29:33.535480+0000","last_undegraded":"2024-09-12T18:29:33.535480+0000","last_fullsized":"2024-09-12T18:29:33.535480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:09.211455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559657+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:32:18.559657+0000","last_peered":"2024-09-12T18:32:18.559657+0000","last_clean":"2024-09-12T18:32:18.559657+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:32:18.559657+0000","last_undegraded":"2024-09-12T18:32:18.559657+0000","last_fullsized":"2024-09-12T18:32:18.559657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610519+0000","last_change":"2024-09-12T17:50:14.843405+0000","last_active":"2024-09-12T18:29:52.610519+0000","last_peered":"2024-09-12T18:29:52.610519+0000","last_clean":"2024-09-12T18:29:52.610519+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:29:52.610519+0000","last_undegraded":"2024-09-12T18:29:52.610519+0000","last_fullsized":"2024-09-12T18:29:52.610519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.738965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514158+0000","last_change":"2024-09-12T18:08:44.185535+0000","last_active":"2024-09-12T18:30:27.514158+0000","last_peered":"2024-09-12T18:30:27.514158+0000","last_clean":"2024-09-12T18:30:27.514158+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:30:27.514158+0000","last_undegraded":"2024-09-12T18:30:27.514158+0000","last_fullsized":"2024-09-12T18:30:27.514158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:31.002329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'9","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.562644+0000","last_change":"2024-09-12T17:53:15.156207+0000","last_active":"2024-09-12T18:33:03.562644+0000","last_peered":"2024-09-12T18:33:03.562644+0000","last_clean":"2024-09-12T18:33:03.562644+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:33:03.562644+0000","last_undegraded":"2024-09-12T18:33:03.562644+0000","last_fullsized":"2024-09-12T18:33:03.562644+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.717848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":21492,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.412301+0000","last_change":"2024-09-12T17:53:12.148444+0000","last_active":"2024-09-12T18:29:22.412301+0000","last_peered":"2024-09-12T18:29:22.412301+0000","last_clean":"2024-09-12T18:29:22.412301+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:29:22.412301+0000","last_undegraded":"2024-09-12T18:29:22.412301+0000","last_fullsized":"2024-09-12T18:29:22.412301+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:25.525568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655558+0000","last_change":"2024-09-12T17:50:14.845855+0000","last_active":"2024-09-12T18:29:52.655558+0000","last_peered":"2024-09-12T18:29:52.655558+0000","last_clean":"2024-09-12T18:29:52.655558+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:29:52.655558+0000","last_undegraded":"2024-09-12T18:29:52.655558+0000","last_fullsized":"2024-09-12T18:29:52.655558+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.841767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.977591+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:33:03.977591+0000","last_peered":"2024-09-12T18:33:03.977591+0000","last_clean":"2024-09-12T18:33:03.977591+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:33:03.977591+0000","last_undegraded":"2024-09-12T18:33:03.977591+0000","last_fullsized":"2024-09-12T18:33:03.977591+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:54.256446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":4,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.449781+0000","last_change":"2024-09-12T17:53:12.141323+0000","last_active":"2024-09-12T18:32:47.449781+0000","last_peered":"2024-09-12T18:32:47.449781+0000","last_clean":"2024-09-12T18:32:47.449781+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:32:47.449781+0000","last_undegraded":"2024-09-12T18:32:47.449781+0000","last_fullsized":"2024-09-12T18:32:47.449781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:51.866615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:53.538225+0000","last_change":"2024-09-12T17:50:14.841037+0000","last_active":"2024-09-12T18:29:53.538225+0000","last_peered":"2024-09-12T18:29:53.538225+0000","last_clean":"2024-09-12T18:29:53.538225+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:29:53.538225+0000","last_undegraded":"2024-09-12T18:29:53.538225+0000","last_fullsized":"2024-09-12T18:29:53.538225+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:08.998454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.843448+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:29:37.843448+0000","last_peered":"2024-09-12T18:29:37.843448+0000","last_clean":"2024-09-12T18:29:37.843448+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:29:37.843448+0000","last_undegraded":"2024-09-12T18:29:37.843448+0000","last_fullsized":"2024-09-12T18:29:37.843448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:46.217476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427908+0000","last_change":"2024-09-12T17:53:15.167067+0000","last_active":"2024-09-12T18:30:47.427908+0000","last_peered":"2024-09-12T18:30:47.427908+0000","last_clean":"2024-09-12T18:30:47.427908+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:30:47.427908+0000","last_undegraded":"2024-09-12T18:30:47.427908+0000","last_fullsized":"2024-09-12T18:30:47.427908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:46.459018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.632674+0000","last_change":"2024-09-12T17:53:12.145714+0000","last_active":"2024-09-12T18:32:47.632674+0000","last_peered":"2024-09-12T18:32:47.632674+0000","last_clean":"2024-09-12T18:32:47.632674+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:32:47.632674+0000","last_undegraded":"2024-09-12T18:32:47.632674+0000","last_fullsized":"2024-09-12T18:32:47.632674+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:38.676442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417826+0000","last_change":"2024-09-12T17:50:14.840332+0000","last_active":"2024-09-12T18:29:52.417826+0000","last_peered":"2024-09-12T18:29:52.417826+0000","last_clean":"2024-09-12T18:29:52.417826+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:29:52.417826+0000","last_undegraded":"2024-09-12T18:29:52.417826+0000","last_fullsized":"2024-09-12T18:29:52.417826+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415951+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:29:42.415951+0000","last_peered":"2024-09-12T18:29:42.415951+0000","last_clean":"2024-09-12T18:29:42.415951+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:29:42.415951+0000","last_undegraded":"2024-09-12T18:29:42.415951+0000","last_fullsized":"2024-09-12T18:29:42.415951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:51.046197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.564563+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:32:53.564563+0000","last_peered":"2024-09-12T18:32:53.564563+0000","last_clean":"2024-09-12T18:32:53.564563+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:32:53.564563+0000","last_undegraded":"2024-09-12T18:32:53.564563+0000","last_fullsized":"2024-09-12T18:32:53.564563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.449849+0000","last_change":"2024-09-12T17:53:12.143851+0000","last_active":"2024-09-12T18:32:47.449849+0000","last_peered":"2024-09-12T18:32:47.449849+0000","last_clean":"2024-09-12T18:32:47.449849+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:32:47.449849+0000","last_undegraded":"2024-09-12T18:32:47.449849+0000","last_fullsized":"2024-09-12T18:32:47.449849+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:28.807772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424131+0000","last_change":"2024-09-12T17:50:14.843604+0000","last_active":"2024-09-12T18:30:27.424131+0000","last_peered":"2024-09-12T18:30:27.424131+0000","last_clean":"2024-09-12T18:30:27.424131+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:30:27.424131+0000","last_undegraded":"2024-09-12T18:30:27.424131+0000","last_fullsized":"2024-09-12T18:30:27.424131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:57.939262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'356","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.709136+0000","last_change":"2024-09-12T17:35:40.897067+0000","last_active":"2024-09-12T18:33:05.709136+0000","last_peered":"2024-09-12T18:33:05.709136+0000","last_clean":"2024-09-12T18:33:05.709136+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:33:05.709136+0000","last_undegraded":"2024-09-12T18:33:05.709136+0000","last_fullsized":"2024-09-12T18:33:05.709136+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:44.766786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":13512,"num_write":1124,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'535","reported_seq":1946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698681+0000","last_change":"2024-09-12T17:35:42.890337+0000","last_active":"2024-09-12T18:30:18.698681+0000","last_peered":"2024-09-12T18:30:18.698681+0000","last_clean":"2024-09-12T18:30:18.698681+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:30:18.698681+0000","last_undegraded":"2024-09-12T18:30:18.698681+0000","last_fullsized":"2024-09-12T18:30:18.698681+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:56.529947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'418","reported_seq":1197,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.970165+0000","last_change":"2024-09-12T17:35:40.895813+0000","last_active":"2024-09-12T18:33:05.970165+0000","last_peered":"2024-09-12T18:33:05.970165+0000","last_clean":"2024-09-12T18:33:05.970165+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:33:05.970165+0000","last_undegraded":"2024-09-12T18:33:05.970165+0000","last_fullsized":"2024-09-12T18:33:05.970165+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:08.595904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342084,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":23039,"num_write":1345,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'484","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812590+0000","last_change":"2024-09-12T17:35:42.888061+0000","last_active":"2024-09-12T18:30:18.812590+0000","last_peered":"2024-09-12T18:30:18.812590+0000","last_clean":"2024-09-12T18:30:18.812590+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:30:18.812590+0000","last_undegraded":"2024-09-12T18:30:18.812590+0000","last_fullsized":"2024-09-12T18:30:18.812590+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:42.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'386","reported_seq":1057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.959669+0000","last_change":"2024-09-12T17:36:16.048276+0000","last_active":"2024-09-12T18:33:05.959669+0000","last_peered":"2024-09-12T18:33:05.959669+0000","last_clean":"2024-09-12T18:33:05.959669+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:33:05.959669+0000","last_undegraded":"2024-09-12T18:33:05.959669+0000","last_fullsized":"2024-09-12T18:33:05.959669+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:44.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342186,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":764,"num_read_kb":32762,"num_write":1205,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'419","reported_seq":1922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.442221+0000","last_change":"2024-09-12T17:35:42.892018+0000","last_active":"2024-09-12T18:30:15.442221+0000","last_peered":"2024-09-12T18:30:15.442221+0000","last_clean":"2024-09-12T18:30:15.442221+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:30:15.442221+0000","last_undegraded":"2024-09-12T18:30:15.442221+0000","last_fullsized":"2024-09-12T18:30:15.442221+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:47.496306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'347","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.943749+0000","last_change":"2024-09-12T17:35:40.878718+0000","last_active":"2024-09-12T18:33:05.943749+0000","last_peered":"2024-09-12T18:33:05.943749+0000","last_clean":"2024-09-12T18:33:05.943749+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:33:05.943749+0000","last_undegraded":"2024-09-12T18:33:05.943749+0000","last_fullsized":"2024-09-12T18:33:05.943749+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.836799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":25007,"num_write":1079,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'459","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816024+0000","last_change":"2024-09-12T17:35:42.901523+0000","last_active":"2024-09-12T18:30:18.816024+0000","last_peered":"2024-09-12T18:30:18.816024+0000","last_clean":"2024-09-12T18:30:18.816024+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:30:18.816024+0000","last_undegraded":"2024-09-12T18:30:18.816024+0000","last_fullsized":"2024-09-12T18:30:18.816024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:21.733978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'325","reported_seq":1039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.731672+0000","last_change":"2024-09-12T17:35:40.893806+0000","last_active":"2024-09-12T18:33:05.731672+0000","last_peered":"2024-09-12T18:33:05.731672+0000","last_clean":"2024-09-12T18:33:05.731672+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:33:05.731672+0000","last_undegraded":"2024-09-12T18:33:05.731672+0000","last_fullsized":"2024-09-12T18:33:05.731672+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:58.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":10934,"num_write":1041,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'856","reported_seq":2380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978627+0000","last_change":"2024-09-12T17:35:42.896618+0000","last_active":"2024-09-12T18:30:25.978627+0000","last_peered":"2024-09-12T18:30:25.978627+0000","last_clean":"2024-09-12T18:30:25.978627+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:30:25.978627+0000","last_undegraded":"2024-09-12T18:30:25.978627+0000","last_fullsized":"2024-09-12T18:30:25.978627+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:28.451347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'339","reported_seq":1133,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.729075+0000","last_change":"2024-09-12T17:35:40.882513+0000","last_active":"2024-09-12T18:33:05.729075+0000","last_peered":"2024-09-12T18:33:05.729075+0000","last_clean":"2024-09-12T18:33:05.729075+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:33:05.729075+0000","last_undegraded":"2024-09-12T18:33:05.729075+0000","last_fullsized":"2024-09-12T18:33:05.729075+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.278996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287593,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":903,"num_read_kb":42337,"num_write":1288,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2407,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136019+0000","last_change":"2024-09-12T17:35:42.892097+0000","last_active":"2024-09-12T18:31:29.136019+0000","last_peered":"2024-09-12T18:31:29.136019+0000","last_clean":"2024-09-12T18:31:29.136019+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:31:29.136019+0000","last_undegraded":"2024-09-12T18:31:29.136019+0000","last_fullsized":"2024-09-12T18:31:29.136019+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:35.311382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'359","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.746149+0000","last_change":"2024-09-12T17:35:40.894162+0000","last_active":"2024-09-12T18:33:05.746149+0000","last_peered":"2024-09-12T18:33:05.746149+0000","last_clean":"2024-09-12T18:33:05.746149+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:33:05.746149+0000","last_undegraded":"2024-09-12T18:33:05.746149+0000","last_fullsized":"2024-09-12T18:33:05.746149+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:33.543998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170843,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":26409,"num_write":1171,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'465","reported_seq":1962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440637+0000","last_change":"2024-09-12T17:35:42.887897+0000","last_active":"2024-09-12T18:30:15.440637+0000","last_peered":"2024-09-12T18:30:15.440637+0000","last_clean":"2024-09-12T18:30:15.440637+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:30:15.440637+0000","last_undegraded":"2024-09-12T18:30:15.440637+0000","last_fullsized":"2024-09-12T18:30:15.440637+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.371385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'400","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.727770+0000","last_change":"2024-09-12T17:35:40.879524+0000","last_active":"2024-09-12T18:33:05.727770+0000","last_peered":"2024-09-12T18:33:05.727770+0000","last_clean":"2024-09-12T18:33:05.727770+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:33:05.727770+0000","last_undegraded":"2024-09-12T18:33:05.727770+0000","last_fullsized":"2024-09-12T18:33:05.727770+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:11.574981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":10679,"num_write":1254,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'484","reported_seq":2063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304996+0000","last_change":"2024-09-12T17:35:42.889118+0000","last_active":"2024-09-12T18:31:28.304996+0000","last_peered":"2024-09-12T18:31:28.304996+0000","last_clean":"2024-09-12T18:31:28.304996+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:31:28.304996+0000","last_undegraded":"2024-09-12T18:31:28.304996+0000","last_fullsized":"2024-09-12T18:31:28.304996+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:50.990196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'759","reported_seq":2185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699100+0000","last_change":"2024-09-12T17:35:42.896662+0000","last_active":"2024-09-12T18:30:18.699100+0000","last_peered":"2024-09-12T18:30:18.699100+0000","last_clean":"2024-09-12T18:30:18.699100+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:30:18.699100+0000","last_undegraded":"2024-09-12T18:30:18.699100+0000","last_fullsized":"2024-09-12T18:30:18.699100+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:32.589294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'355","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.733700+0000","last_change":"2024-09-12T17:35:40.895257+0000","last_active":"2024-09-12T18:33:05.733700+0000","last_peered":"2024-09-12T18:33:05.733700+0000","last_clean":"2024-09-12T18:33:05.733700+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:33:05.733700+0000","last_undegraded":"2024-09-12T18:33:05.733700+0000","last_fullsized":"2024-09-12T18:33:05.733700+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:16.477537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":71616,"num_write":1141,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'417","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392437+0000","last_change":"2024-09-12T17:36:16.050871+0000","last_active":"2024-09-12T18:32:48.392437+0000","last_peered":"2024-09-12T18:32:48.392437+0000","last_clean":"2024-09-12T18:32:48.392437+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:32:48.392437+0000","last_undegraded":"2024-09-12T18:32:48.392437+0000","last_fullsized":"2024-09-12T18:32:48.392437+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:59.500853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'319","reported_seq":950,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.707841+0000","last_change":"2024-09-12T17:35:40.901655+0000","last_active":"2024-09-12T18:33:05.707841+0000","last_peered":"2024-09-12T18:33:05.707841+0000","last_clean":"2024-09-12T18:33:05.707841+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:33:05.707841+0000","last_undegraded":"2024-09-12T18:33:05.707841+0000","last_fullsized":"2024-09-12T18:33:05.707841+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.400186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49172,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":3270,"num_write":1020,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'870","reported_seq":2483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.392732+0000","last_change":"2024-09-12T17:35:42.888574+0000","last_active":"2024-09-12T18:32:48.392732+0000","last_peered":"2024-09-12T18:32:48.392732+0000","last_clean":"2024-09-12T18:32:48.392732+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:32:48.392732+0000","last_undegraded":"2024-09-12T18:32:48.392732+0000","last_fullsized":"2024-09-12T18:32:48.392732+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:49.201685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'387","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.942215+0000","last_change":"2024-09-12T17:35:40.899223+0000","last_active":"2024-09-12T18:33:05.942215+0000","last_peered":"2024-09-12T18:33:05.942215+0000","last_clean":"2024-09-12T18:33:05.942215+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:33:05.942215+0000","last_undegraded":"2024-09-12T18:33:05.942215+0000","last_fullsized":"2024-09-12T18:33:05.942215+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:10.653659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":65942,"num_write":1264,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1104","reported_seq":2609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527373+0000","last_change":"2024-09-12T17:35:42.889897+0000","last_active":"2024-09-12T18:30:04.527373+0000","last_peered":"2024-09-12T18:30:04.527373+0000","last_clean":"2024-09-12T18:30:04.527373+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:30:04.527373+0000","last_undegraded":"2024-09-12T18:30:04.527373+0000","last_fullsized":"2024-09-12T18:30:04.527373+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:49.298029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'292","reported_seq":1058,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.949159+0000","last_change":"2024-09-12T17:35:40.896331+0000","last_active":"2024-09-12T18:33:05.949159+0000","last_peered":"2024-09-12T18:33:05.949159+0000","last_clean":"2024-09-12T18:33:05.949159+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:05.949159+0000","last_undegraded":"2024-09-12T18:33:05.949159+0000","last_fullsized":"2024-09-12T18:33:05.949159+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:10.681642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":760,"num_read_kb":33658,"num_write":1067,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'611","reported_seq":2377,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.306126+0000","last_change":"2024-09-12T17:35:42.897377+0000","last_active":"2024-09-12T18:31:28.306126+0000","last_peered":"2024-09-12T18:31:28.306126+0000","last_clean":"2024-09-12T18:31:28.306126+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:31:28.306126+0000","last_undegraded":"2024-09-12T18:31:28.306126+0000","last_fullsized":"2024-09-12T18:31:28.306126+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:35.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'324","reported_seq":947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.697804+0000","last_change":"2024-09-12T17:35:40.885644+0000","last_active":"2024-09-12T18:33:05.697804+0000","last_peered":"2024-09-12T18:33:05.697804+0000","last_clean":"2024-09-12T18:33:05.697804+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:33:05.697804+0000","last_undegraded":"2024-09-12T18:33:05.697804+0000","last_fullsized":"2024-09-12T18:33:05.697804+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:43.465385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452413,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":42765,"num_write":983,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'305","reported_seq":1678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.370580+0000","last_change":"2024-09-12T17:35:42.902985+0000","last_active":"2024-09-12T18:32:48.370580+0000","last_peered":"2024-09-12T18:32:48.370580+0000","last_clean":"2024-09-12T18:32:48.370580+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:32:48.370580+0000","last_undegraded":"2024-09-12T18:32:48.370580+0000","last_fullsized":"2024-09-12T18:32:48.370580+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:50.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'376","reported_seq":1061,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.664367+0000","last_change":"2024-09-12T17:35:40.901109+0000","last_active":"2024-09-12T18:33:05.664367+0000","last_peered":"2024-09-12T18:33:05.664367+0000","last_clean":"2024-09-12T18:33:05.664367+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:33:05.664367+0000","last_undegraded":"2024-09-12T18:33:05.664367+0000","last_fullsized":"2024-09-12T18:33:05.664367+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:19.735753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5481568,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":590,"num_read_kb":95728,"num_write":1139,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'128","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.236405+0000","last_change":"2024-09-12T17:35:50.911205+0000","last_active":"2024-09-12T18:31:29.236405+0000","last_peered":"2024-09-12T18:31:29.236405+0000","last_clean":"2024-09-12T18:31:29.236405+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:31:29.236405+0000","last_undegraded":"2024-09-12T18:31:29.236405+0000","last_fullsized":"2024-09-12T18:31:29.236405+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.073238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'773","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305568+0000","last_change":"2024-09-12T17:35:42.891760+0000","last_active":"2024-09-12T18:31:28.305568+0000","last_peered":"2024-09-12T18:31:28.305568+0000","last_clean":"2024-09-12T18:31:28.305568+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:31:28.305568+0000","last_undegraded":"2024-09-12T18:31:28.305568+0000","last_fullsized":"2024-09-12T18:31:28.305568+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:36.873441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'350","reported_seq":1116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.731231+0000","last_change":"2024-09-12T17:35:40.893979+0000","last_active":"2024-09-12T18:33:05.731231+0000","last_peered":"2024-09-12T18:33:05.731231+0000","last_clean":"2024-09-12T18:33:05.731231+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:33:05.731231+0000","last_undegraded":"2024-09-12T18:33:05.731231+0000","last_fullsized":"2024-09-12T18:33:05.731231+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:20.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424710,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":775,"num_read_kb":10756,"num_write":1135,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647106+0000","last_change":"2024-09-12T17:35:44.894904+0000","last_active":"2024-09-12T18:28:57.647106+0000","last_peered":"2024-09-12T18:28:57.647106+0000","last_clean":"2024-09-12T18:28:57.647106+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:28:57.647106+0000","last_undegraded":"2024-09-12T18:28:57.647106+0000","last_fullsized":"2024-09-12T18:28:57.647106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:49.733122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'342","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.403871+0000","last_change":"2024-09-12T17:35:46.891705+0000","last_active":"2024-09-12T18:33:03.403871+0000","last_peered":"2024-09-12T18:33:03.403871+0000","last_clean":"2024-09-12T18:33:03.403871+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:33:03.403871+0000","last_undegraded":"2024-09-12T18:33:03.403871+0000","last_fullsized":"2024-09-12T18:33:03.403871+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:37.590312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1162,"num_write":438,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409035+0000","last_change":"2024-09-12T17:35:48.908793+0000","last_active":"2024-09-12T18:29:02.409035+0000","last_peered":"2024-09-12T18:29:02.409035+0000","last_clean":"2024-09-12T18:29:02.409035+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:29:02.409035+0000","last_undegraded":"2024-09-12T18:29:02.409035+0000","last_fullsized":"2024-09-12T18:29:02.409035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.844066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'159","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.215133+0000","last_change":"2024-09-12T17:35:50.921992+0000","last_active":"2024-09-12T18:32:48.215133+0000","last_peered":"2024-09-12T18:32:48.215133+0000","last_clean":"2024-09-12T18:32:48.215133+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:32:48.215133+0000","last_undegraded":"2024-09-12T18:32:48.215133+0000","last_fullsized":"2024-09-12T18:32:48.215133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:51.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'479","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440599+0000","last_change":"2024-09-12T17:35:42.890621+0000","last_active":"2024-09-12T18:30:15.440599+0000","last_peered":"2024-09-12T18:30:15.440599+0000","last_clean":"2024-09-12T18:30:15.440599+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:30:15.440599+0000","last_undegraded":"2024-09-12T18:30:15.440599+0000","last_fullsized":"2024-09-12T18:30:15.440599+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:54.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'420","reported_seq":1108,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.950605+0000","last_change":"2024-09-12T17:35:40.889680+0000","last_active":"2024-09-12T18:33:05.950605+0000","last_peered":"2024-09-12T18:33:05.950605+0000","last_clean":"2024-09-12T18:33:05.950605+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:33:05.950605+0000","last_undegraded":"2024-09-12T18:33:05.950605+0000","last_fullsized":"2024-09-12T18:33:05.950605+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.317264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468829,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":675,"num_read_kb":80579,"num_write":1292,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415429+0000","last_change":"2024-09-12T17:35:44.894677+0000","last_active":"2024-09-12T18:29:42.415429+0000","last_peered":"2024-09-12T18:29:42.415429+0000","last_clean":"2024-09-12T18:29:42.415429+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:29:42.415429+0000","last_undegraded":"2024-09-12T18:29:42.415429+0000","last_fullsized":"2024-09-12T18:29:42.415429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:39.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'89","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530565+0000","last_change":"2024-09-12T17:35:46.899363+0000","last_active":"2024-09-12T18:28:58.530565+0000","last_peered":"2024-09-12T18:28:58.530565+0000","last_clean":"2024-09-12T18:28:58.530565+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:28:58.530565+0000","last_undegraded":"2024-09-12T18:28:58.530565+0000","last_fullsized":"2024-09-12T18:28:58.530565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530549+0000","last_change":"2024-09-12T17:35:48.901307+0000","last_active":"2024-09-12T18:28:58.530549+0000","last_peered":"2024-09-12T18:28:58.530549+0000","last_clean":"2024-09-12T18:28:58.530549+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:28:58.530549+0000","last_undegraded":"2024-09-12T18:28:58.530549+0000","last_fullsized":"2024-09-12T18:28:58.530549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:46.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'172","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.558222+0000","last_change":"2024-09-12T17:35:50.916182+0000","last_active":"2024-09-12T18:29:58.558222+0000","last_peered":"2024-09-12T18:29:58.558222+0000","last_clean":"2024-09-12T18:29:58.558222+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:29:58.558222+0000","last_undegraded":"2024-09-12T18:29:58.558222+0000","last_fullsized":"2024-09-12T18:29:58.558222+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:31.805546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1211","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816008+0000","last_change":"2024-09-12T17:35:42.901505+0000","last_active":"2024-09-12T18:30:18.816008+0000","last_peered":"2024-09-12T18:30:18.816008+0000","last_clean":"2024-09-12T18:30:18.816008+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:30:18.816008+0000","last_undegraded":"2024-09-12T18:30:18.816008+0000","last_fullsized":"2024-09-12T18:30:18.816008+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:38.531579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'399","reported_seq":1045,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.974980+0000","last_change":"2024-09-12T17:35:40.891281+0000","last_active":"2024-09-12T18:33:05.974980+0000","last_peered":"2024-09-12T18:33:05.974980+0000","last_clean":"2024-09-12T18:33:05.974980+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:33:05.974980+0000","last_undegraded":"2024-09-12T18:33:05.974980+0000","last_fullsized":"2024-09-12T18:33:05.974980+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:27.169879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386468,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":554,"num_read_kb":8447,"num_write":1280,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409696+0000","last_change":"2024-09-12T17:35:44.891907+0000","last_active":"2024-09-12T18:28:57.409696+0000","last_peered":"2024-09-12T18:28:57.409696+0000","last_clean":"2024-09-12T18:28:57.409696+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:28:57.409696+0000","last_undegraded":"2024-09-12T18:28:57.409696+0000","last_fullsized":"2024-09-12T18:28:57.409696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:17.733659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'121","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.508338+0000","last_change":"2024-09-12T17:35:46.901224+0000","last_active":"2024-09-12T18:29:37.508338+0000","last_peered":"2024-09-12T18:29:37.508338+0000","last_clean":"2024-09-12T18:29:37.508338+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:29:37.508338+0000","last_undegraded":"2024-09-12T18:29:37.508338+0000","last_fullsized":"2024-09-12T18:29:37.508338+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:25.864997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'763","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.284220+0000","last_change":"2024-09-12T17:35:48.907483+0000","last_active":"2024-09-12T18:33:03.284220+0000","last_peered":"2024-09-12T18:33:03.284220+0000","last_clean":"2024-09-12T18:33:03.284220+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:33:03.284220+0000","last_undegraded":"2024-09-12T18:33:03.284220+0000","last_fullsized":"2024-09-12T18:33:03.284220+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.736753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'230","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.422075+0000","last_change":"2024-09-12T17:35:51.346696+0000","last_active":"2024-09-12T18:31:28.422075+0000","last_peered":"2024-09-12T18:31:28.422075+0000","last_clean":"2024-09-12T18:31:28.422075+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:31:28.422075+0000","last_undegraded":"2024-09-12T18:31:28.422075+0000","last_fullsized":"2024-09-12T18:31:28.422075+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:18.663124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'672","reported_seq":2084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.119270+0000","last_change":"2024-09-12T17:35:42.895732+0000","last_active":"2024-09-12T18:31:29.119270+0000","last_peered":"2024-09-12T18:31:29.119270+0000","last_clean":"2024-09-12T18:31:29.119270+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:31:29.119270+0000","last_undegraded":"2024-09-12T18:31:29.119270+0000","last_fullsized":"2024-09-12T18:31:29.119270+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:25.681124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'341","reported_seq":1021,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.943586+0000","last_change":"2024-09-12T17:35:40.900095+0000","last_active":"2024-09-12T18:33:05.943586+0000","last_peered":"2024-09-12T18:33:05.943586+0000","last_clean":"2024-09-12T18:33:05.943586+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:33:05.943586+0000","last_undegraded":"2024-09-12T18:33:05.943586+0000","last_fullsized":"2024-09-12T18:33:05.943586+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:59.106406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399179,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":57705,"num_write":1124,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647162+0000","last_change":"2024-09-12T17:35:44.893676+0000","last_active":"2024-09-12T18:28:57.647162+0000","last_peered":"2024-09-12T18:28:57.647162+0000","last_clean":"2024-09-12T18:28:57.647162+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:28:57.647162+0000","last_undegraded":"2024-09-12T18:28:57.647162+0000","last_fullsized":"2024-09-12T18:28:57.647162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:14.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'278","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.522269+0000","last_change":"2024-09-12T17:35:47.464920+0000","last_active":"2024-09-12T18:33:05.522269+0000","last_peered":"2024-09-12T18:33:05.522269+0000","last_clean":"2024-09-12T18:33:05.522269+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:33:05.522269+0000","last_undegraded":"2024-09-12T18:33:05.522269+0000","last_fullsized":"2024-09-12T18:33:05.522269+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:46.905458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1082,"num_write":378,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'818","reported_seq":2353,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.254108+0000","last_change":"2024-09-12T17:35:48.899501+0000","last_active":"2024-09-12T18:33:05.254108+0000","last_peered":"2024-09-12T18:33:05.254108+0000","last_clean":"2024-09-12T18:33:05.254108+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:33:05.254108+0000","last_undegraded":"2024-09-12T18:33:05.254108+0000","last_fullsized":"2024-09-12T18:33:05.254108+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:00.483899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'541","reported_seq":2111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:50.407478+0000","last_change":"2024-09-12T17:35:42.891761+0000","last_active":"2024-09-12T18:30:50.407478+0000","last_peered":"2024-09-12T18:30:50.407478+0000","last_clean":"2024-09-12T18:30:50.407478+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:30:50.407478+0000","last_undegraded":"2024-09-12T18:30:50.407478+0000","last_fullsized":"2024-09-12T18:30:50.407478+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:30.116005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'394","reported_seq":1009,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.959207+0000","last_change":"2024-09-12T17:36:16.048265+0000","last_active":"2024-09-12T18:33:05.959207+0000","last_peered":"2024-09-12T18:33:05.959207+0000","last_clean":"2024-09-12T18:33:05.959207+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:33:05.959207+0000","last_undegraded":"2024-09-12T18:33:05.959207+0000","last_fullsized":"2024-09-12T18:33:05.959207+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:28.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512425,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":23815,"num_write":1238,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418824+0000","last_change":"2024-09-12T17:35:44.897503+0000","last_active":"2024-09-12T18:29:57.418824+0000","last_peered":"2024-09-12T18:29:57.418824+0000","last_clean":"2024-09-12T18:29:57.418824+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:29:57.418824+0000","last_undegraded":"2024-09-12T18:29:57.418824+0000","last_fullsized":"2024-09-12T18:29:57.418824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.732782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'365","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.720833+0000","last_change":"2024-09-12T17:35:47.466030+0000","last_active":"2024-09-12T18:33:03.720833+0000","last_peered":"2024-09-12T18:33:03.720833+0000","last_clean":"2024-09-12T18:33:03.720833+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:33:03.720833+0000","last_undegraded":"2024-09-12T18:33:03.720833+0000","last_fullsized":"2024-09-12T18:33:03.720833+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:23.136183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45931,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":1150,"num_write":454,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610510+0000","last_change":"2024-09-12T17:35:48.908512+0000","last_active":"2024-09-12T18:29:52.610510+0000","last_peered":"2024-09-12T18:29:52.610510+0000","last_clean":"2024-09-12T18:29:52.610510+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:29:52.610510+0000","last_undegraded":"2024-09-12T18:29:52.610510+0000","last_fullsized":"2024-09-12T18:29:52.610510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:43.347490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'584","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.244085+0000","last_change":"2024-09-12T17:35:50.922799+0000","last_active":"2024-09-12T18:32:50.244085+0000","last_peered":"2024-09-12T18:32:50.244085+0000","last_clean":"2024-09-12T18:32:50.244085+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:32:50.244085+0000","last_undegraded":"2024-09-12T18:32:50.244085+0000","last_fullsized":"2024-09-12T18:32:50.244085+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:24.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'543","reported_seq":2019,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812212+0000","last_change":"2024-09-12T17:35:42.902988+0000","last_active":"2024-09-12T18:30:18.812212+0000","last_peered":"2024-09-12T18:30:18.812212+0000","last_clean":"2024-09-12T18:30:18.812212+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:30:18.812212+0000","last_undegraded":"2024-09-12T18:30:18.812212+0000","last_fullsized":"2024-09-12T18:30:18.812212+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:13.896842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'393","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.971368+0000","last_change":"2024-09-12T17:36:16.051846+0000","last_active":"2024-09-12T18:33:05.971368+0000","last_peered":"2024-09-12T18:33:05.971368+0000","last_clean":"2024-09-12T18:33:05.971368+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:33:05.971368+0000","last_undegraded":"2024-09-12T18:33:05.971368+0000","last_fullsized":"2024-09-12T18:33:05.971368+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.618855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":15948,"num_write":1231,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510551+0000","last_change":"2024-09-12T17:35:44.891784+0000","last_active":"2024-09-12T18:29:57.510551+0000","last_peered":"2024-09-12T18:29:57.510551+0000","last_clean":"2024-09-12T18:29:57.510551+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:29:57.510551+0000","last_undegraded":"2024-09-12T18:29:57.510551+0000","last_fullsized":"2024-09-12T18:29:57.510551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:27.255253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'273","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.744352+0000","last_change":"2024-09-12T17:35:46.896008+0000","last_active":"2024-09-12T18:33:04.744352+0000","last_peered":"2024-09-12T18:33:04.744352+0000","last_clean":"2024-09-12T18:33:04.744352+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:33:04.744352+0000","last_undegraded":"2024-09-12T18:33:04.744352+0000","last_fullsized":"2024-09-12T18:33:04.744352+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:57.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47879,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1045,"num_write":366,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419734+0000","last_change":"2024-09-12T17:35:48.898203+0000","last_active":"2024-09-12T18:30:17.419734+0000","last_peered":"2024-09-12T18:30:17.419734+0000","last_clean":"2024-09-12T18:30:17.419734+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:30:17.419734+0000","last_undegraded":"2024-09-12T18:30:17.419734+0000","last_fullsized":"2024-09-12T18:30:17.419734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:47.877509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2398","reported_seq":4235,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:17.444594+0000","last_change":"2024-09-12T17:35:50.921094+0000","last_active":"2024-09-12T18:32:17.444594+0000","last_peered":"2024-09-12T18:32:17.444594+0000","last_clean":"2024-09-12T18:32:17.444594+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:32:17.444594+0000","last_undegraded":"2024-09-12T18:32:17.444594+0000","last_fullsized":"2024-09-12T18:32:17.444594+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.702558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1122","reported_seq":2583,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.526751+0000","last_change":"2024-09-12T17:35:42.900928+0000","last_active":"2024-09-12T18:30:04.526751+0000","last_peered":"2024-09-12T18:30:04.526751+0000","last_clean":"2024-09-12T18:30:04.526751+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:30:04.526751+0000","last_undegraded":"2024-09-12T18:30:04.526751+0000","last_fullsized":"2024-09-12T18:30:04.526751+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:07.706166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'336","reported_seq":1006,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.965191+0000","last_change":"2024-09-12T17:36:16.050004+0000","last_active":"2024-09-12T18:33:05.965191+0000","last_peered":"2024-09-12T18:33:05.965191+0000","last_clean":"2024-09-12T18:33:05.965191+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:33:05.965191+0000","last_undegraded":"2024-09-12T18:33:05.965191+0000","last_fullsized":"2024-09-12T18:33:05.965191+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:23.922359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4614985,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":185869,"num_write":1150,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509529+0000","last_change":"2024-09-12T17:35:44.893925+0000","last_active":"2024-09-12T18:29:47.509529+0000","last_peered":"2024-09-12T18:29:47.509529+0000","last_clean":"2024-09-12T18:29:47.509529+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:29:47.509529+0000","last_undegraded":"2024-09-12T18:29:47.509529+0000","last_fullsized":"2024-09-12T18:29:47.509529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:20.847625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'324","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.881003+0000","last_change":"2024-09-12T17:35:46.899126+0000","last_active":"2024-09-12T18:33:03.881003+0000","last_peered":"2024-09-12T18:33:03.881003+0000","last_clean":"2024-09-12T18:33:03.881003+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:33:03.881003+0000","last_undegraded":"2024-09-12T18:33:03.881003+0000","last_fullsized":"2024-09-12T18:33:03.881003+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.188366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49626,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":529,"num_read_kb":1160,"num_write":428,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'790","reported_seq":4758,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.289607+0000","last_change":"2024-09-12T17:35:48.902303+0000","last_active":"2024-09-12T18:33:03.289607+0000","last_peered":"2024-09-12T18:33:03.289607+0000","last_clean":"2024-09-12T18:33:03.289607+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:33:03.289607+0000","last_undegraded":"2024-09-12T18:33:03.289607+0000","last_fullsized":"2024-09-12T18:33:03.289607+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:31.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'116","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.214430+0000","last_change":"2024-09-12T17:35:50.916330+0000","last_active":"2024-09-12T18:32:48.214430+0000","last_peered":"2024-09-12T18:32:48.214430+0000","last_clean":"2024-09-12T18:32:48.214430+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:32:48.214430+0000","last_undegraded":"2024-09-12T18:32:48.214430+0000","last_fullsized":"2024-09-12T18:32:48.214430+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.967026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'517","reported_seq":2158,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.816091+0000","last_change":"2024-09-12T17:35:42.892720+0000","last_active":"2024-09-12T18:30:18.816091+0000","last_peered":"2024-09-12T18:30:18.816091+0000","last_clean":"2024-09-12T18:30:18.816091+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:30:18.816091+0000","last_undegraded":"2024-09-12T18:30:18.816091+0000","last_fullsized":"2024-09-12T18:30:18.816091+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:01.659398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'349","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.955444+0000","last_change":"2024-09-12T17:35:40.893097+0000","last_active":"2024-09-12T18:33:05.955444+0000","last_peered":"2024-09-12T18:33:05.955444+0000","last_clean":"2024-09-12T18:33:05.955444+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:33:05.955444+0000","last_undegraded":"2024-09-12T18:33:05.955444+0000","last_fullsized":"2024-09-12T18:33:05.955444+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:49.867087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399009,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":648,"num_read_kb":11855,"num_write":1224,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.511826+0000","last_change":"2024-09-12T17:35:44.893352+0000","last_active":"2024-09-12T18:30:07.511826+0000","last_peered":"2024-09-12T18:30:07.511826+0000","last_clean":"2024-09-12T18:30:07.511826+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:30:07.511826+0000","last_undegraded":"2024-09-12T18:30:07.511826+0000","last_fullsized":"2024-09-12T18:30:07.511826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:24.100202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'480","reported_seq":1114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.981003+0000","last_change":"2024-09-12T17:35:46.894868+0000","last_active":"2024-09-12T18:33:04.981003+0000","last_peered":"2024-09-12T18:33:04.981003+0000","last_clean":"2024-09-12T18:33:04.981003+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:33:04.981003+0000","last_undegraded":"2024-09-12T18:33:04.981003+0000","last_fullsized":"2024-09-12T18:33:04.981003+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:02.326426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":2056,"num_write":694,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.511164+0000","last_change":"2024-09-12T17:35:48.901213+0000","last_active":"2024-09-12T18:30:02.511164+0000","last_peered":"2024-09-12T18:30:02.511164+0000","last_clean":"2024-09-12T18:30:02.511164+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:30:02.511164+0000","last_undegraded":"2024-09-12T18:30:02.511164+0000","last_fullsized":"2024-09-12T18:30:02.511164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.829487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'162","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611795+0000","last_change":"2024-09-12T17:35:50.911833+0000","last_active":"2024-09-12T18:30:02.611795+0000","last_peered":"2024-09-12T18:30:02.611795+0000","last_clean":"2024-09-12T18:30:02.611795+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:30:02.611795+0000","last_undegraded":"2024-09-12T18:30:02.611795+0000","last_fullsized":"2024-09-12T18:30:02.611795+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:29.046424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'552","reported_seq":2191,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305005+0000","last_change":"2024-09-12T17:35:42.900912+0000","last_active":"2024-09-12T18:31:28.305005+0000","last_peered":"2024-09-12T18:31:28.305005+0000","last_clean":"2024-09-12T18:31:28.305005+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:31:28.305005+0000","last_undegraded":"2024-09-12T18:31:28.305005+0000","last_fullsized":"2024-09-12T18:31:28.305005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:06.952203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'381","reported_seq":1202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.938272+0000","last_change":"2024-09-12T17:35:40.888502+0000","last_active":"2024-09-12T18:33:05.938272+0000","last_peered":"2024-09-12T18:33:05.938272+0000","last_clean":"2024-09-12T18:33:05.938272+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:33:05.938272+0000","last_undegraded":"2024-09-12T18:33:05.938272+0000","last_fullsized":"2024-09-12T18:33:05.938272+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":952,"num_read_kb":1817,"num_write":1243,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509559+0000","last_change":"2024-09-12T17:35:44.894374+0000","last_active":"2024-09-12T18:29:47.509559+0000","last_peered":"2024-09-12T18:29:47.509559+0000","last_clean":"2024-09-12T18:29:47.509559+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:29:47.509559+0000","last_undegraded":"2024-09-12T18:29:47.509559+0000","last_fullsized":"2024-09-12T18:29:47.509559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:37.315095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'292","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.062615+0000","last_change":"2024-09-12T17:35:46.899081+0000","last_active":"2024-09-12T18:33:05.062615+0000","last_peered":"2024-09-12T18:33:05.062615+0000","last_clean":"2024-09-12T18:33:05.062615+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:33:05.062615+0000","last_undegraded":"2024-09-12T18:33:05.062615+0000","last_fullsized":"2024-09-12T18:33:05.062615+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:12.067500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47571,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1071,"num_write":444,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846238+0000","last_change":"2024-09-12T17:35:48.902048+0000","last_active":"2024-09-12T18:29:57.846238+0000","last_peered":"2024-09-12T18:29:57.846238+0000","last_clean":"2024-09-12T18:29:57.846238+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:29:57.846238+0000","last_undegraded":"2024-09-12T18:29:57.846238+0000","last_fullsized":"2024-09-12T18:29:57.846238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:02.774589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'94","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.488770+0000","last_change":"2024-09-12T17:35:50.921798+0000","last_active":"2024-09-12T18:32:38.488770+0000","last_peered":"2024-09-12T18:32:38.488770+0000","last_clean":"2024-09-12T18:32:38.488770+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:32:38.488770+0000","last_undegraded":"2024-09-12T18:32:38.488770+0000","last_fullsized":"2024-09-12T18:32:38.488770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:56.715205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'569","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812211+0000","last_change":"2024-09-12T17:35:42.891518+0000","last_active":"2024-09-12T18:30:18.812211+0000","last_peered":"2024-09-12T18:30:18.812211+0000","last_clean":"2024-09-12T18:30:18.812211+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:30:18.812211+0000","last_undegraded":"2024-09-12T18:30:18.812211+0000","last_fullsized":"2024-09-12T18:30:18.812211+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.251539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'374","reported_seq":1018,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.681369+0000","last_change":"2024-09-12T17:35:40.894104+0000","last_active":"2024-09-12T18:33:05.681369+0000","last_peered":"2024-09-12T18:33:05.681369+0000","last_clean":"2024-09-12T18:33:05.681369+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:33:05.681369+0000","last_undegraded":"2024-09-12T18:33:05.681369+0000","last_fullsized":"2024-09-12T18:33:05.681369+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:58.765499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30147,"num_write":1155,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"36'5","reported_seq":977,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.052746+0000","last_change":"2024-09-12T17:35:44.898322+0000","last_active":"2024-09-12T18:33:03.052746+0000","last_peered":"2024-09-12T18:33:03.052746+0000","last_clean":"2024-09-12T18:33:03.052746+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:33:03.052746+0000","last_undegraded":"2024-09-12T18:33:03.052746+0000","last_fullsized":"2024-09-12T18:33:03.052746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:56.912777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'314","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.521371+0000","last_change":"2024-09-12T17:35:46.902352+0000","last_active":"2024-09-12T18:33:04.521371+0000","last_peered":"2024-09-12T18:33:04.521371+0000","last_clean":"2024-09-12T18:33:04.521371+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:33:04.521371+0000","last_undegraded":"2024-09-12T18:33:04.521371+0000","last_fullsized":"2024-09-12T18:33:04.521371+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:39.492378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1126,"num_write":412,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'741","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.156987+0000","last_change":"2024-09-12T17:35:48.906082+0000","last_active":"2024-09-12T18:33:04.156987+0000","last_peered":"2024-09-12T18:33:04.156987+0000","last_clean":"2024-09-12T18:33:04.156987+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:33:04.156987+0000","last_undegraded":"2024-09-12T18:33:04.156987+0000","last_fullsized":"2024-09-12T18:33:04.156987+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:57.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'132","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.193519+0000","last_change":"2024-09-12T17:35:50.909941+0000","last_active":"2024-09-12T18:31:27.193519+0000","last_peered":"2024-09-12T18:31:27.193519+0000","last_clean":"2024-09-12T18:31:27.193519+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:31:27.193519+0000","last_undegraded":"2024-09-12T18:31:27.193519+0000","last_fullsized":"2024-09-12T18:31:27.193519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:20.080003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'391","reported_seq":1810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812238+0000","last_change":"2024-09-12T17:35:42.899041+0000","last_active":"2024-09-12T18:30:18.812238+0000","last_peered":"2024-09-12T18:30:18.812238+0000","last_clean":"2024-09-12T18:30:18.812238+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:30:18.812238+0000","last_undegraded":"2024-09-12T18:30:18.812238+0000","last_fullsized":"2024-09-12T18:30:18.812238+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:37.507108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'343","reported_seq":986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.974622+0000","last_change":"2024-09-12T17:35:40.904599+0000","last_active":"2024-09-12T18:33:05.974622+0000","last_peered":"2024-09-12T18:33:05.974622+0000","last_clean":"2024-09-12T18:33:05.974622+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:05.974622+0000","last_undegraded":"2024-09-12T18:33:05.974622+0000","last_fullsized":"2024-09-12T18:33:05.974622+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.738624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":4238,"num_write":1153,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1446,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.064201+0000","last_change":"2024-09-12T17:35:44.898038+0000","last_active":"2024-09-12T18:33:03.064201+0000","last_peered":"2024-09-12T18:33:03.064201+0000","last_clean":"2024-09-12T18:33:03.064201+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:33:03.064201+0000","last_undegraded":"2024-09-12T18:33:03.064201+0000","last_fullsized":"2024-09-12T18:33:03.064201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:34.625148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'95","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416056+0000","last_change":"2024-09-12T17:35:47.464847+0000","last_active":"2024-09-12T18:29:47.416056+0000","last_peered":"2024-09-12T18:29:47.416056+0000","last_clean":"2024-09-12T18:29:47.416056+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:29:47.416056+0000","last_undegraded":"2024-09-12T18:29:47.416056+0000","last_fullsized":"2024-09-12T18:29:47.416056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:21.681360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'780","reported_seq":2602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.286647+0000","last_change":"2024-09-12T17:35:48.904923+0000","last_active":"2024-09-12T18:33:03.286647+0000","last_peered":"2024-09-12T18:33:03.286647+0000","last_clean":"2024-09-12T18:33:03.286647+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:33:03.286647+0000","last_undegraded":"2024-09-12T18:33:03.286647+0000","last_fullsized":"2024-09-12T18:33:03.286647+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.107183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'108","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.539421+0000","last_change":"2024-09-12T17:35:50.910651+0000","last_active":"2024-09-12T18:30:03.539421+0000","last_peered":"2024-09-12T18:30:03.539421+0000","last_clean":"2024-09-12T18:30:03.539421+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:30:03.539421+0000","last_undegraded":"2024-09-12T18:30:03.539421+0000","last_fullsized":"2024-09-12T18:30:03.539421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'456","reported_seq":2050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.354919+0000","last_change":"2024-09-12T17:35:42.893296+0000","last_active":"2024-09-12T18:30:02.354919+0000","last_peered":"2024-09-12T18:30:02.354919+0000","last_clean":"2024-09-12T18:30:02.354919+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:30:02.354919+0000","last_undegraded":"2024-09-12T18:30:02.354919+0000","last_fullsized":"2024-09-12T18:30:02.354919+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.897104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'370","reported_seq":1116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.966577+0000","last_change":"2024-09-12T17:35:40.887751+0000","last_active":"2024-09-12T18:33:05.966577+0000","last_peered":"2024-09-12T18:33:05.966577+0000","last_clean":"2024-09-12T18:33:05.966577+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:33:05.966577+0000","last_undegraded":"2024-09-12T18:33:05.966577+0000","last_fullsized":"2024-09-12T18:33:05.966577+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:38.884936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":622,"num_read_kb":18794,"num_write":1042,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:48.537562+0000","last_change":"2024-09-12T17:35:44.894399+0000","last_active":"2024-09-12T18:29:48.537562+0000","last_peered":"2024-09-12T18:29:48.537562+0000","last_clean":"2024-09-12T18:29:48.537562+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:29:48.537562+0000","last_undegraded":"2024-09-12T18:29:48.537562+0000","last_fullsized":"2024-09-12T18:29:48.537562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:44.105931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'351","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.480160+0000","last_change":"2024-09-12T17:35:46.899125+0000","last_active":"2024-09-12T18:33:03.480160+0000","last_peered":"2024-09-12T18:33:03.480160+0000","last_clean":"2024-09-12T18:33:03.480160+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:33:03.480160+0000","last_undegraded":"2024-09-12T18:33:03.480160+0000","last_fullsized":"2024-09-12T18:33:03.480160+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:44.324703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1185,"num_write":448,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417912+0000","last_change":"2024-09-12T17:35:48.906391+0000","last_active":"2024-09-12T18:29:52.417912+0000","last_peered":"2024-09-12T18:29:52.417912+0000","last_clean":"2024-09-12T18:29:52.417912+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:29:52.417912+0000","last_undegraded":"2024-09-12T18:29:52.417912+0000","last_fullsized":"2024-09-12T18:29:52.417912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.195528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'123","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.371706+0000","last_change":"2024-09-12T17:35:50.921659+0000","last_active":"2024-09-12T18:30:12.371706+0000","last_peered":"2024-09-12T18:30:12.371706+0000","last_clean":"2024-09-12T18:30:12.371706+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:30:12.371706+0000","last_undegraded":"2024-09-12T18:30:12.371706+0000","last_fullsized":"2024-09-12T18:30:12.371706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:51.201223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'925","reported_seq":2656,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440823+0000","last_change":"2024-09-12T17:35:42.902610+0000","last_active":"2024-09-12T18:30:15.440823+0000","last_peered":"2024-09-12T18:30:15.440823+0000","last_clean":"2024-09-12T18:30:15.440823+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:30:15.440823+0000","last_undegraded":"2024-09-12T18:30:15.440823+0000","last_fullsized":"2024-09-12T18:30:15.440823+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":900,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:15.705104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.414933+0000","last_change":"2024-09-12T17:35:23.841031+0000","last_active":"2024-09-12T18:29:37.414933+0000","last_peered":"2024-09-12T18:29:37.414933+0000","last_clean":"2024-09-12T18:29:37.414933+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:29:37.414933+0000","last_undegraded":"2024-09-12T18:29:37.414933+0000","last_fullsized":"2024-09-12T18:29:37.414933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:22.677132+0000","last_clean_scrub_stamp":"2024-09-12T17:35:22.677132+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:25.295510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.654007+0000","last_change":"2024-09-12T17:35:31.719588+0000","last_active":"2024-09-12T18:29:42.654007+0000","last_peered":"2024-09-12T18:29:42.654007+0000","last_clean":"2024-09-12T18:29:42.654007+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:29:42.654007+0000","last_undegraded":"2024-09-12T18:29:42.654007+0000","last_fullsized":"2024-09-12T18:29:42.654007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:22.391585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'314","reported_seq":947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.717712+0000","last_change":"2024-09-12T17:35:40.885469+0000","last_active":"2024-09-12T18:33:05.717712+0000","last_peered":"2024-09-12T18:33:05.717712+0000","last_clean":"2024-09-12T18:33:05.717712+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:33:05.717712+0000","last_undegraded":"2024-09-12T18:33:05.717712+0000","last_fullsized":"2024-09-12T18:33:05.717712+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.530648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":16545,"num_write":1010,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418918+0000","last_change":"2024-09-12T17:35:44.896284+0000","last_active":"2024-09-12T18:29:57.418918+0000","last_peered":"2024-09-12T18:29:57.418918+0000","last_clean":"2024-09-12T18:29:57.418918+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:29:57.418918+0000","last_undegraded":"2024-09-12T18:29:57.418918+0000","last_fullsized":"2024-09-12T18:29:57.418918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.136280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'724","reported_seq":1424,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.736150+0000","last_change":"2024-09-12T17:35:46.902551+0000","last_active":"2024-09-12T18:33:05.736150+0000","last_peered":"2024-09-12T18:33:05.736150+0000","last_clean":"2024-09-12T18:33:05.736150+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:33:05.736150+0000","last_undegraded":"2024-09-12T18:33:05.736150+0000","last_fullsized":"2024-09-12T18:33:05.736150+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:53.419712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141929,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1422,"num_read_kb":3270,"num_write":1334,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846900+0000","last_change":"2024-09-12T17:35:48.901898+0000","last_active":"2024-09-12T18:30:02.846900+0000","last_peered":"2024-09-12T18:30:02.846900+0000","last_clean":"2024-09-12T18:30:02.846900+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:30:02.846900+0000","last_undegraded":"2024-09-12T18:30:02.846900+0000","last_fullsized":"2024-09-12T18:30:02.846900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'186","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.265154+0000","last_change":"2024-09-12T17:35:50.921223+0000","last_active":"2024-09-12T18:31:29.265154+0000","last_peered":"2024-09-12T18:31:29.265154+0000","last_clean":"2024-09-12T18:31:29.265154+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:31:29.265154+0000","last_undegraded":"2024-09-12T18:31:29.265154+0000","last_fullsized":"2024-09-12T18:31:29.265154+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.825503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'773","reported_seq":2219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.978406+0000","last_change":"2024-09-12T17:35:42.900821+0000","last_active":"2024-09-12T18:30:25.978406+0000","last_peered":"2024-09-12T18:30:25.978406+0000","last_clean":"2024-09-12T18:30:25.978406+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:30:25.978406+0000","last_undegraded":"2024-09-12T18:30:25.978406+0000","last_fullsized":"2024-09-12T18:30:25.978406+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:57.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415813+0000","last_change":"2024-09-12T17:35:32.132875+0000","last_active":"2024-09-12T18:29:42.415813+0000","last_peered":"2024-09-12T18:29:42.415813+0000","last_clean":"2024-09-12T18:29:42.415813+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:29:42.415813+0000","last_undegraded":"2024-09-12T18:29:42.415813+0000","last_fullsized":"2024-09-12T18:29:42.415813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:43.835691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'360","reported_seq":1000,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.729777+0000","last_change":"2024-09-12T17:35:40.899267+0000","last_active":"2024-09-12T18:33:05.729777+0000","last_peered":"2024-09-12T18:33:05.729777+0000","last_clean":"2024-09-12T18:33:05.729777+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:33:05.729777+0000","last_undegraded":"2024-09-12T18:33:05.729777+0000","last_fullsized":"2024-09-12T18:33:05.729777+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.692194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493074,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":8966,"num_write":1133,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656378+0000","last_change":"2024-09-12T17:35:44.895852+0000","last_active":"2024-09-12T18:29:57.656378+0000","last_peered":"2024-09-12T18:29:57.656378+0000","last_clean":"2024-09-12T18:29:57.656378+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:29:57.656378+0000","last_undegraded":"2024-09-12T18:29:57.656378+0000","last_fullsized":"2024-09-12T18:29:57.656378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1306","reported_seq":2928,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.668056+0000","last_change":"2024-09-12T17:35:46.899606+0000","last_active":"2024-09-12T18:33:05.668056+0000","last_peered":"2024-09-12T18:33:05.668056+0000","last_clean":"2024-09-12T18:33:05.668056+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:33:05.668056+0000","last_undegraded":"2024-09-12T18:33:05.668056+0000","last_fullsized":"2024-09-12T18:33:05.668056+0000","mapping_epoch":30,"log_start":"262'1200","ondisk_log_start":"262'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:45.048964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2069,"num_read_kb":3913,"num_write":1176,"num_write_kb":1005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.421442+0000","last_change":"2024-09-12T17:35:48.903717+0000","last_active":"2024-09-12T18:30:12.421442+0000","last_peered":"2024-09-12T18:30:12.421442+0000","last_clean":"2024-09-12T18:30:12.421442+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:30:12.421442+0000","last_undegraded":"2024-09-12T18:30:12.421442+0000","last_fullsized":"2024-09-12T18:30:12.421442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:26.731204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'253","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.259283+0000","last_change":"2024-09-12T17:35:51.345599+0000","last_active":"2024-09-12T18:31:29.259283+0000","last_peered":"2024-09-12T18:31:29.259283+0000","last_clean":"2024-09-12T18:31:29.259283+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:31:29.259283+0000","last_undegraded":"2024-09-12T18:31:29.259283+0000","last_fullsized":"2024-09-12T18:31:29.259283+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.606088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'489","reported_seq":2066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304547+0000","last_change":"2024-09-12T17:35:42.897417+0000","last_active":"2024-09-12T18:31:28.304547+0000","last_peered":"2024-09-12T18:31:28.304547+0000","last_clean":"2024-09-12T18:31:28.304547+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:31:28.304547+0000","last_undegraded":"2024-09-12T18:31:28.304547+0000","last_fullsized":"2024-09-12T18:31:28.304547+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:48.996327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.508930+0000","last_change":"2024-09-12T17:35:31.712263+0000","last_active":"2024-09-12T18:29:42.508930+0000","last_peered":"2024-09-12T18:29:42.508930+0000","last_clean":"2024-09-12T18:29:42.508930+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:29:42.508930+0000","last_undegraded":"2024-09-12T18:29:42.508930+0000","last_fullsized":"2024-09-12T18:29:42.508930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:24.611585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'331","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.680686+0000","last_change":"2024-09-12T17:35:40.892528+0000","last_active":"2024-09-12T18:33:05.680686+0000","last_peered":"2024-09-12T18:33:05.680686+0000","last_clean":"2024-09-12T18:33:05.680686+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:33:05.680686+0000","last_undegraded":"2024-09-12T18:33:05.680686+0000","last_fullsized":"2024-09-12T18:33:05.680686+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:49.177521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":5597,"num_write":1146,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.510633+0000","last_change":"2024-09-12T17:35:44.894603+0000","last_active":"2024-09-12T18:29:57.510633+0000","last_peered":"2024-09-12T18:29:57.510633+0000","last_clean":"2024-09-12T18:29:57.510633+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:29:57.510633+0000","last_undegraded":"2024-09-12T18:29:57.510633+0000","last_fullsized":"2024-09-12T18:29:57.510633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:34.593008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'261","reported_seq":1487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.728475+0000","last_change":"2024-09-12T17:35:47.465906+0000","last_active":"2024-09-12T18:32:47.728475+0000","last_peered":"2024-09-12T18:32:47.728475+0000","last_clean":"2024-09-12T18:32:47.728475+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:32:47.728475+0000","last_undegraded":"2024-09-12T18:32:47.728475+0000","last_fullsized":"2024-09-12T18:32:47.728475+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:51.604150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846850+0000","last_change":"2024-09-12T17:35:48.900323+0000","last_active":"2024-09-12T18:30:02.846850+0000","last_peered":"2024-09-12T18:30:02.846850+0000","last_clean":"2024-09-12T18:30:02.846850+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:30:02.846850+0000","last_undegraded":"2024-09-12T18:30:02.846850+0000","last_fullsized":"2024-09-12T18:30:02.846850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:55.834585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'282","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.403339+0000","last_change":"2024-09-12T17:35:50.910605+0000","last_active":"2024-09-12T18:31:29.403339+0000","last_peered":"2024-09-12T18:31:29.403339+0000","last_clean":"2024-09-12T18:31:29.403339+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:31:29.403339+0000","last_undegraded":"2024-09-12T18:31:29.403339+0000","last_fullsized":"2024-09-12T18:31:29.403339+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:55.444849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'395","reported_seq":1861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610548+0000","last_change":"2024-09-12T17:35:42.888553+0000","last_active":"2024-09-12T18:29:52.610548+0000","last_peered":"2024-09-12T18:29:52.610548+0000","last_clean":"2024-09-12T18:29:52.610548+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:29:52.610548+0000","last_undegraded":"2024-09-12T18:29:52.610548+0000","last_fullsized":"2024-09-12T18:29:52.610548+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:41.651814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":523,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.653977+0000","last_change":"2024-09-12T17:35:31.720108+0000","last_active":"2024-09-12T18:29:42.653977+0000","last_peered":"2024-09-12T18:29:42.653977+0000","last_clean":"2024-09-12T18:29:42.653977+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:29:42.653977+0000","last_undegraded":"2024-09-12T18:29:42.653977+0000","last_fullsized":"2024-09-12T18:29:42.653977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:18.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'318","reported_seq":955,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.620402+0000","last_change":"2024-09-12T17:35:40.895684+0000","last_active":"2024-09-12T18:33:05.620402+0000","last_peered":"2024-09-12T18:33:05.620402+0000","last_clean":"2024-09-12T18:33:05.620402+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:05.620402+0000","last_undegraded":"2024-09-12T18:33:05.620402+0000","last_fullsized":"2024-09-12T18:33:05.620402+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:57.907352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524430,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":24675,"num_write":1010,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846866+0000","last_change":"2024-09-12T17:35:44.894175+0000","last_active":"2024-09-12T18:30:02.846866+0000","last_peered":"2024-09-12T18:30:02.846866+0000","last_clean":"2024-09-12T18:30:02.846866+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:30:02.846866+0000","last_undegraded":"2024-09-12T18:30:02.846866+0000","last_fullsized":"2024-09-12T18:30:02.846866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:36.440643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'127","reported_seq":670,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.434575+0000","last_change":"2024-09-12T17:35:46.901548+0000","last_active":"2024-09-12T18:32:07.434575+0000","last_peered":"2024-09-12T18:32:07.434575+0000","last_clean":"2024-09-12T18:32:07.434575+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:32:07.434575+0000","last_undegraded":"2024-09-12T18:32:07.434575+0000","last_fullsized":"2024-09-12T18:32:07.434575+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.552114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419806+0000","last_change":"2024-09-12T17:35:48.903992+0000","last_active":"2024-09-12T18:30:02.419806+0000","last_peered":"2024-09-12T18:30:02.419806+0000","last_clean":"2024-09-12T18:30:02.419806+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:30:02.419806+0000","last_undegraded":"2024-09-12T18:30:02.419806+0000","last_fullsized":"2024-09-12T18:30:02.419806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.680834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.983301+0000","last_change":"2024-09-12T17:35:50.920568+0000","last_active":"2024-09-12T18:30:25.983301+0000","last_peered":"2024-09-12T18:30:25.983301+0000","last_clean":"2024-09-12T18:30:25.983301+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:30:25.983301+0000","last_undegraded":"2024-09-12T18:30:25.983301+0000","last_fullsized":"2024-09-12T18:30:25.983301+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.171883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'752","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.367704+0000","last_change":"2024-09-12T17:35:42.897300+0000","last_active":"2024-09-12T18:32:48.367704+0000","last_peered":"2024-09-12T18:32:48.367704+0000","last_clean":"2024-09-12T18:32:48.367704+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:32:48.367704+0000","last_undegraded":"2024-09-12T18:32:48.367704+0000","last_fullsized":"2024-09-12T18:32:48.367704+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:37.575175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'326","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.691452+0000","last_change":"2024-09-12T17:35:40.898323+0000","last_active":"2024-09-12T18:33:05.691452+0000","last_peered":"2024-09-12T18:33:05.691452+0000","last_clean":"2024-09-12T18:33:05.691452+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:33:05.691452+0000","last_undegraded":"2024-09-12T18:33:05.691452+0000","last_fullsized":"2024-09-12T18:33:05.691452+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:02.559929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":16635,"num_write":1112,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609344+0000","last_change":"2024-09-12T17:35:31.721848+0000","last_active":"2024-09-12T18:29:42.609344+0000","last_peered":"2024-09-12T18:29:42.609344+0000","last_clean":"2024-09-12T18:29:42.609344+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:29:42.609344+0000","last_undegraded":"2024-09-12T18:29:42.609344+0000","last_fullsized":"2024-09-12T18:29:42.609344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:53.319579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846145+0000","last_change":"2024-09-12T17:35:44.897241+0000","last_active":"2024-09-12T18:29:57.846145+0000","last_peered":"2024-09-12T18:29:57.846145+0000","last_clean":"2024-09-12T18:29:57.846145+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:29:57.846145+0000","last_undegraded":"2024-09-12T18:29:57.846145+0000","last_fullsized":"2024-09-12T18:29:57.846145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:54.095785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'568","reported_seq":1238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.597924+0000","last_change":"2024-09-12T17:35:46.896066+0000","last_active":"2024-09-12T18:33:05.597924+0000","last_peered":"2024-09-12T18:33:05.597924+0000","last_clean":"2024-09-12T18:33:05.597924+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:33:05.597924+0000","last_undegraded":"2024-09-12T18:33:05.597924+0000","last_fullsized":"2024-09-12T18:33:05.597924+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.503068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1576,"num_read_kb":2723,"num_write":2042,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538876+0000","last_change":"2024-09-12T17:35:48.894684+0000","last_active":"2024-09-12T18:29:58.538876+0000","last_peered":"2024-09-12T18:29:58.538876+0000","last_clean":"2024-09-12T18:29:58.538876+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:29:58.538876+0000","last_undegraded":"2024-09-12T18:29:58.538876+0000","last_fullsized":"2024-09-12T18:29:58.538876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:49.417148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'108","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.266811+0000","last_change":"2024-09-12T17:35:51.346736+0000","last_active":"2024-09-12T18:31:26.266811+0000","last_peered":"2024-09-12T18:31:26.266811+0000","last_clean":"2024-09-12T18:31:26.266811+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:31:26.266811+0000","last_undegraded":"2024-09-12T18:31:26.266811+0000","last_fullsized":"2024-09-12T18:31:26.266811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:44.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1006","reported_seq":2568,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.696514+0000","last_change":"2024-09-12T17:35:42.894625+0000","last_active":"2024-09-12T18:30:18.696514+0000","last_peered":"2024-09-12T18:30:18.696514+0000","last_clean":"2024-09-12T18:30:18.696514+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:30:18.696514+0000","last_undegraded":"2024-09-12T18:30:18.696514+0000","last_fullsized":"2024-09-12T18:30:18.696514+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'378","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.975968+0000","last_change":"2024-09-12T17:35:40.893165+0000","last_active":"2024-09-12T18:33:05.975968+0000","last_peered":"2024-09-12T18:33:05.975968+0000","last_clean":"2024-09-12T18:33:05.975968+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:33:05.975968+0000","last_undegraded":"2024-09-12T18:33:05.975968+0000","last_fullsized":"2024-09-12T18:33:05.975968+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:35.842097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820443,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":48347,"num_write":1175,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417867+0000","last_change":"2024-09-12T17:35:32.132884+0000","last_active":"2024-09-12T18:29:52.417867+0000","last_peered":"2024-09-12T18:29:52.417867+0000","last_clean":"2024-09-12T18:29:52.417867+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:29:52.417867+0000","last_undegraded":"2024-09-12T18:29:52.417867+0000","last_fullsized":"2024-09-12T18:29:52.417867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:21.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418796+0000","last_change":"2024-09-12T17:35:44.893378+0000","last_active":"2024-09-12T18:29:57.418796+0000","last_peered":"2024-09-12T18:29:57.418796+0000","last_clean":"2024-09-12T18:29:57.418796+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:29:57.418796+0000","last_undegraded":"2024-09-12T18:29:57.418796+0000","last_fullsized":"2024-09-12T18:29:57.418796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:00.649691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'201","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.324384+0000","last_change":"2024-09-12T17:35:47.465022+0000","last_active":"2024-09-12T18:31:52.324384+0000","last_peered":"2024-09-12T18:31:52.324384+0000","last_clean":"2024-09-12T18:31:52.324384+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:31:52.324384+0000","last_undegraded":"2024-09-12T18:31:52.324384+0000","last_fullsized":"2024-09-12T18:31:52.324384+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:20.452871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'786","reported_seq":2477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.062671+0000","last_change":"2024-09-12T17:35:48.905261+0000","last_active":"2024-09-12T18:33:05.062671+0000","last_peered":"2024-09-12T18:33:05.062671+0000","last_clean":"2024-09-12T18:33:05.062671+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:33:05.062671+0000","last_undegraded":"2024-09-12T18:33:05.062671+0000","last_fullsized":"2024-09-12T18:33:05.062671+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:47.769518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'442","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977350+0000","last_change":"2024-09-12T17:35:42.883869+0000","last_active":"2024-09-12T18:30:25.977350+0000","last_peered":"2024-09-12T18:30:25.977350+0000","last_clean":"2024-09-12T18:30:25.977350+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:30:25.977350+0000","last_undegraded":"2024-09-12T18:30:25.977350+0000","last_fullsized":"2024-09-12T18:30:25.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:13.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'361","reported_seq":1012,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.681672+0000","last_change":"2024-09-12T17:35:40.889008+0000","last_active":"2024-09-12T18:33:05.681672+0000","last_peered":"2024-09-12T18:33:05.681672+0000","last_clean":"2024-09-12T18:33:05.681672+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:33:05.681672+0000","last_undegraded":"2024-09-12T18:33:05.681672+0000","last_fullsized":"2024-09-12T18:33:05.681672+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:41.906990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":50118,"num_write":1078,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.609379+0000","last_change":"2024-09-12T17:35:31.721843+0000","last_active":"2024-09-12T18:29:42.609379+0000","last_peered":"2024-09-12T18:29:42.609379+0000","last_clean":"2024-09-12T18:29:42.609379+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:29:42.609379+0000","last_undegraded":"2024-09-12T18:29:42.609379+0000","last_fullsized":"2024-09-12T18:29:42.609379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538843+0000","last_change":"2024-09-12T17:35:44.889025+0000","last_active":"2024-09-12T18:29:58.538843+0000","last_peered":"2024-09-12T18:29:58.538843+0000","last_clean":"2024-09-12T18:29:58.538843+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:29:58.538843+0000","last_undegraded":"2024-09-12T18:29:58.538843+0000","last_fullsized":"2024-09-12T18:29:58.538843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:25.842079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'113","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538898+0000","last_change":"2024-09-12T17:35:46.896908+0000","last_active":"2024-09-12T18:29:58.538898+0000","last_peered":"2024-09-12T18:29:58.538898+0000","last_clean":"2024-09-12T18:29:58.538898+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:29:58.538898+0000","last_undegraded":"2024-09-12T18:29:58.538898+0000","last_fullsized":"2024-09-12T18:29:58.538898+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:22.911858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'818","reported_seq":2745,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.253989+0000","last_change":"2024-09-12T17:35:48.900105+0000","last_active":"2024-09-12T18:33:05.253989+0000","last_peered":"2024-09-12T18:33:05.253989+0000","last_clean":"2024-09-12T18:33:05.253989+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:33:05.253989+0000","last_undegraded":"2024-09-12T18:33:05.253989+0000","last_fullsized":"2024-09-12T18:33:05.253989+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:30.882725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'184","reported_seq":689,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845406+0000","last_change":"2024-09-12T17:35:50.910752+0000","last_active":"2024-09-12T18:29:52.845406+0000","last_peered":"2024-09-12T18:29:52.845406+0000","last_clean":"2024-09-12T18:29:52.845406+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:29:52.845406+0000","last_undegraded":"2024-09-12T18:29:52.845406+0000","last_fullsized":"2024-09-12T18:29:52.845406+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.734993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'538","reported_seq":2142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.549252+0000","last_change":"2024-09-12T17:35:42.895619+0000","last_active":"2024-09-12T18:29:58.549252+0000","last_peered":"2024-09-12T18:29:58.549252+0000","last_clean":"2024-09-12T18:29:58.549252+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:29:58.549252+0000","last_undegraded":"2024-09-12T18:29:58.549252+0000","last_fullsized":"2024-09-12T18:29:58.549252+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:43.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'301","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.661304+0000","last_change":"2024-09-12T17:35:40.896218+0000","last_active":"2024-09-12T18:33:05.661304+0000","last_peered":"2024-09-12T18:33:05.661304+0000","last_clean":"2024-09-12T18:33:05.661304+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:33:05.661304+0000","last_undegraded":"2024-09-12T18:33:05.661304+0000","last_fullsized":"2024-09-12T18:33:05.661304+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:29.873178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":18058,"num_write":1049,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415941+0000","last_change":"2024-09-12T17:35:31.797225+0000","last_active":"2024-09-12T18:29:42.415941+0000","last_peered":"2024-09-12T18:29:42.415941+0000","last_clean":"2024-09-12T18:29:42.415941+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:29:42.415941+0000","last_undegraded":"2024-09-12T18:29:42.415941+0000","last_fullsized":"2024-09-12T18:29:42.415941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:28.693162+0000","last_clean_scrub_stamp":"2024-09-12T17:35:28.693162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:29.148594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417831+0000","last_change":"2024-09-12T17:35:44.893144+0000","last_active":"2024-09-12T18:30:02.417831+0000","last_peered":"2024-09-12T18:30:02.417831+0000","last_clean":"2024-09-12T18:30:02.417831+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:30:02.417831+0000","last_undegraded":"2024-09-12T18:30:02.417831+0000","last_fullsized":"2024-09-12T18:30:02.417831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:31.642197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'718","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.990899+0000","last_change":"2024-09-12T17:35:47.464888+0000","last_active":"2024-09-12T18:33:05.990899+0000","last_peered":"2024-09-12T18:33:05.990899+0000","last_clean":"2024-09-12T18:33:05.990899+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:33:05.990899+0000","last_undegraded":"2024-09-12T18:33:05.990899+0000","last_fullsized":"2024-09-12T18:33:05.990899+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":3013,"num_write":1042,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417876+0000","last_change":"2024-09-12T17:35:48.899057+0000","last_active":"2024-09-12T18:30:02.417876+0000","last_peered":"2024-09-12T18:30:02.417876+0000","last_clean":"2024-09-12T18:30:02.417876+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:30:02.417876+0000","last_undegraded":"2024-09-12T18:30:02.417876+0000","last_fullsized":"2024-09-12T18:30:02.417876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:39.593576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'129","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655594+0000","last_change":"2024-09-12T17:35:50.924579+0000","last_active":"2024-09-12T18:29:52.655594+0000","last_peered":"2024-09-12T18:29:52.655594+0000","last_clean":"2024-09-12T18:29:52.655594+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:29:52.655594+0000","last_undegraded":"2024-09-12T18:29:52.655594+0000","last_fullsized":"2024-09-12T18:29:52.655594+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:27.853643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.346697+0000","last_change":"2024-09-12T17:35:50.923096+0000","last_active":"2024-09-12T18:31:29.346697+0000","last_peered":"2024-09-12T18:31:29.346697+0000","last_clean":"2024-09-12T18:31:29.346697+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:31:29.346697+0000","last_undegraded":"2024-09-12T18:31:29.346697+0000","last_fullsized":"2024-09-12T18:31:29.346697+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:15.866908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'395","reported_seq":1898,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.812218+0000","last_change":"2024-09-12T17:35:42.898207+0000","last_active":"2024-09-12T18:30:18.812218+0000","last_peered":"2024-09-12T18:30:18.812218+0000","last_clean":"2024-09-12T18:30:18.812218+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:30:18.812218+0000","last_undegraded":"2024-09-12T18:30:18.812218+0000","last_fullsized":"2024-09-12T18:30:18.812218+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:18.941988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'323","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.964512+0000","last_change":"2024-09-12T17:35:40.904851+0000","last_active":"2024-09-12T18:33:05.964512+0000","last_peered":"2024-09-12T18:33:05.964512+0000","last_clean":"2024-09-12T18:33:05.964512+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:05.964512+0000","last_undegraded":"2024-09-12T18:33:05.964512+0000","last_fullsized":"2024-09-12T18:33:05.964512+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":63909,"num_write":1001,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.607639+0000","last_change":"2024-09-12T17:35:44.898123+0000","last_active":"2024-09-12T18:29:27.607639+0000","last_peered":"2024-09-12T18:29:27.607639+0000","last_clean":"2024-09-12T18:29:27.607639+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:29:27.607639+0000","last_undegraded":"2024-09-12T18:29:27.607639+0000","last_fullsized":"2024-09-12T18:29:27.607639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:45.043204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'262","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.799077+0000","last_change":"2024-09-12T17:35:46.898039+0000","last_active":"2024-09-12T18:33:03.799077+0000","last_peered":"2024-09-12T18:33:03.799077+0000","last_clean":"2024-09-12T18:33:03.799077+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:33:03.799077+0000","last_undegraded":"2024-09-12T18:33:03.799077+0000","last_fullsized":"2024-09-12T18:33:03.799077+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.270815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":1008,"num_write":356,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414122+0000","last_change":"2024-09-12T17:35:48.899309+0000","last_active":"2024-09-12T18:29:32.414122+0000","last_peered":"2024-09-12T18:29:32.414122+0000","last_clean":"2024-09-12T18:29:32.414122+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:29:32.414122+0000","last_undegraded":"2024-09-12T18:29:32.414122+0000","last_fullsized":"2024-09-12T18:29:32.414122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:50.941565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'974","reported_seq":2454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136707+0000","last_change":"2024-09-12T17:35:42.896669+0000","last_active":"2024-09-12T18:31:29.136707+0000","last_peered":"2024-09-12T18:31:29.136707+0000","last_clean":"2024-09-12T18:31:29.136707+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:31:29.136707+0000","last_undegraded":"2024-09-12T18:31:29.136707+0000","last_fullsized":"2024-09-12T18:31:29.136707+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'391","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.712254+0000","last_change":"2024-09-12T17:35:40.886913+0000","last_active":"2024-09-12T18:33:05.712254+0000","last_peered":"2024-09-12T18:33:05.712254+0000","last_clean":"2024-09-12T18:33:05.712254+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:33:05.712254+0000","last_undegraded":"2024-09-12T18:33:05.712254+0000","last_fullsized":"2024-09-12T18:33:05.712254+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079946,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":8296,"num_write":1132,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'3","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.053740+0000","last_change":"2024-09-12T17:35:44.893880+0000","last_active":"2024-09-12T18:33:03.053740+0000","last_peered":"2024-09-12T18:33:03.053740+0000","last_clean":"2024-09-12T18:33:03.053740+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:33:03.053740+0000","last_undegraded":"2024-09-12T18:33:03.053740+0000","last_fullsized":"2024-09-12T18:33:03.053740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:43.603787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'55","reported_seq":559,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842309+0000","last_change":"2024-09-12T17:35:46.898981+0000","last_active":"2024-09-12T18:29:27.842309+0000","last_peered":"2024-09-12T18:29:27.842309+0000","last_clean":"2024-09-12T18:29:27.842309+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:29:27.842309+0000","last_undegraded":"2024-09-12T18:29:27.842309+0000","last_fullsized":"2024-09-12T18:29:27.842309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414052+0000","last_change":"2024-09-12T17:35:48.906133+0000","last_active":"2024-09-12T18:29:32.414052+0000","last_peered":"2024-09-12T18:29:32.414052+0000","last_clean":"2024-09-12T18:29:32.414052+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:29:32.414052+0000","last_undegraded":"2024-09-12T18:29:32.414052+0000","last_fullsized":"2024-09-12T18:29:32.414052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:11.783795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'186","reported_seq":721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.272851+0000","last_change":"2024-09-12T17:35:50.911342+0000","last_active":"2024-09-12T18:31:28.272851+0000","last_peered":"2024-09-12T18:31:28.272851+0000","last_clean":"2024-09-12T18:31:28.272851+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:31:28.272851+0000","last_undegraded":"2024-09-12T18:31:28.272851+0000","last_fullsized":"2024-09-12T18:31:28.272851+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.588084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'555","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.135761+0000","last_change":"2024-09-12T17:35:42.894287+0000","last_active":"2024-09-12T18:31:29.135761+0000","last_peered":"2024-09-12T18:31:29.135761+0000","last_clean":"2024-09-12T18:31:29.135761+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:31:29.135761+0000","last_undegraded":"2024-09-12T18:31:29.135761+0000","last_fullsized":"2024-09-12T18:31:29.135761+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:58.138070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'368","reported_seq":1037,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.733700+0000","last_change":"2024-09-12T17:35:40.895963+0000","last_active":"2024-09-12T18:33:05.733700+0000","last_peered":"2024-09-12T18:33:05.733700+0000","last_clean":"2024-09-12T18:33:05.733700+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:33:05.733700+0000","last_undegraded":"2024-09-12T18:33:05.733700+0000","last_fullsized":"2024-09-12T18:33:05.733700+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:58.280652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350736,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":674,"num_read_kb":8078,"num_write":1180,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413192+0000","last_change":"2024-09-12T17:35:44.899119+0000","last_active":"2024-09-12T18:29:27.413192+0000","last_peered":"2024-09-12T18:29:27.413192+0000","last_clean":"2024-09-12T18:29:27.413192+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:29:27.413192+0000","last_undegraded":"2024-09-12T18:29:27.413192+0000","last_fullsized":"2024-09-12T18:29:27.413192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.437374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'319","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.440519+0000","last_change":"2024-09-12T17:35:46.899592+0000","last_active":"2024-09-12T18:33:05.440519+0000","last_peered":"2024-09-12T18:33:05.440519+0000","last_clean":"2024-09-12T18:33:05.440519+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:33:05.440519+0000","last_undegraded":"2024-09-12T18:33:05.440519+0000","last_fullsized":"2024-09-12T18:33:05.440519+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:41.130246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48623,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1190,"num_write":438,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414094+0000","last_change":"2024-09-12T17:35:48.904071+0000","last_active":"2024-09-12T18:29:32.414094+0000","last_peered":"2024-09-12T18:29:32.414094+0000","last_clean":"2024-09-12T18:29:32.414094+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:29:32.414094+0000","last_undegraded":"2024-09-12T18:29:32.414094+0000","last_fullsized":"2024-09-12T18:29:32.414094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.350511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'98","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642138+0000","last_change":"2024-09-12T17:35:50.921087+0000","last_active":"2024-09-12T18:28:22.642138+0000","last_peered":"2024-09-12T18:28:22.642138+0000","last_clean":"2024-09-12T18:28:22.642138+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:28:22.642138+0000","last_undegraded":"2024-09-12T18:28:22.642138+0000","last_fullsized":"2024-09-12T18:28:22.642138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:26.137184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1026","reported_seq":2665,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.546129+0000","last_change":"2024-09-12T17:35:42.891619+0000","last_active":"2024-09-12T18:29:58.546129+0000","last_peered":"2024-09-12T18:29:58.546129+0000","last_clean":"2024-09-12T18:29:58.546129+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:29:58.546129+0000","last_undegraded":"2024-09-12T18:29:58.546129+0000","last_fullsized":"2024-09-12T18:29:58.546129+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:44.416070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'378","reported_seq":998,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.956901+0000","last_change":"2024-09-12T17:35:40.898320+0000","last_active":"2024-09-12T18:33:05.956901+0000","last_peered":"2024-09-12T18:33:05.956901+0000","last_clean":"2024-09-12T18:33:05.956901+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:33:05.956901+0000","last_undegraded":"2024-09-12T18:33:05.956901+0000","last_fullsized":"2024-09-12T18:33:05.956901+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:44.296291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":38183,"num_write":1089,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413134+0000","last_change":"2024-09-12T17:35:44.895748+0000","last_active":"2024-09-12T18:29:27.413134+0000","last_peered":"2024-09-12T18:29:27.413134+0000","last_clean":"2024-09-12T18:29:27.413134+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:29:27.413134+0000","last_undegraded":"2024-09-12T18:29:27.413134+0000","last_fullsized":"2024-09-12T18:29:27.413134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'276","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.201749+0000","last_change":"2024-09-12T17:35:46.899948+0000","last_active":"2024-09-12T18:33:05.201749+0000","last_peered":"2024-09-12T18:33:05.201749+0000","last_clean":"2024-09-12T18:33:05.201749+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:33:05.201749+0000","last_undegraded":"2024-09-12T18:33:05.201749+0000","last_fullsized":"2024-09-12T18:33:05.201749+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.546669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54427,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1013,"num_write":368,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.842896+0000","last_change":"2024-09-12T17:35:48.900909+0000","last_active":"2024-09-12T18:29:32.842896+0000","last_peered":"2024-09-12T18:29:32.842896+0000","last_clean":"2024-09-12T18:29:32.842896+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:29:32.842896+0000","last_undegraded":"2024-09-12T18:29:32.842896+0000","last_fullsized":"2024-09-12T18:29:32.842896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.781603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'860","reported_seq":2482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417988+0000","last_change":"2024-09-12T17:35:42.896175+0000","last_active":"2024-09-12T18:29:52.417988+0000","last_peered":"2024-09-12T18:29:52.417988+0000","last_clean":"2024-09-12T18:29:52.417988+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:29:52.417988+0000","last_undegraded":"2024-09-12T18:29:52.417988+0000","last_fullsized":"2024-09-12T18:29:52.417988+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:52.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'357","reported_seq":1084,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.941880+0000","last_change":"2024-09-12T17:35:40.884915+0000","last_active":"2024-09-12T18:33:05.941880+0000","last_peered":"2024-09-12T18:33:05.941880+0000","last_clean":"2024-09-12T18:33:05.941880+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:33:05.941880+0000","last_undegraded":"2024-09-12T18:33:05.941880+0000","last_fullsized":"2024-09-12T18:33:05.941880+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:51.644098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080042,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":5768,"num_write":997,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845447+0000","last_change":"2024-09-12T17:35:44.897738+0000","last_active":"2024-09-12T18:29:52.845447+0000","last_peered":"2024-09-12T18:29:52.845447+0000","last_clean":"2024-09-12T18:29:52.845447+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:29:52.845447+0000","last_undegraded":"2024-09-12T18:29:52.845447+0000","last_fullsized":"2024-09-12T18:29:52.845447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:43.811251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'498","reported_seq":1128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.138174+0000","last_change":"2024-09-12T17:35:46.899736+0000","last_active":"2024-09-12T18:33:05.138174+0000","last_peered":"2024-09-12T18:33:05.138174+0000","last_clean":"2024-09-12T18:33:05.138174+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:33:05.138174+0000","last_undegraded":"2024-09-12T18:33:05.138174+0000","last_fullsized":"2024-09-12T18:33:05.138174+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:36.496520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110948,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":875,"num_read_kb":2101,"num_write":752,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.642155+0000","last_change":"2024-09-12T17:35:48.900061+0000","last_active":"2024-09-12T18:28:22.642155+0000","last_peered":"2024-09-12T18:28:22.642155+0000","last_clean":"2024-09-12T18:28:22.642155+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:28:22.642155+0000","last_undegraded":"2024-09-12T18:28:22.642155+0000","last_fullsized":"2024-09-12T18:28:22.642155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:58.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'164","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.297167+0000","last_change":"2024-09-12T17:35:51.347046+0000","last_active":"2024-09-12T18:31:28.297167+0000","last_peered":"2024-09-12T18:31:28.297167+0000","last_clean":"2024-09-12T18:31:28.297167+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:31:28.297167+0000","last_undegraded":"2024-09-12T18:31:28.297167+0000","last_fullsized":"2024-09-12T18:31:28.297167+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.856381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'775","reported_seq":2167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305413+0000","last_change":"2024-09-12T17:35:42.896418+0000","last_active":"2024-09-12T18:31:28.305413+0000","last_peered":"2024-09-12T18:31:28.305413+0000","last_clean":"2024-09-12T18:31:28.305413+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:31:28.305413+0000","last_undegraded":"2024-09-12T18:31:28.305413+0000","last_fullsized":"2024-09-12T18:31:28.305413+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.201642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'292","reported_seq":928,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.691438+0000","last_change":"2024-09-12T17:35:40.892252+0000","last_active":"2024-09-12T18:33:05.691438+0000","last_peered":"2024-09-12T18:33:05.691438+0000","last_clean":"2024-09-12T18:33:05.691438+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:33:05.691438+0000","last_undegraded":"2024-09-12T18:33:05.691438+0000","last_fullsized":"2024-09-12T18:33:05.691438+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:53.303511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694644,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":28092,"num_write":983,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418873+0000","last_change":"2024-09-12T17:35:44.897834+0000","last_active":"2024-09-12T18:29:57.418873+0000","last_peered":"2024-09-12T18:29:57.418873+0000","last_clean":"2024-09-12T18:29:57.418873+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:29:57.418873+0000","last_undegraded":"2024-09-12T18:29:57.418873+0000","last_fullsized":"2024-09-12T18:29:57.418873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:52.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'326","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.291889+0000","last_change":"2024-09-12T17:35:46.899505+0000","last_active":"2024-09-12T18:33:05.291889+0000","last_peered":"2024-09-12T18:33:05.291889+0000","last_clean":"2024-09-12T18:33:05.291889+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:33:05.291889+0000","last_undegraded":"2024-09-12T18:33:05.291889+0000","last_fullsized":"2024-09-12T18:33:05.291889+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.056459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56643,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1253,"num_write":470,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.600262+0000","last_change":"2024-09-12T17:35:48.906992+0000","last_active":"2024-09-12T18:28:22.600262+0000","last_peered":"2024-09-12T18:28:22.600262+0000","last_clean":"2024-09-12T18:28:22.600262+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:28:22.600262+0000","last_undegraded":"2024-09-12T18:28:22.600262+0000","last_fullsized":"2024-09-12T18:28:22.600262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.979695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'197","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.615415+0000","last_change":"2024-09-12T17:35:50.916243+0000","last_active":"2024-09-12T18:31:26.615415+0000","last_peered":"2024-09-12T18:31:26.615415+0000","last_clean":"2024-09-12T18:31:26.615415+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:31:26.615415+0000","last_undegraded":"2024-09-12T18:31:26.615415+0000","last_fullsized":"2024-09-12T18:31:26.615415+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:37.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1293","reported_seq":2864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.360743+0000","last_change":"2024-09-12T17:35:42.890895+0000","last_active":"2024-09-12T18:32:48.360743+0000","last_peered":"2024-09-12T18:32:48.360743+0000","last_clean":"2024-09-12T18:32:48.360743+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:32:48.360743+0000","last_undegraded":"2024-09-12T18:32:48.360743+0000","last_fullsized":"2024-09-12T18:32:48.360743+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:52.254143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'314","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.723565+0000","last_change":"2024-09-12T17:35:40.904317+0000","last_active":"2024-09-12T18:33:05.723565+0000","last_peered":"2024-09-12T18:33:05.723565+0000","last_clean":"2024-09-12T18:33:05.723565+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:05.723565+0000","last_undegraded":"2024-09-12T18:33:05.723565+0000","last_fullsized":"2024-09-12T18:33:05.723565+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:35.506278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":10892,"num_write":984,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525199+0000","last_change":"2024-09-12T17:35:44.893724+0000","last_active":"2024-09-12T18:28:18.525199+0000","last_peered":"2024-09-12T18:28:18.525199+0000","last_clean":"2024-09-12T18:28:18.525199+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:28:18.525199+0000","last_undegraded":"2024-09-12T18:28:18.525199+0000","last_fullsized":"2024-09-12T18:28:18.525199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:31.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'291","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.126353+0000","last_change":"2024-09-12T17:35:47.464841+0000","last_active":"2024-09-12T18:33:04.126353+0000","last_peered":"2024-09-12T18:33:04.126353+0000","last_clean":"2024-09-12T18:33:04.126353+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:33:04.126353+0000","last_undegraded":"2024-09-12T18:33:04.126353+0000","last_fullsized":"2024-09-12T18:33:04.126353+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:30.514600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48414,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":1088,"num_write":394,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.612492+0000","last_change":"2024-09-12T17:35:48.901108+0000","last_active":"2024-09-12T18:30:07.612492+0000","last_peered":"2024-09-12T18:30:07.612492+0000","last_clean":"2024-09-12T18:30:07.612492+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:30:07.612492+0000","last_undegraded":"2024-09-12T18:30:07.612492+0000","last_fullsized":"2024-09-12T18:30:07.612492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:24.864398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'134","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.243540+0000","last_change":"2024-09-12T17:35:50.924276+0000","last_active":"2024-09-12T18:32:50.243540+0000","last_peered":"2024-09-12T18:32:50.243540+0000","last_clean":"2024-09-12T18:32:50.243540+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:32:50.243540+0000","last_undegraded":"2024-09-12T18:32:50.243540+0000","last_fullsized":"2024-09-12T18:32:50.243540+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:54.892800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'547","reported_seq":2157,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.118099+0000","last_change":"2024-09-12T17:35:42.885892+0000","last_active":"2024-09-12T18:31:29.118099+0000","last_peered":"2024-09-12T18:31:29.118099+0000","last_clean":"2024-09-12T18:31:29.118099+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:31:29.118099+0000","last_undegraded":"2024-09-12T18:31:29.118099+0000","last_fullsized":"2024-09-12T18:31:29.118099+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:40.576868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'359","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.964076+0000","last_change":"2024-09-12T17:35:40.890946+0000","last_active":"2024-09-12T18:33:05.964076+0000","last_peered":"2024-09-12T18:33:05.964076+0000","last_clean":"2024-09-12T18:33:05.964076+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:33:05.964076+0000","last_undegraded":"2024-09-12T18:33:05.964076+0000","last_fullsized":"2024-09-12T18:33:05.964076+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:09.696514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":50516,"num_write":1214,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.599620+0000","last_change":"2024-09-12T17:35:44.898107+0000","last_active":"2024-09-12T18:28:17.599620+0000","last_peered":"2024-09-12T18:28:17.599620+0000","last_clean":"2024-09-12T18:28:17.599620+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:28:17.599620+0000","last_undegraded":"2024-09-12T18:28:17.599620+0000","last_fullsized":"2024-09-12T18:28:17.599620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:05.181659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'103","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538945+0000","last_change":"2024-09-12T17:35:47.464849+0000","last_active":"2024-09-12T18:29:58.538945+0000","last_peered":"2024-09-12T18:29:58.538945+0000","last_clean":"2024-09-12T18:29:58.538945+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:29:58.538945+0000","last_undegraded":"2024-09-12T18:29:58.538945+0000","last_fullsized":"2024-09-12T18:29:58.538945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:58.141528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'779","reported_seq":4141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.281828+0000","last_change":"2024-09-12T17:35:48.900442+0000","last_active":"2024-09-12T18:33:03.281828+0000","last_peered":"2024-09-12T18:33:03.281828+0000","last_clean":"2024-09-12T18:33:03.281828+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:33:03.281828+0000","last_undegraded":"2024-09-12T18:33:03.281828+0000","last_fullsized":"2024-09-12T18:33:03.281828+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:15.114968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.761165+0000","last_change":"2024-09-12T17:35:50.922214+0000","last_active":"2024-09-12T18:29:46.761165+0000","last_peered":"2024-09-12T18:29:46.761165+0000","last_clean":"2024-09-12T18:29:46.761165+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:29:46.761165+0000","last_undegraded":"2024-09-12T18:29:46.761165+0000","last_fullsized":"2024-09-12T18:29:46.761165+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.526052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'765","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651768+0000","last_change":"2024-09-12T17:35:42.900581+0000","last_active":"2024-09-12T18:30:10.651768+0000","last_peered":"2024-09-12T18:30:10.651768+0000","last_clean":"2024-09-12T18:30:10.651768+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:30:10.651768+0000","last_undegraded":"2024-09-12T18:30:10.651768+0000","last_fullsized":"2024-09-12T18:30:10.651768+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:13.276710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'337","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.959263+0000","last_change":"2024-09-12T17:36:16.051163+0000","last_active":"2024-09-12T18:33:05.959263+0000","last_peered":"2024-09-12T18:33:05.959263+0000","last_clean":"2024-09-12T18:33:05.959263+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:33:05.959263+0000","last_undegraded":"2024-09-12T18:33:05.959263+0000","last_fullsized":"2024-09-12T18:33:05.959263+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:40.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":50614,"num_write":1066,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.400910+0000","last_change":"2024-09-12T17:35:44.899845+0000","last_active":"2024-09-12T18:28:17.400910+0000","last_peered":"2024-09-12T18:28:17.400910+0000","last_clean":"2024-09-12T18:28:17.400910+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:28:17.400910+0000","last_undegraded":"2024-09-12T18:28:17.400910+0000","last_fullsized":"2024-09-12T18:28:17.400910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:48.236755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'307","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.601122+0000","last_change":"2024-09-12T17:35:46.897904+0000","last_active":"2024-09-12T18:33:04.601122+0000","last_peered":"2024-09-12T18:33:04.601122+0000","last_clean":"2024-09-12T18:33:04.601122+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:33:04.601122+0000","last_undegraded":"2024-09-12T18:33:04.601122+0000","last_fullsized":"2024-09-12T18:33:04.601122+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:11.348372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44344,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":1104,"num_write":414,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839380+0000","last_change":"2024-09-12T17:35:48.900397+0000","last_active":"2024-09-12T18:29:02.839380+0000","last_peered":"2024-09-12T18:29:02.839380+0000","last_clean":"2024-09-12T18:29:02.839380+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:29:02.839380+0000","last_undegraded":"2024-09-12T18:29:02.839380+0000","last_fullsized":"2024-09-12T18:29:02.839380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:17.530372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'122","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.269926+0000","last_change":"2024-09-12T17:35:50.921023+0000","last_active":"2024-09-12T18:31:26.269926+0000","last_peered":"2024-09-12T18:31:26.269926+0000","last_clean":"2024-09-12T18:31:26.269926+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:31:26.269926+0000","last_undegraded":"2024-09-12T18:31:26.269926+0000","last_fullsized":"2024-09-12T18:31:26.269926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:23.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'393","reported_seq":1990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.977717+0000","last_change":"2024-09-12T17:35:42.899906+0000","last_active":"2024-09-12T18:30:25.977717+0000","last_peered":"2024-09-12T18:30:25.977717+0000","last_clean":"2024-09-12T18:30:25.977717+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:30:25.977717+0000","last_undegraded":"2024-09-12T18:30:25.977717+0000","last_fullsized":"2024-09-12T18:30:25.977717+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:41.974957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'346","reported_seq":984,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.974355+0000","last_change":"2024-09-12T17:35:40.902378+0000","last_active":"2024-09-12T18:33:05.974355+0000","last_peered":"2024-09-12T18:33:05.974355+0000","last_clean":"2024-09-12T18:33:05.974355+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:33:05.974355+0000","last_undegraded":"2024-09-12T18:33:05.974355+0000","last_fullsized":"2024-09-12T18:33:05.974355+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:21.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5819619,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":36012,"num_write":1062,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:17.641108+0000","last_change":"2024-09-12T17:35:44.895548+0000","last_active":"2024-09-12T18:28:17.641108+0000","last_peered":"2024-09-12T18:28:17.641108+0000","last_clean":"2024-09-12T18:28:17.641108+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:28:17.641108+0000","last_undegraded":"2024-09-12T18:28:17.641108+0000","last_fullsized":"2024-09-12T18:28:17.641108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.590737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'286","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.672602+0000","last_change":"2024-09-12T17:35:46.894996+0000","last_active":"2024-09-12T18:33:04.672602+0000","last_peered":"2024-09-12T18:33:04.672602+0000","last_clean":"2024-09-12T18:33:04.672602+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:33:04.672602+0000","last_undegraded":"2024-09-12T18:33:04.672602+0000","last_fullsized":"2024-09-12T18:33:04.672602+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:53.303510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53785,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1068,"num_write":382,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410641+0000","last_change":"2024-09-12T17:35:48.901220+0000","last_active":"2024-09-12T18:29:12.410641+0000","last_peered":"2024-09-12T18:29:12.410641+0000","last_clean":"2024-09-12T18:29:12.410641+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:29:12.410641+0000","last_undegraded":"2024-09-12T18:29:12.410641+0000","last_fullsized":"2024-09-12T18:29:12.410641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:24.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.746414+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:28.746414+0000","last_peered":"2024-09-12T18:31:28.746414+0000","last_clean":"2024-09-12T18:31:28.746414+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:28.746414+0000","last_undegraded":"2024-09-12T18:31:28.746414+0000","last_fullsized":"2024-09-12T18:31:28.746414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:21.959973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'539","reported_seq":2090,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.693922+0000","last_change":"2024-09-12T17:35:42.886124+0000","last_active":"2024-09-12T18:30:18.693922+0000","last_peered":"2024-09-12T18:30:18.693922+0000","last_clean":"2024-09-12T18:30:18.693922+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:30:18.693922+0000","last_undegraded":"2024-09-12T18:30:18.693922+0000","last_fullsized":"2024-09-12T18:30:18.693922+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'389","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.959412+0000","last_change":"2024-09-12T17:36:16.051402+0000","last_active":"2024-09-12T18:33:05.959412+0000","last_peered":"2024-09-12T18:33:05.959412+0000","last_clean":"2024-09-12T18:33:05.959412+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:33:05.959412+0000","last_undegraded":"2024-09-12T18:33:05.959412+0000","last_fullsized":"2024-09-12T18:33:05.959412+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:10.073958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":33965,"num_write":1123,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530433+0000","last_change":"2024-09-12T17:35:44.891585+0000","last_active":"2024-09-12T18:28:58.530433+0000","last_peered":"2024-09-12T18:28:58.530433+0000","last_clean":"2024-09-12T18:28:58.530433+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:28:58.530433+0000","last_undegraded":"2024-09-12T18:28:58.530433+0000","last_fullsized":"2024-09-12T18:28:58.530433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:53.135715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'270","reported_seq":824,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.969660+0000","last_change":"2024-09-12T17:35:46.899537+0000","last_active":"2024-09-12T18:33:03.969660+0000","last_peered":"2024-09-12T18:33:03.969660+0000","last_clean":"2024-09-12T18:33:03.969660+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:33:03.969660+0000","last_undegraded":"2024-09-12T18:33:03.969660+0000","last_fullsized":"2024-09-12T18:33:03.969660+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:08.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":1159,"num_write":392,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:18.525166+0000","last_change":"2024-09-12T17:35:48.902756+0000","last_active":"2024-09-12T18:28:18.525166+0000","last_peered":"2024-09-12T18:28:18.525166+0000","last_clean":"2024-09-12T18:28:18.525166+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:28:18.525166+0000","last_undegraded":"2024-09-12T18:28:18.525166+0000","last_fullsized":"2024-09-12T18:28:18.525166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:23.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'144","reported_seq":1246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.225226+0000","last_change":"2024-09-12T17:35:50.916082+0000","last_active":"2024-09-12T18:31:26.225226+0000","last_peered":"2024-09-12T18:31:26.225226+0000","last_clean":"2024-09-12T18:31:26.225226+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:31:26.225226+0000","last_undegraded":"2024-09-12T18:31:26.225226+0000","last_fullsized":"2024-09-12T18:31:26.225226+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:10.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'492","reported_seq":2047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.110427+0000","last_change":"2024-09-12T17:35:42.899320+0000","last_active":"2024-09-12T18:31:29.110427+0000","last_peered":"2024-09-12T18:31:29.110427+0000","last_clean":"2024-09-12T18:31:29.110427+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:31:29.110427+0000","last_undegraded":"2024-09-12T18:31:29.110427+0000","last_fullsized":"2024-09-12T18:31:29.110427+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:24.186327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'370","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.969814+0000","last_change":"2024-09-12T17:35:40.900130+0000","last_active":"2024-09-12T18:33:05.969814+0000","last_peered":"2024-09-12T18:33:05.969814+0000","last_clean":"2024-09-12T18:33:05.969814+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:33:05.969814+0000","last_undegraded":"2024-09-12T18:33:05.969814+0000","last_fullsized":"2024-09-12T18:33:05.969814+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:06.988604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":31832,"num_write":1234,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.605775+0000","last_change":"2024-09-12T17:35:44.893851+0000","last_active":"2024-09-12T18:29:12.605775+0000","last_peered":"2024-09-12T18:29:12.605775+0000","last_clean":"2024-09-12T18:29:12.605775+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:29:12.605775+0000","last_undegraded":"2024-09-12T18:29:12.605775+0000","last_fullsized":"2024-09-12T18:29:12.605775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:10.822361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'306","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.208511+0000","last_change":"2024-09-12T17:35:46.902681+0000","last_active":"2024-09-12T18:33:04.208511+0000","last_peered":"2024-09-12T18:33:04.208511+0000","last_clean":"2024-09-12T18:33:04.208511+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:33:04.208511+0000","last_undegraded":"2024-09-12T18:33:04.208511+0000","last_fullsized":"2024-09-12T18:33:04.208511+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:12.683935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58480,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":1106,"num_write":388,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:22.834803+0000","last_change":"2024-09-12T17:35:48.902815+0000","last_active":"2024-09-12T18:28:22.834803+0000","last_peered":"2024-09-12T18:28:22.834803+0000","last_clean":"2024-09-12T18:28:22.834803+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:28:22.834803+0000","last_undegraded":"2024-09-12T18:28:22.834803+0000","last_fullsized":"2024-09-12T18:28:22.834803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:32.377869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'125","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.358965+0000","last_change":"2024-09-12T17:35:50.912183+0000","last_active":"2024-09-12T18:32:48.358965+0000","last_peered":"2024-09-12T18:32:48.358965+0000","last_clean":"2024-09-12T18:32:48.358965+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:32:48.358965+0000","last_undegraded":"2024-09-12T18:32:48.358965+0000","last_fullsized":"2024-09-12T18:32:48.358965+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:21.503473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'468","reported_seq":2175,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610600+0000","last_change":"2024-09-12T17:35:42.897252+0000","last_active":"2024-09-12T18:29:52.610600+0000","last_peered":"2024-09-12T18:29:52.610600+0000","last_clean":"2024-09-12T18:29:52.610600+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:29:52.610600+0000","last_undegraded":"2024-09-12T18:29:52.610600+0000","last_fullsized":"2024-09-12T18:29:52.610600+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:51.073547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'394","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.950902+0000","last_change":"2024-09-12T17:35:40.900262+0000","last_active":"2024-09-12T18:33:05.950902+0000","last_peered":"2024-09-12T18:33:05.950902+0000","last_clean":"2024-09-12T18:33:05.950902+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:33:05.950902+0000","last_undegraded":"2024-09-12T18:33:05.950902+0000","last_fullsized":"2024-09-12T18:33:05.950902+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:32.115449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":20627,"num_write":1276,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'529","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.362071+0000","last_change":"2024-09-12T17:35:42.902909+0000","last_active":"2024-09-12T18:32:48.362071+0000","last_peered":"2024-09-12T18:32:48.362071+0000","last_clean":"2024-09-12T18:32:48.362071+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:32:48.362071+0000","last_undegraded":"2024-09-12T18:32:48.362071+0000","last_fullsized":"2024-09-12T18:32:48.362071+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:11.016006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'405","reported_seq":1088,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.640372+0000","last_change":"2024-09-12T17:35:40.886916+0000","last_active":"2024-09-12T18:33:05.640372+0000","last_peered":"2024-09-12T18:33:05.640372+0000","last_clean":"2024-09-12T18:33:05.640372+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:33:05.640372+0000","last_undegraded":"2024-09-12T18:33:05.640372+0000","last_fullsized":"2024-09-12T18:33:05.640372+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.356041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":58921,"num_write":1278,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'934","reported_seq":2520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.365913+0000","last_change":"2024-09-12T17:35:42.892077+0000","last_active":"2024-09-12T18:30:12.365913+0000","last_peered":"2024-09-12T18:30:12.365913+0000","last_clean":"2024-09-12T18:30:12.365913+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:30:12.365913+0000","last_undegraded":"2024-09-12T18:30:12.365913+0000","last_fullsized":"2024-09-12T18:30:12.365913+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:05.128987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'375","reported_seq":1035,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.676123+0000","last_change":"2024-09-12T17:35:40.887565+0000","last_active":"2024-09-12T18:33:05.676123+0000","last_peered":"2024-09-12T18:33:05.676123+0000","last_clean":"2024-09-12T18:33:05.676123+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:33:05.676123+0000","last_undegraded":"2024-09-12T18:33:05.676123+0000","last_fullsized":"2024-09-12T18:33:05.676123+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:10.621969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1189379,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":34034,"num_write":1140,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'760","reported_seq":2329,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.304375+0000","last_change":"2024-09-12T17:35:42.891207+0000","last_active":"2024-09-12T18:31:28.304375+0000","last_peered":"2024-09-12T18:31:28.304375+0000","last_clean":"2024-09-12T18:31:28.304375+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:31:28.304375+0000","last_undegraded":"2024-09-12T18:31:28.304375+0000","last_fullsized":"2024-09-12T18:31:28.304375+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:12.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'384","reported_seq":1016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.697149+0000","last_change":"2024-09-12T17:35:40.892755+0000","last_active":"2024-09-12T18:33:05.697149+0000","last_peered":"2024-09-12T18:33:05.697149+0000","last_clean":"2024-09-12T18:33:05.697149+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:33:05.697149+0000","last_undegraded":"2024-09-12T18:33:05.697149+0000","last_fullsized":"2024-09-12T18:33:05.697149+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.729813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":12325,"num_write":1129,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.418508+0000","last_change":"2024-09-12T17:35:42.894174+0000","last_active":"2024-09-12T18:30:07.418508+0000","last_peered":"2024-09-12T18:30:07.418508+0000","last_clean":"2024-09-12T18:30:07.418508+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:30:07.418508+0000","last_undegraded":"2024-09-12T18:30:07.418508+0000","last_fullsized":"2024-09-12T18:30:07.418508+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.648231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'389","reported_seq":1060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.952743+0000","last_change":"2024-09-12T17:36:15.950449+0000","last_active":"2024-09-12T18:33:05.952743+0000","last_peered":"2024-09-12T18:33:05.952743+0000","last_clean":"2024-09-12T18:33:05.952743+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:33:05.952743+0000","last_undegraded":"2024-09-12T18:33:05.952743+0000","last_fullsized":"2024-09-12T18:33:05.952743+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:21.732603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190223,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":50386,"num_write":1084,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'479","reported_seq":2221,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136342+0000","last_change":"2024-09-12T17:35:42.897624+0000","last_active":"2024-09-12T18:31:29.136342+0000","last_peered":"2024-09-12T18:31:29.136342+0000","last_clean":"2024-09-12T18:31:29.136342+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:31:29.136342+0000","last_undegraded":"2024-09-12T18:31:29.136342+0000","last_fullsized":"2024-09-12T18:31:29.136342+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:22.096489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'331","reported_seq":1014,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.577840+0000","last_change":"2024-09-12T17:35:40.893038+0000","last_active":"2024-09-12T18:33:05.577840+0000","last_peered":"2024-09-12T18:33:05.577840+0000","last_clean":"2024-09-12T18:33:05.577840+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:33:05.577840+0000","last_undegraded":"2024-09-12T18:33:05.577840+0000","last_fullsized":"2024-09-12T18:33:05.577840+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:11.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":699027,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":70299,"num_write":1012,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'478","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699290+0000","last_change":"2024-09-12T17:35:42.891672+0000","last_active":"2024-09-12T18:30:18.699290+0000","last_peered":"2024-09-12T18:30:18.699290+0000","last_clean":"2024-09-12T18:30:18.699290+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:30:18.699290+0000","last_undegraded":"2024-09-12T18:30:18.699290+0000","last_fullsized":"2024-09-12T18:30:18.699290+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:22.565304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'341","reported_seq":985,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.624213+0000","last_change":"2024-09-12T17:35:40.902619+0000","last_active":"2024-09-12T18:33:05.624213+0000","last_peered":"2024-09-12T18:33:05.624213+0000","last_clean":"2024-09-12T18:33:05.624213+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:33:05.624213+0000","last_undegraded":"2024-09-12T18:33:05.624213+0000","last_fullsized":"2024-09-12T18:33:05.624213+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:31.350419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1407190,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":51065,"num_write":1119,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'540","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.375708+0000","last_change":"2024-09-12T17:35:42.897448+0000","last_active":"2024-09-12T18:32:48.375708+0000","last_peered":"2024-09-12T18:32:48.375708+0000","last_clean":"2024-09-12T18:32:48.375708+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:32:48.375708+0000","last_undegraded":"2024-09-12T18:32:48.375708+0000","last_fullsized":"2024-09-12T18:32:48.375708+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.748388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'284","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.696706+0000","last_change":"2024-09-12T17:35:40.883103+0000","last_active":"2024-09-12T18:33:05.696706+0000","last_peered":"2024-09-12T18:33:05.696706+0000","last_clean":"2024-09-12T18:33:05.696706+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:33:05.696706+0000","last_undegraded":"2024-09-12T18:33:05.696706+0000","last_fullsized":"2024-09-12T18:33:05.696706+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.291106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511862,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":37901,"num_write":823,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'583","reported_seq":2406,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.651201+0000","last_change":"2024-09-12T17:35:42.902435+0000","last_active":"2024-09-12T18:30:10.651201+0000","last_peered":"2024-09-12T18:30:10.651201+0000","last_clean":"2024-09-12T18:30:10.651201+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:30:10.651201+0000","last_undegraded":"2024-09-12T18:30:10.651201+0000","last_fullsized":"2024-09-12T18:30:10.651201+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.291333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'376","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.592722+0000","last_change":"2024-09-12T17:35:40.904096+0000","last_active":"2024-09-12T18:33:05.592722+0000","last_peered":"2024-09-12T18:33:05.592722+0000","last_clean":"2024-09-12T18:33:05.592722+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:33:05.592722+0000","last_undegraded":"2024-09-12T18:33:05.592722+0000","last_fullsized":"2024-09-12T18:33:05.592722+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":34152,"num_write":1143,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1179","reported_seq":2808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.698955+0000","last_change":"2024-09-12T17:35:42.893016+0000","last_active":"2024-09-12T18:30:18.698955+0000","last_peered":"2024-09-12T18:30:18.698955+0000","last_clean":"2024-09-12T18:30:18.698955+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:30:18.698955+0000","last_undegraded":"2024-09-12T18:30:18.698955+0000","last_fullsized":"2024-09-12T18:30:18.698955+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:15.472517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'384","reported_seq":1086,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.570680+0000","last_change":"2024-09-12T17:35:40.881782+0000","last_active":"2024-09-12T18:33:05.570680+0000","last_peered":"2024-09-12T18:33:05.570680+0000","last_clean":"2024-09-12T18:33:05.570680+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:33:05.570680+0000","last_undegraded":"2024-09-12T18:33:05.570680+0000","last_fullsized":"2024-09-12T18:33:05.570680+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:38.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":17939,"num_write":1185,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'779","reported_seq":2264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:04.527379+0000","last_change":"2024-09-12T17:35:42.898127+0000","last_active":"2024-09-12T18:30:04.527379+0000","last_peered":"2024-09-12T18:30:04.527379+0000","last_clean":"2024-09-12T18:30:04.527379+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:30:04.527379+0000","last_undegraded":"2024-09-12T18:30:04.527379+0000","last_fullsized":"2024-09-12T18:30:04.527379+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.391709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'498","reported_seq":1211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.628048+0000","last_change":"2024-09-12T17:36:16.042288+0000","last_active":"2024-09-12T18:33:05.628048+0000","last_peered":"2024-09-12T18:33:05.628048+0000","last_clean":"2024-09-12T18:33:05.628048+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:33:05.628048+0000","last_undegraded":"2024-09-12T18:33:05.628048+0000","last_fullsized":"2024-09-12T18:33:05.628048+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.423582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355583,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":996,"num_read_kb":22424,"num_write":1615,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'507","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.363476+0000","last_change":"2024-09-12T17:35:42.901620+0000","last_active":"2024-09-12T18:32:48.363476+0000","last_peered":"2024-09-12T18:32:48.363476+0000","last_clean":"2024-09-12T18:32:48.363476+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:32:48.363476+0000","last_undegraded":"2024-09-12T18:32:48.363476+0000","last_fullsized":"2024-09-12T18:32:48.363476+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:37.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'323","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.950641+0000","last_change":"2024-09-12T17:35:40.893566+0000","last_active":"2024-09-12T18:33:05.950641+0000","last_peered":"2024-09-12T18:33:05.950641+0000","last_clean":"2024-09-12T18:33:05.950641+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:33:05.950641+0000","last_undegraded":"2024-09-12T18:33:05.950641+0000","last_fullsized":"2024-09-12T18:33:05.950641+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:53.347084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270110,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":8170,"num_write":997,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'783","reported_seq":2222,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.548109+0000","last_change":"2024-09-12T17:35:42.897318+0000","last_active":"2024-09-12T18:29:58.548109+0000","last_peered":"2024-09-12T18:29:58.548109+0000","last_clean":"2024-09-12T18:29:58.548109+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:29:58.548109+0000","last_undegraded":"2024-09-12T18:29:58.548109+0000","last_fullsized":"2024-09-12T18:29:58.548109+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:59.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'333","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.964638+0000","last_change":"2024-09-12T17:35:40.894257+0000","last_active":"2024-09-12T18:33:05.964638+0000","last_peered":"2024-09-12T18:33:05.964638+0000","last_clean":"2024-09-12T18:33:05.964638+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:33:05.964638+0000","last_undegraded":"2024-09-12T18:33:05.964638+0000","last_fullsized":"2024-09-12T18:33:05.964638+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:16.285766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652723,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":483,"num_read_kb":27896,"num_write":1098,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'568","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.439691+0000","last_change":"2024-09-12T17:35:42.900094+0000","last_active":"2024-09-12T18:30:15.439691+0000","last_peered":"2024-09-12T18:30:15.439691+0000","last_clean":"2024-09-12T18:30:15.439691+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:30:15.439691+0000","last_undegraded":"2024-09-12T18:30:15.439691+0000","last_fullsized":"2024-09-12T18:30:15.439691+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.607330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'290","reported_seq":900,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.949978+0000","last_change":"2024-09-12T17:35:40.886954+0000","last_active":"2024-09-12T18:33:05.949978+0000","last_peered":"2024-09-12T18:33:05.949978+0000","last_clean":"2024-09-12T18:33:05.949978+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:33:05.949978+0000","last_undegraded":"2024-09-12T18:33:05.949978+0000","last_fullsized":"2024-09-12T18:33:05.949978+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:46.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":4469,"num_write":888,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'520","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.654360+0000","last_change":"2024-09-12T17:35:42.895055+0000","last_active":"2024-09-12T18:30:10.654360+0000","last_peered":"2024-09-12T18:30:10.654360+0000","last_clean":"2024-09-12T18:30:10.654360+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:30:10.654360+0000","last_undegraded":"2024-09-12T18:30:10.654360+0000","last_fullsized":"2024-09-12T18:30:10.654360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:39.969384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'317","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.716195+0000","last_change":"2024-09-12T17:35:40.894178+0000","last_active":"2024-09-12T18:33:05.716195+0000","last_peered":"2024-09-12T18:33:05.716195+0000","last_clean":"2024-09-12T18:33:05.716195+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:33:05.716195+0000","last_undegraded":"2024-09-12T18:33:05.716195+0000","last_fullsized":"2024-09-12T18:33:05.716195+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:59.754829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":27660,"num_write":1072,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'391","reported_seq":1866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.567235+0000","last_change":"2024-09-12T17:36:15.950421+0000","last_active":"2024-09-12T18:30:07.567235+0000","last_peered":"2024-09-12T18:30:07.567235+0000","last_clean":"2024-09-12T18:30:07.567235+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:30:07.567235+0000","last_undegraded":"2024-09-12T18:30:07.567235+0000","last_fullsized":"2024-09-12T18:30:07.567235+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:25.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'345","reported_seq":981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.712288+0000","last_change":"2024-09-12T17:35:40.885615+0000","last_active":"2024-09-12T18:33:05.712288+0000","last_peered":"2024-09-12T18:33:05.712288+0000","last_clean":"2024-09-12T18:33:05.712288+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:33:05.712288+0000","last_undegraded":"2024-09-12T18:33:05.712288+0000","last_fullsized":"2024-09-12T18:33:05.712288+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.664147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":34548,"num_write":1063,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'376","reported_seq":1025,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.724319+0000","last_change":"2024-09-12T17:35:40.892904+0000","last_active":"2024-09-12T18:33:05.724319+0000","last_peered":"2024-09-12T18:33:05.724319+0000","last_clean":"2024-09-12T18:33:05.724319+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:33:05.724319+0000","last_undegraded":"2024-09-12T18:33:05.724319+0000","last_fullsized":"2024-09-12T18:33:05.724319+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:46.084095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052945,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":6964,"num_write":1129,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1470","reported_seq":2919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.368989+0000","last_change":"2024-09-12T17:35:42.902453+0000","last_active":"2024-09-12T18:32:48.368989+0000","last_peered":"2024-09-12T18:32:48.368989+0000","last_clean":"2024-09-12T18:32:48.368989+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:32:48.368989+0000","last_undegraded":"2024-09-12T18:32:48.368989+0000","last_fullsized":"2024-09-12T18:32:48.368989+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:29.174028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'298","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.482215+0000","last_change":"2024-09-12T17:35:40.893486+0000","last_active":"2024-09-12T18:33:05.482215+0000","last_peered":"2024-09-12T18:33:05.482215+0000","last_clean":"2024-09-12T18:33:05.482215+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:33:05.482215+0000","last_undegraded":"2024-09-12T18:33:05.482215+0000","last_fullsized":"2024-09-12T18:33:05.482215+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:39.855714+0000","last_clean_scrub_stamp":"2024-09-12T17:35:39.855714+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.422582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":8217,"num_write":971,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1011","reported_seq":2978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.115606+0000","last_change":"2024-09-12T17:35:42.894495+0000","last_active":"2024-09-12T18:31:29.115606+0000","last_peered":"2024-09-12T18:31:29.115606+0000","last_clean":"2024-09-12T18:31:29.115606+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:31:29.115606+0000","last_undegraded":"2024-09-12T18:31:29.115606+0000","last_fullsized":"2024-09-12T18:31:29.115606+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:16.817173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1571818,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17916,"num_read_kb":37265,"num_write":15035,"num_write_kb":11780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2041,"ondisk_log_size":2041,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":68589489,"num_objects":377,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":36438,"num_read_kb":2030723,"num_write":72188,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93863936,"data_stored":93863936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":184607,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":188613,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575545,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144872,"kb_used_data":15128,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226968,"statfs":{"total":96636764160,"available":96488415232,"internally_reserved":0,"allocated":15491072,"data_stored":13570247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575545,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333592,"kb_used_data":13556,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038248,"statfs":{"total":96636764160,"available":96295165952,"internally_reserved":0,"allocated":13881344,"data_stored":11918715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575544,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310448,"kb_used_data":18096,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94061392,"statfs":{"total":96636764160,"available":96318865408,"internally_reserved":0,"allocated":18530304,"data_stored":16608104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575546,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185140,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94186700,"statfs":{"total":96636764160,"available":96447180800,"internally_reserved":0,"allocated":19529728,"data_stored":17538028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575544,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293500,"kb_used_data":13664,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94078340,"statfs":{"total":96636764160,"available":96336220160,"internally_reserved":0,"allocated":13991936,"data_stored":12011933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575546,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123972,"kb_used_data":12136,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94247868,"statfs":{"total":96636764160,"available":96509816832,"internally_reserved":0,"allocated":12427264,"data_stored":10520336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575544,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192256,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94179584,"statfs":{"total":96636764160,"available":96439894016,"internally_reserved":0,"allocated":16822272,"data_stored":14877078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575547,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292104,"kb_used_data":17664,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94079736,"statfs":{"total":96636764160,"available":96337649664,"internally_reserved":0,"allocated":18087936,"data_stored":16087657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13234176,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12615680,"data_stored":12615680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":8261632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11309056,"data_stored":11309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15278080,"data_stored":15278080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14348288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9068544,"data_stored":9068544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:12.852 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.852 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.852 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.853 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.854 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.855 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.856 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.857 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.858 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.859 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.860 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.861 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.862 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.863 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.864 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.865 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.866 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.867 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.868 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.869 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.870 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.871 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.872 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.873 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.874 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.875 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.876 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.877 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:35:22.677132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.878 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.879 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.880 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.881 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.882 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:35:28.693162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.883 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.884 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.885 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.886 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.887 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.888 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.889 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.890 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.891 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.892 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.893 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.894 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:35:39.855714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.895 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:12.896 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:33:32.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:33.247 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:33.249 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1999,"stamp":"2024-09-12T18:33:31.573257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70768882,"num_objects":845,"num_object_clones":0,"num_object_copies":2444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":845,"num_whiteouts":0,"num_read":292045,"num_read_kb":2658521,"num_write":161680,"num_write_kb":2423567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40116,"num_omap_keys":161,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13774,"ondisk_log_size":13774,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1882736,"kb_used_data":125744,"kb_used_omap":12,"kb_used_meta":1756851,"kb_avail":753091984,"statfs":{"total":773094113280,"available":771166191616,"internally_reserved":0,"allocated":128761856,"data_stored":113132098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1799015984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37644,"num_omap_keys":151,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005488"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.645460+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:28:47.645460+0000","last_peered":"2024-09-12T18:28:47.645460+0000","last_clean":"2024-09-12T18:28:47.645460+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:28:47.645460+0000","last_undegraded":"2024-09-12T18:28:47.645460+0000","last_fullsized":"2024-09-12T18:28:47.645460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.750454+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:33:04.750454+0000","last_peered":"2024-09-12T18:33:04.750454+0000","last_clean":"2024-09-12T18:33:04.750454+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:33:04.750454+0000","last_undegraded":"2024-09-12T18:33:04.750454+0000","last_fullsized":"2024-09-12T18:33:04.750454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.446816+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:33:05.446816+0000","last_peered":"2024-09-12T18:33:05.446816+0000","last_clean":"2024-09-12T18:33:05.446816+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:33:05.446816+0000","last_undegraded":"2024-09-12T18:33:05.446816+0000","last_fullsized":"2024-09-12T18:33:05.446816+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.503031+0000","last_change":"2024-09-12T18:08:44.184390+0000","last_active":"2024-09-12T18:28:47.503031+0000","last_peered":"2024-09-12T18:28:47.503031+0000","last_clean":"2024-09-12T18:28:47.503031+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:28:47.503031+0000","last_undegraded":"2024-09-12T18:28:47.503031+0000","last_fullsized":"2024-09-12T18:28:47.503031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:51.778841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546353+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:30:48.546353+0000","last_peered":"2024-09-12T18:30:48.546353+0000","last_clean":"2024-09-12T18:30:48.546353+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:30:48.546353+0000","last_undegraded":"2024-09-12T18:30:48.546353+0000","last_fullsized":"2024-09-12T18:30:48.546353+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'2","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.291093+0000","last_change":"2024-09-12T17:53:12.148575+0000","last_active":"2024-09-12T18:33:04.291093+0000","last_peered":"2024-09-12T18:33:04.291093+0000","last_clean":"2024-09-12T18:33:04.291093+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:33:04.291093+0000","last_undegraded":"2024-09-12T18:33:04.291093+0000","last_fullsized":"2024-09-12T18:33:04.291093+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514184+0000","last_change":"2024-09-12T17:50:14.836684+0000","last_active":"2024-09-12T18:30:27.514184+0000","last_peered":"2024-09-12T18:30:27.514184+0000","last_clean":"2024-09-12T18:30:27.514184+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:30:27.514184+0000","last_undegraded":"2024-09-12T18:30:27.514184+0000","last_fullsized":"2024-09-12T18:30:27.514184+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:16.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.425027+0000","last_change":"2024-09-12T18:08:44.178158+0000","last_active":"2024-09-12T18:30:32.425027+0000","last_peered":"2024-09-12T18:30:32.425027+0000","last_clean":"2024-09-12T18:30:32.425027+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:30:32.425027+0000","last_undegraded":"2024-09-12T18:30:32.425027+0000","last_fullsized":"2024-09-12T18:30:32.425027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:48.796260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:52.868027+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:32:52.868027+0000","last_peered":"2024-09-12T18:32:52.868027+0000","last_clean":"2024-09-12T18:32:52.868027+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:32:52.868027+0000","last_undegraded":"2024-09-12T18:32:52.868027+0000","last_fullsized":"2024-09-12T18:32:52.868027+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.519773+0000","last_change":"2024-09-12T17:53:12.146240+0000","last_active":"2024-09-12T18:31:22.519773+0000","last_peered":"2024-09-12T18:31:22.519773+0000","last_clean":"2024-09-12T18:31:22.519773+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:31:22.519773+0000","last_undegraded":"2024-09-12T18:31:22.519773+0000","last_fullsized":"2024-09-12T18:31:22.519773+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.848535+0000","last_change":"2024-09-12T17:50:14.830812+0000","last_active":"2024-09-12T18:30:17.848535+0000","last_peered":"2024-09-12T18:30:17.848535+0000","last_clean":"2024-09-12T18:30:17.848535+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:30:17.848535+0000","last_undegraded":"2024-09-12T18:30:17.848535+0000","last_fullsized":"2024-09-12T18:30:17.848535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:04.011300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'7","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.603990+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:33:05.603990+0000","last_peered":"2024-09-12T18:33:05.603990+0000","last_clean":"2024-09-12T18:33:05.603990+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:33:05.603990+0000","last_undegraded":"2024-09-12T18:33:05.603990+0000","last_fullsized":"2024-09-12T18:33:05.603990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2101,"num_write":12,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.563840+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:32:48.563840+0000","last_peered":"2024-09-12T18:32:48.563840+0000","last_clean":"2024-09-12T18:32:48.563840+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:32:48.563840+0000","last_undegraded":"2024-09-12T18:32:48.563840+0000","last_fullsized":"2024-09-12T18:32:48.563840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674609+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:32:02.674609+0000","last_peered":"2024-09-12T18:32:02.674609+0000","last_clean":"2024-09-12T18:32:02.674609+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:32:02.674609+0000","last_undegraded":"2024-09-12T18:32:02.674609+0000","last_fullsized":"2024-09-12T18:32:02.674609+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'7","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.859981+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:31:52.859981+0000","last_peered":"2024-09-12T18:31:52.859981+0000","last_clean":"2024-09-12T18:31:52.859981+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:31:52.859981+0000","last_undegraded":"2024-09-12T18:31:52.859981+0000","last_fullsized":"2024-09-12T18:31:52.859981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4114,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.608852+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:29:37.608852+0000","last_peered":"2024-09-12T18:29:37.608852+0000","last_clean":"2024-09-12T18:29:37.608852+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:29:37.608852+0000","last_undegraded":"2024-09-12T18:29:37.608852+0000","last_fullsized":"2024-09-12T18:29:37.608852+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.447117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'11","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.054093+0000","last_change":"2024-09-12T17:53:15.163967+0000","last_active":"2024-09-12T18:33:04.054093+0000","last_peered":"2024-09-12T18:33:04.054093+0000","last_clean":"2024-09-12T18:33:04.054093+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:33:04.054093+0000","last_undegraded":"2024-09-12T18:33:04.054093+0000","last_fullsized":"2024-09-12T18:33:04.054093+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:21.391926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16462,"num_write":16,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'9","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:03.557382+0000","last_change":"2024-09-12T17:53:12.139099+0000","last_active":"2024-09-12T18:32:03.557382+0000","last_peered":"2024-09-12T18:32:03.557382+0000","last_clean":"2024-09-12T18:32:03.557382+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:32:03.557382+0000","last_undegraded":"2024-09-12T18:32:03.557382+0000","last_fullsized":"2024-09-12T18:32:03.557382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:32.128312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13304,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.422211+0000","last_change":"2024-09-12T17:50:14.842952+0000","last_active":"2024-09-12T18:30:17.422211+0000","last_peered":"2024-09-12T18:30:17.422211+0000","last_clean":"2024-09-12T18:30:17.422211+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:30:17.422211+0000","last_undegraded":"2024-09-12T18:30:17.422211+0000","last_fullsized":"2024-09-12T18:30:17.422211+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:31.774447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406069+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:28:47.406069+0000","last_peered":"2024-09-12T18:28:47.406069+0000","last_clean":"2024-09-12T18:28:47.406069+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:28:47.406069+0000","last_undegraded":"2024-09-12T18:28:47.406069+0000","last_fullsized":"2024-09-12T18:28:47.406069+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:26.401744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.375227+0000","last_change":"2024-09-12T17:53:15.159424+0000","last_active":"2024-09-12T18:33:05.375227+0000","last_peered":"2024-09-12T18:33:05.375227+0000","last_clean":"2024-09-12T18:33:05.375227+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:33:05.375227+0000","last_undegraded":"2024-09-12T18:33:05.375227+0000","last_fullsized":"2024-09-12T18:33:05.375227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6178,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:43.545479+0000","last_change":"2024-09-12T17:53:12.146586+0000","last_active":"2024-09-12T18:30:43.545479+0000","last_peered":"2024-09-12T18:30:43.545479+0000","last_clean":"2024-09-12T18:30:43.545479+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:30:43.545479+0000","last_undegraded":"2024-09-12T18:30:43.545479+0000","last_fullsized":"2024-09-12T18:30:43.545479+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839397+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:29:02.839397+0000","last_peered":"2024-09-12T18:29:02.839397+0000","last_clean":"2024-09-12T18:29:02.839397+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:29:02.839397+0000","last_undegraded":"2024-09-12T18:29:02.839397+0000","last_fullsized":"2024-09-12T18:29:02.839397+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:50.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:47.406134+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:28:47.406134+0000","last_peered":"2024-09-12T18:28:47.406134+0000","last_clean":"2024-09-12T18:28:47.406134+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:28:47.406134+0000","last_undegraded":"2024-09-12T18:28:47.406134+0000","last_fullsized":"2024-09-12T18:28:47.406134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:07.255733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.423657+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:30:47.423657+0000","last_peered":"2024-09-12T18:30:47.423657+0000","last_clean":"2024-09-12T18:30:47.423657+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:30:47.423657+0000","last_undegraded":"2024-09-12T18:30:47.423657+0000","last_fullsized":"2024-09-12T18:30:47.423657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'8","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.939041+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:33:05.939041+0000","last_peered":"2024-09-12T18:33:05.939041+0000","last_clean":"2024-09-12T18:33:05.939041+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:33:05.939041+0000","last_undegraded":"2024-09-12T18:33:05.939041+0000","last_fullsized":"2024-09-12T18:33:05.939041+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15356,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.604077+0000","last_change":"2024-09-12T17:50:14.841323+0000","last_active":"2024-09-12T18:28:57.604077+0000","last_peered":"2024-09-12T18:28:57.604077+0000","last_clean":"2024-09-12T18:28:57.604077+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:28:57.604077+0000","last_undegraded":"2024-09-12T18:28:57.604077+0000","last_fullsized":"2024-09-12T18:28:57.604077+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:41.858948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.609892+0000","last_change":"2024-09-12T18:08:44.184970+0000","last_active":"2024-09-12T18:29:47.609892+0000","last_peered":"2024-09-12T18:29:47.609892+0000","last_clean":"2024-09-12T18:29:47.609892+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:29:47.609892+0000","last_undegraded":"2024-09-12T18:29:47.609892+0000","last_fullsized":"2024-09-12T18:29:47.609892+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:13.461628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433041+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:31:57.433041+0000","last_peered":"2024-09-12T18:31:57.433041+0000","last_clean":"2024-09-12T18:31:57.433041+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:31:57.433041+0000","last_undegraded":"2024-09-12T18:31:57.433041+0000","last_fullsized":"2024-09-12T18:31:57.433041+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.661852+0000","last_change":"2024-09-12T17:53:12.143997+0000","last_active":"2024-09-12T18:30:37.661852+0000","last_peered":"2024-09-12T18:30:37.661852+0000","last_clean":"2024-09-12T18:30:37.661852+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:30:37.661852+0000","last_undegraded":"2024-09-12T18:30:37.661852+0000","last_fullsized":"2024-09-12T18:30:37.661852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:11.692360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":103,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.838922+0000","last_change":"2024-09-12T17:50:14.839525+0000","last_active":"2024-09-12T18:28:57.838922+0000","last_peered":"2024-09-12T18:28:57.838922+0000","last_clean":"2024-09-12T18:28:57.838922+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:28:57.838922+0000","last_undegraded":"2024-09-12T18:28:57.838922+0000","last_fullsized":"2024-09-12T18:28:57.838922+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:08.454207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.509504+0000","last_change":"2024-09-12T18:08:44.184023+0000","last_active":"2024-09-12T18:29:47.509504+0000","last_peered":"2024-09-12T18:29:47.509504+0000","last_clean":"2024-09-12T18:29:47.509504+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:29:47.509504+0000","last_undegraded":"2024-09-12T18:29:47.509504+0000","last_fullsized":"2024-09-12T18:29:47.509504+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.820279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.561269+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:33:03.561269+0000","last_peered":"2024-09-12T18:33:03.561269+0000","last_clean":"2024-09-12T18:33:03.561269+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:33:03.561269+0000","last_undegraded":"2024-09-12T18:33:03.561269+0000","last_fullsized":"2024-09-12T18:33:03.561269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409647+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:28:57.409647+0000","last_peered":"2024-09-12T18:28:57.409647+0000","last_clean":"2024-09-12T18:28:57.409647+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:28:57.409647+0000","last_undegraded":"2024-09-12T18:28:57.409647+0000","last_fullsized":"2024-09-12T18:28:57.409647+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:39.923261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'7","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433088+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:31:57.433088+0000","last_peered":"2024-09-12T18:31:57.433088+0000","last_clean":"2024-09-12T18:31:57.433088+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:31:57.433088+0000","last_undegraded":"2024-09-12T18:31:57.433088+0000","last_fullsized":"2024-09-12T18:31:57.433088+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20478,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.523626+0000","last_change":"2024-09-12T17:53:12.144615+0000","last_active":"2024-09-12T18:31:52.523626+0000","last_peered":"2024-09-12T18:31:52.523626+0000","last_clean":"2024-09-12T18:31:52.523626+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:31:52.523626+0000","last_undegraded":"2024-09-12T18:31:52.523626+0000","last_fullsized":"2024-09-12T18:31:52.523626+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:01.824724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4132,"num_write":4,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.504229+0000","last_change":"2024-09-12T17:50:14.845069+0000","last_active":"2024-09-12T18:28:57.504229+0000","last_peered":"2024-09-12T18:28:57.504229+0000","last_clean":"2024-09-12T18:28:57.504229+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:28:57.504229+0000","last_undegraded":"2024-09-12T18:28:57.504229+0000","last_fullsized":"2024-09-12T18:28:57.504229+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:11.099086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'68","reported_seq":308,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420555+0000","last_change":"2024-09-12T17:50:14.842178+0000","last_active":"2024-09-12T18:30:07.420555+0000","last_peered":"2024-09-12T18:30:07.420555+0000","last_clean":"2024-09-12T18:30:07.420555+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:30:07.420555+0000","last_undegraded":"2024-09-12T18:30:07.420555+0000","last_fullsized":"2024-09-12T18:30:07.420555+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:23.280624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615983+0000","last_change":"2024-09-12T17:53:15.160000+0000","last_active":"2024-09-12T18:30:37.615983+0000","last_peered":"2024-09-12T18:30:37.615983+0000","last_clean":"2024-09-12T18:30:37.615983+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:30:37.615983+0000","last_undegraded":"2024-09-12T18:30:37.615983+0000","last_fullsized":"2024-09-12T18:30:37.615983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:16.584362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:33.544028+0000","last_change":"2024-09-12T17:53:12.138225+0000","last_active":"2024-09-12T18:30:33.544028+0000","last_peered":"2024-09-12T18:30:33.544028+0000","last_clean":"2024-09-12T18:30:33.544028+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:30:33.544028+0000","last_undegraded":"2024-09-12T18:30:33.544028+0000","last_fullsized":"2024-09-12T18:30:33.544028+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":298,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418863+0000","last_change":"2024-09-12T17:50:14.839535+0000","last_active":"2024-09-12T18:29:57.418863+0000","last_peered":"2024-09-12T18:29:57.418863+0000","last_clean":"2024-09-12T18:29:57.418863+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:29:57.418863+0000","last_undegraded":"2024-09-12T18:29:57.418863+0000","last_fullsized":"2024-09-12T18:29:57.418863+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:47.803289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.615945+0000","last_change":"2024-09-12T17:53:15.161893+0000","last_active":"2024-09-12T18:30:37.615945+0000","last_peered":"2024-09-12T18:30:37.615945+0000","last_clean":"2024-09-12T18:30:37.615945+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:30:37.615945+0000","last_undegraded":"2024-09-12T18:30:37.615945+0000","last_fullsized":"2024-09-12T18:30:37.615945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:04.296609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.134151+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:33:04.134151+0000","last_peered":"2024-09-12T18:33:04.134151+0000","last_clean":"2024-09-12T18:33:04.134151+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:33:04.134151+0000","last_undegraded":"2024-09-12T18:33:04.134151+0000","last_fullsized":"2024-09-12T18:33:04.134151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846075+0000","last_change":"2024-09-12T17:50:14.840630+0000","last_active":"2024-09-12T18:29:57.846075+0000","last_peered":"2024-09-12T18:29:57.846075+0000","last_clean":"2024-09-12T18:29:57.846075+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:29:57.846075+0000","last_undegraded":"2024-09-12T18:29:57.846075+0000","last_fullsized":"2024-09-12T18:29:57.846075+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.197122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:57.441586+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:32:57.441586+0000","last_peered":"2024-09-12T18:32:57.441586+0000","last_clean":"2024-09-12T18:32:57.441586+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:32:57.441586+0000","last_undegraded":"2024-09-12T18:32:57.441586+0000","last_fullsized":"2024-09-12T18:32:57.441586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'6","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:52.450627+0000","last_change":"2024-09-12T17:53:12.148814+0000","last_active":"2024-09-12T18:32:52.450627+0000","last_peered":"2024-09-12T18:32:52.450627+0000","last_clean":"2024-09-12T18:32:52.450627+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:32:52.450627+0000","last_undegraded":"2024-09-12T18:32:52.450627+0000","last_fullsized":"2024-09-12T18:32:52.450627+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:08.076954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16370,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538860+0000","last_change":"2024-09-12T17:50:14.841498+0000","last_active":"2024-09-12T18:29:58.538860+0000","last_peered":"2024-09-12T18:29:58.538860+0000","last_clean":"2024-09-12T18:29:58.538860+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:29:58.538860+0000","last_undegraded":"2024-09-12T18:29:58.538860+0000","last_fullsized":"2024-09-12T18:29:58.538860+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.140268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.426002+0000","last_change":"2024-09-12T17:53:15.158874+0000","last_active":"2024-09-12T18:30:37.426002+0000","last_peered":"2024-09-12T18:30:37.426002+0000","last_clean":"2024-09-12T18:30:37.426002+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:30:37.426002+0000","last_undegraded":"2024-09-12T18:30:37.426002+0000","last_fullsized":"2024-09-12T18:30:37.426002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:50.215733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.651959+0000","last_change":"2024-09-12T17:53:12.146649+0000","last_active":"2024-09-12T18:33:03.651959+0000","last_peered":"2024-09-12T18:33:03.651959+0000","last_clean":"2024-09-12T18:33:03.651959+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:33:03.651959+0000","last_undegraded":"2024-09-12T18:33:03.651959+0000","last_fullsized":"2024-09-12T18:33:03.651959+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:57.575965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.515181+0000","last_change":"2024-09-12T18:08:44.180436+0000","last_active":"2024-09-12T18:30:37.515181+0000","last_peered":"2024-09-12T18:30:37.515181+0000","last_clean":"2024-09-12T18:30:37.515181+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:30:37.515181+0000","last_undegraded":"2024-09-12T18:30:37.515181+0000","last_fullsized":"2024-09-12T18:30:37.515181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:14.400883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'7","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.441583+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:33:04.441583+0000","last_peered":"2024-09-12T18:33:04.441583+0000","last_clean":"2024-09-12T18:33:04.441583+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:33:04.441583+0000","last_undegraded":"2024-09-12T18:33:04.441583+0000","last_fullsized":"2024-09-12T18:33:04.441583+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:02.994171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.435261+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:31:27.435261+0000","last_peered":"2024-09-12T18:31:27.435261+0000","last_clean":"2024-09-12T18:31:27.435261+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:31:27.435261+0000","last_undegraded":"2024-09-12T18:31:27.435261+0000","last_fullsized":"2024-09-12T18:31:27.435261+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:44.516117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:02.425494+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:31:02.425494+0000","last_peered":"2024-09-12T18:31:02.425494+0000","last_clean":"2024-09-12T18:31:02.425494+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:31:02.425494+0000","last_undegraded":"2024-09-12T18:31:02.425494+0000","last_fullsized":"2024-09-12T18:31:02.425494+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408851+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:29:02.408851+0000","last_peered":"2024-09-12T18:29:02.408851+0000","last_clean":"2024-09-12T18:29:02.408851+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:29:02.408851+0000","last_undegraded":"2024-09-12T18:29:02.408851+0000","last_fullsized":"2024-09-12T18:29:02.408851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:26.810924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412214+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:29:17.412214+0000","last_peered":"2024-09-12T18:29:17.412214+0000","last_clean":"2024-09-12T18:29:17.412214+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:29:17.412214+0000","last_undegraded":"2024-09-12T18:29:17.412214+0000","last_fullsized":"2024-09-12T18:29:17.412214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.836700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.520279+0000","last_change":"2024-09-12T17:53:12.143791+0000","last_active":"2024-09-12T18:31:27.520279+0000","last_peered":"2024-09-12T18:31:27.520279+0000","last_clean":"2024-09-12T18:31:27.520279+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:31:27.520279+0000","last_undegraded":"2024-09-12T18:31:27.520279+0000","last_fullsized":"2024-09-12T18:31:27.520279+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:50.203716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7180,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663487+0000","last_change":"2024-09-12T17:50:14.842898+0000","last_active":"2024-09-12T18:30:47.663487+0000","last_peered":"2024-09-12T18:30:47.663487+0000","last_clean":"2024-09-12T18:30:47.663487+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:30:47.663487+0000","last_undegraded":"2024-09-12T18:30:47.663487+0000","last_fullsized":"2024-09-12T18:30:47.663487+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:36.700805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424139+0000","last_change":"2024-09-12T18:08:44.182811+0000","last_active":"2024-09-12T18:30:27.424139+0000","last_peered":"2024-09-12T18:30:27.424139+0000","last_clean":"2024-09-12T18:30:27.424139+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:30:27.424139+0000","last_undegraded":"2024-09-12T18:30:27.424139+0000","last_fullsized":"2024-09-12T18:30:27.424139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.055368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.624296+0000","last_change":"2024-09-12T17:53:15.162967+0000","last_active":"2024-09-12T18:31:42.624296+0000","last_peered":"2024-09-12T18:31:42.624296+0000","last_clean":"2024-09-12T18:31:42.624296+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:31:42.624296+0000","last_undegraded":"2024-09-12T18:31:42.624296+0000","last_fullsized":"2024-09-12T18:31:42.624296+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:00.026005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8190,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.856483+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:31:27.856483+0000","last_peered":"2024-09-12T18:31:27.856483+0000","last_clean":"2024-09-12T18:31:27.856483+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:31:27.856483+0000","last_undegraded":"2024-09-12T18:31:27.856483+0000","last_fullsized":"2024-09-12T18:31:27.856483+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:33.879161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":12,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427976+0000","last_change":"2024-09-12T17:50:14.845493+0000","last_active":"2024-09-12T18:30:47.427976+0000","last_peered":"2024-09-12T18:30:47.427976+0000","last_clean":"2024-09-12T18:30:47.427976+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:30:47.427976+0000","last_undegraded":"2024-09-12T18:30:47.427976+0000","last_fullsized":"2024-09-12T18:30:47.427976+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:34.662412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:32.429503+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:31:32.429503+0000","last_peered":"2024-09-12T18:31:32.429503+0000","last_clean":"2024-09-12T18:31:32.429503+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:31:32.429503+0000","last_undegraded":"2024-09-12T18:31:32.429503+0000","last_fullsized":"2024-09-12T18:31:32.429503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:25.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:22.607128+0000","last_change":"2024-09-12T17:53:12.149630+0000","last_active":"2024-09-12T18:29:22.607128+0000","last_peered":"2024-09-12T18:29:22.607128+0000","last_clean":"2024-09-12T18:29:22.607128+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:29:22.607128+0000","last_undegraded":"2024-09-12T18:29:22.607128+0000","last_fullsized":"2024-09-12T18:29:22.607128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:16.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.516222+0000","last_change":"2024-09-12T17:50:14.840844+0000","last_active":"2024-09-12T18:30:47.516222+0000","last_peered":"2024-09-12T18:30:47.516222+0000","last_clean":"2024-09-12T18:30:47.516222+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:30:47.516222+0000","last_undegraded":"2024-09-12T18:30:47.516222+0000","last_fullsized":"2024-09-12T18:30:47.516222+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:46.536171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.410294+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:29:02.410294+0000","last_peered":"2024-09-12T18:29:02.410294+0000","last_clean":"2024-09-12T18:29:02.410294+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:29:02.410294+0000","last_undegraded":"2024-09-12T18:29:02.410294+0000","last_fullsized":"2024-09-12T18:29:02.410294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:48.278214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.862842+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:32:12.862842+0000","last_peered":"2024-09-12T18:32:12.862842+0000","last_clean":"2024-09-12T18:32:12.862842+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:32:12.862842+0000","last_undegraded":"2024-09-12T18:32:12.862842+0000","last_fullsized":"2024-09-12T18:32:12.862842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"259'83","reported_seq":352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851871+0000","last_change":"2024-09-12T17:50:14.839010+0000","last_active":"2024-09-12T18:30:47.851871+0000","last_peered":"2024-09-12T18:30:47.851871+0000","last_clean":"2024-09-12T18:30:47.851871+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:30:47.851871+0000","last_undegraded":"2024-09-12T18:30:47.851871+0000","last_fullsized":"2024-09-12T18:30:47.851871+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:25.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:07.409815+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:29:07.409815+0000","last_peered":"2024-09-12T18:29:07.409815+0000","last_clean":"2024-09-12T18:29:07.409815+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:29:07.409815+0000","last_undegraded":"2024-09-12T18:29:07.409815+0000","last_fullsized":"2024-09-12T18:29:07.409815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:47.977130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.628398+0000","last_change":"2024-09-12T17:53:12.148669+0000","last_active":"2024-09-12T18:32:12.628398+0000","last_peered":"2024-09-12T18:32:12.628398+0000","last_clean":"2024-09-12T18:32:12.628398+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:32:12.628398+0000","last_undegraded":"2024-09-12T18:32:12.628398+0000","last_fullsized":"2024-09-12T18:32:12.628398+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:34.792507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2093,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":207,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413248+0000","last_change":"2024-09-12T17:50:14.841525+0000","last_active":"2024-09-12T18:29:27.413248+0000","last_peered":"2024-09-12T18:29:27.413248+0000","last_clean":"2024-09-12T18:29:27.413248+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:29:27.413248+0000","last_undegraded":"2024-09-12T18:29:27.413248+0000","last_fullsized":"2024-09-12T18:29:27.413248+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.064279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.408899+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:29:02.408899+0000","last_peered":"2024-09-12T18:29:02.408899+0000","last_clean":"2024-09-12T18:29:02.408899+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:29:02.408899+0000","last_undegraded":"2024-09-12T18:29:02.408899+0000","last_fullsized":"2024-09-12T18:29:02.408899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.682875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'3","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:32.622593+0000","last_change":"2024-09-12T17:53:15.162122+0000","last_active":"2024-09-12T18:31:32.622593+0000","last_peered":"2024-09-12T18:31:32.622593+0000","last_clean":"2024-09-12T18:31:32.622593+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:31:32.622593+0000","last_undegraded":"2024-09-12T18:31:32.622593+0000","last_fullsized":"2024-09-12T18:31:32.622593+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.412132+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:29:17.412132+0000","last_peered":"2024-09-12T18:29:17.412132+0000","last_clean":"2024-09-12T18:29:17.412132+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:29:17.412132+0000","last_undegraded":"2024-09-12T18:29:17.412132+0000","last_fullsized":"2024-09-12T18:29:17.412132+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:32.030251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839464+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:29:02.839464+0000","last_peered":"2024-09-12T18:29:02.839464+0000","last_clean":"2024-09-12T18:29:02.839464+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:29:02.839464+0000","last_undegraded":"2024-09-12T18:29:02.839464+0000","last_fullsized":"2024-09-12T18:29:02.839464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:21.136369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'7","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.749815+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:33:04.749815+0000","last_peered":"2024-09-12T18:33:04.749815+0000","last_clean":"2024-09-12T18:33:04.749815+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:33:04.749815+0000","last_undegraded":"2024-09-12T18:33:04.749815+0000","last_fullsized":"2024-09-12T18:33:04.749815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":12,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:13.532493+0000","last_change":"2024-09-12T17:53:12.147444+0000","last_active":"2024-09-12T18:29:13.532493+0000","last_peered":"2024-09-12T18:29:13.532493+0000","last_clean":"2024-09-12T18:29:13.532493+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:29:13.532493+0000","last_undegraded":"2024-09-12T18:29:13.532493+0000","last_fullsized":"2024-09-12T18:29:13.532493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:33.139490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411513+0000","last_change":"2024-09-12T17:50:14.845091+0000","last_active":"2024-09-12T18:29:17.411513+0000","last_peered":"2024-09-12T18:29:17.411513+0000","last_clean":"2024-09-12T18:29:17.411513+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:29:17.411513+0000","last_undegraded":"2024-09-12T18:29:17.411513+0000","last_fullsized":"2024-09-12T18:29:17.411513+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:59.523739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.415011+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:29:37.415011+0000","last_peered":"2024-09-12T18:29:37.415011+0000","last_clean":"2024-09-12T18:29:37.415011+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:29:37.415011+0000","last_undegraded":"2024-09-12T18:29:37.415011+0000","last_fullsized":"2024-09-12T18:29:37.415011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:49.644621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.427023+0000","last_change":"2024-09-12T17:53:12.146834+0000","last_active":"2024-09-12T18:30:42.427023+0000","last_peered":"2024-09-12T18:30:42.427023+0000","last_clean":"2024-09-12T18:30:42.427023+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:30:42.427023+0000","last_undegraded":"2024-09-12T18:30:42.427023+0000","last_fullsized":"2024-09-12T18:30:42.427023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:24.998862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.841210+0000","last_change":"2024-09-12T17:50:14.843252+0000","last_active":"2024-09-12T18:29:17.841210+0000","last_peered":"2024-09-12T18:29:17.841210+0000","last_clean":"2024-09-12T18:29:17.841210+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:29:17.841210+0000","last_undegraded":"2024-09-12T18:29:17.841210+0000","last_fullsized":"2024-09-12T18:29:17.841210+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.189495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.653142+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:29:37.653142+0000","last_peered":"2024-09-12T18:29:37.653142+0000","last_clean":"2024-09-12T18:29:37.653142+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:29:37.653142+0000","last_undegraded":"2024-09-12T18:29:37.653142+0000","last_fullsized":"2024-09-12T18:29:37.653142+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:54.893645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.134037+0000","last_change":"2024-09-12T17:53:12.145287+0000","last_active":"2024-09-12T18:33:04.134037+0000","last_peered":"2024-09-12T18:33:04.134037+0000","last_clean":"2024-09-12T18:33:04.134037+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:33:04.134037+0000","last_undegraded":"2024-09-12T18:33:04.134037+0000","last_fullsized":"2024-09-12T18:33:04.134037+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:04.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:17.411632+0000","last_change":"2024-09-12T17:50:14.845672+0000","last_active":"2024-09-12T18:29:17.411632+0000","last_peered":"2024-09-12T18:29:17.411632+0000","last_clean":"2024-09-12T18:29:17.411632+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:29:17.411632+0000","last_undegraded":"2024-09-12T18:29:17.411632+0000","last_fullsized":"2024-09-12T18:29:17.411632+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:46.707631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617831+0000","last_change":"2024-09-12T18:08:44.180779+0000","last_active":"2024-09-12T18:30:52.617831+0000","last_peered":"2024-09-12T18:30:52.617831+0000","last_clean":"2024-09-12T18:30:52.617831+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:30:52.617831+0000","last_undegraded":"2024-09-12T18:30:52.617831+0000","last_fullsized":"2024-09-12T18:30:52.617831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:51.232292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'7","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.447080+0000","last_change":"2024-09-12T17:53:12.147578+0000","last_active":"2024-09-12T18:33:05.447080+0000","last_peered":"2024-09-12T18:33:05.447080+0000","last_clean":"2024-09-12T18:33:05.447080+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:33:05.447080+0000","last_undegraded":"2024-09-12T18:33:05.447080+0000","last_fullsized":"2024-09-12T18:33:05.447080+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.387228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419760+0000","last_change":"2024-09-12T17:50:14.843005+0000","last_active":"2024-09-12T18:30:02.419760+0000","last_peered":"2024-09-12T18:30:02.419760+0000","last_clean":"2024-09-12T18:30:02.419760+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:30:02.419760+0000","last_undegraded":"2024-09-12T18:30:02.419760+0000","last_fullsized":"2024-09-12T18:30:02.419760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:21.412702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535480+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:29:33.535480+0000","last_peered":"2024-09-12T18:29:33.535480+0000","last_clean":"2024-09-12T18:29:33.535480+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:29:33.535480+0000","last_undegraded":"2024-09-12T18:29:33.535480+0000","last_fullsized":"2024-09-12T18:29:33.535480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:09.211455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559657+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:32:18.559657+0000","last_peered":"2024-09-12T18:32:18.559657+0000","last_clean":"2024-09-12T18:32:18.559657+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:32:18.559657+0000","last_undegraded":"2024-09-12T18:32:18.559657+0000","last_fullsized":"2024-09-12T18:32:18.559657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610519+0000","last_change":"2024-09-12T17:50:14.843405+0000","last_active":"2024-09-12T18:29:52.610519+0000","last_peered":"2024-09-12T18:29:52.610519+0000","last_clean":"2024-09-12T18:29:52.610519+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:29:52.610519+0000","last_undegraded":"2024-09-12T18:29:52.610519+0000","last_fullsized":"2024-09-12T18:29:52.610519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:41.738965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.514158+0000","last_change":"2024-09-12T18:08:44.185535+0000","last_active":"2024-09-12T18:30:27.514158+0000","last_peered":"2024-09-12T18:30:27.514158+0000","last_clean":"2024-09-12T18:30:27.514158+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:30:27.514158+0000","last_undegraded":"2024-09-12T18:30:27.514158+0000","last_fullsized":"2024-09-12T18:30:27.514158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:31.002329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'9","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.562644+0000","last_change":"2024-09-12T17:53:15.156207+0000","last_active":"2024-09-12T18:33:03.562644+0000","last_peered":"2024-09-12T18:33:03.562644+0000","last_clean":"2024-09-12T18:33:03.562644+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:33:03.562644+0000","last_undegraded":"2024-09-12T18:33:03.562644+0000","last_fullsized":"2024-09-12T18:33:03.562644+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.717848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":21492,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.434133+0000","last_change":"2024-09-12T17:53:12.148444+0000","last_active":"2024-09-12T18:31:22.434133+0000","last_peered":"2024-09-12T18:31:22.434133+0000","last_clean":"2024-09-12T18:31:22.434133+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:31:22.434133+0000","last_undegraded":"2024-09-12T18:31:22.434133+0000","last_fullsized":"2024-09-12T18:31:22.434133+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655558+0000","last_change":"2024-09-12T17:50:14.845855+0000","last_active":"2024-09-12T18:29:52.655558+0000","last_peered":"2024-09-12T18:29:52.655558+0000","last_clean":"2024-09-12T18:29:52.655558+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:29:52.655558+0000","last_undegraded":"2024-09-12T18:29:52.655558+0000","last_fullsized":"2024-09-12T18:29:52.655558+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.841767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.604429+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:33:05.604429+0000","last_peered":"2024-09-12T18:33:05.604429+0000","last_clean":"2024-09-12T18:33:05.604429+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:33:05.604429+0000","last_undegraded":"2024-09-12T18:33:05.604429+0000","last_fullsized":"2024-09-12T18:33:05.604429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":4,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.449781+0000","last_change":"2024-09-12T17:53:12.141323+0000","last_active":"2024-09-12T18:32:47.449781+0000","last_peered":"2024-09-12T18:32:47.449781+0000","last_clean":"2024-09-12T18:32:47.449781+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:32:47.449781+0000","last_undegraded":"2024-09-12T18:32:47.449781+0000","last_fullsized":"2024-09-12T18:32:47.449781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:51.866615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:53.538225+0000","last_change":"2024-09-12T17:50:14.841037+0000","last_active":"2024-09-12T18:29:53.538225+0000","last_peered":"2024-09-12T18:29:53.538225+0000","last_clean":"2024-09-12T18:29:53.538225+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:29:53.538225+0000","last_undegraded":"2024-09-12T18:29:53.538225+0000","last_fullsized":"2024-09-12T18:29:53.538225+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:08.998454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.843448+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:29:37.843448+0000","last_peered":"2024-09-12T18:29:37.843448+0000","last_clean":"2024-09-12T18:29:37.843448+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:29:37.843448+0000","last_undegraded":"2024-09-12T18:29:37.843448+0000","last_fullsized":"2024-09-12T18:29:37.843448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:46.217476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427908+0000","last_change":"2024-09-12T17:53:15.167067+0000","last_active":"2024-09-12T18:30:47.427908+0000","last_peered":"2024-09-12T18:30:47.427908+0000","last_clean":"2024-09-12T18:30:47.427908+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:30:47.427908+0000","last_undegraded":"2024-09-12T18:30:47.427908+0000","last_fullsized":"2024-09-12T18:30:47.427908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:46.459018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.632674+0000","last_change":"2024-09-12T17:53:12.145714+0000","last_active":"2024-09-12T18:32:47.632674+0000","last_peered":"2024-09-12T18:32:47.632674+0000","last_clean":"2024-09-12T18:32:47.632674+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:32:47.632674+0000","last_undegraded":"2024-09-12T18:32:47.632674+0000","last_fullsized":"2024-09-12T18:32:47.632674+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:38.676442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417826+0000","last_change":"2024-09-12T17:50:14.840332+0000","last_active":"2024-09-12T18:29:52.417826+0000","last_peered":"2024-09-12T18:29:52.417826+0000","last_clean":"2024-09-12T18:29:52.417826+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:29:52.417826+0000","last_undegraded":"2024-09-12T18:29:52.417826+0000","last_fullsized":"2024-09-12T18:29:52.417826+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:22.784535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415951+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:29:42.415951+0000","last_peered":"2024-09-12T18:29:42.415951+0000","last_clean":"2024-09-12T18:29:42.415951+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:29:42.415951+0000","last_undegraded":"2024-09-12T18:29:42.415951+0000","last_fullsized":"2024-09-12T18:29:42.415951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:51.046197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.564563+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:32:53.564563+0000","last_peered":"2024-09-12T18:32:53.564563+0000","last_clean":"2024-09-12T18:32:53.564563+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:32:53.564563+0000","last_undegraded":"2024-09-12T18:32:53.564563+0000","last_fullsized":"2024-09-12T18:32:53.564563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.449849+0000","last_change":"2024-09-12T17:53:12.143851+0000","last_active":"2024-09-12T18:32:47.449849+0000","last_peered":"2024-09-12T18:32:47.449849+0000","last_clean":"2024-09-12T18:32:47.449849+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:32:47.449849+0000","last_undegraded":"2024-09-12T18:32:47.449849+0000","last_fullsized":"2024-09-12T18:32:47.449849+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:28.807772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424131+0000","last_change":"2024-09-12T17:50:14.843604+0000","last_active":"2024-09-12T18:30:27.424131+0000","last_peered":"2024-09-12T18:30:27.424131+0000","last_clean":"2024-09-12T18:30:27.424131+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:30:27.424131+0000","last_undegraded":"2024-09-12T18:30:27.424131+0000","last_fullsized":"2024-09-12T18:30:27.424131+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:57.939262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'356","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.002517+0000","last_change":"2024-09-12T18:33:23.002517+0000","last_active":"2024-09-12T18:33:23.002517+0000","last_peered":"2024-09-12T18:33:23.002517+0000","last_clean":"2024-09-12T18:33:23.002517+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:33:23.002517+0000","last_undegraded":"2024-09-12T18:33:23.002517+0000","last_fullsized":"2024-09-12T18:33:23.002517+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'356","last_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_deep_scrub":"262'356","last_deep_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.002381+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:15.336304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":13512,"num_write":1124,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'535","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:42.662644+0000","last_change":"2024-09-12T17:35:42.890337+0000","last_active":"2024-09-12T18:30:42.662644+0000","last_peered":"2024-09-12T18:30:42.662644+0000","last_clean":"2024-09-12T18:30:42.662644+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:30:42.662644+0000","last_undegraded":"2024-09-12T18:30:42.662644+0000","last_fullsized":"2024-09-12T18:30:42.662644+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'418","reported_seq":1205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.544275+0000","last_change":"2024-09-12T18:33:18.544275+0000","last_active":"2024-09-12T18:33:18.544275+0000","last_peered":"2024-09-12T18:33:18.544275+0000","last_clean":"2024-09-12T18:33:18.544275+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:33:18.544275+0000","last_undegraded":"2024-09-12T18:33:18.544275+0000","last_fullsized":"2024-09-12T18:33:18.544275+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'418","last_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_deep_scrub":"262'418","last_deep_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.544159+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:31.620304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342084,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":23039,"num_write":1345,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'487","reported_seq":2080,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.047086+0000","last_change":"2024-09-12T18:33:27.047086+0000","last_active":"2024-09-12T18:33:27.047086+0000","last_peered":"2024-09-12T18:33:27.047086+0000","last_clean":"2024-09-12T18:33:27.047086+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:33:27.047086+0000","last_undegraded":"2024-09-12T18:33:27.047086+0000","last_fullsized":"2024-09-12T18:33:27.047086+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.047001+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:35.965293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'386","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.295051+0000","last_change":"2024-09-12T18:33:24.295051+0000","last_active":"2024-09-12T18:33:24.295051+0000","last_peered":"2024-09-12T18:33:24.295051+0000","last_clean":"2024-09-12T18:33:24.295051+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:33:24.295051+0000","last_undegraded":"2024-09-12T18:33:24.295051+0000","last_fullsized":"2024-09-12T18:33:24.295051+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'386","last_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_deep_scrub":"262'386","last_deep_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.294831+0000","objects_scrubbed":9,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:26.207847+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342186,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":764,"num_read_kb":32762,"num_write":1205,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'419","reported_seq":1923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:43.545500+0000","last_change":"2024-09-12T17:35:42.892018+0000","last_active":"2024-09-12T18:30:43.545500+0000","last_peered":"2024-09-12T18:30:43.545500+0000","last_clean":"2024-09-12T18:30:43.545500+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:30:43.545500+0000","last_undegraded":"2024-09-12T18:30:43.545500+0000","last_fullsized":"2024-09-12T18:30:43.545500+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'347","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.680367+0000","last_change":"2024-09-12T18:33:22.680367+0000","last_active":"2024-09-12T18:33:22.680367+0000","last_peered":"2024-09-12T18:33:22.680367+0000","last_clean":"2024-09-12T18:33:22.680367+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:33:22.680367+0000","last_undegraded":"2024-09-12T18:33:22.680367+0000","last_fullsized":"2024-09-12T18:33:22.680367+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'347","last_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_deep_scrub":"262'347","last_deep_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.680245+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:30.990184+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":25007,"num_write":1079,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'463","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.634928+0000","last_change":"2024-09-12T18:33:24.634928+0000","last_active":"2024-09-12T18:33:24.634928+0000","last_peered":"2024-09-12T18:33:24.634928+0000","last_clean":"2024-09-12T18:33:24.634928+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:33:24.634928+0000","last_undegraded":"2024-09-12T18:33:24.634928+0000","last_fullsized":"2024-09-12T18:33:24.634928+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'463","last_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_deep_scrub":"262'463","last_deep_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.634835+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.682588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'325","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.976983+0000","last_change":"2024-09-12T18:33:21.976983+0000","last_active":"2024-09-12T18:33:21.976983+0000","last_peered":"2024-09-12T18:33:21.976983+0000","last_clean":"2024-09-12T18:33:21.976983+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:33:21.976983+0000","last_undegraded":"2024-09-12T18:33:21.976983+0000","last_fullsized":"2024-09-12T18:33:21.976983+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.976849+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:40.343209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":10934,"num_write":1041,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'858","reported_seq":2390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.686890+0000","last_change":"2024-09-12T18:33:25.686890+0000","last_active":"2024-09-12T18:33:25.686890+0000","last_peered":"2024-09-12T18:33:25.686890+0000","last_clean":"2024-09-12T18:33:25.686890+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:33:25.686890+0000","last_undegraded":"2024-09-12T18:33:25.686890+0000","last_fullsized":"2024-09-12T18:33:25.686890+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'858","last_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_deep_scrub":"262'858","last_deep_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.686759+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:21.725139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'339","reported_seq":1142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.669828+0000","last_change":"2024-09-12T18:33:19.669828+0000","last_active":"2024-09-12T18:33:19.669828+0000","last_peered":"2024-09-12T18:33:19.669828+0000","last_clean":"2024-09-12T18:33:19.669828+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:33:19.669828+0000","last_undegraded":"2024-09-12T18:33:19.669828+0000","last_fullsized":"2024-09-12T18:33:19.669828+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.669637+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:57.288656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287593,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":903,"num_read_kb":42337,"num_write":1288,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2407,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.136019+0000","last_change":"2024-09-12T17:35:42.892097+0000","last_active":"2024-09-12T18:31:29.136019+0000","last_peered":"2024-09-12T18:31:29.136019+0000","last_clean":"2024-09-12T18:31:29.136019+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:31:29.136019+0000","last_undegraded":"2024-09-12T18:31:29.136019+0000","last_fullsized":"2024-09-12T18:31:29.136019+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:35.311382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'359","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.952233+0000","last_change":"2024-09-12T18:33:20.952233+0000","last_active":"2024-09-12T18:33:20.952233+0000","last_peered":"2024-09-12T18:33:20.952233+0000","last_clean":"2024-09-12T18:33:20.952233+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:33:20.952233+0000","last_undegraded":"2024-09-12T18:33:20.952233+0000","last_fullsized":"2024-09-12T18:33:20.952233+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.952116+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.745872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170843,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":26409,"num_write":1171,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'465","reported_seq":1962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:15.440637+0000","last_change":"2024-09-12T17:35:42.887897+0000","last_active":"2024-09-12T18:30:15.440637+0000","last_peered":"2024-09-12T18:30:15.440637+0000","last_clean":"2024-09-12T18:30:15.440637+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:30:15.440637+0000","last_undegraded":"2024-09-12T18:30:15.440637+0000","last_fullsized":"2024-09-12T18:30:15.440637+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:31.371385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'400","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.292029+0000","last_change":"2024-09-12T18:33:22.292029+0000","last_active":"2024-09-12T18:33:22.292029+0000","last_peered":"2024-09-12T18:33:22.292029+0000","last_clean":"2024-09-12T18:33:22.292029+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:33:22.292029+0000","last_undegraded":"2024-09-12T18:33:22.292029+0000","last_fullsized":"2024-09-12T18:33:22.292029+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'400","last_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_deep_scrub":"262'400","last_deep_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.291796+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:58.671981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":10679,"num_write":1254,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'487","reported_seq":2074,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.075118+0000","last_change":"2024-09-12T18:33:21.075118+0000","last_active":"2024-09-12T18:33:21.075118+0000","last_peered":"2024-09-12T18:33:21.075118+0000","last_clean":"2024-09-12T18:33:21.075118+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:33:21.075118+0000","last_undegraded":"2024-09-12T18:33:21.075118+0000","last_fullsized":"2024-09-12T18:33:21.075118+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.075019+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:54.397374+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.300808+0000","last_change":"2024-09-12T18:33:28.300808+0000","last_active":"2024-09-12T18:33:28.300808+0000","last_peered":"2024-09-12T18:33:28.300808+0000","last_clean":"2024-09-12T18:33:28.300808+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:33:28.300808+0000","last_undegraded":"2024-09-12T18:33:28.300808+0000","last_fullsized":"2024-09-12T18:33:28.300808+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'760","last_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_deep_scrub":"262'760","last_deep_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.300716+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:14.805759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'355","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.957318+0000","last_change":"2024-09-12T18:33:19.957318+0000","last_active":"2024-09-12T18:33:19.957318+0000","last_peered":"2024-09-12T18:33:19.957318+0000","last_clean":"2024-09-12T18:33:19.957318+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:33:19.957318+0000","last_undegraded":"2024-09-12T18:33:19.957318+0000","last_fullsized":"2024-09-12T18:33:19.957318+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'355","last_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_deep_scrub":"262'355","last_deep_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.957207+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:43.487020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":71616,"num_write":1141,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'420","reported_seq":1943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.032588+0000","last_change":"2024-09-12T18:33:26.032588+0000","last_active":"2024-09-12T18:33:26.032588+0000","last_peered":"2024-09-12T18:33:26.032588+0000","last_clean":"2024-09-12T18:33:26.032588+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:33:26.032588+0000","last_undegraded":"2024-09-12T18:33:26.032588+0000","last_fullsized":"2024-09-12T18:33:26.032588+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.032490+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.483514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'319","reported_seq":958,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.672682+0000","last_change":"2024-09-12T18:33:18.672682+0000","last_active":"2024-09-12T18:33:18.672682+0000","last_peered":"2024-09-12T18:33:18.672682+0000","last_clean":"2024-09-12T18:33:18.672682+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:33:18.672682+0000","last_undegraded":"2024-09-12T18:33:18.672682+0000","last_fullsized":"2024-09-12T18:33:18.672682+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'319","last_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_deep_scrub":"262'319","last_deep_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.672393+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:47.254680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49172,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":3270,"num_write":1020,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'872","reported_seq":2493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.641379+0000","last_change":"2024-09-12T18:33:26.641379+0000","last_active":"2024-09-12T18:33:26.641379+0000","last_peered":"2024-09-12T18:33:26.641379+0000","last_clean":"2024-09-12T18:33:26.641379+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:33:26.641379+0000","last_undegraded":"2024-09-12T18:33:26.641379+0000","last_fullsized":"2024-09-12T18:33:26.641379+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'872","last_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_deep_scrub":"262'872","last_deep_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.641291+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.568382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'387","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.697469+0000","last_change":"2024-09-12T18:33:17.697469+0000","last_active":"2024-09-12T18:33:17.697469+0000","last_peered":"2024-09-12T18:33:17.697469+0000","last_clean":"2024-09-12T18:33:17.697469+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:33:17.697469+0000","last_undegraded":"2024-09-12T18:33:17.697469+0000","last_fullsized":"2024-09-12T18:33:17.697469+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'387","last_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_deep_scrub":"262'387","last_deep_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.697260+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:05.335710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":65942,"num_write":1264,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1106","reported_seq":2619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.099374+0000","last_change":"2024-09-12T18:33:19.099374+0000","last_active":"2024-09-12T18:33:19.099374+0000","last_peered":"2024-09-12T18:33:19.099374+0000","last_clean":"2024-09-12T18:33:19.099374+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:33:19.099374+0000","last_undegraded":"2024-09-12T18:33:19.099374+0000","last_fullsized":"2024-09-12T18:33:19.099374+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1106","last_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_deep_scrub":"262'1106","last_deep_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.099250+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":1000,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:44.344091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'292","reported_seq":1066,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.238905+0000","last_change":"2024-09-12T18:33:15.238905+0000","last_active":"2024-09-12T18:33:15.238905+0000","last_peered":"2024-09-12T18:33:15.238905+0000","last_clean":"2024-09-12T18:33:15.238905+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:15.238905+0000","last_undegraded":"2024-09-12T18:33:15.238905+0000","last_fullsized":"2024-09-12T18:33:15.238905+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.238775+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.181757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":760,"num_read_kb":33658,"num_write":1067,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'615","reported_seq":2389,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.104176+0000","last_change":"2024-09-12T18:33:20.104176+0000","last_active":"2024-09-12T18:33:20.104176+0000","last_peered":"2024-09-12T18:33:20.104176+0000","last_clean":"2024-09-12T18:33:20.104176+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:33:20.104176+0000","last_undegraded":"2024-09-12T18:33:20.104176+0000","last_fullsized":"2024-09-12T18:33:20.104176+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'615","last_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_deep_scrub":"262'615","last_deep_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.104093+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:14.426305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3278,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'324","reported_seq":955,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.256705+0000","last_change":"2024-09-12T18:33:21.256705+0000","last_active":"2024-09-12T18:33:21.256705+0000","last_peered":"2024-09-12T18:33:21.256705+0000","last_clean":"2024-09-12T18:33:21.256705+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:33:21.256705+0000","last_undegraded":"2024-09-12T18:33:21.256705+0000","last_fullsized":"2024-09-12T18:33:21.256705+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.256481+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:27.688415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452413,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":42765,"num_write":983,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'305","reported_seq":1678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.370580+0000","last_change":"2024-09-12T17:35:42.902985+0000","last_active":"2024-09-12T18:32:48.370580+0000","last_peered":"2024-09-12T18:32:48.370580+0000","last_clean":"2024-09-12T18:32:48.370580+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:32:48.370580+0000","last_undegraded":"2024-09-12T18:32:48.370580+0000","last_fullsized":"2024-09-12T18:32:48.370580+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:50.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'376","reported_seq":1069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.613356+0000","last_change":"2024-09-12T18:33:15.613356+0000","last_active":"2024-09-12T18:33:15.613356+0000","last_peered":"2024-09-12T18:33:15.613356+0000","last_clean":"2024-09-12T18:33:15.613356+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:33:15.613356+0000","last_undegraded":"2024-09-12T18:33:15.613356+0000","last_fullsized":"2024-09-12T18:33:15.613356+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.613239+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:10.394785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5481568,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":590,"num_read_kb":95728,"num_write":1139,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'128","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.236405+0000","last_change":"2024-09-12T17:35:50.911205+0000","last_active":"2024-09-12T18:31:29.236405+0000","last_peered":"2024-09-12T18:31:29.236405+0000","last_clean":"2024-09-12T18:31:29.236405+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:31:29.236405+0000","last_undegraded":"2024-09-12T18:31:29.236405+0000","last_fullsized":"2024-09-12T18:31:29.236405+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.073238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'773","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.305568+0000","last_change":"2024-09-12T17:35:42.891760+0000","last_active":"2024-09-12T18:31:28.305568+0000","last_peered":"2024-09-12T18:31:28.305568+0000","last_clean":"2024-09-12T18:31:28.305568+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:31:28.305568+0000","last_undegraded":"2024-09-12T18:31:28.305568+0000","last_fullsized":"2024-09-12T18:31:28.305568+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:36.873441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'350","reported_seq":1124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.989242+0000","last_change":"2024-09-12T18:33:16.989242+0000","last_active":"2024-09-12T18:33:16.989242+0000","last_peered":"2024-09-12T18:33:16.989242+0000","last_clean":"2024-09-12T18:33:16.989242+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:33:16.989242+0000","last_undegraded":"2024-09-12T18:33:16.989242+0000","last_fullsized":"2024-09-12T18:33:16.989242+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'350","last_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_deep_scrub":"262'350","last_deep_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.989082+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.856138+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424710,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":775,"num_read_kb":10756,"num_write":1135,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647106+0000","last_change":"2024-09-12T17:35:44.894904+0000","last_active":"2024-09-12T18:28:57.647106+0000","last_peered":"2024-09-12T18:28:57.647106+0000","last_clean":"2024-09-12T18:28:57.647106+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:28:57.647106+0000","last_undegraded":"2024-09-12T18:28:57.647106+0000","last_fullsized":"2024-09-12T18:28:57.647106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:49.733122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'342","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.403871+0000","last_change":"2024-09-12T17:35:46.891705+0000","last_active":"2024-09-12T18:33:03.403871+0000","last_peered":"2024-09-12T18:33:03.403871+0000","last_clean":"2024-09-12T18:33:03.403871+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:33:03.403871+0000","last_undegraded":"2024-09-12T18:33:03.403871+0000","last_fullsized":"2024-09-12T18:33:03.403871+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:37.590312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1162,"num_write":438,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.409035+0000","last_change":"2024-09-12T17:35:48.908793+0000","last_active":"2024-09-12T18:29:02.409035+0000","last_peered":"2024-09-12T18:29:02.409035+0000","last_clean":"2024-09-12T18:29:02.409035+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:29:02.409035+0000","last_undegraded":"2024-09-12T18:29:02.409035+0000","last_fullsized":"2024-09-12T18:29:02.409035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.844066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'159","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.215133+0000","last_change":"2024-09-12T17:35:50.921992+0000","last_active":"2024-09-12T18:32:48.215133+0000","last_peered":"2024-09-12T18:32:48.215133+0000","last_clean":"2024-09-12T18:32:48.215133+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:32:48.215133+0000","last_undegraded":"2024-09-12T18:32:48.215133+0000","last_fullsized":"2024-09-12T18:32:48.215133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:51.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'480","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.693653+0000","last_change":"2024-09-12T18:33:23.693653+0000","last_active":"2024-09-12T18:33:23.693653+0000","last_peered":"2024-09-12T18:33:23.693653+0000","last_clean":"2024-09-12T18:33:23.693653+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:33:23.693653+0000","last_undegraded":"2024-09-12T18:33:23.693653+0000","last_fullsized":"2024-09-12T18:33:23.693653+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'480","last_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_deep_scrub":"262'480","last_deep_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.693570+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:07.678162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'420","reported_seq":1116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.540174+0000","last_change":"2024-09-12T18:33:11.540174+0000","last_active":"2024-09-12T18:33:11.540174+0000","last_peered":"2024-09-12T18:33:11.540174+0000","last_clean":"2024-09-12T18:33:11.540174+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:33:11.540174+0000","last_undegraded":"2024-09-12T18:33:11.540174+0000","last_fullsized":"2024-09-12T18:33:11.540174+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.540056+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:31.139934+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468829,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":675,"num_read_kb":80579,"num_write":1292,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:42.415429+0000","last_change":"2024-09-12T17:35:44.894677+0000","last_active":"2024-09-12T18:29:42.415429+0000","last_peered":"2024-09-12T18:29:42.415429+0000","last_clean":"2024-09-12T18:29:42.415429+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:29:42.415429+0000","last_undegraded":"2024-09-12T18:29:42.415429+0000","last_fullsized":"2024-09-12T18:29:42.415429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:39.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'89","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530565+0000","last_change":"2024-09-12T17:35:46.899363+0000","last_active":"2024-09-12T18:28:58.530565+0000","last_peered":"2024-09-12T18:28:58.530565+0000","last_clean":"2024-09-12T18:28:58.530565+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:28:58.530565+0000","last_undegraded":"2024-09-12T18:28:58.530565+0000","last_fullsized":"2024-09-12T18:28:58.530565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530549+0000","last_change":"2024-09-12T17:35:48.901307+0000","last_active":"2024-09-12T18:28:58.530549+0000","last_peered":"2024-09-12T18:28:58.530549+0000","last_clean":"2024-09-12T18:28:58.530549+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:28:58.530549+0000","last_undegraded":"2024-09-12T18:28:58.530549+0000","last_fullsized":"2024-09-12T18:28:58.530549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:46.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'172","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.852488+0000","last_change":"2024-09-12T17:35:50.916182+0000","last_active":"2024-09-12T18:30:52.852488+0000","last_peered":"2024-09-12T18:30:52.852488+0000","last_clean":"2024-09-12T18:30:52.852488+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:30:52.852488+0000","last_undegraded":"2024-09-12T18:30:52.852488+0000","last_fullsized":"2024-09-12T18:30:52.852488+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1215","reported_seq":2943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.625322+0000","last_change":"2024-09-12T18:33:21.625322+0000","last_active":"2024-09-12T18:33:21.625322+0000","last_peered":"2024-09-12T18:33:21.625322+0000","last_clean":"2024-09-12T18:33:21.625322+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:33:21.625322+0000","last_undegraded":"2024-09-12T18:33:21.625322+0000","last_fullsized":"2024-09-12T18:33:21.625322+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1215","last_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_deep_scrub":"262'1215","last_deep_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.625227+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.877851+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'399","reported_seq":1053,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.013929+0000","last_change":"2024-09-12T18:33:15.013929+0000","last_active":"2024-09-12T18:33:15.013929+0000","last_peered":"2024-09-12T18:33:15.013929+0000","last_clean":"2024-09-12T18:33:15.013929+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:33:15.013929+0000","last_undegraded":"2024-09-12T18:33:15.013929+0000","last_fullsized":"2024-09-12T18:33:15.013929+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.013801+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:15.692669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386468,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":554,"num_read_kb":8447,"num_write":1280,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.409696+0000","last_change":"2024-09-12T17:35:44.891907+0000","last_active":"2024-09-12T18:28:57.409696+0000","last_peered":"2024-09-12T18:28:57.409696+0000","last_clean":"2024-09-12T18:28:57.409696+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:28:57.409696+0000","last_undegraded":"2024-09-12T18:28:57.409696+0000","last_fullsized":"2024-09-12T18:28:57.409696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:17.733659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'121","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:37.508338+0000","last_change":"2024-09-12T17:35:46.901224+0000","last_active":"2024-09-12T18:29:37.508338+0000","last_peered":"2024-09-12T18:29:37.508338+0000","last_clean":"2024-09-12T18:29:37.508338+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:29:37.508338+0000","last_undegraded":"2024-09-12T18:29:37.508338+0000","last_fullsized":"2024-09-12T18:29:37.508338+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:25.864997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'763","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.284220+0000","last_change":"2024-09-12T17:35:48.907483+0000","last_active":"2024-09-12T18:33:03.284220+0000","last_peered":"2024-09-12T18:33:03.284220+0000","last_clean":"2024-09-12T18:33:03.284220+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:33:03.284220+0000","last_undegraded":"2024-09-12T18:33:03.284220+0000","last_fullsized":"2024-09-12T18:33:03.284220+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.736753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'230","reported_seq":1049,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.328808+0000","last_change":"2024-09-12T17:35:51.346696+0000","last_active":"2024-09-12T18:31:29.328808+0000","last_peered":"2024-09-12T18:31:29.328808+0000","last_clean":"2024-09-12T18:31:29.328808+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:31:29.328808+0000","last_undegraded":"2024-09-12T18:31:29.328808+0000","last_fullsized":"2024-09-12T18:31:29.328808+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'673","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.396515+0000","last_change":"2024-09-12T18:33:27.396515+0000","last_active":"2024-09-12T18:33:27.396515+0000","last_peered":"2024-09-12T18:33:27.396515+0000","last_clean":"2024-09-12T18:33:27.396515+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:33:27.396515+0000","last_undegraded":"2024-09-12T18:33:27.396515+0000","last_fullsized":"2024-09-12T18:33:27.396515+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'673","last_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_deep_scrub":"262'673","last_deep_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.396425+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:51.901322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'341","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.715413+0000","last_change":"2024-09-12T18:33:14.715413+0000","last_active":"2024-09-12T18:33:14.715413+0000","last_peered":"2024-09-12T18:33:14.715413+0000","last_clean":"2024-09-12T18:33:14.715413+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:33:14.715413+0000","last_undegraded":"2024-09-12T18:33:14.715413+0000","last_fullsized":"2024-09-12T18:33:14.715413+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.715259+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:05.915818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399179,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":57705,"num_write":1124,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:57.647162+0000","last_change":"2024-09-12T17:35:44.893676+0000","last_active":"2024-09-12T18:28:57.647162+0000","last_peered":"2024-09-12T18:28:57.647162+0000","last_clean":"2024-09-12T18:28:57.647162+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:28:57.647162+0000","last_undegraded":"2024-09-12T18:28:57.647162+0000","last_fullsized":"2024-09-12T18:28:57.647162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:14.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'278","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.522269+0000","last_change":"2024-09-12T17:35:47.464920+0000","last_active":"2024-09-12T18:33:05.522269+0000","last_peered":"2024-09-12T18:33:05.522269+0000","last_clean":"2024-09-12T18:33:05.522269+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:33:05.522269+0000","last_undegraded":"2024-09-12T18:33:05.522269+0000","last_fullsized":"2024-09-12T18:33:05.522269+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:46.905458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1082,"num_write":378,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'818","reported_seq":2353,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.254108+0000","last_change":"2024-09-12T17:35:48.899501+0000","last_active":"2024-09-12T18:33:05.254108+0000","last_peered":"2024-09-12T18:33:05.254108+0000","last_clean":"2024-09-12T18:33:05.254108+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:33:05.254108+0000","last_undegraded":"2024-09-12T18:33:05.254108+0000","last_fullsized":"2024-09-12T18:33:05.254108+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:00.483899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'542","reported_seq":2120,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.657751+0000","last_change":"2024-09-12T18:33:24.657751+0000","last_active":"2024-09-12T18:33:24.657751+0000","last_peered":"2024-09-12T18:33:24.657751+0000","last_clean":"2024-09-12T18:33:24.657751+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:33:24.657751+0000","last_undegraded":"2024-09-12T18:33:24.657751+0000","last_fullsized":"2024-09-12T18:33:24.657751+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.657662+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:53.428163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2021,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'394","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.039545+0000","last_change":"2024-09-12T18:33:14.039545+0000","last_active":"2024-09-12T18:33:14.039545+0000","last_peered":"2024-09-12T18:33:14.039545+0000","last_clean":"2024-09-12T18:33:14.039545+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:33:14.039545+0000","last_undegraded":"2024-09-12T18:33:14.039545+0000","last_fullsized":"2024-09-12T18:33:14.039545+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.039390+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:37.692448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512425,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":23815,"num_write":1238,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418824+0000","last_change":"2024-09-12T17:35:44.897503+0000","last_active":"2024-09-12T18:29:57.418824+0000","last_peered":"2024-09-12T18:29:57.418824+0000","last_clean":"2024-09-12T18:29:57.418824+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:29:57.418824+0000","last_undegraded":"2024-09-12T18:29:57.418824+0000","last_fullsized":"2024-09-12T18:29:57.418824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.732782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'365","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.720833+0000","last_change":"2024-09-12T17:35:47.466030+0000","last_active":"2024-09-12T18:33:03.720833+0000","last_peered":"2024-09-12T18:33:03.720833+0000","last_clean":"2024-09-12T18:33:03.720833+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:33:03.720833+0000","last_undegraded":"2024-09-12T18:33:03.720833+0000","last_fullsized":"2024-09-12T18:33:03.720833+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:23.136183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45931,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":1150,"num_write":454,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.610510+0000","last_change":"2024-09-12T17:35:48.908512+0000","last_active":"2024-09-12T18:29:52.610510+0000","last_peered":"2024-09-12T18:29:52.610510+0000","last_clean":"2024-09-12T18:29:52.610510+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:29:52.610510+0000","last_undegraded":"2024-09-12T18:29:52.610510+0000","last_fullsized":"2024-09-12T18:29:52.610510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:43.347490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'584","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.244085+0000","last_change":"2024-09-12T17:35:50.922799+0000","last_active":"2024-09-12T18:32:50.244085+0000","last_peered":"2024-09-12T18:32:50.244085+0000","last_clean":"2024-09-12T18:32:50.244085+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:32:50.244085+0000","last_undegraded":"2024-09-12T18:32:50.244085+0000","last_fullsized":"2024-09-12T18:32:50.244085+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:24.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'544","reported_seq":2028,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.216806+0000","last_change":"2024-09-12T18:33:17.216806+0000","last_active":"2024-09-12T18:33:17.216806+0000","last_peered":"2024-09-12T18:33:17.216806+0000","last_clean":"2024-09-12T18:33:17.216806+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:33:17.216806+0000","last_undegraded":"2024-09-12T18:33:17.216806+0000","last_fullsized":"2024-09-12T18:33:17.216806+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'544","last_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_deep_scrub":"262'544","last_deep_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.216707+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.670785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'393","reported_seq":1039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.215990+0000","last_change":"2024-09-12T18:33:15.215990+0000","last_active":"2024-09-12T18:33:15.215990+0000","last_peered":"2024-09-12T18:33:15.215990+0000","last_clean":"2024-09-12T18:33:15.215990+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:33:15.215990+0000","last_undegraded":"2024-09-12T18:33:15.215990+0000","last_fullsized":"2024-09-12T18:33:15.215990+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'393","last_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_deep_scrub":"262'393","last_deep_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.215872+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:55.176918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":15948,"num_write":1231,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.079381+0000","last_change":"2024-09-12T18:33:26.079381+0000","last_active":"2024-09-12T18:33:26.079381+0000","last_peered":"2024-09-12T18:33:26.079381+0000","last_clean":"2024-09-12T18:33:26.079381+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:33:26.079381+0000","last_undegraded":"2024-09-12T18:33:26.079381+0000","last_fullsized":"2024-09-12T18:33:26.079381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.079288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:46.736637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'273","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.744352+0000","last_change":"2024-09-12T17:35:46.896008+0000","last_active":"2024-09-12T18:33:04.744352+0000","last_peered":"2024-09-12T18:33:04.744352+0000","last_clean":"2024-09-12T18:33:04.744352+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:33:04.744352+0000","last_undegraded":"2024-09-12T18:33:04.744352+0000","last_fullsized":"2024-09-12T18:33:04.744352+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:57.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47879,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1045,"num_write":366,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419734+0000","last_change":"2024-09-12T17:35:48.898203+0000","last_active":"2024-09-12T18:30:17.419734+0000","last_peered":"2024-09-12T18:30:17.419734+0000","last_clean":"2024-09-12T18:30:17.419734+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:30:17.419734+0000","last_undegraded":"2024-09-12T18:30:17.419734+0000","last_fullsized":"2024-09-12T18:30:17.419734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:47.877509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2398","reported_seq":4235,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:17.444594+0000","last_change":"2024-09-12T17:35:50.921094+0000","last_active":"2024-09-12T18:32:17.444594+0000","last_peered":"2024-09-12T18:32:17.444594+0000","last_clean":"2024-09-12T18:32:17.444594+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:32:17.444594+0000","last_undegraded":"2024-09-12T18:32:17.444594+0000","last_fullsized":"2024-09-12T18:32:17.444594+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.702558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1123","reported_seq":2592,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.691930+0000","last_change":"2024-09-12T18:33:21.691930+0000","last_active":"2024-09-12T18:33:21.691930+0000","last_peered":"2024-09-12T18:33:21.691930+0000","last_clean":"2024-09-12T18:33:21.691930+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:33:21.691930+0000","last_undegraded":"2024-09-12T18:33:21.691930+0000","last_fullsized":"2024-09-12T18:33:21.691930+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1123","last_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_deep_scrub":"262'1123","last_deep_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.691845+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":1100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:09.232918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'336","reported_seq":1014,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.086221+0000","last_change":"2024-09-12T18:33:12.086221+0000","last_active":"2024-09-12T18:33:12.086221+0000","last_peered":"2024-09-12T18:33:12.086221+0000","last_clean":"2024-09-12T18:33:12.086221+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:33:12.086221+0000","last_undegraded":"2024-09-12T18:33:12.086221+0000","last_fullsized":"2024-09-12T18:33:12.086221+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.086103+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:25.986928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4614985,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":185869,"num_write":1150,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.088545+0000","last_change":"2024-09-12T18:33:27.088545+0000","last_active":"2024-09-12T18:33:27.088545+0000","last_peered":"2024-09-12T18:33:27.088545+0000","last_clean":"2024-09-12T18:33:27.088545+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:33:27.088545+0000","last_undegraded":"2024-09-12T18:33:27.088545+0000","last_fullsized":"2024-09-12T18:33:27.088545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.088448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:18.854173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'324","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.881003+0000","last_change":"2024-09-12T17:35:46.899126+0000","last_active":"2024-09-12T18:33:03.881003+0000","last_peered":"2024-09-12T18:33:03.881003+0000","last_clean":"2024-09-12T18:33:03.881003+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:33:03.881003+0000","last_undegraded":"2024-09-12T18:33:03.881003+0000","last_fullsized":"2024-09-12T18:33:03.881003+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.188366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49626,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":529,"num_read_kb":1160,"num_write":428,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'790","reported_seq":4758,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.289607+0000","last_change":"2024-09-12T17:35:48.902303+0000","last_active":"2024-09-12T18:33:03.289607+0000","last_peered":"2024-09-12T18:33:03.289607+0000","last_clean":"2024-09-12T18:33:03.289607+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:33:03.289607+0000","last_undegraded":"2024-09-12T18:33:03.289607+0000","last_fullsized":"2024-09-12T18:33:03.289607+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:31.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'116","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.214430+0000","last_change":"2024-09-12T17:35:50.916330+0000","last_active":"2024-09-12T18:32:48.214430+0000","last_peered":"2024-09-12T18:32:48.214430+0000","last_clean":"2024-09-12T18:32:48.214430+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:32:48.214430+0000","last_undegraded":"2024-09-12T18:32:48.214430+0000","last_fullsized":"2024-09-12T18:32:48.214430+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.967026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'520","reported_seq":2169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.619048+0000","last_change":"2024-09-12T18:33:25.619048+0000","last_active":"2024-09-12T18:33:25.619048+0000","last_peered":"2024-09-12T18:33:25.619048+0000","last_clean":"2024-09-12T18:33:25.619048+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:33:25.619048+0000","last_undegraded":"2024-09-12T18:33:25.619048+0000","last_fullsized":"2024-09-12T18:33:25.619048+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'520","last_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_deep_scrub":"262'520","last_deep_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.618938+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.541602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'349","reported_seq":1050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.659128+0000","last_change":"2024-09-12T18:33:15.659128+0000","last_active":"2024-09-12T18:33:15.659128+0000","last_peered":"2024-09-12T18:33:15.659128+0000","last_clean":"2024-09-12T18:33:15.659128+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:33:15.659128+0000","last_undegraded":"2024-09-12T18:33:15.659128+0000","last_fullsized":"2024-09-12T18:33:15.659128+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'349","last_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_deep_scrub":"262'349","last_deep_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.658993+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:57.692359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399009,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":648,"num_read_kb":11855,"num_write":1224,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.132737+0000","last_change":"2024-09-12T18:33:24.132737+0000","last_active":"2024-09-12T18:33:24.132737+0000","last_peered":"2024-09-12T18:33:24.132737+0000","last_clean":"2024-09-12T18:33:24.132737+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:33:24.132737+0000","last_undegraded":"2024-09-12T18:33:24.132737+0000","last_fullsized":"2024-09-12T18:33:24.132737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.132652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:47.476929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'480","reported_seq":1114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.981003+0000","last_change":"2024-09-12T17:35:46.894868+0000","last_active":"2024-09-12T18:33:04.981003+0000","last_peered":"2024-09-12T18:33:04.981003+0000","last_clean":"2024-09-12T18:33:04.981003+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:33:04.981003+0000","last_undegraded":"2024-09-12T18:33:04.981003+0000","last_fullsized":"2024-09-12T18:33:04.981003+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:02.326426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":2056,"num_write":694,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.511164+0000","last_change":"2024-09-12T17:35:48.901213+0000","last_active":"2024-09-12T18:30:02.511164+0000","last_peered":"2024-09-12T18:30:02.511164+0000","last_clean":"2024-09-12T18:30:02.511164+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:30:02.511164+0000","last_undegraded":"2024-09-12T18:30:02.511164+0000","last_fullsized":"2024-09-12T18:30:02.511164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.829487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'162","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.611795+0000","last_change":"2024-09-12T17:35:50.911833+0000","last_active":"2024-09-12T18:30:02.611795+0000","last_peered":"2024-09-12T18:30:02.611795+0000","last_clean":"2024-09-12T18:30:02.611795+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:30:02.611795+0000","last_undegraded":"2024-09-12T18:30:02.611795+0000","last_fullsized":"2024-09-12T18:30:02.611795+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:29.046424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'555","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.239412+0000","last_change":"2024-09-12T18:33:19.239412+0000","last_active":"2024-09-12T18:33:19.239412+0000","last_peered":"2024-09-12T18:33:19.239412+0000","last_clean":"2024-09-12T18:33:19.239412+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:33:19.239412+0000","last_undegraded":"2024-09-12T18:33:19.239412+0000","last_fullsized":"2024-09-12T18:33:19.239412+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'555","last_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_deep_scrub":"262'555","last_deep_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.239331+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:45.930298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'381","reported_seq":1210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.171237+0000","last_change":"2024-09-12T18:33:14.171237+0000","last_active":"2024-09-12T18:33:14.171237+0000","last_peered":"2024-09-12T18:33:14.171237+0000","last_clean":"2024-09-12T18:33:14.171237+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:33:14.171237+0000","last_undegraded":"2024-09-12T18:33:14.171237+0000","last_fullsized":"2024-09-12T18:33:14.171237+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'381","last_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_deep_scrub":"262'381","last_deep_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.171043+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:04.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":952,"num_read_kb":1817,"num_write":1243,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.119518+0000","last_change":"2024-09-12T18:33:25.119518+0000","last_active":"2024-09-12T18:33:25.119518+0000","last_peered":"2024-09-12T18:33:25.119518+0000","last_clean":"2024-09-12T18:33:25.119518+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:33:25.119518+0000","last_undegraded":"2024-09-12T18:33:25.119518+0000","last_fullsized":"2024-09-12T18:33:25.119518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.119405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:06.087705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'292","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.062615+0000","last_change":"2024-09-12T17:35:46.899081+0000","last_active":"2024-09-12T18:33:05.062615+0000","last_peered":"2024-09-12T18:33:05.062615+0000","last_clean":"2024-09-12T18:33:05.062615+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:33:05.062615+0000","last_undegraded":"2024-09-12T18:33:05.062615+0000","last_fullsized":"2024-09-12T18:33:05.062615+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:12.067500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47571,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1071,"num_write":444,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.846238+0000","last_change":"2024-09-12T17:35:48.902048+0000","last_active":"2024-09-12T18:29:57.846238+0000","last_peered":"2024-09-12T18:29:57.846238+0000","last_clean":"2024-09-12T18:29:57.846238+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:29:57.846238+0000","last_undegraded":"2024-09-12T18:29:57.846238+0000","last_fullsized":"2024-09-12T18:29:57.846238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:02.774589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'94","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.488770+0000","last_change":"2024-09-12T17:35:50.921798+0000","last_active":"2024-09-12T18:32:38.488770+0000","last_peered":"2024-09-12T18:32:38.488770+0000","last_clean":"2024-09-12T18:32:38.488770+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:32:38.488770+0000","last_undegraded":"2024-09-12T18:32:38.488770+0000","last_fullsized":"2024-09-12T18:32:38.488770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:56.715205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'574","reported_seq":2088,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.219164+0000","last_change":"2024-09-12T18:33:18.219164+0000","last_active":"2024-09-12T18:33:18.219164+0000","last_peered":"2024-09-12T18:33:18.219164+0000","last_clean":"2024-09-12T18:33:18.219164+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:33:18.219164+0000","last_undegraded":"2024-09-12T18:33:18.219164+0000","last_fullsized":"2024-09-12T18:33:18.219164+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.219044+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.862000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'374","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.728566+0000","last_change":"2024-09-12T18:33:13.728566+0000","last_active":"2024-09-12T18:33:13.728566+0000","last_peered":"2024-09-12T18:33:13.728566+0000","last_clean":"2024-09-12T18:33:13.728566+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:33:13.728566+0000","last_undegraded":"2024-09-12T18:33:13.728566+0000","last_fullsized":"2024-09-12T18:33:13.728566+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'374","last_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_deep_scrub":"262'374","last_deep_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.728424+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:02.902426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30147,"num_write":1155,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"262'6","reported_seq":986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.630372+0000","last_change":"2024-09-12T18:33:25.630372+0000","last_active":"2024-09-12T18:33:25.630372+0000","last_peered":"2024-09-12T18:33:25.630372+0000","last_clean":"2024-09-12T18:33:25.630372+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:33:25.630372+0000","last_undegraded":"2024-09-12T18:33:25.630372+0000","last_fullsized":"2024-09-12T18:33:25.630372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.630267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:05.121838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'314","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.521371+0000","last_change":"2024-09-12T17:35:46.902352+0000","last_active":"2024-09-12T18:33:04.521371+0000","last_peered":"2024-09-12T18:33:04.521371+0000","last_clean":"2024-09-12T18:33:04.521371+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:33:04.521371+0000","last_undegraded":"2024-09-12T18:33:04.521371+0000","last_fullsized":"2024-09-12T18:33:04.521371+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:39.492378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1126,"num_write":412,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'741","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.156987+0000","last_change":"2024-09-12T17:35:48.906082+0000","last_active":"2024-09-12T18:33:04.156987+0000","last_peered":"2024-09-12T18:33:04.156987+0000","last_clean":"2024-09-12T18:33:04.156987+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:33:04.156987+0000","last_undegraded":"2024-09-12T18:33:04.156987+0000","last_fullsized":"2024-09-12T18:33:04.156987+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:57.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'132","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.193519+0000","last_change":"2024-09-12T17:35:50.909941+0000","last_active":"2024-09-12T18:31:27.193519+0000","last_peered":"2024-09-12T18:31:27.193519+0000","last_clean":"2024-09-12T18:31:27.193519+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:31:27.193519+0000","last_undegraded":"2024-09-12T18:31:27.193519+0000","last_fullsized":"2024-09-12T18:31:27.193519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:20.080003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'392","reported_seq":1819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.266301+0000","last_change":"2024-09-12T18:33:20.266301+0000","last_active":"2024-09-12T18:33:20.266301+0000","last_peered":"2024-09-12T18:33:20.266301+0000","last_clean":"2024-09-12T18:33:20.266301+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:33:20.266301+0000","last_undegraded":"2024-09-12T18:33:20.266301+0000","last_fullsized":"2024-09-12T18:33:20.266301+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.266203+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:44.161180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'343","reported_seq":994,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.228696+0000","last_change":"2024-09-12T18:33:14.228696+0000","last_active":"2024-09-12T18:33:14.228696+0000","last_peered":"2024-09-12T18:33:14.228696+0000","last_clean":"2024-09-12T18:33:14.228696+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:14.228696+0000","last_undegraded":"2024-09-12T18:33:14.228696+0000","last_fullsized":"2024-09-12T18:33:14.228696+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'343","last_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_deep_scrub":"262'343","last_deep_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.228588+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.850074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":4238,"num_write":1153,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1446,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.064201+0000","last_change":"2024-09-12T17:35:44.898038+0000","last_active":"2024-09-12T18:33:03.064201+0000","last_peered":"2024-09-12T18:33:03.064201+0000","last_clean":"2024-09-12T18:33:03.064201+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:33:03.064201+0000","last_undegraded":"2024-09-12T18:33:03.064201+0000","last_fullsized":"2024-09-12T18:33:03.064201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:34.625148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'95","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416056+0000","last_change":"2024-09-12T17:35:47.464847+0000","last_active":"2024-09-12T18:29:47.416056+0000","last_peered":"2024-09-12T18:29:47.416056+0000","last_clean":"2024-09-12T18:29:47.416056+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:29:47.416056+0000","last_undegraded":"2024-09-12T18:29:47.416056+0000","last_fullsized":"2024-09-12T18:29:47.416056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:21.681360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'780","reported_seq":2602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.286647+0000","last_change":"2024-09-12T17:35:48.904923+0000","last_active":"2024-09-12T18:33:03.286647+0000","last_peered":"2024-09-12T18:33:03.286647+0000","last_clean":"2024-09-12T18:33:03.286647+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:33:03.286647+0000","last_undegraded":"2024-09-12T18:33:03.286647+0000","last_fullsized":"2024-09-12T18:33:03.286647+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.107183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'108","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:03.539421+0000","last_change":"2024-09-12T17:35:50.910651+0000","last_active":"2024-09-12T18:30:03.539421+0000","last_peered":"2024-09-12T18:30:03.539421+0000","last_clean":"2024-09-12T18:30:03.539421+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:30:03.539421+0000","last_undegraded":"2024-09-12T18:30:03.539421+0000","last_fullsized":"2024-09-12T18:30:03.539421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'457","reported_seq":2059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.674992+0000","last_change":"2024-09-12T18:33:24.674992+0000","last_active":"2024-09-12T18:33:24.674992+0000","last_peered":"2024-09-12T18:33:24.674992+0000","last_clean":"2024-09-12T18:33:24.674992+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:33:24.674992+0000","last_undegraded":"2024-09-12T18:33:24.674992+0000","last_fullsized":"2024-09-12T18:33:24.674992+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.674869+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:09.706871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'370","reported_seq":1124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.177644+0000","last_change":"2024-09-12T18:33:11.177644+0000","last_active":"2024-09-12T18:33:11.177644+0000","last_peered":"2024-09-12T18:33:11.177644+0000","last_clean":"2024-09-12T18:33:11.177644+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:33:11.177644+0000","last_undegraded":"2024-09-12T18:33:11.177644+0000","last_fullsized":"2024-09-12T18:33:11.177644+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.177401+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:34.320877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":622,"num_read_kb":18794,"num_write":1042,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:48.537562+0000","last_change":"2024-09-12T17:35:44.894399+0000","last_active":"2024-09-12T18:29:48.537562+0000","last_peered":"2024-09-12T18:29:48.537562+0000","last_clean":"2024-09-12T18:29:48.537562+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:29:48.537562+0000","last_undegraded":"2024-09-12T18:29:48.537562+0000","last_fullsized":"2024-09-12T18:29:48.537562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:44.105931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'351","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.480160+0000","last_change":"2024-09-12T17:35:46.899125+0000","last_active":"2024-09-12T18:33:03.480160+0000","last_peered":"2024-09-12T18:33:03.480160+0000","last_clean":"2024-09-12T18:33:03.480160+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:33:03.480160+0000","last_undegraded":"2024-09-12T18:33:03.480160+0000","last_fullsized":"2024-09-12T18:33:03.480160+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:44.324703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1185,"num_write":448,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.417912+0000","last_change":"2024-09-12T17:35:48.906391+0000","last_active":"2024-09-12T18:29:52.417912+0000","last_peered":"2024-09-12T18:29:52.417912+0000","last_clean":"2024-09-12T18:29:52.417912+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:29:52.417912+0000","last_undegraded":"2024-09-12T18:29:52.417912+0000","last_fullsized":"2024-09-12T18:29:52.417912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.195528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'123","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.371706+0000","last_change":"2024-09-12T17:35:50.921659+0000","last_active":"2024-09-12T18:30:12.371706+0000","last_peered":"2024-09-12T18:30:12.371706+0000","last_clean":"2024-09-12T18:30:12.371706+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:30:12.371706+0000","last_undegraded":"2024-09-12T18:30:12.371706+0000","last_fullsized":"2024-09-12T18:30:12.371706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:51.201223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'928","reported_seq":2667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.649116+0000","last_change":"2024-09-12T18:33:22.649116+0000","last_active":"2024-09-12T18:33:22.649116+0000","last_peered":"2024-09-12T18:33:22.649116+0000","last_clean":"2024-09-12T18:33:22.649116+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:33:22.649116+0000","last_undegraded":"2024-09-12T18:33:22.649116+0000","last_fullsized":"2024-09-12T18:33:22.649116+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'928","last_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_deep_scrub":"262'928","last_deep_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.648951+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:49.317398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.024500+0000","last_change":"2024-09-12T18:33:13.024500+0000","last_active":"2024-09-12T18:33:13.024500+0000","last_peered":"2024-09-12T18:33:13.024500+0000","last_clean":"2024-09-12T18:33:13.024500+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:33:13.024500+0000","last_undegraded":"2024-09-12T18:33:13.024500+0000","last_fullsized":"2024-09-12T18:33:13.024500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.024409+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.444574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.699741+0000","last_change":"2024-09-12T18:33:13.699741+0000","last_active":"2024-09-12T18:33:13.699741+0000","last_peered":"2024-09-12T18:33:13.699741+0000","last_clean":"2024-09-12T18:33:13.699741+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:33:13.699741+0000","last_undegraded":"2024-09-12T18:33:13.699741+0000","last_fullsized":"2024-09-12T18:33:13.699741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.699652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.289929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'314","reported_seq":955,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.163437+0000","last_change":"2024-09-12T18:33:12.163437+0000","last_active":"2024-09-12T18:33:12.163437+0000","last_peered":"2024-09-12T18:33:12.163437+0000","last_clean":"2024-09-12T18:33:12.163437+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:33:12.163437+0000","last_undegraded":"2024-09-12T18:33:12.163437+0000","last_fullsized":"2024-09-12T18:33:12.163437+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.163325+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:48.898263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":16545,"num_write":1010,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418918+0000","last_change":"2024-09-12T17:35:44.896284+0000","last_active":"2024-09-12T18:29:57.418918+0000","last_peered":"2024-09-12T18:29:57.418918+0000","last_clean":"2024-09-12T18:29:57.418918+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:29:57.418918+0000","last_undegraded":"2024-09-12T18:29:57.418918+0000","last_fullsized":"2024-09-12T18:29:57.418918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.136280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'724","reported_seq":1424,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.736150+0000","last_change":"2024-09-12T17:35:46.902551+0000","last_active":"2024-09-12T18:33:05.736150+0000","last_peered":"2024-09-12T18:33:05.736150+0000","last_clean":"2024-09-12T18:33:05.736150+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:33:05.736150+0000","last_undegraded":"2024-09-12T18:33:05.736150+0000","last_fullsized":"2024-09-12T18:33:05.736150+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:53.419712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141929,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1422,"num_read_kb":3270,"num_write":1334,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846900+0000","last_change":"2024-09-12T17:35:48.901898+0000","last_active":"2024-09-12T18:30:02.846900+0000","last_peered":"2024-09-12T18:30:02.846900+0000","last_clean":"2024-09-12T18:30:02.846900+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:30:02.846900+0000","last_undegraded":"2024-09-12T18:30:02.846900+0000","last_fullsized":"2024-09-12T18:30:02.846900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'186","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.265154+0000","last_change":"2024-09-12T17:35:50.921223+0000","last_active":"2024-09-12T18:31:29.265154+0000","last_peered":"2024-09-12T18:31:29.265154+0000","last_clean":"2024-09-12T18:31:29.265154+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:31:29.265154+0000","last_undegraded":"2024-09-12T18:31:29.265154+0000","last_fullsized":"2024-09-12T18:31:29.265154+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.825503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'774","reported_seq":2228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.642138+0000","last_change":"2024-09-12T18:33:18.642138+0000","last_active":"2024-09-12T18:33:18.642138+0000","last_peered":"2024-09-12T18:33:18.642138+0000","last_clean":"2024-09-12T18:33:18.642138+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:33:18.642138+0000","last_undegraded":"2024-09-12T18:33:18.642138+0000","last_fullsized":"2024-09-12T18:33:18.642138+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.642044+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:43.372937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.980705+0000","last_change":"2024-09-12T18:33:13.980705+0000","last_active":"2024-09-12T18:33:13.980705+0000","last_peered":"2024-09-12T18:33:13.980705+0000","last_clean":"2024-09-12T18:33:13.980705+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:33:13.980705+0000","last_undegraded":"2024-09-12T18:33:13.980705+0000","last_fullsized":"2024-09-12T18:33:13.980705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.980562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:37.681267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'360","reported_seq":1008,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.526881+0000","last_change":"2024-09-12T18:33:10.526881+0000","last_active":"2024-09-12T18:33:10.526881+0000","last_peered":"2024-09-12T18:33:10.526881+0000","last_clean":"2024-09-12T18:33:10.526881+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:33:10.526881+0000","last_undegraded":"2024-09-12T18:33:10.526881+0000","last_fullsized":"2024-09-12T18:33:10.526881+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'360","last_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_deep_scrub":"262'360","last_deep_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.526734+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:39.807485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493074,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":8966,"num_write":1133,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.656378+0000","last_change":"2024-09-12T17:35:44.895852+0000","last_active":"2024-09-12T18:29:57.656378+0000","last_peered":"2024-09-12T18:29:57.656378+0000","last_clean":"2024-09-12T18:29:57.656378+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:29:57.656378+0000","last_undegraded":"2024-09-12T18:29:57.656378+0000","last_fullsized":"2024-09-12T18:29:57.656378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1306","reported_seq":2928,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.668056+0000","last_change":"2024-09-12T17:35:46.899606+0000","last_active":"2024-09-12T18:33:05.668056+0000","last_peered":"2024-09-12T18:33:05.668056+0000","last_clean":"2024-09-12T18:33:05.668056+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:33:05.668056+0000","last_undegraded":"2024-09-12T18:33:05.668056+0000","last_fullsized":"2024-09-12T18:33:05.668056+0000","mapping_epoch":30,"log_start":"262'1200","ondisk_log_start":"262'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:45.048964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2069,"num_read_kb":3913,"num_write":1176,"num_write_kb":1005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:12.421442+0000","last_change":"2024-09-12T17:35:48.903717+0000","last_active":"2024-09-12T18:30:12.421442+0000","last_peered":"2024-09-12T18:30:12.421442+0000","last_clean":"2024-09-12T18:30:12.421442+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:30:12.421442+0000","last_undegraded":"2024-09-12T18:30:12.421442+0000","last_fullsized":"2024-09-12T18:30:12.421442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:26.731204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'253","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.259283+0000","last_change":"2024-09-12T17:35:51.345599+0000","last_active":"2024-09-12T18:31:29.259283+0000","last_peered":"2024-09-12T18:31:29.259283+0000","last_clean":"2024-09-12T18:31:29.259283+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:31:29.259283+0000","last_undegraded":"2024-09-12T18:31:29.259283+0000","last_fullsized":"2024-09-12T18:31:29.259283+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.606088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'492","reported_seq":2077,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.577961+0000","last_change":"2024-09-12T18:33:19.577961+0000","last_active":"2024-09-12T18:33:19.577961+0000","last_peered":"2024-09-12T18:33:19.577961+0000","last_clean":"2024-09-12T18:33:19.577961+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:33:19.577961+0000","last_undegraded":"2024-09-12T18:33:19.577961+0000","last_fullsized":"2024-09-12T18:33:19.577961+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'492","last_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_deep_scrub":"262'492","last_deep_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.577829+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:20.823502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.033801+0000","last_change":"2024-09-12T18:33:11.033801+0000","last_active":"2024-09-12T18:33:11.033801+0000","last_peered":"2024-09-12T18:33:11.033801+0000","last_clean":"2024-09-12T18:33:11.033801+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:33:11.033801+0000","last_undegraded":"2024-09-12T18:33:11.033801+0000","last_fullsized":"2024-09-12T18:33:11.033801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.033735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:58.231249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'331","reported_seq":964,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.619922+0000","last_change":"2024-09-12T18:33:11.619922+0000","last_active":"2024-09-12T18:33:11.619922+0000","last_peered":"2024-09-12T18:33:11.619922+0000","last_clean":"2024-09-12T18:33:11.619922+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:33:11.619922+0000","last_undegraded":"2024-09-12T18:33:11.619922+0000","last_fullsized":"2024-09-12T18:33:11.619922+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.619798+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.863692+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":5597,"num_write":1146,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.139449+0000","last_change":"2024-09-12T18:33:23.139449+0000","last_active":"2024-09-12T18:33:23.139449+0000","last_peered":"2024-09-12T18:33:23.139449+0000","last_clean":"2024-09-12T18:33:23.139449+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:33:23.139449+0000","last_undegraded":"2024-09-12T18:33:23.139449+0000","last_fullsized":"2024-09-12T18:33:23.139449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.139366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:40.988736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'261","reported_seq":1487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:47.728475+0000","last_change":"2024-09-12T17:35:47.465906+0000","last_active":"2024-09-12T18:32:47.728475+0000","last_peered":"2024-09-12T18:32:47.728475+0000","last_clean":"2024-09-12T18:32:47.728475+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:32:47.728475+0000","last_undegraded":"2024-09-12T18:32:47.728475+0000","last_fullsized":"2024-09-12T18:32:47.728475+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:51.604150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846850+0000","last_change":"2024-09-12T17:35:48.900323+0000","last_active":"2024-09-12T18:30:02.846850+0000","last_peered":"2024-09-12T18:30:02.846850+0000","last_clean":"2024-09-12T18:30:02.846850+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:30:02.846850+0000","last_undegraded":"2024-09-12T18:30:02.846850+0000","last_fullsized":"2024-09-12T18:30:02.846850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:55.834585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'282","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.403339+0000","last_change":"2024-09-12T17:35:50.910605+0000","last_active":"2024-09-12T18:31:29.403339+0000","last_peered":"2024-09-12T18:31:29.403339+0000","last_clean":"2024-09-12T18:31:29.403339+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:31:29.403339+0000","last_undegraded":"2024-09-12T18:31:29.403339+0000","last_fullsized":"2024-09-12T18:31:29.403339+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:55.444849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.585034+0000","last_change":"2024-09-12T18:33:15.585034+0000","last_active":"2024-09-12T18:33:15.585034+0000","last_peered":"2024-09-12T18:33:15.585034+0000","last_clean":"2024-09-12T18:33:15.585034+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:33:15.585034+0000","last_undegraded":"2024-09-12T18:33:15.585034+0000","last_fullsized":"2024-09-12T18:33:15.585034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.584923+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:08.823358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":532,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.668450+0000","last_change":"2024-09-12T18:33:12.668450+0000","last_active":"2024-09-12T18:33:12.668450+0000","last_peered":"2024-09-12T18:33:12.668450+0000","last_clean":"2024-09-12T18:33:12.668450+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:33:12.668450+0000","last_undegraded":"2024-09-12T18:33:12.668450+0000","last_fullsized":"2024-09-12T18:33:12.668450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.668348+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:16.360994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'318","reported_seq":963,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.277484+0000","last_change":"2024-09-12T18:33:11.277484+0000","last_active":"2024-09-12T18:33:11.277484+0000","last_peered":"2024-09-12T18:33:11.277484+0000","last_clean":"2024-09-12T18:33:11.277484+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:11.277484+0000","last_undegraded":"2024-09-12T18:33:11.277484+0000","last_fullsized":"2024-09-12T18:33:11.277484+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'318","last_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_deep_scrub":"262'318","last_deep_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.277353+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.314572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524430,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":24675,"num_write":1010,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846866+0000","last_change":"2024-09-12T17:35:44.894175+0000","last_active":"2024-09-12T18:30:02.846866+0000","last_peered":"2024-09-12T18:30:02.846866+0000","last_clean":"2024-09-12T18:30:02.846866+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:30:02.846866+0000","last_undegraded":"2024-09-12T18:30:02.846866+0000","last_fullsized":"2024-09-12T18:30:02.846866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:36.440643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'127","reported_seq":670,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:07.434575+0000","last_change":"2024-09-12T17:35:46.901548+0000","last_active":"2024-09-12T18:32:07.434575+0000","last_peered":"2024-09-12T18:32:07.434575+0000","last_clean":"2024-09-12T18:32:07.434575+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:32:07.434575+0000","last_undegraded":"2024-09-12T18:32:07.434575+0000","last_fullsized":"2024-09-12T18:32:07.434575+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.552114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419806+0000","last_change":"2024-09-12T17:35:48.903992+0000","last_active":"2024-09-12T18:30:02.419806+0000","last_peered":"2024-09-12T18:30:02.419806+0000","last_clean":"2024-09-12T18:30:02.419806+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:30:02.419806+0000","last_undegraded":"2024-09-12T18:30:02.419806+0000","last_fullsized":"2024-09-12T18:30:02.419806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.680834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:25.983301+0000","last_change":"2024-09-12T17:35:50.920568+0000","last_active":"2024-09-12T18:30:25.983301+0000","last_peered":"2024-09-12T18:30:25.983301+0000","last_clean":"2024-09-12T18:30:25.983301+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:30:25.983301+0000","last_undegraded":"2024-09-12T18:30:25.983301+0000","last_fullsized":"2024-09-12T18:30:25.983301+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:05.171883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'754","reported_seq":2211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.610690+0000","last_change":"2024-09-12T18:33:16.610690+0000","last_active":"2024-09-12T18:33:16.610690+0000","last_peered":"2024-09-12T18:33:16.610690+0000","last_clean":"2024-09-12T18:33:16.610690+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:33:16.610690+0000","last_undegraded":"2024-09-12T18:33:16.610690+0000","last_fullsized":"2024-09-12T18:33:16.610690+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'754","last_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_deep_scrub":"262'754","last_deep_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.610589+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:33.968420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'326","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.624372+0000","last_change":"2024-09-12T18:33:11.624372+0000","last_active":"2024-09-12T18:33:11.624372+0000","last_peered":"2024-09-12T18:33:11.624372+0000","last_clean":"2024-09-12T18:33:11.624372+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:33:11.624372+0000","last_undegraded":"2024-09-12T18:33:11.624372+0000","last_fullsized":"2024-09-12T18:33:11.624372+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'326","last_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_deep_scrub":"262'326","last_deep_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.624231+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:49.428871+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":16635,"num_write":1112,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.624559+0000","last_change":"2024-09-12T18:33:10.624559+0000","last_active":"2024-09-12T18:33:10.624559+0000","last_peered":"2024-09-12T18:33:10.624559+0000","last_clean":"2024-09-12T18:33:10.624559+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:33:10.624559+0000","last_undegraded":"2024-09-12T18:33:10.624559+0000","last_fullsized":"2024-09-12T18:33:10.624559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.624487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:45.146624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.683023+0000","last_change":"2024-09-12T18:33:27.683023+0000","last_active":"2024-09-12T18:33:27.683023+0000","last_peered":"2024-09-12T18:33:27.683023+0000","last_clean":"2024-09-12T18:33:27.683023+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:33:27.683023+0000","last_undegraded":"2024-09-12T18:33:27.683023+0000","last_fullsized":"2024-09-12T18:33:27.683023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.682917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.162425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'568","reported_seq":1238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.597924+0000","last_change":"2024-09-12T17:35:46.896066+0000","last_active":"2024-09-12T18:33:05.597924+0000","last_peered":"2024-09-12T18:33:05.597924+0000","last_clean":"2024-09-12T18:33:05.597924+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:33:05.597924+0000","last_undegraded":"2024-09-12T18:33:05.597924+0000","last_fullsized":"2024-09-12T18:33:05.597924+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.503068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1576,"num_read_kb":2723,"num_write":2042,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538876+0000","last_change":"2024-09-12T17:35:48.894684+0000","last_active":"2024-09-12T18:29:58.538876+0000","last_peered":"2024-09-12T18:29:58.538876+0000","last_clean":"2024-09-12T18:29:58.538876+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:29:58.538876+0000","last_undegraded":"2024-09-12T18:29:58.538876+0000","last_fullsized":"2024-09-12T18:29:58.538876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:49.417148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'108","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.266811+0000","last_change":"2024-09-12T17:35:51.346736+0000","last_active":"2024-09-12T18:31:26.266811+0000","last_peered":"2024-09-12T18:31:26.266811+0000","last_clean":"2024-09-12T18:31:26.266811+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:31:26.266811+0000","last_undegraded":"2024-09-12T18:31:26.266811+0000","last_fullsized":"2024-09-12T18:31:26.266811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:44.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1008","reported_seq":2578,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.613529+0000","last_change":"2024-09-12T18:33:19.613529+0000","last_active":"2024-09-12T18:33:19.613529+0000","last_peered":"2024-09-12T18:33:19.613529+0000","last_clean":"2024-09-12T18:33:19.613529+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:33:19.613529+0000","last_undegraded":"2024-09-12T18:33:19.613529+0000","last_fullsized":"2024-09-12T18:33:19.613529+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1008","last_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_deep_scrub":"262'1008","last_deep_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.613439+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:00.782809+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'378","reported_seq":1064,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.566857+0000","last_change":"2024-09-12T18:33:17.566857+0000","last_active":"2024-09-12T18:33:17.566857+0000","last_peered":"2024-09-12T18:33:17.566857+0000","last_clean":"2024-09-12T18:33:17.566857+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:33:17.566857+0000","last_undegraded":"2024-09-12T18:33:17.566857+0000","last_fullsized":"2024-09-12T18:33:17.566857+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.566746+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:24.317944+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820443,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":48347,"num_write":1175,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.966167+0000","last_change":"2024-09-12T18:33:15.966167+0000","last_active":"2024-09-12T18:33:15.966167+0000","last_peered":"2024-09-12T18:33:15.966167+0000","last_clean":"2024-09-12T18:33:15.966167+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:33:15.966167+0000","last_undegraded":"2024-09-12T18:33:15.966167+0000","last_fullsized":"2024-09-12T18:33:15.966167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.966071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.134360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.689372+0000","last_change":"2024-09-12T18:33:23.689372+0000","last_active":"2024-09-12T18:33:23.689372+0000","last_peered":"2024-09-12T18:33:23.689372+0000","last_clean":"2024-09-12T18:33:23.689372+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:33:23.689372+0000","last_undegraded":"2024-09-12T18:33:23.689372+0000","last_fullsized":"2024-09-12T18:33:23.689372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.689279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:38.802520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'201","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.324384+0000","last_change":"2024-09-12T17:35:47.465022+0000","last_active":"2024-09-12T18:31:52.324384+0000","last_peered":"2024-09-12T18:31:52.324384+0000","last_clean":"2024-09-12T18:31:52.324384+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:31:52.324384+0000","last_undegraded":"2024-09-12T18:31:52.324384+0000","last_fullsized":"2024-09-12T18:31:52.324384+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:20.452871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'786","reported_seq":2477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.062671+0000","last_change":"2024-09-12T17:35:48.905261+0000","last_active":"2024-09-12T18:33:05.062671+0000","last_peered":"2024-09-12T18:33:05.062671+0000","last_clean":"2024-09-12T18:33:05.062671+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:33:05.062671+0000","last_undegraded":"2024-09-12T18:33:05.062671+0000","last_fullsized":"2024-09-12T18:33:05.062671+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:47.769518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'444","reported_seq":1988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.284074+0000","last_change":"2024-09-12T18:33:23.284074+0000","last_active":"2024-09-12T18:33:23.284074+0000","last_peered":"2024-09-12T18:33:23.284074+0000","last_clean":"2024-09-12T18:33:23.284074+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:33:23.284074+0000","last_undegraded":"2024-09-12T18:33:23.284074+0000","last_fullsized":"2024-09-12T18:33:23.284074+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.283986+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.932404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'361","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.141754+0000","last_change":"2024-09-12T18:33:13.141754+0000","last_active":"2024-09-12T18:33:13.141754+0000","last_peered":"2024-09-12T18:33:13.141754+0000","last_clean":"2024-09-12T18:33:13.141754+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:33:13.141754+0000","last_undegraded":"2024-09-12T18:33:13.141754+0000","last_fullsized":"2024-09-12T18:33:13.141754+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.141659+0000","objects_scrubbed":8,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:39.600554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":50118,"num_write":1078,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.639195+0000","last_change":"2024-09-12T18:33:22.639195+0000","last_active":"2024-09-12T18:33:22.639195+0000","last_peered":"2024-09-12T18:33:22.639195+0000","last_clean":"2024-09-12T18:33:22.639195+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:33:22.639195+0000","last_undegraded":"2024-09-12T18:33:22.639195+0000","last_fullsized":"2024-09-12T18:33:22.639195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.639106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:28.364727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538843+0000","last_change":"2024-09-12T17:35:44.889025+0000","last_active":"2024-09-12T18:29:58.538843+0000","last_peered":"2024-09-12T18:29:58.538843+0000","last_clean":"2024-09-12T18:29:58.538843+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:29:58.538843+0000","last_undegraded":"2024-09-12T18:29:58.538843+0000","last_fullsized":"2024-09-12T18:29:58.538843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:25.842079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'113","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538898+0000","last_change":"2024-09-12T17:35:46.896908+0000","last_active":"2024-09-12T18:29:58.538898+0000","last_peered":"2024-09-12T18:29:58.538898+0000","last_clean":"2024-09-12T18:29:58.538898+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:29:58.538898+0000","last_undegraded":"2024-09-12T18:29:58.538898+0000","last_fullsized":"2024-09-12T18:29:58.538898+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:22.911858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'818","reported_seq":2745,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.253989+0000","last_change":"2024-09-12T17:35:48.900105+0000","last_active":"2024-09-12T18:33:05.253989+0000","last_peered":"2024-09-12T18:33:05.253989+0000","last_clean":"2024-09-12T18:33:05.253989+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:33:05.253989+0000","last_undegraded":"2024-09-12T18:33:05.253989+0000","last_fullsized":"2024-09-12T18:33:05.253989+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:30.882725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'184","reported_seq":689,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845406+0000","last_change":"2024-09-12T17:35:50.910752+0000","last_active":"2024-09-12T18:29:52.845406+0000","last_peered":"2024-09-12T18:29:52.845406+0000","last_clean":"2024-09-12T18:29:52.845406+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:29:52.845406+0000","last_undegraded":"2024-09-12T18:29:52.845406+0000","last_fullsized":"2024-09-12T18:29:52.845406+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.734993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'541","reported_seq":2153,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.238244+0000","last_change":"2024-09-12T18:33:16.238244+0000","last_active":"2024-09-12T18:33:16.238244+0000","last_peered":"2024-09-12T18:33:16.238244+0000","last_clean":"2024-09-12T18:33:16.238244+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:33:16.238244+0000","last_undegraded":"2024-09-12T18:33:16.238244+0000","last_fullsized":"2024-09-12T18:33:16.238244+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.238154+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.758872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'301","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.484120+0000","last_change":"2024-09-12T18:33:09.484120+0000","last_active":"2024-09-12T18:33:09.484120+0000","last_peered":"2024-09-12T18:33:09.484120+0000","last_clean":"2024-09-12T18:33:09.484120+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:33:09.484120+0000","last_undegraded":"2024-09-12T18:33:09.484120+0000","last_fullsized":"2024-09-12T18:33:09.484120+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'301","last_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_deep_scrub":"262'301","last_deep_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_clean_scrub_stamp":"2024-09-12T18:33:09.484014+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:09.383970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":18058,"num_write":1049,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.699204+0000","last_change":"2024-09-12T18:33:12.699204+0000","last_active":"2024-09-12T18:33:12.699204+0000","last_peered":"2024-09-12T18:33:12.699204+0000","last_clean":"2024-09-12T18:33:12.699204+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:33:12.699204+0000","last_undegraded":"2024-09-12T18:33:12.699204+0000","last_fullsized":"2024-09-12T18:33:12.699204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.699122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.717334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417831+0000","last_change":"2024-09-12T17:35:44.893144+0000","last_active":"2024-09-12T18:30:02.417831+0000","last_peered":"2024-09-12T18:30:02.417831+0000","last_clean":"2024-09-12T18:30:02.417831+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:30:02.417831+0000","last_undegraded":"2024-09-12T18:30:02.417831+0000","last_fullsized":"2024-09-12T18:30:02.417831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:31.642197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'718","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.990899+0000","last_change":"2024-09-12T17:35:47.464888+0000","last_active":"2024-09-12T18:33:05.990899+0000","last_peered":"2024-09-12T18:33:05.990899+0000","last_clean":"2024-09-12T18:33:05.990899+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:33:05.990899+0000","last_undegraded":"2024-09-12T18:33:05.990899+0000","last_fullsized":"2024-09-12T18:33:05.990899+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":3013,"num_write":1042,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.417876+0000","last_change":"2024-09-12T17:35:48.899057+0000","last_active":"2024-09-12T18:30:02.417876+0000","last_peered":"2024-09-12T18:30:02.417876+0000","last_clean":"2024-09-12T18:30:02.417876+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:30:02.417876+0000","last_undegraded":"2024-09-12T18:30:02.417876+0000","last_fullsized":"2024-09-12T18:30:02.417876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:39.593576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'129","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.655594+0000","last_change":"2024-09-12T17:35:50.924579+0000","last_active":"2024-09-12T18:29:52.655594+0000","last_peered":"2024-09-12T18:29:52.655594+0000","last_clean":"2024-09-12T18:29:52.655594+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:29:52.655594+0000","last_undegraded":"2024-09-12T18:29:52.655594+0000","last_fullsized":"2024-09-12T18:29:52.655594+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:27.853643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.346697+0000","last_change":"2024-09-12T17:35:50.923096+0000","last_active":"2024-09-12T18:31:29.346697+0000","last_peered":"2024-09-12T18:31:29.346697+0000","last_clean":"2024-09-12T18:31:29.346697+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:31:29.346697+0000","last_undegraded":"2024-09-12T18:31:29.346697+0000","last_fullsized":"2024-09-12T18:31:29.346697+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:15.866908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'397","reported_seq":1908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.247025+0000","last_change":"2024-09-12T18:33:21.247025+0000","last_active":"2024-09-12T18:33:21.247025+0000","last_peered":"2024-09-12T18:33:21.247025+0000","last_clean":"2024-09-12T18:33:21.247025+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:33:21.247025+0000","last_undegraded":"2024-09-12T18:33:21.247025+0000","last_fullsized":"2024-09-12T18:33:21.247025+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'397","last_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_deep_scrub":"262'397","last_deep_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.246937+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:02.793084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'323","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.235775+0000","last_change":"2024-09-12T18:33:12.235775+0000","last_active":"2024-09-12T18:33:12.235775+0000","last_peered":"2024-09-12T18:33:12.235775+0000","last_clean":"2024-09-12T18:33:12.235775+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:12.235775+0000","last_undegraded":"2024-09-12T18:33:12.235775+0000","last_fullsized":"2024-09-12T18:33:12.235775+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.235626+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:59.915198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":63909,"num_write":1001,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.626695+0000","last_change":"2024-09-12T18:33:23.626695+0000","last_active":"2024-09-12T18:33:23.626695+0000","last_peered":"2024-09-12T18:33:23.626695+0000","last_clean":"2024-09-12T18:33:23.626695+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:33:23.626695+0000","last_undegraded":"2024-09-12T18:33:23.626695+0000","last_fullsized":"2024-09-12T18:33:23.626695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.626609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:00.714762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'262","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.799077+0000","last_change":"2024-09-12T17:35:46.898039+0000","last_active":"2024-09-12T18:33:03.799077+0000","last_peered":"2024-09-12T18:33:03.799077+0000","last_clean":"2024-09-12T18:33:03.799077+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:33:03.799077+0000","last_undegraded":"2024-09-12T18:33:03.799077+0000","last_fullsized":"2024-09-12T18:33:03.799077+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.270815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":1008,"num_write":356,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414122+0000","last_change":"2024-09-12T17:35:48.899309+0000","last_active":"2024-09-12T18:29:32.414122+0000","last_peered":"2024-09-12T18:29:32.414122+0000","last_clean":"2024-09-12T18:29:32.414122+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:29:32.414122+0000","last_undegraded":"2024-09-12T18:29:32.414122+0000","last_fullsized":"2024-09-12T18:29:32.414122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:50.941565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'977","reported_seq":2465,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.612697+0000","last_change":"2024-09-12T18:33:20.612697+0000","last_active":"2024-09-12T18:33:20.612697+0000","last_peered":"2024-09-12T18:33:20.612697+0000","last_clean":"2024-09-12T18:33:20.612697+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:33:20.612697+0000","last_undegraded":"2024-09-12T18:33:20.612697+0000","last_fullsized":"2024-09-12T18:33:20.612697+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'977","last_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_deep_scrub":"262'977","last_deep_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.612589+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":900,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:51.536947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'391","reported_seq":1032,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.958378+0000","last_change":"2024-09-12T18:33:17.958378+0000","last_active":"2024-09-12T18:33:17.958378+0000","last_peered":"2024-09-12T18:33:17.958378+0000","last_clean":"2024-09-12T18:33:17.958378+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:33:17.958378+0000","last_undegraded":"2024-09-12T18:33:17.958378+0000","last_fullsized":"2024-09-12T18:33:17.958378+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'391","last_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_deep_scrub":"262'391","last_deep_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.958248+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:10.190084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079946,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":8296,"num_write":1132,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'3","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.053740+0000","last_change":"2024-09-12T17:35:44.893880+0000","last_active":"2024-09-12T18:33:03.053740+0000","last_peered":"2024-09-12T18:33:03.053740+0000","last_clean":"2024-09-12T18:33:03.053740+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:33:03.053740+0000","last_undegraded":"2024-09-12T18:33:03.053740+0000","last_fullsized":"2024-09-12T18:33:03.053740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:43.603787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'55","reported_seq":559,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842309+0000","last_change":"2024-09-12T17:35:46.898981+0000","last_active":"2024-09-12T18:29:27.842309+0000","last_peered":"2024-09-12T18:29:27.842309+0000","last_clean":"2024-09-12T18:29:27.842309+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:29:27.842309+0000","last_undegraded":"2024-09-12T18:29:27.842309+0000","last_fullsized":"2024-09-12T18:29:27.842309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414052+0000","last_change":"2024-09-12T17:35:48.906133+0000","last_active":"2024-09-12T18:29:32.414052+0000","last_peered":"2024-09-12T18:29:32.414052+0000","last_clean":"2024-09-12T18:29:32.414052+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:29:32.414052+0000","last_undegraded":"2024-09-12T18:29:32.414052+0000","last_fullsized":"2024-09-12T18:29:32.414052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:11.783795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'186","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.314659+0000","last_change":"2024-09-12T17:35:50.911342+0000","last_active":"2024-09-12T18:31:28.314659+0000","last_peered":"2024-09-12T18:31:28.314659+0000","last_clean":"2024-09-12T18:31:28.314659+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:31:28.314659+0000","last_undegraded":"2024-09-12T18:31:28.314659+0000","last_fullsized":"2024-09-12T18:31:28.314659+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'556","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.319941+0000","last_change":"2024-09-12T18:33:25.319941+0000","last_active":"2024-09-12T18:33:25.319941+0000","last_peered":"2024-09-12T18:33:25.319941+0000","last_clean":"2024-09-12T18:33:25.319941+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:33:25.319941+0000","last_undegraded":"2024-09-12T18:33:25.319941+0000","last_fullsized":"2024-09-12T18:33:25.319941+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'556","last_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_deep_scrub":"262'556","last_deep_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.319848+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:58.204185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'368","reported_seq":1045,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.702522+0000","last_change":"2024-09-12T18:33:14.702522+0000","last_active":"2024-09-12T18:33:14.702522+0000","last_peered":"2024-09-12T18:33:14.702522+0000","last_clean":"2024-09-12T18:33:14.702522+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:33:14.702522+0000","last_undegraded":"2024-09-12T18:33:14.702522+0000","last_fullsized":"2024-09-12T18:33:14.702522+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'368","last_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_deep_scrub":"262'368","last_deep_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.702321+0000","objects_scrubbed":11,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:33.790945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350736,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":674,"num_read_kb":8078,"num_write":1180,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413192+0000","last_change":"2024-09-12T17:35:44.899119+0000","last_active":"2024-09-12T18:29:27.413192+0000","last_peered":"2024-09-12T18:29:27.413192+0000","last_clean":"2024-09-12T18:29:27.413192+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:29:27.413192+0000","last_undegraded":"2024-09-12T18:29:27.413192+0000","last_fullsized":"2024-09-12T18:29:27.413192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.437374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'319","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.440519+0000","last_change":"2024-09-12T17:35:46.899592+0000","last_active":"2024-09-12T18:33:05.440519+0000","last_peered":"2024-09-12T18:33:05.440519+0000","last_clean":"2024-09-12T18:33:05.440519+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:33:05.440519+0000","last_undegraded":"2024-09-12T18:33:05.440519+0000","last_fullsized":"2024-09-12T18:33:05.440519+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:41.130246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48623,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1190,"num_write":438,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.414094+0000","last_change":"2024-09-12T17:35:48.904071+0000","last_active":"2024-09-12T18:29:32.414094+0000","last_peered":"2024-09-12T18:29:32.414094+0000","last_clean":"2024-09-12T18:29:32.414094+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:29:32.414094+0000","last_undegraded":"2024-09-12T18:29:32.414094+0000","last_fullsized":"2024-09-12T18:29:32.414094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:07.350511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'98","reported_seq":609,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.664248+0000","last_change":"2024-09-12T17:35:50.921087+0000","last_active":"2024-09-12T18:30:52.664248+0000","last_peered":"2024-09-12T18:30:52.664248+0000","last_clean":"2024-09-12T18:30:52.664248+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:30:52.664248+0000","last_undegraded":"2024-09-12T18:30:52.664248+0000","last_fullsized":"2024-09-12T18:30:52.664248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1027","reported_seq":2674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.355171+0000","last_change":"2024-09-12T18:33:26.355171+0000","last_active":"2024-09-12T18:33:26.355171+0000","last_peered":"2024-09-12T18:33:26.355171+0000","last_clean":"2024-09-12T18:33:26.355171+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:33:26.355171+0000","last_undegraded":"2024-09-12T18:33:26.355171+0000","last_fullsized":"2024-09-12T18:33:26.355171+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1027","last_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_deep_scrub":"262'1027","last_deep_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.355090+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:15.967085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'378","reported_seq":1006,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.546149+0000","last_change":"2024-09-12T18:33:13.546149+0000","last_active":"2024-09-12T18:33:13.546149+0000","last_peered":"2024-09-12T18:33:13.546149+0000","last_clean":"2024-09-12T18:33:13.546149+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:33:13.546149+0000","last_undegraded":"2024-09-12T18:33:13.546149+0000","last_fullsized":"2024-09-12T18:33:13.546149+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.546033+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:18.615258+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":38183,"num_write":1089,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.720977+0000","last_change":"2024-09-12T18:33:26.720977+0000","last_active":"2024-09-12T18:33:26.720977+0000","last_peered":"2024-09-12T18:33:26.720977+0000","last_clean":"2024-09-12T18:33:26.720977+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:33:26.720977+0000","last_undegraded":"2024-09-12T18:33:26.720977+0000","last_fullsized":"2024-09-12T18:33:26.720977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.720886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:00.916187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'276","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.201749+0000","last_change":"2024-09-12T17:35:46.899948+0000","last_active":"2024-09-12T18:33:05.201749+0000","last_peered":"2024-09-12T18:33:05.201749+0000","last_clean":"2024-09-12T18:33:05.201749+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:33:05.201749+0000","last_undegraded":"2024-09-12T18:33:05.201749+0000","last_fullsized":"2024-09-12T18:33:05.201749+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.546669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54427,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1013,"num_write":368,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:32.842896+0000","last_change":"2024-09-12T17:35:48.900909+0000","last_active":"2024-09-12T18:29:32.842896+0000","last_peered":"2024-09-12T18:29:32.842896+0000","last_clean":"2024-09-12T18:29:32.842896+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:29:32.842896+0000","last_undegraded":"2024-09-12T18:29:32.842896+0000","last_fullsized":"2024-09-12T18:29:32.842896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.781603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'862","reported_seq":2492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.706522+0000","last_change":"2024-09-12T18:33:20.706522+0000","last_active":"2024-09-12T18:33:20.706522+0000","last_peered":"2024-09-12T18:33:20.706522+0000","last_clean":"2024-09-12T18:33:20.706522+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:33:20.706522+0000","last_undegraded":"2024-09-12T18:33:20.706522+0000","last_fullsized":"2024-09-12T18:33:20.706522+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.706397+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:46.363194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'357","reported_seq":1092,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.251755+0000","last_change":"2024-09-12T18:33:16.251755+0000","last_active":"2024-09-12T18:33:16.251755+0000","last_peered":"2024-09-12T18:33:16.251755+0000","last_clean":"2024-09-12T18:33:16.251755+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:33:16.251755+0000","last_undegraded":"2024-09-12T18:33:16.251755+0000","last_fullsized":"2024-09-12T18:33:16.251755+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.251595+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.014047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080042,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":5768,"num_write":997,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845447+0000","last_change":"2024-09-12T17:35:44.897738+0000","last_active":"2024-09-12T18:29:52.845447+0000","last_peered":"2024-09-12T18:29:52.845447+0000","last_clean":"2024-09-12T18:29:52.845447+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:29:52.845447+0000","last_undegraded":"2024-09-12T18:29:52.845447+0000","last_fullsized":"2024-09-12T18:29:52.845447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:43.811251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'498","reported_seq":1129,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.139067+0000","last_change":"2024-09-12T17:35:46.899736+0000","last_active":"2024-09-12T18:33:05.139067+0000","last_peered":"2024-09-12T18:33:05.139067+0000","last_clean":"2024-09-12T18:33:05.139067+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:33:05.139067+0000","last_undegraded":"2024-09-12T18:33:05.139067+0000","last_fullsized":"2024-09-12T18:33:05.139067+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110948,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":875,"num_read_kb":2101,"num_write":752,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.664274+0000","last_change":"2024-09-12T17:35:48.900061+0000","last_active":"2024-09-12T18:30:52.664274+0000","last_peered":"2024-09-12T18:30:52.664274+0000","last_clean":"2024-09-12T18:30:52.664274+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:30:52.664274+0000","last_undegraded":"2024-09-12T18:30:52.664274+0000","last_fullsized":"2024-09-12T18:30:52.664274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'164","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.297167+0000","last_change":"2024-09-12T17:35:51.347046+0000","last_active":"2024-09-12T18:31:28.297167+0000","last_peered":"2024-09-12T18:31:28.297167+0000","last_clean":"2024-09-12T18:31:28.297167+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:31:28.297167+0000","last_undegraded":"2024-09-12T18:31:28.297167+0000","last_fullsized":"2024-09-12T18:31:28.297167+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.856381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'776","reported_seq":2176,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.637333+0000","last_change":"2024-09-12T18:33:23.637333+0000","last_active":"2024-09-12T18:33:23.637333+0000","last_peered":"2024-09-12T18:33:23.637333+0000","last_clean":"2024-09-12T18:33:23.637333+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:33:23.637333+0000","last_undegraded":"2024-09-12T18:33:23.637333+0000","last_fullsized":"2024-09-12T18:33:23.637333+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'776","last_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_deep_scrub":"262'776","last_deep_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.637244+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:07.717470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'292","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.609610+0000","last_change":"2024-09-12T18:33:12.609610+0000","last_active":"2024-09-12T18:33:12.609610+0000","last_peered":"2024-09-12T18:33:12.609610+0000","last_clean":"2024-09-12T18:33:12.609610+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:33:12.609610+0000","last_undegraded":"2024-09-12T18:33:12.609610+0000","last_fullsized":"2024-09-12T18:33:12.609610+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.609480+0000","objects_scrubbed":9,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:33.114173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694644,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":28092,"num_write":983,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.418873+0000","last_change":"2024-09-12T17:35:44.897834+0000","last_active":"2024-09-12T18:29:57.418873+0000","last_peered":"2024-09-12T18:29:57.418873+0000","last_clean":"2024-09-12T18:29:57.418873+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:29:57.418873+0000","last_undegraded":"2024-09-12T18:29:57.418873+0000","last_fullsized":"2024-09-12T18:29:57.418873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:52.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'326","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.294433+0000","last_change":"2024-09-12T17:35:46.899505+0000","last_active":"2024-09-12T18:33:05.294433+0000","last_peered":"2024-09-12T18:33:05.294433+0000","last_clean":"2024-09-12T18:33:05.294433+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:33:05.294433+0000","last_undegraded":"2024-09-12T18:33:05.294433+0000","last_fullsized":"2024-09-12T18:33:05.294433+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56643,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1253,"num_write":470,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.617902+0000","last_change":"2024-09-12T17:35:48.906992+0000","last_active":"2024-09-12T18:30:52.617902+0000","last_peered":"2024-09-12T18:30:52.617902+0000","last_clean":"2024-09-12T18:30:52.617902+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:30:52.617902+0000","last_undegraded":"2024-09-12T18:30:52.617902+0000","last_fullsized":"2024-09-12T18:30:52.617902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'197","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.615415+0000","last_change":"2024-09-12T17:35:50.916243+0000","last_active":"2024-09-12T18:31:26.615415+0000","last_peered":"2024-09-12T18:31:26.615415+0000","last_clean":"2024-09-12T18:31:26.615415+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:31:26.615415+0000","last_undegraded":"2024-09-12T18:31:26.615415+0000","last_fullsized":"2024-09-12T18:31:26.615415+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:37.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1293","reported_seq":2865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.391795+0000","last_change":"2024-09-12T17:35:42.890895+0000","last_active":"2024-09-12T18:32:48.391795+0000","last_peered":"2024-09-12T18:32:48.391795+0000","last_clean":"2024-09-12T18:32:48.391795+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:32:48.391795+0000","last_undegraded":"2024-09-12T18:32:48.391795+0000","last_fullsized":"2024-09-12T18:32:48.391795+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'314","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.214145+0000","last_change":"2024-09-12T18:33:13.214086+0000","last_active":"2024-09-12T18:33:13.214145+0000","last_peered":"2024-09-12T18:33:13.214145+0000","last_clean":"2024-09-12T18:33:13.214145+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:13.214145+0000","last_undegraded":"2024-09-12T18:33:13.214145+0000","last_fullsized":"2024-09-12T18:33:13.214145+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.213966+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:52.702345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":10892,"num_write":984,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546366+0000","last_change":"2024-09-12T17:35:44.893724+0000","last_active":"2024-09-12T18:30:48.546366+0000","last_peered":"2024-09-12T18:30:48.546366+0000","last_clean":"2024-09-12T18:30:48.546366+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:30:48.546366+0000","last_undegraded":"2024-09-12T18:30:48.546366+0000","last_fullsized":"2024-09-12T18:30:48.546366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'291","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.126353+0000","last_change":"2024-09-12T17:35:47.464841+0000","last_active":"2024-09-12T18:33:04.126353+0000","last_peered":"2024-09-12T18:33:04.126353+0000","last_clean":"2024-09-12T18:33:04.126353+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:33:04.126353+0000","last_undegraded":"2024-09-12T18:33:04.126353+0000","last_fullsized":"2024-09-12T18:33:04.126353+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:30.514600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48414,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":1088,"num_write":394,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.612492+0000","last_change":"2024-09-12T17:35:48.901108+0000","last_active":"2024-09-12T18:30:07.612492+0000","last_peered":"2024-09-12T18:30:07.612492+0000","last_clean":"2024-09-12T18:30:07.612492+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:30:07.612492+0000","last_undegraded":"2024-09-12T18:30:07.612492+0000","last_fullsized":"2024-09-12T18:30:07.612492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:24.864398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'134","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.243540+0000","last_change":"2024-09-12T17:35:50.924276+0000","last_active":"2024-09-12T18:32:50.243540+0000","last_peered":"2024-09-12T18:32:50.243540+0000","last_clean":"2024-09-12T18:32:50.243540+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:32:50.243540+0000","last_undegraded":"2024-09-12T18:32:50.243540+0000","last_fullsized":"2024-09-12T18:32:50.243540+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:54.892800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'552","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.071677+0000","last_change":"2024-09-12T18:33:17.071677+0000","last_active":"2024-09-12T18:33:17.071677+0000","last_peered":"2024-09-12T18:33:17.071677+0000","last_clean":"2024-09-12T18:33:17.071677+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:33:17.071677+0000","last_undegraded":"2024-09-12T18:33:17.071677+0000","last_fullsized":"2024-09-12T18:33:17.071677+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'552","last_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_deep_scrub":"262'552","last_deep_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.071573+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:16.342863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'359","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.585198+0000","last_change":"2024-09-12T18:33:12.585151+0000","last_active":"2024-09-12T18:33:12.585198+0000","last_peered":"2024-09-12T18:33:12.585198+0000","last_clean":"2024-09-12T18:33:12.585198+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:33:12.585198+0000","last_undegraded":"2024-09-12T18:33:12.585198+0000","last_fullsized":"2024-09-12T18:33:12.585198+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.585060+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:16.468003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":50516,"num_write":1214,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.617318+0000","last_change":"2024-09-12T17:35:44.898107+0000","last_active":"2024-09-12T18:30:47.617318+0000","last_peered":"2024-09-12T18:30:47.617318+0000","last_clean":"2024-09-12T18:30:47.617318+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:30:47.617318+0000","last_undegraded":"2024-09-12T18:30:47.617318+0000","last_fullsized":"2024-09-12T18:30:47.617318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'103","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:58.538945+0000","last_change":"2024-09-12T17:35:47.464849+0000","last_active":"2024-09-12T18:29:58.538945+0000","last_peered":"2024-09-12T18:29:58.538945+0000","last_clean":"2024-09-12T18:29:58.538945+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:29:58.538945+0000","last_undegraded":"2024-09-12T18:29:58.538945+0000","last_fullsized":"2024-09-12T18:29:58.538945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:58.141528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'779","reported_seq":4141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.281828+0000","last_change":"2024-09-12T17:35:48.900442+0000","last_active":"2024-09-12T18:33:03.281828+0000","last_peered":"2024-09-12T18:33:03.281828+0000","last_clean":"2024-09-12T18:33:03.281828+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:33:03.281828+0000","last_undegraded":"2024-09-12T18:33:03.281828+0000","last_fullsized":"2024-09-12T18:33:03.281828+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:15.114968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:46.761165+0000","last_change":"2024-09-12T17:35:50.922214+0000","last_active":"2024-09-12T18:29:46.761165+0000","last_peered":"2024-09-12T18:29:46.761165+0000","last_clean":"2024-09-12T18:29:46.761165+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:29:46.761165+0000","last_undegraded":"2024-09-12T18:29:46.761165+0000","last_fullsized":"2024-09-12T18:29:46.761165+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.526052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'766","reported_seq":2352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.332245+0000","last_change":"2024-09-12T18:33:24.332245+0000","last_active":"2024-09-12T18:33:24.332245+0000","last_peered":"2024-09-12T18:33:24.332245+0000","last_clean":"2024-09-12T18:33:24.332245+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:33:24.332245+0000","last_undegraded":"2024-09-12T18:33:24.332245+0000","last_fullsized":"2024-09-12T18:33:24.332245+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'766","last_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_deep_scrub":"262'766","last_deep_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.332108+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:12.983708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'337","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.052912+0000","last_change":"2024-09-12T18:33:13.052912+0000","last_active":"2024-09-12T18:33:13.052912+0000","last_peered":"2024-09-12T18:33:13.052912+0000","last_clean":"2024-09-12T18:33:13.052912+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:33:13.052912+0000","last_undegraded":"2024-09-12T18:33:13.052912+0000","last_fullsized":"2024-09-12T18:33:13.052912+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'337","last_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_deep_scrub":"262'337","last_deep_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.052825+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:55.171930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":50614,"num_write":1066,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.427915+0000","last_change":"2024-09-12T17:35:44.899845+0000","last_active":"2024-09-12T18:30:47.427915+0000","last_peered":"2024-09-12T18:30:47.427915+0000","last_clean":"2024-09-12T18:30:47.427915+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:30:47.427915+0000","last_undegraded":"2024-09-12T18:30:47.427915+0000","last_fullsized":"2024-09-12T18:30:47.427915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'307","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.601122+0000","last_change":"2024-09-12T17:35:46.897904+0000","last_active":"2024-09-12T18:33:04.601122+0000","last_peered":"2024-09-12T18:33:04.601122+0000","last_clean":"2024-09-12T18:33:04.601122+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:33:04.601122+0000","last_undegraded":"2024-09-12T18:33:04.601122+0000","last_fullsized":"2024-09-12T18:33:04.601122+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:11.348372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44344,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":1104,"num_write":414,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:02.839380+0000","last_change":"2024-09-12T17:35:48.900397+0000","last_active":"2024-09-12T18:29:02.839380+0000","last_peered":"2024-09-12T18:29:02.839380+0000","last_clean":"2024-09-12T18:29:02.839380+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:29:02.839380+0000","last_undegraded":"2024-09-12T18:29:02.839380+0000","last_fullsized":"2024-09-12T18:29:02.839380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:17.530372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'122","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.269926+0000","last_change":"2024-09-12T17:35:50.921023+0000","last_active":"2024-09-12T18:31:26.269926+0000","last_peered":"2024-09-12T18:31:26.269926+0000","last_clean":"2024-09-12T18:31:26.269926+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:31:26.269926+0000","last_undegraded":"2024-09-12T18:31:26.269926+0000","last_fullsized":"2024-09-12T18:31:26.269926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:23.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'399","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.327113+0000","last_change":"2024-09-12T18:33:23.327113+0000","last_active":"2024-09-12T18:33:23.327113+0000","last_peered":"2024-09-12T18:33:23.327113+0000","last_clean":"2024-09-12T18:33:23.327113+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:33:23.327113+0000","last_undegraded":"2024-09-12T18:33:23.327113+0000","last_fullsized":"2024-09-12T18:33:23.327113+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.326995+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:31.607912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3241,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'346","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.675047+0000","last_change":"2024-09-12T18:33:17.675047+0000","last_active":"2024-09-12T18:33:17.675047+0000","last_peered":"2024-09-12T18:33:17.675047+0000","last_clean":"2024-09-12T18:33:17.675047+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:33:17.675047+0000","last_undegraded":"2024-09-12T18:33:17.675047+0000","last_fullsized":"2024-09-12T18:33:17.675047+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.674867+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:20.180450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5819619,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":36012,"num_write":1062,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.663418+0000","last_change":"2024-09-12T17:35:44.895548+0000","last_active":"2024-09-12T18:30:47.663418+0000","last_peered":"2024-09-12T18:30:47.663418+0000","last_clean":"2024-09-12T18:30:47.663418+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:30:47.663418+0000","last_undegraded":"2024-09-12T18:30:47.663418+0000","last_fullsized":"2024-09-12T18:30:47.663418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'286","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.672602+0000","last_change":"2024-09-12T17:35:46.894996+0000","last_active":"2024-09-12T18:33:04.672602+0000","last_peered":"2024-09-12T18:33:04.672602+0000","last_clean":"2024-09-12T18:33:04.672602+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:33:04.672602+0000","last_undegraded":"2024-09-12T18:33:04.672602+0000","last_fullsized":"2024-09-12T18:33:04.672602+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:53.303510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53785,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1068,"num_write":382,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.410641+0000","last_change":"2024-09-12T17:35:48.901220+0000","last_active":"2024-09-12T18:29:12.410641+0000","last_peered":"2024-09-12T18:29:12.410641+0000","last_clean":"2024-09-12T18:29:12.410641+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:29:12.410641+0000","last_undegraded":"2024-09-12T18:29:12.410641+0000","last_fullsized":"2024-09-12T18:29:12.410641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:24.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.746414+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:28.746414+0000","last_peered":"2024-09-12T18:31:28.746414+0000","last_clean":"2024-09-12T18:31:28.746414+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:28.746414+0000","last_undegraded":"2024-09-12T18:31:28.746414+0000","last_fullsized":"2024-09-12T18:31:28.746414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:21.959973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'539","reported_seq":2090,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.693922+0000","last_change":"2024-09-12T17:35:42.886124+0000","last_active":"2024-09-12T18:30:18.693922+0000","last_peered":"2024-09-12T18:30:18.693922+0000","last_clean":"2024-09-12T18:30:18.693922+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:30:18.693922+0000","last_undegraded":"2024-09-12T18:30:18.693922+0000","last_fullsized":"2024-09-12T18:30:18.693922+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'389","reported_seq":1064,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.172964+0000","last_change":"2024-09-12T18:33:19.172964+0000","last_active":"2024-09-12T18:33:19.172964+0000","last_peered":"2024-09-12T18:33:19.172964+0000","last_clean":"2024-09-12T18:33:19.172964+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:33:19.172964+0000","last_undegraded":"2024-09-12T18:33:19.172964+0000","last_fullsized":"2024-09-12T18:33:19.172964+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.172834+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:19.523494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":33965,"num_write":1123,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:28:58.530433+0000","last_change":"2024-09-12T17:35:44.891585+0000","last_active":"2024-09-12T18:28:58.530433+0000","last_peered":"2024-09-12T18:28:58.530433+0000","last_clean":"2024-09-12T18:28:58.530433+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:28:58.530433+0000","last_undegraded":"2024-09-12T18:28:58.530433+0000","last_fullsized":"2024-09-12T18:28:58.530433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:53.135715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'270","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.970594+0000","last_change":"2024-09-12T17:35:46.899537+0000","last_active":"2024-09-12T18:33:03.970594+0000","last_peered":"2024-09-12T18:33:03.970594+0000","last_clean":"2024-09-12T18:33:03.970594+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:33:03.970594+0000","last_undegraded":"2024-09-12T18:33:03.970594+0000","last_fullsized":"2024-09-12T18:33:03.970594+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":1159,"num_write":392,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546327+0000","last_change":"2024-09-12T17:35:48.902756+0000","last_active":"2024-09-12T18:30:48.546327+0000","last_peered":"2024-09-12T18:30:48.546327+0000","last_clean":"2024-09-12T18:30:48.546327+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:30:48.546327+0000","last_undegraded":"2024-09-12T18:30:48.546327+0000","last_fullsized":"2024-09-12T18:30:48.546327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'144","reported_seq":1246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:26.225226+0000","last_change":"2024-09-12T17:35:50.916082+0000","last_active":"2024-09-12T18:31:26.225226+0000","last_peered":"2024-09-12T18:31:26.225226+0000","last_clean":"2024-09-12T18:31:26.225226+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:31:26.225226+0000","last_undegraded":"2024-09-12T18:31:26.225226+0000","last_fullsized":"2024-09-12T18:31:26.225226+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:10.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'496","reported_seq":2059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.275302+0000","last_change":"2024-09-12T18:33:22.275302+0000","last_active":"2024-09-12T18:33:22.275302+0000","last_peered":"2024-09-12T18:33:22.275302+0000","last_clean":"2024-09-12T18:33:22.275302+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:33:22.275302+0000","last_undegraded":"2024-09-12T18:33:22.275302+0000","last_fullsized":"2024-09-12T18:33:22.275302+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.275213+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:50.196779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'370","reported_seq":1037,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.586776+0000","last_change":"2024-09-12T18:33:14.586776+0000","last_active":"2024-09-12T18:33:14.586776+0000","last_peered":"2024-09-12T18:33:14.586776+0000","last_clean":"2024-09-12T18:33:14.586776+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:33:14.586776+0000","last_undegraded":"2024-09-12T18:33:14.586776+0000","last_fullsized":"2024-09-12T18:33:14.586776+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.586592+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:48.010872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":31832,"num_write":1234,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:12.605775+0000","last_change":"2024-09-12T17:35:44.893851+0000","last_active":"2024-09-12T18:29:12.605775+0000","last_peered":"2024-09-12T18:29:12.605775+0000","last_clean":"2024-09-12T18:29:12.605775+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:29:12.605775+0000","last_undegraded":"2024-09-12T18:29:12.605775+0000","last_fullsized":"2024-09-12T18:29:12.605775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:43.876786+0000","last_clean_scrub_stamp":"2024-09-12T17:35:43.876786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:10.822361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'306","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.209555+0000","last_change":"2024-09-12T17:35:46.902681+0000","last_active":"2024-09-12T18:33:04.209555+0000","last_peered":"2024-09-12T18:33:04.209555+0000","last_clean":"2024-09-12T18:33:04.209555+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:33:04.209555+0000","last_undegraded":"2024-09-12T18:33:04.209555+0000","last_fullsized":"2024-09-12T18:33:04.209555+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:45.880648+0000","last_clean_scrub_stamp":"2024-09-12T17:35:45.880648+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58480,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":1106,"num_write":388,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.852511+0000","last_change":"2024-09-12T17:35:48.902815+0000","last_active":"2024-09-12T18:30:52.852511+0000","last_peered":"2024-09-12T18:30:52.852511+0000","last_clean":"2024-09-12T18:30:52.852511+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:30:52.852511+0000","last_undegraded":"2024-09-12T18:30:52.852511+0000","last_fullsized":"2024-09-12T18:30:52.852511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:47.883912+0000","last_clean_scrub_stamp":"2024-09-12T17:35:47.883912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'125","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.358965+0000","last_change":"2024-09-12T17:35:50.912183+0000","last_active":"2024-09-12T18:32:48.358965+0000","last_peered":"2024-09-12T18:32:48.358965+0000","last_clean":"2024-09-12T18:32:48.358965+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:32:48.358965+0000","last_undegraded":"2024-09-12T18:32:48.358965+0000","last_fullsized":"2024-09-12T18:32:48.358965+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:21.503473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'471","reported_seq":2186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.650462+0000","last_change":"2024-09-12T18:33:26.650462+0000","last_active":"2024-09-12T18:33:26.650462+0000","last_peered":"2024-09-12T18:33:26.650462+0000","last_clean":"2024-09-12T18:33:26.650462+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:33:26.650462+0000","last_undegraded":"2024-09-12T18:33:26.650462+0000","last_fullsized":"2024-09-12T18:33:26.650462+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'471","last_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_deep_scrub":"262'471","last_deep_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.650376+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.061452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'394","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.702575+0000","last_change":"2024-09-12T18:33:19.702575+0000","last_active":"2024-09-12T18:33:19.702575+0000","last_peered":"2024-09-12T18:33:19.702575+0000","last_clean":"2024-09-12T18:33:19.702575+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:33:19.702575+0000","last_undegraded":"2024-09-12T18:33:19.702575+0000","last_fullsized":"2024-09-12T18:33:19.702575+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.702403+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:43.504939+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":20627,"num_write":1276,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'529","reported_seq":2068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.362071+0000","last_change":"2024-09-12T17:35:42.902909+0000","last_active":"2024-09-12T18:32:48.362071+0000","last_peered":"2024-09-12T18:32:48.362071+0000","last_clean":"2024-09-12T18:32:48.362071+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:32:48.362071+0000","last_undegraded":"2024-09-12T18:32:48.362071+0000","last_fullsized":"2024-09-12T18:32:48.362071+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:11.016006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'405","reported_seq":1096,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.030355+0000","last_change":"2024-09-12T18:33:15.030355+0000","last_active":"2024-09-12T18:33:15.030355+0000","last_peered":"2024-09-12T18:33:15.030355+0000","last_clean":"2024-09-12T18:33:15.030355+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:33:15.030355+0000","last_undegraded":"2024-09-12T18:33:15.030355+0000","last_fullsized":"2024-09-12T18:33:15.030355+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.030175+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:29.411062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":58921,"num_write":1278,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'936","reported_seq":2530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.628715+0000","last_change":"2024-09-12T18:33:25.628715+0000","last_active":"2024-09-12T18:33:25.628715+0000","last_peered":"2024-09-12T18:33:25.628715+0000","last_clean":"2024-09-12T18:33:25.628715+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:33:25.628715+0000","last_undegraded":"2024-09-12T18:33:25.628715+0000","last_fullsized":"2024-09-12T18:33:25.628715+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'936","last_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_deep_scrub":"262'936","last_deep_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.628616+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:44.784169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'375","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.707536+0000","last_change":"2024-09-12T18:33:20.707536+0000","last_active":"2024-09-12T18:33:20.707536+0000","last_peered":"2024-09-12T18:33:20.707536+0000","last_clean":"2024-09-12T18:33:20.707536+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:33:20.707536+0000","last_undegraded":"2024-09-12T18:33:20.707536+0000","last_fullsized":"2024-09-12T18:33:20.707536+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.707383+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.729608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1189379,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":34034,"num_write":1140,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'762","reported_seq":2339,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.612612+0000","last_change":"2024-09-12T18:33:21.612612+0000","last_active":"2024-09-12T18:33:21.612612+0000","last_peered":"2024-09-12T18:33:21.612612+0000","last_clean":"2024-09-12T18:33:21.612612+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:33:21.612612+0000","last_undegraded":"2024-09-12T18:33:21.612612+0000","last_fullsized":"2024-09-12T18:33:21.612612+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'762","last_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_deep_scrub":"262'762","last_deep_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.612531+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.677937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'384","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.645224+0000","last_change":"2024-09-12T18:33:17.645224+0000","last_active":"2024-09-12T18:33:17.645224+0000","last_peered":"2024-09-12T18:33:17.645224+0000","last_clean":"2024-09-12T18:33:17.645224+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:33:17.645224+0000","last_undegraded":"2024-09-12T18:33:17.645224+0000","last_fullsized":"2024-09-12T18:33:17.645224+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.645107+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.274616+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":12325,"num_write":1129,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.418508+0000","last_change":"2024-09-12T17:35:42.894174+0000","last_active":"2024-09-12T18:30:07.418508+0000","last_peered":"2024-09-12T18:30:07.418508+0000","last_clean":"2024-09-12T18:30:07.418508+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:30:07.418508+0000","last_undegraded":"2024-09-12T18:30:07.418508+0000","last_fullsized":"2024-09-12T18:30:07.418508+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.648231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'389","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.203831+0000","last_change":"2024-09-12T18:33:20.203831+0000","last_active":"2024-09-12T18:33:20.203831+0000","last_peered":"2024-09-12T18:33:20.203831+0000","last_clean":"2024-09-12T18:33:20.203831+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:33:20.203831+0000","last_undegraded":"2024-09-12T18:33:20.203831+0000","last_fullsized":"2024-09-12T18:33:20.203831+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.203681+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.448871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190223,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":50386,"num_write":1084,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'483","reported_seq":2233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.286445+0000","last_change":"2024-09-12T18:33:25.286445+0000","last_active":"2024-09-12T18:33:25.286445+0000","last_peered":"2024-09-12T18:33:25.286445+0000","last_clean":"2024-09-12T18:33:25.286445+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:33:25.286445+0000","last_undegraded":"2024-09-12T18:33:25.286445+0000","last_fullsized":"2024-09-12T18:33:25.286445+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.286332+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.078569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3572,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'331","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.626160+0000","last_change":"2024-09-12T18:33:14.626160+0000","last_active":"2024-09-12T18:33:14.626160+0000","last_peered":"2024-09-12T18:33:14.626160+0000","last_clean":"2024-09-12T18:33:14.626160+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:33:14.626160+0000","last_undegraded":"2024-09-12T18:33:14.626160+0000","last_fullsized":"2024-09-12T18:33:14.626160+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.625987+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:07.872404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":699027,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":70299,"num_write":1012,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'478","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:18.699290+0000","last_change":"2024-09-12T17:35:42.891672+0000","last_active":"2024-09-12T18:30:18.699290+0000","last_peered":"2024-09-12T18:30:18.699290+0000","last_clean":"2024-09-12T18:30:18.699290+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:30:18.699290+0000","last_undegraded":"2024-09-12T18:30:18.699290+0000","last_fullsized":"2024-09-12T18:30:18.699290+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:22.565304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'341","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.696096+0000","last_change":"2024-09-12T18:33:15.696096+0000","last_active":"2024-09-12T18:33:15.696096+0000","last_peered":"2024-09-12T18:33:15.696096+0000","last_clean":"2024-09-12T18:33:15.696096+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:33:15.696096+0000","last_undegraded":"2024-09-12T18:33:15.696096+0000","last_fullsized":"2024-09-12T18:33:15.696096+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.695906+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.837354+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1407190,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":51065,"num_write":1119,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'542","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.691024+0000","last_change":"2024-09-12T18:33:24.691024+0000","last_active":"2024-09-12T18:33:24.691024+0000","last_peered":"2024-09-12T18:33:24.691024+0000","last_clean":"2024-09-12T18:33:24.691024+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:33:24.691024+0000","last_undegraded":"2024-09-12T18:33:24.691024+0000","last_fullsized":"2024-09-12T18:33:24.691024+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.690944+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:08.527284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'284","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.232418+0000","last_change":"2024-09-12T18:33:17.232418+0000","last_active":"2024-09-12T18:33:17.232418+0000","last_peered":"2024-09-12T18:33:17.232418+0000","last_clean":"2024-09-12T18:33:17.232418+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:33:17.232418+0000","last_undegraded":"2024-09-12T18:33:17.232418+0000","last_fullsized":"2024-09-12T18:33:17.232418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.232228+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:12.380580+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511862,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":37901,"num_write":823,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'587","reported_seq":2418,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.620643+0000","last_change":"2024-09-12T18:33:22.620643+0000","last_active":"2024-09-12T18:33:22.620643+0000","last_peered":"2024-09-12T18:33:22.620643+0000","last_clean":"2024-09-12T18:33:22.620643+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:33:22.620643+0000","last_undegraded":"2024-09-12T18:33:22.620643+0000","last_fullsized":"2024-09-12T18:33:22.620643+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'587","last_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_deep_scrub":"262'587","last_deep_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.620530+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:42.505857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6001,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'376","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.635997+0000","last_change":"2024-09-12T18:33:16.635997+0000","last_active":"2024-09-12T18:33:16.635997+0000","last_peered":"2024-09-12T18:33:16.635997+0000","last_clean":"2024-09-12T18:33:16.635997+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:33:16.635997+0000","last_undegraded":"2024-09-12T18:33:16.635997+0000","last_fullsized":"2024-09-12T18:33:16.635997+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.635865+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:02.528484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":34152,"num_write":1143,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1181","reported_seq":2818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.253053+0000","last_change":"2024-09-12T18:33:27.253053+0000","last_active":"2024-09-12T18:33:27.253053+0000","last_peered":"2024-09-12T18:33:27.253053+0000","last_clean":"2024-09-12T18:33:27.253053+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:33:27.253053+0000","last_undegraded":"2024-09-12T18:33:27.253053+0000","last_fullsized":"2024-09-12T18:33:27.253053+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1181","last_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_deep_scrub":"262'1181","last_deep_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.252969+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":1100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:53.177342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'384","reported_seq":1094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.196517+0000","last_change":"2024-09-12T18:33:18.196517+0000","last_active":"2024-09-12T18:33:18.196517+0000","last_peered":"2024-09-12T18:33:18.196517+0000","last_clean":"2024-09-12T18:33:18.196517+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:33:18.196517+0000","last_undegraded":"2024-09-12T18:33:18.196517+0000","last_fullsized":"2024-09-12T18:33:18.196517+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.196285+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:32.438997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":17939,"num_write":1185,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'781","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.057074+0000","last_change":"2024-09-12T18:33:18.057074+0000","last_active":"2024-09-12T18:33:18.057074+0000","last_peered":"2024-09-12T18:33:18.057074+0000","last_clean":"2024-09-12T18:33:18.057074+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:33:18.057074+0000","last_undegraded":"2024-09-12T18:33:18.057074+0000","last_fullsized":"2024-09-12T18:33:18.057074+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'781","last_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_deep_scrub":"262'781","last_deep_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.056988+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:37.444745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'498","reported_seq":1219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.074483+0000","last_change":"2024-09-12T18:33:16.074483+0000","last_active":"2024-09-12T18:33:16.074483+0000","last_peered":"2024-09-12T18:33:16.074483+0000","last_clean":"2024-09-12T18:33:16.074483+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:33:16.074483+0000","last_undegraded":"2024-09-12T18:33:16.074483+0000","last_fullsized":"2024-09-12T18:33:16.074483+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'498","last_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_deep_scrub":"262'498","last_deep_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.074328+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:08.965353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355583,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":996,"num_read_kb":22424,"num_write":1615,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'511","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.297878+0000","last_change":"2024-09-12T18:33:26.297878+0000","last_active":"2024-09-12T18:33:26.297878+0000","last_peered":"2024-09-12T18:33:26.297878+0000","last_clean":"2024-09-12T18:33:26.297878+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:33:26.297878+0000","last_undegraded":"2024-09-12T18:33:26.297878+0000","last_fullsized":"2024-09-12T18:33:26.297878+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'511","last_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_deep_scrub":"262'511","last_deep_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.297768+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:12.130346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'323","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.616656+0000","last_change":"2024-09-12T18:33:16.616656+0000","last_active":"2024-09-12T18:33:16.616656+0000","last_peered":"2024-09-12T18:33:16.616656+0000","last_clean":"2024-09-12T18:33:16.616656+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:33:16.616656+0000","last_undegraded":"2024-09-12T18:33:16.616656+0000","last_fullsized":"2024-09-12T18:33:16.616656+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.616520+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.598136+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270110,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":8170,"num_write":997,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'785","reported_seq":2232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.000801+0000","last_change":"2024-09-12T18:33:25.000801+0000","last_active":"2024-09-12T18:33:25.000801+0000","last_peered":"2024-09-12T18:33:25.000801+0000","last_clean":"2024-09-12T18:33:25.000801+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:33:25.000801+0000","last_undegraded":"2024-09-12T18:33:25.000801+0000","last_fullsized":"2024-09-12T18:33:25.000801+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'785","last_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_deep_scrub":"262'785","last_deep_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.000690+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.295948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'333","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.699288+0000","last_change":"2024-09-12T18:33:16.699288+0000","last_active":"2024-09-12T18:33:16.699288+0000","last_peered":"2024-09-12T18:33:16.699288+0000","last_clean":"2024-09-12T18:33:16.699288+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:33:16.699288+0000","last_undegraded":"2024-09-12T18:33:16.699288+0000","last_fullsized":"2024-09-12T18:33:16.699288+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.699173+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:06.503747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652723,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":483,"num_read_kb":27896,"num_write":1098,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'571","reported_seq":2188,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.654838+0000","last_change":"2024-09-12T18:33:20.654838+0000","last_active":"2024-09-12T18:33:20.654838+0000","last_peered":"2024-09-12T18:33:20.654838+0000","last_clean":"2024-09-12T18:33:20.654838+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:33:20.654838+0000","last_undegraded":"2024-09-12T18:33:20.654838+0000","last_fullsized":"2024-09-12T18:33:20.654838+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'571","last_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_deep_scrub":"262'571","last_deep_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.654735+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:00.197882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'290","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.991759+0000","last_change":"2024-09-12T18:33:18.991759+0000","last_active":"2024-09-12T18:33:18.991759+0000","last_peered":"2024-09-12T18:33:18.991759+0000","last_clean":"2024-09-12T18:33:18.991759+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:33:18.991759+0000","last_undegraded":"2024-09-12T18:33:18.991759+0000","last_fullsized":"2024-09-12T18:33:18.991759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'290","last_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_deep_scrub":"262'290","last_deep_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.991570+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.511173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":4469,"num_write":888,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'520","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:10.654360+0000","last_change":"2024-09-12T17:35:42.895055+0000","last_active":"2024-09-12T18:30:10.654360+0000","last_peered":"2024-09-12T18:30:10.654360+0000","last_clean":"2024-09-12T18:30:10.654360+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:30:10.654360+0000","last_undegraded":"2024-09-12T18:30:10.654360+0000","last_fullsized":"2024-09-12T18:30:10.654360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:41.873072+0000","last_clean_scrub_stamp":"2024-09-12T17:35:41.873072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:39.969384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'317","reported_seq":944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.101698+0000","last_change":"2024-09-12T18:33:22.101698+0000","last_active":"2024-09-12T18:33:22.101698+0000","last_peered":"2024-09-12T18:33:22.101698+0000","last_clean":"2024-09-12T18:33:22.101698+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:33:22.101698+0000","last_undegraded":"2024-09-12T18:33:22.101698+0000","last_fullsized":"2024-09-12T18:33:22.101698+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'317","last_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_deep_scrub":"262'317","last_deep_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.101570+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:04.807102+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":27660,"num_write":1072,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'392","reported_seq":1875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.957476+0000","last_change":"2024-09-12T18:33:23.957476+0000","last_active":"2024-09-12T18:33:23.957476+0000","last_peered":"2024-09-12T18:33:23.957476+0000","last_clean":"2024-09-12T18:33:23.957476+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:33:23.957476+0000","last_undegraded":"2024-09-12T18:33:23.957476+0000","last_fullsized":"2024-09-12T18:33:23.957476+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.957391+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:40.123662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'345","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.705741+0000","last_change":"2024-09-12T18:33:21.705741+0000","last_active":"2024-09-12T18:33:21.705741+0000","last_peered":"2024-09-12T18:33:21.705741+0000","last_clean":"2024-09-12T18:33:21.705741+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:33:21.705741+0000","last_undegraded":"2024-09-12T18:33:21.705741+0000","last_fullsized":"2024-09-12T18:33:21.705741+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.705579+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.131383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":34548,"num_write":1063,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'376","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.680955+0000","last_change":"2024-09-12T18:33:18.680955+0000","last_active":"2024-09-12T18:33:18.680955+0000","last_peered":"2024-09-12T18:33:18.680955+0000","last_clean":"2024-09-12T18:33:18.680955+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:33:18.680955+0000","last_undegraded":"2024-09-12T18:33:18.680955+0000","last_fullsized":"2024-09-12T18:33:18.680955+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.680862+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:43.127892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052945,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":6964,"num_write":1129,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1473","reported_seq":2930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.668632+0000","last_change":"2024-09-12T18:33:26.668632+0000","last_active":"2024-09-12T18:33:26.668632+0000","last_peered":"2024-09-12T18:33:26.668632+0000","last_clean":"2024-09-12T18:33:26.668632+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:33:26.668632+0000","last_undegraded":"2024-09-12T18:33:26.668632+0000","last_fullsized":"2024-09-12T18:33:26.668632+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1473","last_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_deep_scrub":"262'1473","last_deep_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.668544+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:30.893522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'298","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.589172+0000","last_change":"2024-09-12T18:33:13.589172+0000","last_active":"2024-09-12T18:33:13.589172+0000","last_peered":"2024-09-12T18:33:13.589172+0000","last_clean":"2024-09-12T18:33:13.589172+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:33:13.589172+0000","last_undegraded":"2024-09-12T18:33:13.589172+0000","last_fullsized":"2024-09-12T18:33:13.589172+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.589042+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.715072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":8217,"num_write":971,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1017","reported_seq":2992,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.623624+0000","last_change":"2024-09-12T18:33:27.623624+0000","last_active":"2024-09-12T18:33:27.623624+0000","last_peered":"2024-09-12T18:33:27.623624+0000","last_clean":"2024-09-12T18:33:27.623624+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:33:27.623624+0000","last_undegraded":"2024-09-12T18:33:27.623624+0000","last_fullsized":"2024-09-12T18:33:27.623624+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1017","last_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_deep_scrub":"262'1017","last_deep_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.623520+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.482416+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5285,"num_omap_keys":21,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1571818,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17916,"num_read_kb":37265,"num_write":15035,"num_write_kb":11780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2041,"ondisk_log_size":2041,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40116,"num_omap_keys":161,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":68589489,"num_objects":377,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":36438,"num_read_kb":2030723,"num_write":72188,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93863936,"data_stored":93863936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":184607,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":188613,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575549,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144872,"kb_used_data":15128,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226968,"statfs":{"total":96636764160,"available":96488415232,"internally_reserved":0,"allocated":15491072,"data_stored":13570247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575549,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333508,"kb_used_data":13556,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038332,"statfs":{"total":96636764160,"available":96295251968,"internally_reserved":0,"allocated":13881344,"data_stored":11918715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575548,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":18096,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":18530304,"data_stored":16608104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575550,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189008,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":169918,"kb_avail":94182832,"statfs":{"total":96636764160,"available":96443219968,"internally_reserved":0,"allocated":19529728,"data_stored":17538028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":173996485},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575548,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":13664,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":13991936,"data_stored":12011933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575550,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123832,"kb_used_data":12136,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94248008,"statfs":{"total":96636764160,"available":96509960192,"internally_reserved":0,"allocated":12427264,"data_stored":10520336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575548,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191932,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94179908,"statfs":{"total":96636764160,"available":96440225792,"internally_reserved":0,"allocated":16822272,"data_stored":14877078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575551,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291792,"kb_used_data":17664,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080048,"statfs":{"total":96636764160,"available":96337969152,"internally_reserved":0,"allocated":18087936,"data_stored":16087657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13234176,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12615680,"data_stored":12615680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":8261632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11309056,"data_stored":11309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15278080,"data_stored":15278080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14348288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9068544,"data_stored":9068544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:33.266 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.267 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.268 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.269 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.270 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.271 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.272 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.273 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.273 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.273 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.273 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.273 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.274 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.275 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.276 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.277 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.278 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.279 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.280 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.281 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.282 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.283 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.284 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.285 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.286 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.287 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.288 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.289 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.290 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.291 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.292 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.293 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.294 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.295 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.295 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.295 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.295 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.296 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.297 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.298 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.299 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:35:43.876786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:35:45.880648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.300 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:35:47.883912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.301 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.301 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.301 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.301 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.301 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:35:41.873072+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:33.302 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:33:53.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:33:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:33:53.647 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:33:53.649 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":2010,"stamp":"2024-09-12T18:33:53.582921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70768882,"num_objects":845,"num_object_clones":0,"num_object_copies":2444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":845,"num_whiteouts":0,"num_read":292045,"num_read_kb":2658521,"num_write":161680,"num_write_kb":2423567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733502,"num_omap_keys":1764,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13677,"ondisk_log_size":13677,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1870256,"kb_used_data":125744,"kb_used_omap":12,"kb_used_meta":1744371,"kb_avail":753104464,"statfs":{"total":773094113280,"available":771178971136,"internally_reserved":0,"allocated":128761856,"data_stored":113132098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1786236464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29728,"num_omap_keys":87,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004947"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.667586+0000","last_change":"2024-09-12T18:08:44.173813+0000","last_active":"2024-09-12T18:31:17.667586+0000","last_peered":"2024-09-12T18:31:17.667586+0000","last_clean":"2024-09-12T18:31:17.667586+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:31:17.667586+0000","last_undegraded":"2024-09-12T18:31:17.667586+0000","last_fullsized":"2024-09-12T18:31:17.667586+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.750454+0000","last_change":"2024-09-12T17:53:15.157475+0000","last_active":"2024-09-12T18:33:04.750454+0000","last_peered":"2024-09-12T18:33:04.750454+0000","last_clean":"2024-09-12T18:33:04.750454+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:33:04.750454+0000","last_undegraded":"2024-09-12T18:33:04.750454+0000","last_fullsized":"2024-09-12T18:33:04.750454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.446816+0000","last_change":"2024-09-12T17:53:12.141144+0000","last_active":"2024-09-12T18:33:05.446816+0000","last_peered":"2024-09-12T18:33:05.446816+0000","last_clean":"2024-09-12T18:33:05.446816+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:33:05.446816+0000","last_undegraded":"2024-09-12T18:33:05.446816+0000","last_fullsized":"2024-09-12T18:33:05.446816+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:52.845471+0000","last_change":"2024-09-12T17:50:14.840635+0000","last_active":"2024-09-12T18:29:52.845471+0000","last_peered":"2024-09-12T18:29:52.845471+0000","last_clean":"2024-09-12T18:29:52.845471+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:29:52.845471+0000","last_undegraded":"2024-09-12T18:29:52.845471+0000","last_fullsized":"2024-09-12T18:29:52.845471+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.125007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.080856+0000","last_change":"2024-09-12T18:33:41.080793+0000","last_active":"2024-09-12T18:33:41.080856+0000","last_peered":"2024-09-12T18:33:41.080856+0000","last_clean":"2024-09-12T18:33:41.080856+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:33:41.080856+0000","last_undegraded":"2024-09-12T18:33:41.080856+0000","last_fullsized":"2024-09-12T18:33:41.080856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.080701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:10.660771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:48.546353+0000","last_change":"2024-09-12T17:53:15.158704+0000","last_active":"2024-09-12T18:30:48.546353+0000","last_peered":"2024-09-12T18:30:48.546353+0000","last_clean":"2024-09-12T18:30:48.546353+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:30:48.546353+0000","last_undegraded":"2024-09-12T18:30:48.546353+0000","last_fullsized":"2024-09-12T18:30:48.546353+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.571618+0000","last_change":"2024-09-12T18:33:44.571618+0000","last_active":"2024-09-12T18:33:44.571618+0000","last_peered":"2024-09-12T18:33:44.571618+0000","last_clean":"2024-09-12T18:33:44.571618+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:33:44.571618+0000","last_undegraded":"2024-09-12T18:33:44.571618+0000","last_fullsized":"2024-09-12T18:33:44.571618+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.571533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:16.885149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.116829+0000","last_change":"2024-09-12T18:33:34.116829+0000","last_active":"2024-09-12T18:33:34.116829+0000","last_peered":"2024-09-12T18:33:34.116829+0000","last_clean":"2024-09-12T18:33:34.116829+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:33:34.116829+0000","last_undegraded":"2024-09-12T18:33:34.116829+0000","last_fullsized":"2024-09-12T18:33:34.116829+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.116716+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:54.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.785662+0000","last_change":"2024-09-12T18:33:49.785662+0000","last_active":"2024-09-12T18:33:49.785662+0000","last_peered":"2024-09-12T18:33:49.785662+0000","last_clean":"2024-09-12T18:33:49.785662+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:33:49.785662+0000","last_undegraded":"2024-09-12T18:33:49.785662+0000","last_fullsized":"2024-09-12T18:33:49.785662+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.785575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:17.247986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:52.868027+0000","last_change":"2024-09-12T17:53:15.153018+0000","last_active":"2024-09-12T18:32:52.868027+0000","last_peered":"2024-09-12T18:32:52.868027+0000","last_clean":"2024-09-12T18:32:52.868027+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:32:52.868027+0000","last_undegraded":"2024-09-12T18:32:52.868027+0000","last_fullsized":"2024-09-12T18:32:52.868027+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:41.205364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.089410+0000","last_change":"2024-09-12T18:33:40.089410+0000","last_active":"2024-09-12T18:33:40.089410+0000","last_peered":"2024-09-12T18:33:40.089410+0000","last_clean":"2024-09-12T18:33:40.089410+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:33:40.089410+0000","last_undegraded":"2024-09-12T18:33:40.089410+0000","last_fullsized":"2024-09-12T18:33:40.089410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.089298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:47.053837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.671382+0000","last_change":"2024-09-12T18:33:52.671382+0000","last_active":"2024-09-12T18:33:52.671382+0000","last_peered":"2024-09-12T18:33:52.671382+0000","last_clean":"2024-09-12T18:33:52.671382+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:33:52.671382+0000","last_undegraded":"2024-09-12T18:33:52.671382+0000","last_fullsized":"2024-09-12T18:33:52.671382+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.671265+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:55.226775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'7","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.603990+0000","last_change":"2024-09-12T17:53:15.164743+0000","last_active":"2024-09-12T18:33:05.603990+0000","last_peered":"2024-09-12T18:33:05.603990+0000","last_clean":"2024-09-12T18:33:05.603990+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:33:05.603990+0000","last_undegraded":"2024-09-12T18:33:05.603990+0000","last_fullsized":"2024-09-12T18:33:05.603990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2101,"num_write":12,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.563840+0000","last_change":"2024-09-12T17:53:12.145541+0000","last_active":"2024-09-12T18:32:48.563840+0000","last_peered":"2024-09-12T18:32:48.563840+0000","last_clean":"2024-09-12T18:32:48.563840+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:32:48.563840+0000","last_undegraded":"2024-09-12T18:32:48.563840+0000","last_fullsized":"2024-09-12T18:32:48.563840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:28.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419815+0000","last_change":"2024-09-12T17:50:14.843429+0000","last_active":"2024-09-12T18:30:17.419815+0000","last_peered":"2024-09-12T18:30:17.419815+0000","last_clean":"2024-09-12T18:30:17.419815+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:30:17.419815+0000","last_undegraded":"2024-09-12T18:30:17.419815+0000","last_fullsized":"2024-09-12T18:30:17.419815+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:24.521761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:02.674609+0000","last_change":"2024-09-12T17:53:15.166296+0000","last_active":"2024-09-12T18:32:02.674609+0000","last_peered":"2024-09-12T18:32:02.674609+0000","last_clean":"2024-09-12T18:32:02.674609+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:32:02.674609+0000","last_undegraded":"2024-09-12T18:32:02.674609+0000","last_fullsized":"2024-09-12T18:32:02.674609+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:41.827626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'7","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:52.859981+0000","last_change":"2024-09-12T17:53:12.142831+0000","last_active":"2024-09-12T18:31:52.859981+0000","last_peered":"2024-09-12T18:31:52.859981+0000","last_clean":"2024-09-12T18:31:52.859981+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:31:52.859981+0000","last_undegraded":"2024-09-12T18:31:52.859981+0000","last_fullsized":"2024-09-12T18:31:52.859981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4114,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:17.419767+0000","last_change":"2024-09-12T17:50:14.841064+0000","last_active":"2024-09-12T18:30:17.419767+0000","last_peered":"2024-09-12T18:30:17.419767+0000","last_clean":"2024-09-12T18:30:17.419767+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:30:17.419767+0000","last_undegraded":"2024-09-12T18:30:17.419767+0000","last_fullsized":"2024-09-12T18:30:17.419767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.501755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.624278+0000","last_change":"2024-09-12T18:08:44.186269+0000","last_active":"2024-09-12T18:31:42.624278+0000","last_peered":"2024-09-12T18:31:42.624278+0000","last_clean":"2024-09-12T18:31:42.624278+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:31:42.624278+0000","last_undegraded":"2024-09-12T18:31:42.624278+0000","last_fullsized":"2024-09-12T18:31:42.624278+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'11","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.748051+0000","last_change":"2024-09-12T18:33:46.748051+0000","last_active":"2024-09-12T18:33:46.748051+0000","last_peered":"2024-09-12T18:33:46.748051+0000","last_clean":"2024-09-12T18:33:46.748051+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:33:46.748051+0000","last_undegraded":"2024-09-12T18:33:46.748051+0000","last_fullsized":"2024-09-12T18:33:46.748051+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.747953+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:04.571236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16462,"num_write":16,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'9","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.437205+0000","last_change":"2024-09-12T18:33:52.437205+0000","last_active":"2024-09-12T18:33:52.437205+0000","last_peered":"2024-09-12T18:33:52.437205+0000","last_clean":"2024-09-12T18:33:52.437205+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:33:52.437205+0000","last_undegraded":"2024-09-12T18:33:52.437205+0000","last_fullsized":"2024-09-12T18:33:52.437205+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.437104+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:19.574310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13304,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":227,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.792015+0000","last_change":"2024-09-12T18:33:41.792015+0000","last_active":"2024-09-12T18:33:41.792015+0000","last_peered":"2024-09-12T18:33:41.792015+0000","last_clean":"2024-09-12T18:33:41.792015+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:33:41.792015+0000","last_undegraded":"2024-09-12T18:33:41.792015+0000","last_fullsized":"2024-09-12T18:33:41.792015+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.791915+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:48.494958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.433220+0000","last_change":"2024-09-12T18:08:44.184512+0000","last_active":"2024-09-12T18:31:17.433220+0000","last_peered":"2024-09-12T18:31:17.433220+0000","last_clean":"2024-09-12T18:31:17.433220+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:31:17.433220+0000","last_undegraded":"2024-09-12T18:31:17.433220+0000","last_fullsized":"2024-09-12T18:31:17.433220+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'6","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.760894+0000","last_change":"2024-09-12T18:33:47.760894+0000","last_active":"2024-09-12T18:33:47.760894+0000","last_peered":"2024-09-12T18:33:47.760894+0000","last_clean":"2024-09-12T18:33:47.760894+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:33:47.760894+0000","last_undegraded":"2024-09-12T18:33:47.760894+0000","last_fullsized":"2024-09-12T18:33:47.760894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.760785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:14.666756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6178,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.420818+0000","last_change":"2024-09-12T18:33:53.420818+0000","last_active":"2024-09-12T18:33:53.420818+0000","last_peered":"2024-09-12T18:33:53.420818+0000","last_clean":"2024-09-12T18:33:53.420818+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:33:53.420818+0000","last_undegraded":"2024-09-12T18:33:53.420818+0000","last_fullsized":"2024-09-12T18:33:53.420818+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.420697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.359186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":78,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.856415+0000","last_change":"2024-09-12T17:50:14.841923+0000","last_active":"2024-09-12T18:31:27.856415+0000","last_peered":"2024-09-12T18:31:27.856415+0000","last_clean":"2024-09-12T18:31:27.856415+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:31:27.856415+0000","last_undegraded":"2024-09-12T18:31:27.856415+0000","last_fullsized":"2024-09-12T18:31:27.856415+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.433284+0000","last_change":"2024-09-12T18:08:44.186459+0000","last_active":"2024-09-12T18:31:17.433284+0000","last_peered":"2024-09-12T18:31:17.433284+0000","last_clean":"2024-09-12T18:31:17.433284+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:31:17.433284+0000","last_undegraded":"2024-09-12T18:31:17.433284+0000","last_fullsized":"2024-09-12T18:31:17.433284+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.423657+0000","last_change":"2024-09-12T17:53:15.160284+0000","last_active":"2024-09-12T18:30:47.423657+0000","last_peered":"2024-09-12T18:30:47.423657+0000","last_clean":"2024-09-12T18:30:47.423657+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:30:47.423657+0000","last_undegraded":"2024-09-12T18:30:47.423657+0000","last_fullsized":"2024-09-12T18:30:47.423657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'8","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.939041+0000","last_change":"2024-09-12T17:53:12.141285+0000","last_active":"2024-09-12T18:33:05.939041+0000","last_peered":"2024-09-12T18:33:05.939041+0000","last_clean":"2024-09-12T18:33:05.939041+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:33:05.939041+0000","last_undegraded":"2024-09-12T18:33:05.939041+0000","last_fullsized":"2024-09-12T18:33:05.939041+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15356,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.562571+0000","last_change":"2024-09-12T18:33:43.562477+0000","last_active":"2024-09-12T18:33:43.562571+0000","last_peered":"2024-09-12T18:33:43.562571+0000","last_clean":"2024-09-12T18:33:43.562571+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:33:43.562571+0000","last_undegraded":"2024-09-12T18:33:43.562571+0000","last_fullsized":"2024-09-12T18:33:43.562571+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.562352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.656097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.595331+0000","last_change":"2024-09-12T18:33:50.595331+0000","last_active":"2024-09-12T18:33:50.595331+0000","last_peered":"2024-09-12T18:33:50.595331+0000","last_clean":"2024-09-12T18:33:50.595331+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:33:50.595331+0000","last_undegraded":"2024-09-12T18:33:50.595331+0000","last_fullsized":"2024-09-12T18:33:50.595331+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.595231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:05.062592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'2","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433041+0000","last_change":"2024-09-12T17:53:15.165875+0000","last_active":"2024-09-12T18:31:57.433041+0000","last_peered":"2024-09-12T18:31:57.433041+0000","last_clean":"2024-09-12T18:31:57.433041+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:31:57.433041+0000","last_undegraded":"2024-09-12T18:31:57.433041+0000","last_fullsized":"2024-09-12T18:31:57.433041+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:19.804315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.654412+0000","last_change":"2024-09-12T18:33:51.654412+0000","last_active":"2024-09-12T18:33:51.654412+0000","last_peered":"2024-09-12T18:33:51.654412+0000","last_clean":"2024-09-12T18:33:51.654412+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:33:51.654412+0000","last_undegraded":"2024-09-12T18:33:51.654412+0000","last_fullsized":"2024-09-12T18:33:51.654412+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.654316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.697352+0000","last_change":"2024-09-12T18:33:51.697352+0000","last_active":"2024-09-12T18:33:51.697352+0000","last_peered":"2024-09-12T18:33:51.697352+0000","last_clean":"2024-09-12T18:33:51.697352+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:33:51.697352+0000","last_undegraded":"2024-09-12T18:33:51.697352+0000","last_fullsized":"2024-09-12T18:33:51.697352+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.697203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:21.639036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.118463+0000","last_change":"2024-09-12T18:33:39.118463+0000","last_active":"2024-09-12T18:33:39.118463+0000","last_peered":"2024-09-12T18:33:39.118463+0000","last_clean":"2024-09-12T18:33:39.118463+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:33:39.118463+0000","last_undegraded":"2024-09-12T18:33:39.118463+0000","last_fullsized":"2024-09-12T18:33:39.118463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.118340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:21.575993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.561269+0000","last_change":"2024-09-12T17:54:16.799448+0000","last_active":"2024-09-12T18:33:03.561269+0000","last_peered":"2024-09-12T18:33:03.561269+0000","last_clean":"2024-09-12T18:33:03.561269+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:33:03.561269+0000","last_undegraded":"2024-09-12T18:33:03.561269+0000","last_fullsized":"2024-09-12T18:33:03.561269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.022550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.413344+0000","last_change":"2024-09-12T17:53:12.146844+0000","last_active":"2024-09-12T18:29:27.413344+0000","last_peered":"2024-09-12T18:29:27.413344+0000","last_clean":"2024-09-12T18:29:27.413344+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:29:27.413344+0000","last_undegraded":"2024-09-12T18:29:27.413344+0000","last_fullsized":"2024-09-12T18:29:27.413344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:18.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.427885+0000","last_change":"2024-09-12T17:50:14.841183+0000","last_active":"2024-09-12T18:31:22.427885+0000","last_peered":"2024-09-12T18:31:22.427885+0000","last_clean":"2024-09-12T18:31:22.427885+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:31:22.427885+0000","last_undegraded":"2024-09-12T18:31:22.427885+0000","last_fullsized":"2024-09-12T18:31:22.427885+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.416856+0000","last_change":"2024-09-12T18:08:44.182044+0000","last_active":"2024-09-12T18:29:47.416856+0000","last_peered":"2024-09-12T18:29:47.416856+0000","last_clean":"2024-09-12T18:29:47.416856+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:29:47.416856+0000","last_undegraded":"2024-09-12T18:29:47.416856+0000","last_fullsized":"2024-09-12T18:29:47.416856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.688313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'7","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:57.433088+0000","last_change":"2024-09-12T17:53:15.165142+0000","last_active":"2024-09-12T18:31:57.433088+0000","last_peered":"2024-09-12T18:31:57.433088+0000","last_clean":"2024-09-12T18:31:57.433088+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:31:57.433088+0000","last_undegraded":"2024-09-12T18:31:57.433088+0000","last_fullsized":"2024-09-12T18:31:57.433088+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:10.751452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20478,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.030992+0000","last_change":"2024-09-12T18:33:37.030992+0000","last_active":"2024-09-12T18:33:37.030992+0000","last_peered":"2024-09-12T18:33:37.030992+0000","last_clean":"2024-09-12T18:33:37.030992+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:33:37.030992+0000","last_undegraded":"2024-09-12T18:33:37.030992+0000","last_fullsized":"2024-09-12T18:33:37.030992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.030874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.608998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4132,"num_write":4,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.131760+0000","last_change":"2024-09-12T18:33:31.131681+0000","last_active":"2024-09-12T18:33:31.131760+0000","last_peered":"2024-09-12T18:33:31.131760+0000","last_clean":"2024-09-12T18:33:31.131760+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:33:31.131760+0000","last_undegraded":"2024-09-12T18:33:31.131760+0000","last_fullsized":"2024-09-12T18:33:31.131760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.131587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.722593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.654803+0000","last_change":"2024-09-12T18:08:44.173064+0000","last_active":"2024-09-12T18:29:47.654803+0000","last_peered":"2024-09-12T18:29:47.654803+0000","last_clean":"2024-09-12T18:29:47.654803+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:29:47.654803+0000","last_undegraded":"2024-09-12T18:29:47.654803+0000","last_fullsized":"2024-09-12T18:29:47.654803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:26.564974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:33.535585+0000","last_change":"2024-09-12T17:53:15.159813+0000","last_active":"2024-09-12T18:29:33.535585+0000","last_peered":"2024-09-12T18:29:33.535585+0000","last_clean":"2024-09-12T18:29:33.535585+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:29:33.535585+0000","last_undegraded":"2024-09-12T18:29:33.535585+0000","last_fullsized":"2024-09-12T18:29:33.535585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:41.613815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:27.842402+0000","last_change":"2024-09-12T17:53:12.144038+0000","last_active":"2024-09-12T18:29:27.842402+0000","last_peered":"2024-09-12T18:29:27.842402+0000","last_clean":"2024-09-12T18:29:27.842402+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:29:27.842402+0000","last_undegraded":"2024-09-12T18:29:27.842402+0000","last_fullsized":"2024-09-12T18:29:27.842402+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:07.194276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'69","reported_seq":317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.117485+0000","last_change":"2024-09-12T18:33:49.117485+0000","last_active":"2024-09-12T18:33:49.117485+0000","last_peered":"2024-09-12T18:33:49.117485+0000","last_clean":"2024-09-12T18:33:49.117485+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:33:49.117485+0000","last_undegraded":"2024-09-12T18:33:49.117485+0000","last_fullsized":"2024-09-12T18:33:49.117485+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'69","last_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_deep_scrub":"262'69","last_deep_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.117387+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:26.470549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2510,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.562587+0000","last_change":"2024-09-12T18:33:49.562587+0000","last_active":"2024-09-12T18:33:49.562587+0000","last_peered":"2024-09-12T18:33:49.562587+0000","last_clean":"2024-09-12T18:33:49.562587+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:33:49.562587+0000","last_undegraded":"2024-09-12T18:33:49.562587+0000","last_fullsized":"2024-09-12T18:33:49.562587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.562461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:32.217105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.479709+0000","last_change":"2024-09-12T18:33:50.479709+0000","last_active":"2024-09-12T18:33:50.479709+0000","last_peered":"2024-09-12T18:33:50.479709+0000","last_clean":"2024-09-12T18:33:50.479709+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:33:50.479709+0000","last_undegraded":"2024-09-12T18:33:50.479709+0000","last_fullsized":"2024-09-12T18:33:50.479709+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.479625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:19.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":306,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.068448+0000","last_change":"2024-09-12T18:33:48.068448+0000","last_active":"2024-09-12T18:33:48.068448+0000","last_peered":"2024-09-12T18:33:48.068448+0000","last_clean":"2024-09-12T18:33:48.068448+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:33:48.068448+0000","last_undegraded":"2024-09-12T18:33:48.068448+0000","last_fullsized":"2024-09-12T18:33:48.068448+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'86","last_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_deep_scrub":"262'86","last_deep_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.068336+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:23.878729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.850205+0000","last_change":"2024-09-12T18:08:44.184768+0000","last_active":"2024-09-12T18:30:32.850205+0000","last_peered":"2024-09-12T18:30:32.850205+0000","last_clean":"2024-09-12T18:30:32.850205+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:30:32.850205+0000","last_undegraded":"2024-09-12T18:30:32.850205+0000","last_fullsized":"2024-09-12T18:30:32.850205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:15.733399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.549641+0000","last_change":"2024-09-12T18:33:48.549641+0000","last_active":"2024-09-12T18:33:48.549641+0000","last_peered":"2024-09-12T18:33:48.549641+0000","last_clean":"2024-09-12T18:33:48.549641+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:33:48.549641+0000","last_undegraded":"2024-09-12T18:33:48.549641+0000","last_fullsized":"2024-09-12T18:33:48.549641+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.549549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:57.676603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.134151+0000","last_change":"2024-09-12T17:53:12.138819+0000","last_active":"2024-09-12T18:33:04.134151+0000","last_peered":"2024-09-12T18:33:04.134151+0000","last_clean":"2024-09-12T18:33:04.134151+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:33:04.134151+0000","last_undegraded":"2024-09-12T18:33:04.134151+0000","last_fullsized":"2024-09-12T18:33:04.134151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:24.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.688319+0000","last_change":"2024-09-12T18:33:48.688319+0000","last_active":"2024-09-12T18:33:48.688319+0000","last_peered":"2024-09-12T18:33:48.688319+0000","last_clean":"2024-09-12T18:33:48.688319+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:33:48.688319+0000","last_undegraded":"2024-09-12T18:33:48.688319+0000","last_fullsized":"2024-09-12T18:33:48.688319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.688232+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:31.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:47.844721+0000","last_change":"2024-09-12T18:08:44.182992+0000","last_active":"2024-09-12T18:29:47.844721+0000","last_peered":"2024-09-12T18:29:47.844721+0000","last_clean":"2024-09-12T18:29:47.844721+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:29:47.844721+0000","last_undegraded":"2024-09-12T18:29:47.844721+0000","last_fullsized":"2024-09-12T18:29:47.844721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:16.373282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:57.441586+0000","last_change":"2024-09-12T17:53:15.166278+0000","last_active":"2024-09-12T18:32:57.441586+0000","last_peered":"2024-09-12T18:32:57.441586+0000","last_clean":"2024-09-12T18:32:57.441586+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:32:57.441586+0000","last_undegraded":"2024-09-12T18:32:57.441586+0000","last_fullsized":"2024-09-12T18:32:57.441586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:11.564721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.750115+0000","last_change":"2024-09-12T18:33:43.750115+0000","last_active":"2024-09-12T18:33:43.750115+0000","last_peered":"2024-09-12T18:33:43.750115+0000","last_clean":"2024-09-12T18:33:43.750115+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:33:43.750115+0000","last_undegraded":"2024-09-12T18:33:43.750115+0000","last_fullsized":"2024-09-12T18:33:43.750115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.750030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:15.962557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16370,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":149,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.435189+0000","last_change":"2024-09-12T18:33:51.435189+0000","last_active":"2024-09-12T18:33:51.435189+0000","last_peered":"2024-09-12T18:33:51.435189+0000","last_clean":"2024-09-12T18:33:51.435189+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:33:51.435189+0000","last_undegraded":"2024-09-12T18:33:51.435189+0000","last_fullsized":"2024-09-12T18:33:51.435189+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.435102+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:43.729892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.776324+0000","last_change":"2024-09-12T18:33:45.776324+0000","last_active":"2024-09-12T18:33:45.776324+0000","last_peered":"2024-09-12T18:33:45.776324+0000","last_clean":"2024-09-12T18:33:45.776324+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:33:45.776324+0000","last_undegraded":"2024-09-12T18:33:45.776324+0000","last_fullsized":"2024-09-12T18:33:45.776324+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.776236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.587480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.733575+0000","last_change":"2024-09-12T18:33:49.733575+0000","last_active":"2024-09-12T18:33:49.733575+0000","last_peered":"2024-09-12T18:33:49.733575+0000","last_clean":"2024-09-12T18:33:49.733575+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:33:49.733575+0000","last_undegraded":"2024-09-12T18:33:49.733575+0000","last_fullsized":"2024-09-12T18:33:49.733575+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.733492+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:11.435583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:29:57.417195+0000","last_change":"2024-09-12T17:50:14.842083+0000","last_active":"2024-09-12T18:29:57.417195+0000","last_peered":"2024-09-12T18:29:57.417195+0000","last_clean":"2024-09-12T18:29:57.417195+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:29:57.417195+0000","last_undegraded":"2024-09-12T18:29:57.417195+0000","last_fullsized":"2024-09-12T18:29:57.417195+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.363467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.077276+0000","last_change":"2024-09-12T18:33:38.077276+0000","last_active":"2024-09-12T18:33:38.077276+0000","last_peered":"2024-09-12T18:33:38.077276+0000","last_clean":"2024-09-12T18:33:38.077276+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:33:38.077276+0000","last_undegraded":"2024-09-12T18:33:38.077276+0000","last_fullsized":"2024-09-12T18:33:38.077276+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.077154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:15.304159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'7","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.607579+0000","last_change":"2024-09-12T17:53:15.164985+0000","last_active":"2024-09-12T18:33:05.607579+0000","last_peered":"2024-09-12T18:33:05.607579+0000","last_clean":"2024-09-12T18:33:05.607579+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:33:05.607579+0000","last_undegraded":"2024-09-12T18:33:05.607579+0000","last_fullsized":"2024-09-12T18:33:05.607579+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.300824+0000","last_change":"2024-09-12T17:53:12.144617+0000","last_active":"2024-09-12T18:33:05.300824+0000","last_peered":"2024-09-12T18:33:05.300824+0000","last_clean":"2024-09-12T18:33:05.300824+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:33:05.300824+0000","last_undegraded":"2024-09-12T18:33:05.300824+0000","last_fullsized":"2024-09-12T18:33:05.300824+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:02.425494+0000","last_change":"2024-09-12T17:50:14.844734+0000","last_active":"2024-09-12T18:31:02.425494+0000","last_peered":"2024-09-12T18:31:02.425494+0000","last_clean":"2024-09-12T18:31:02.425494+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:31:02.425494+0000","last_undegraded":"2024-09-12T18:31:02.425494+0000","last_fullsized":"2024-09-12T18:31:02.425494+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.433155+0000","last_change":"2024-09-12T18:08:44.186584+0000","last_active":"2024-09-12T18:31:17.433155+0000","last_peered":"2024-09-12T18:31:17.433155+0000","last_clean":"2024-09-12T18:31:17.433155+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:31:17.433155+0000","last_undegraded":"2024-09-12T18:31:17.433155+0000","last_fullsized":"2024-09-12T18:31:17.433155+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:32.429453+0000","last_change":"2024-09-12T17:53:15.163463+0000","last_active":"2024-09-12T18:31:32.429453+0000","last_peered":"2024-09-12T18:31:32.429453+0000","last_clean":"2024-09-12T18:31:32.429453+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:31:32.429453+0000","last_undegraded":"2024-09-12T18:31:32.429453+0000","last_fullsized":"2024-09-12T18:31:32.429453+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.059842+0000","last_change":"2024-09-12T18:33:36.059779+0000","last_active":"2024-09-12T18:33:36.059842+0000","last_peered":"2024-09-12T18:33:36.059842+0000","last_clean":"2024-09-12T18:33:36.059842+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:33:36.059842+0000","last_undegraded":"2024-09-12T18:33:36.059842+0000","last_fullsized":"2024-09-12T18:33:36.059842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.059690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.315136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7180,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.710357+0000","last_change":"2024-09-12T18:33:48.710357+0000","last_active":"2024-09-12T18:33:48.710357+0000","last_peered":"2024-09-12T18:33:48.710357+0000","last_clean":"2024-09-12T18:33:48.710357+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:33:48.710357+0000","last_undegraded":"2024-09-12T18:33:48.710357+0000","last_fullsized":"2024-09-12T18:33:48.710357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'39","last_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_deep_scrub":"262'39","last_deep_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.710256+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:19.803857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.796099+0000","last_change":"2024-09-12T18:33:48.796099+0000","last_active":"2024-09-12T18:33:48.796099+0000","last_peered":"2024-09-12T18:33:48.796099+0000","last_clean":"2024-09-12T18:33:48.796099+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:33:48.796099+0000","last_undegraded":"2024-09-12T18:33:48.796099+0000","last_fullsized":"2024-09-12T18:33:48.796099+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.796012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:53.301486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'7","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.506056+0000","last_change":"2024-09-12T18:33:46.506056+0000","last_active":"2024-09-12T18:33:46.506056+0000","last_peered":"2024-09-12T18:33:46.506056+0000","last_clean":"2024-09-12T18:33:46.506056+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:33:46.506056+0000","last_undegraded":"2024-09-12T18:33:46.506056+0000","last_fullsized":"2024-09-12T18:33:46.506056+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.505974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:34.339593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8190,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'7","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:03.977740+0000","last_change":"2024-09-12T17:53:12.146625+0000","last_active":"2024-09-12T18:33:03.977740+0000","last_peered":"2024-09-12T18:33:03.977740+0000","last_clean":"2024-09-12T18:33:03.977740+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:33:03.977740+0000","last_undegraded":"2024-09-12T18:33:03.977740+0000","last_fullsized":"2024-09-12T18:33:03.977740+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":12,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.785539+0000","last_change":"2024-09-12T18:33:40.785539+0000","last_active":"2024-09-12T18:33:40.785539+0000","last_peered":"2024-09-12T18:33:40.785539+0000","last_clean":"2024-09-12T18:33:40.785539+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:33:40.785539+0000","last_undegraded":"2024-09-12T18:33:40.785539+0000","last_fullsized":"2024-09-12T18:33:40.785539+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.785448+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.888653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.424188+0000","last_change":"2024-09-12T18:08:44.181437+0000","last_active":"2024-09-12T18:30:27.424188+0000","last_peered":"2024-09-12T18:30:27.424188+0000","last_clean":"2024-09-12T18:30:27.424188+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:30:27.424188+0000","last_undegraded":"2024-09-12T18:30:27.424188+0000","last_fullsized":"2024-09-12T18:30:27.424188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:10.703409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.441717+0000","last_change":"2024-09-12T17:53:15.164400+0000","last_active":"2024-09-12T18:33:04.441717+0000","last_peered":"2024-09-12T18:33:04.441717+0000","last_clean":"2024-09-12T18:33:04.441717+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:33:04.441717+0000","last_undegraded":"2024-09-12T18:33:04.441717+0000","last_fullsized":"2024-09-12T18:33:04.441717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.533567+0000","last_change":"2024-09-12T18:33:45.533486+0000","last_active":"2024-09-12T18:33:45.533567+0000","last_peered":"2024-09-12T18:33:45.533567+0000","last_clean":"2024-09-12T18:33:45.533567+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:33:45.533567+0000","last_undegraded":"2024-09-12T18:33:45.533567+0000","last_fullsized":"2024-09-12T18:33:45.533567+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.533395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:25.583217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":129,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.126504+0000","last_change":"2024-09-12T18:33:32.126504+0000","last_active":"2024-09-12T18:33:32.126504+0000","last_peered":"2024-09-12T18:33:32.126504+0000","last_clean":"2024-09-12T18:33:32.126504+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:33:32.126504+0000","last_undegraded":"2024-09-12T18:33:32.126504+0000","last_fullsized":"2024-09-12T18:33:32.126504+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.126421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:07.003050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.427289+0000","last_change":"2024-09-12T18:08:44.186628+0000","last_active":"2024-09-12T18:31:17.427289+0000","last_peered":"2024-09-12T18:31:17.427289+0000","last_clean":"2024-09-12T18:31:17.427289+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:31:17.427289+0000","last_undegraded":"2024-09-12T18:31:17.427289+0000","last_fullsized":"2024-09-12T18:31:17.427289+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559559+0000","last_change":"2024-09-12T17:53:15.166289+0000","last_active":"2024-09-12T18:32:18.559559+0000","last_peered":"2024-09-12T18:32:18.559559+0000","last_clean":"2024-09-12T18:32:18.559559+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:32:18.559559+0000","last_undegraded":"2024-09-12T18:32:18.559559+0000","last_fullsized":"2024-09-12T18:32:18.559559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:00.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:12.862842+0000","last_change":"2024-09-12T17:53:12.146523+0000","last_active":"2024-09-12T18:32:12.862842+0000","last_peered":"2024-09-12T18:32:12.862842+0000","last_clean":"2024-09-12T18:32:12.862842+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:32:12.862842+0000","last_undegraded":"2024-09-12T18:32:12.862842+0000","last_fullsized":"2024-09-12T18:32:12.862842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.960319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'84","reported_seq":361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.726698+0000","last_change":"2024-09-12T18:33:47.726698+0000","last_active":"2024-09-12T18:33:47.726698+0000","last_peered":"2024-09-12T18:33:47.726698+0000","last_clean":"2024-09-12T18:33:47.726698+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:33:47.726698+0000","last_undegraded":"2024-09-12T18:33:47.726698+0000","last_fullsized":"2024-09-12T18:33:47.726698+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'84","last_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_deep_scrub":"262'84","last_deep_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.726617+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:13.084915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:22.434303+0000","last_change":"2024-09-12T18:08:44.184755+0000","last_active":"2024-09-12T18:31:22.434303+0000","last_peered":"2024-09-12T18:31:22.434303+0000","last_clean":"2024-09-12T18:31:22.434303+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:31:22.434303+0000","last_undegraded":"2024-09-12T18:31:22.434303+0000","last_fullsized":"2024-09-12T18:31:22.434303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420454+0000","last_change":"2024-09-12T17:53:15.161680+0000","last_active":"2024-09-12T18:30:07.420454+0000","last_peered":"2024-09-12T18:30:07.420454+0000","last_clean":"2024-09-12T18:30:07.420454+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:30:07.420454+0000","last_undegraded":"2024-09-12T18:30:07.420454+0000","last_fullsized":"2024-09-12T18:30:07.420454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:38.671913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.540924+0000","last_change":"2024-09-12T18:33:42.540924+0000","last_active":"2024-09-12T18:33:42.540924+0000","last_peered":"2024-09-12T18:33:42.540924+0000","last_clean":"2024-09-12T18:33:42.540924+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:33:42.540924+0000","last_undegraded":"2024-09-12T18:33:42.540924+0000","last_fullsized":"2024-09-12T18:33:42.540924+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.540836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:50.406845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2093,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":216,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.101232+0000","last_change":"2024-09-12T18:33:47.101176+0000","last_active":"2024-09-12T18:33:47.101232+0000","last_peered":"2024-09-12T18:33:47.101232+0000","last_clean":"2024-09-12T18:33:47.101232+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:33:47.101232+0000","last_undegraded":"2024-09-12T18:33:47.101232+0000","last_fullsized":"2024-09-12T18:33:47.101232+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.101091+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:51.288656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.433194+0000","last_change":"2024-09-12T18:08:44.184327+0000","last_active":"2024-09-12T18:31:17.433194+0000","last_peered":"2024-09-12T18:31:17.433194+0000","last_clean":"2024-09-12T18:31:17.433194+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:31:17.433194+0000","last_undegraded":"2024-09-12T18:31:17.433194+0000","last_fullsized":"2024-09-12T18:31:17.433194+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.578293+0000","last_change":"2024-09-12T18:33:51.578293+0000","last_active":"2024-09-12T18:33:51.578293+0000","last_peered":"2024-09-12T18:33:51.578293+0000","last_clean":"2024-09-12T18:33:51.578293+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:33:51.578293+0000","last_undegraded":"2024-09-12T18:33:51.578293+0000","last_fullsized":"2024-09-12T18:33:51.578293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.578175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.289043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.846792+0000","last_change":"2024-09-12T17:53:12.143064+0000","last_active":"2024-09-12T18:30:02.846792+0000","last_peered":"2024-09-12T18:30:02.846792+0000","last_clean":"2024-09-12T18:30:02.846792+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:30:02.846792+0000","last_undegraded":"2024-09-12T18:30:02.846792+0000","last_fullsized":"2024-09-12T18:30:02.846792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:23.396969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:27.428422+0000","last_change":"2024-09-12T17:50:14.838559+0000","last_active":"2024-09-12T18:31:27.428422+0000","last_peered":"2024-09-12T18:31:27.428422+0000","last_clean":"2024-09-12T18:31:27.428422+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:31:27.428422+0000","last_undegraded":"2024-09-12T18:31:27.428422+0000","last_fullsized":"2024-09-12T18:31:27.428422+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:13.814350+0000","last_clean_scrub_stamp":"2024-09-12T17:50:13.814350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:17.855263+0000","last_change":"2024-09-12T18:08:44.179330+0000","last_active":"2024-09-12T18:31:17.855263+0000","last_peered":"2024-09-12T18:31:17.855263+0000","last_clean":"2024-09-12T18:31:17.855263+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:31:17.855263+0000","last_undegraded":"2024-09-12T18:31:17.855263+0000","last_fullsized":"2024-09-12T18:31:17.855263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'7","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.749815+0000","last_change":"2024-09-12T17:53:15.165675+0000","last_active":"2024-09-12T18:33:04.749815+0000","last_peered":"2024-09-12T18:33:04.749815+0000","last_clean":"2024-09-12T18:33:04.749815+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:33:04.749815+0000","last_undegraded":"2024-09-12T18:33:04.749815+0000","last_fullsized":"2024-09-12T18:33:04.749815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:51.560211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":12,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.483317+0000","last_change":"2024-09-12T18:33:49.483317+0000","last_active":"2024-09-12T18:33:49.483317+0000","last_peered":"2024-09-12T18:33:49.483317+0000","last_clean":"2024-09-12T18:33:49.483317+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:33:49.483317+0000","last_undegraded":"2024-09-12T18:33:49.483317+0000","last_fullsized":"2024-09-12T18:33:49.483317+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.483230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:14.375303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.742508+0000","last_change":"2024-09-12T18:33:39.742508+0000","last_active":"2024-09-12T18:33:39.742508+0000","last_peered":"2024-09-12T18:33:39.742508+0000","last_clean":"2024-09-12T18:33:39.742508+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:33:39.742508+0000","last_undegraded":"2024-09-12T18:33:39.742508+0000","last_fullsized":"2024-09-12T18:33:39.742508+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.742414+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.937032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.438236+0000","last_change":"2024-09-12T18:08:44.183128+0000","last_active":"2024-09-12T18:31:42.438236+0000","last_peered":"2024-09-12T18:31:42.438236+0000","last_clean":"2024-09-12T18:31:42.438236+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:31:42.438236+0000","last_undegraded":"2024-09-12T18:31:42.438236+0000","last_fullsized":"2024-09-12T18:31:42.438236+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851933+0000","last_change":"2024-09-12T17:53:15.157590+0000","last_active":"2024-09-12T18:30:47.851933+0000","last_peered":"2024-09-12T18:30:47.851933+0000","last_clean":"2024-09-12T18:30:47.851933+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:30:47.851933+0000","last_undegraded":"2024-09-12T18:30:47.851933+0000","last_fullsized":"2024-09-12T18:30:47.851933+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:52.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.129011+0000","last_change":"2024-09-12T18:33:51.129011+0000","last_active":"2024-09-12T18:33:51.129011+0000","last_peered":"2024-09-12T18:33:51.129011+0000","last_clean":"2024-09-12T18:33:51.129011+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:33:51.129011+0000","last_undegraded":"2024-09-12T18:33:51.129011+0000","last_fullsized":"2024-09-12T18:33:51.129011+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.128916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:09.750403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.684159+0000","last_change":"2024-09-12T18:33:50.684159+0000","last_active":"2024-09-12T18:33:50.684159+0000","last_peered":"2024-09-12T18:33:50.684159+0000","last_clean":"2024-09-12T18:33:50.684159+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:33:50.684159+0000","last_undegraded":"2024-09-12T18:33:50.684159+0000","last_fullsized":"2024-09-12T18:33:50.684159+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'43","last_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_deep_scrub":"262'43","last_deep_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.684073+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:13.128231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.671351+0000","last_change":"2024-09-12T18:08:44.183496+0000","last_active":"2024-09-12T18:31:42.671351+0000","last_peered":"2024-09-12T18:31:42.671351+0000","last_clean":"2024-09-12T18:31:42.671351+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:31:42.671351+0000","last_undegraded":"2024-09-12T18:31:42.671351+0000","last_fullsized":"2024-09-12T18:31:42.671351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:47.851912+0000","last_change":"2024-09-12T17:53:15.160062+0000","last_active":"2024-09-12T18:30:47.851912+0000","last_peered":"2024-09-12T18:30:47.851912+0000","last_clean":"2024-09-12T18:30:47.851912+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:30:47.851912+0000","last_undegraded":"2024-09-12T18:30:47.851912+0000","last_fullsized":"2024-09-12T18:30:47.851912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.159684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.072762+0000","last_change":"2024-09-12T18:33:35.072762+0000","last_active":"2024-09-12T18:33:35.072762+0000","last_peered":"2024-09-12T18:33:35.072762+0000","last_clean":"2024-09-12T18:33:35.072762+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:33:35.072762+0000","last_undegraded":"2024-09-12T18:33:35.072762+0000","last_fullsized":"2024-09-12T18:33:35.072762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.072666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:25.314427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.790476+0000","last_change":"2024-09-12T18:33:38.790476+0000","last_active":"2024-09-12T18:33:38.790476+0000","last_peered":"2024-09-12T18:33:38.790476+0000","last_clean":"2024-09-12T18:33:38.790476+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:33:38.790476+0000","last_undegraded":"2024-09-12T18:33:38.790476+0000","last_fullsized":"2024-09-12T18:33:38.790476+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'20","last_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_deep_scrub":"262'20","last_deep_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.790391+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:37.347221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.625450+0000","last_change":"2024-09-12T18:33:52.625450+0000","last_active":"2024-09-12T18:33:52.625450+0000","last_peered":"2024-09-12T18:33:52.625450+0000","last_clean":"2024-09-12T18:33:52.625450+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:33:52.625450+0000","last_undegraded":"2024-09-12T18:33:52.625450+0000","last_fullsized":"2024-09-12T18:33:52.625450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.625356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:27.503484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:07.420634+0000","last_change":"2024-09-12T17:53:15.161378+0000","last_active":"2024-09-12T18:30:07.420634+0000","last_peered":"2024-09-12T18:30:07.420634+0000","last_clean":"2024-09-12T18:30:07.420634+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:30:07.420634+0000","last_undegraded":"2024-09-12T18:30:07.420634+0000","last_fullsized":"2024-09-12T18:30:07.420634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:52.339216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'7","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.693090+0000","last_change":"2024-09-12T18:33:50.693090+0000","last_active":"2024-09-12T18:33:50.693090+0000","last_peered":"2024-09-12T18:33:50.693090+0000","last_clean":"2024-09-12T18:33:50.693090+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:33:50.693090+0000","last_undegraded":"2024-09-12T18:33:50.693090+0000","last_fullsized":"2024-09-12T18:33:50.693090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.692996+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:25.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":162,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.052767+0000","last_change":"2024-09-12T18:33:46.052767+0000","last_active":"2024-09-12T18:33:46.052767+0000","last_peered":"2024-09-12T18:33:46.052767+0000","last_clean":"2024-09-12T18:33:46.052767+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:33:46.052767+0000","last_undegraded":"2024-09-12T18:33:46.052767+0000","last_fullsized":"2024-09-12T18:33:46.052767+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.052674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:08.793575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:38.553571+0000","last_change":"2024-09-12T18:08:44.186339+0000","last_active":"2024-09-12T18:31:38.553571+0000","last_peered":"2024-09-12T18:31:38.553571+0000","last_clean":"2024-09-12T18:31:38.553571+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:31:38.553571+0000","last_undegraded":"2024-09-12T18:31:38.553571+0000","last_fullsized":"2024-09-12T18:31:38.553571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'7","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:18.559657+0000","last_change":"2024-09-12T17:53:15.158576+0000","last_active":"2024-09-12T18:32:18.559657+0000","last_peered":"2024-09-12T18:32:18.559657+0000","last_clean":"2024-09-12T18:32:18.559657+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:32:18.559657+0000","last_undegraded":"2024-09-12T18:32:18.559657+0000","last_fullsized":"2024-09-12T18:32:18.559657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.469335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:02.419823+0000","last_change":"2024-09-12T17:53:12.144540+0000","last_active":"2024-09-12T18:30:02.419823+0000","last_peered":"2024-09-12T18:30:02.419823+0000","last_clean":"2024-09-12T18:30:02.419823+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:30:02.419823+0000","last_undegraded":"2024-09-12T18:30:02.419823+0000","last_fullsized":"2024-09-12T18:30:02.419823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:11.120010+0000","last_clean_scrub_stamp":"2024-09-12T17:53:11.120010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.752287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.559181+0000","last_change":"2024-09-12T18:33:40.559181+0000","last_active":"2024-09-12T18:33:40.559181+0000","last_peered":"2024-09-12T18:33:40.559181+0000","last_clean":"2024-09-12T18:33:40.559181+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:33:40.559181+0000","last_undegraded":"2024-09-12T18:33:40.559181+0000","last_fullsized":"2024-09-12T18:33:40.559181+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.559081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:57.983997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.073004+0000","last_change":"2024-09-12T18:33:42.073004+0000","last_active":"2024-09-12T18:33:42.073004+0000","last_peered":"2024-09-12T18:33:42.073004+0000","last_clean":"2024-09-12T18:33:42.073004+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:33:42.073004+0000","last_undegraded":"2024-09-12T18:33:42.073004+0000","last_fullsized":"2024-09-12T18:33:42.073004+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.072907+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:31.992134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'9","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.551587+0000","last_change":"2024-09-12T18:33:47.551587+0000","last_active":"2024-09-12T18:33:47.551587+0000","last_peered":"2024-09-12T18:33:47.551587+0000","last_clean":"2024-09-12T18:33:47.551587+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:33:47.551587+0000","last_undegraded":"2024-09-12T18:33:47.551587+0000","last_fullsized":"2024-09-12T18:33:47.551587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.551500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:34.296392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":21492,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.142147+0000","last_change":"2024-09-12T18:33:50.142147+0000","last_active":"2024-09-12T18:33:50.142147+0000","last_peered":"2024-09-12T18:33:50.142147+0000","last_clean":"2024-09-12T18:33:50.142147+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:33:50.142147+0000","last_undegraded":"2024-09-12T18:33:50.142147+0000","last_fullsized":"2024-09-12T18:33:50.142147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.142028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.397527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.667434+0000","last_change":"2024-09-12T18:33:47.667434+0000","last_active":"2024-09-12T18:33:47.667434+0000","last_peered":"2024-09-12T18:33:47.667434+0000","last_clean":"2024-09-12T18:33:47.667434+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:33:47.667434+0000","last_undegraded":"2024-09-12T18:33:47.667434+0000","last_fullsized":"2024-09-12T18:33:47.667434+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'63","last_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_deep_scrub":"262'63","last_deep_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.667339+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:42.294995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:27.849632+0000","last_change":"2024-09-12T18:08:44.181747+0000","last_active":"2024-09-12T18:30:27.849632+0000","last_peered":"2024-09-12T18:30:27.849632+0000","last_clean":"2024-09-12T18:30:27.849632+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:30:27.849632+0000","last_undegraded":"2024-09-12T18:30:27.849632+0000","last_fullsized":"2024-09-12T18:30:27.849632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.139557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.604429+0000","last_change":"2024-09-12T17:53:15.159457+0000","last_active":"2024-09-12T18:33:05.604429+0000","last_peered":"2024-09-12T18:33:05.604429+0000","last_clean":"2024-09-12T18:33:05.604429+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:33:05.604429+0000","last_undegraded":"2024-09-12T18:33:05.604429+0000","last_fullsized":"2024-09-12T18:33:05.604429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":4,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.137464+0000","last_change":"2024-09-12T18:33:52.137464+0000","last_active":"2024-09-12T18:33:52.137464+0000","last_peered":"2024-09-12T18:33:52.137464+0000","last_clean":"2024-09-12T18:33:52.137464+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:33:52.137464+0000","last_undegraded":"2024-09-12T18:33:52.137464+0000","last_fullsized":"2024-09-12T18:33:52.137464+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.137345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:19.251983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.410627+0000","last_change":"2024-09-12T18:33:47.410627+0000","last_active":"2024-09-12T18:33:47.410627+0000","last_peered":"2024-09-12T18:33:47.410627+0000","last_clean":"2024-09-12T18:33:47.410627+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:33:47.410627+0000","last_undegraded":"2024-09-12T18:33:47.410627+0000","last_fullsized":"2024-09-12T18:33:47.410627+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.410546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:13.633680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:42.858707+0000","last_change":"2024-09-12T18:08:44.178856+0000","last_active":"2024-09-12T18:31:42.858707+0000","last_peered":"2024-09-12T18:31:42.858707+0000","last_clean":"2024-09-12T18:31:42.858707+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:31:42.858707+0000","last_undegraded":"2024-09-12T18:31:42.858707+0000","last_fullsized":"2024-09-12T18:31:42.858707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.746737+0000","last_change":"2024-09-12T18:33:44.746737+0000","last_active":"2024-09-12T18:33:44.746737+0000","last_peered":"2024-09-12T18:33:44.746737+0000","last_clean":"2024-09-12T18:33:44.746737+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:33:44.746737+0000","last_undegraded":"2024-09-12T18:33:44.746737+0000","last_fullsized":"2024-09-12T18:33:44.746737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.746644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:18.534212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.527686+0000","last_change":"2024-09-12T18:33:41.527686+0000","last_active":"2024-09-12T18:33:41.527686+0000","last_peered":"2024-09-12T18:33:41.527686+0000","last_clean":"2024-09-12T18:33:41.527686+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:33:41.527686+0000","last_undegraded":"2024-09-12T18:33:41.527686+0000","last_fullsized":"2024-09-12T18:33:41.527686+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.527572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:40.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.802441+0000","last_change":"2024-09-12T18:33:37.802441+0000","last_active":"2024-09-12T18:33:37.802441+0000","last_peered":"2024-09-12T18:33:37.802441+0000","last_clean":"2024-09-12T18:33:37.802441+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:33:37.802441+0000","last_undegraded":"2024-09-12T18:33:37.802441+0000","last_fullsized":"2024-09-12T18:33:37.802441+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'52","last_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_deep_scrub":"262'52","last_deep_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.802357+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:54.223569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:47.439232+0000","last_change":"2024-09-12T18:08:44.186686+0000","last_active":"2024-09-12T18:31:47.439232+0000","last_peered":"2024-09-12T18:31:47.439232+0000","last_clean":"2024-09-12T18:31:47.439232+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:31:47.439232+0000","last_undegraded":"2024-09-12T18:31:47.439232+0000","last_fullsized":"2024-09-12T18:31:47.439232+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:53.564563+0000","last_change":"2024-09-12T17:53:15.157527+0000","last_active":"2024-09-12T18:32:53.564563+0000","last_peered":"2024-09-12T18:32:53.564563+0000","last_clean":"2024-09-12T18:32:53.564563+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:32:53.564563+0000","last_undegraded":"2024-09-12T18:32:53.564563+0000","last_fullsized":"2024-09-12T18:32:53.564563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:14.140235+0000","last_clean_scrub_stamp":"2024-09-12T17:53:14.140235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:18.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.749770+0000","last_change":"2024-09-12T18:33:42.749770+0000","last_active":"2024-09-12T18:33:42.749770+0000","last_peered":"2024-09-12T18:33:42.749770+0000","last_clean":"2024-09-12T18:33:42.749770+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:33:42.749770+0000","last_undegraded":"2024-09-12T18:33:42.749770+0000","last_fullsized":"2024-09-12T18:33:42.749770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.749692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.877571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.076246+0000","last_change":"2024-09-12T18:33:45.076246+0000","last_active":"2024-09-12T18:33:45.076246+0000","last_peered":"2024-09-12T18:33:45.076246+0000","last_clean":"2024-09-12T18:33:45.076246+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:33:45.076246+0000","last_undegraded":"2024-09-12T18:33:45.076246+0000","last_fullsized":"2024-09-12T18:33:45.076246+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.076154+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:12.368273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'356","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.002517+0000","last_change":"2024-09-12T18:33:23.002517+0000","last_active":"2024-09-12T18:33:23.002517+0000","last_peered":"2024-09-12T18:33:23.002517+0000","last_clean":"2024-09-12T18:33:23.002517+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:33:23.002517+0000","last_undegraded":"2024-09-12T18:33:23.002517+0000","last_fullsized":"2024-09-12T18:33:23.002517+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'356","last_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_deep_scrub":"262'356","last_deep_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.002381+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:15.336304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":13512,"num_write":1124,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'539","reported_seq":1959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.650205+0000","last_change":"2024-09-12T18:33:28.650205+0000","last_active":"2024-09-12T18:33:28.650205+0000","last_peered":"2024-09-12T18:33:28.650205+0000","last_clean":"2024-09-12T18:33:28.650205+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:33:28.650205+0000","last_undegraded":"2024-09-12T18:33:28.650205+0000","last_fullsized":"2024-09-12T18:33:28.650205+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'539","last_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_deep_scrub":"262'539","last_deep_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.650119+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:52.021435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":773,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'418","reported_seq":1205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.544275+0000","last_change":"2024-09-12T18:33:18.544275+0000","last_active":"2024-09-12T18:33:18.544275+0000","last_peered":"2024-09-12T18:33:18.544275+0000","last_clean":"2024-09-12T18:33:18.544275+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:33:18.544275+0000","last_undegraded":"2024-09-12T18:33:18.544275+0000","last_fullsized":"2024-09-12T18:33:18.544275+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'418","last_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_deep_scrub":"262'418","last_deep_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.544159+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:31.620304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342084,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":23039,"num_write":1345,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'487","reported_seq":2080,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.047086+0000","last_change":"2024-09-12T18:33:27.047086+0000","last_active":"2024-09-12T18:33:27.047086+0000","last_peered":"2024-09-12T18:33:27.047086+0000","last_clean":"2024-09-12T18:33:27.047086+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:33:27.047086+0000","last_undegraded":"2024-09-12T18:33:27.047086+0000","last_fullsized":"2024-09-12T18:33:27.047086+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.047001+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:35.965293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'386","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.295051+0000","last_change":"2024-09-12T18:33:24.295051+0000","last_active":"2024-09-12T18:33:24.295051+0000","last_peered":"2024-09-12T18:33:24.295051+0000","last_clean":"2024-09-12T18:33:24.295051+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:33:24.295051+0000","last_undegraded":"2024-09-12T18:33:24.295051+0000","last_fullsized":"2024-09-12T18:33:24.295051+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'386","last_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_deep_scrub":"262'386","last_deep_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.294831+0000","objects_scrubbed":9,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:26.207847+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342186,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":764,"num_read_kb":32762,"num_write":1205,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'420","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.309452+0000","last_change":"2024-09-12T18:33:30.309452+0000","last_active":"2024-09-12T18:33:30.309452+0000","last_peered":"2024-09-12T18:33:30.309452+0000","last_clean":"2024-09-12T18:33:30.309452+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:33:30.309452+0000","last_undegraded":"2024-09-12T18:33:30.309452+0000","last_fullsized":"2024-09-12T18:33:30.309452+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.309353+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.906318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'347","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.680429+0000","last_change":"2024-09-12T18:33:22.680367+0000","last_active":"2024-09-12T18:33:22.680429+0000","last_peered":"2024-09-12T18:33:22.680429+0000","last_clean":"2024-09-12T18:33:22.680429+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:33:22.680429+0000","last_undegraded":"2024-09-12T18:33:22.680429+0000","last_fullsized":"2024-09-12T18:33:22.680429+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'347","last_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_deep_scrub":"262'347","last_deep_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.680245+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:30.990184+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":25007,"num_write":1079,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'463","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.634928+0000","last_change":"2024-09-12T18:33:24.634928+0000","last_active":"2024-09-12T18:33:24.634928+0000","last_peered":"2024-09-12T18:33:24.634928+0000","last_clean":"2024-09-12T18:33:24.634928+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:33:24.634928+0000","last_undegraded":"2024-09-12T18:33:24.634928+0000","last_fullsized":"2024-09-12T18:33:24.634928+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'463","last_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_deep_scrub":"262'463","last_deep_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.634835+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.682588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'325","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.976983+0000","last_change":"2024-09-12T18:33:21.976983+0000","last_active":"2024-09-12T18:33:21.976983+0000","last_peered":"2024-09-12T18:33:21.976983+0000","last_clean":"2024-09-12T18:33:21.976983+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:33:21.976983+0000","last_undegraded":"2024-09-12T18:33:21.976983+0000","last_fullsized":"2024-09-12T18:33:21.976983+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.976849+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:40.343209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":10934,"num_write":1041,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'858","reported_seq":2391,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.686947+0000","last_change":"2024-09-12T18:33:25.686890+0000","last_active":"2024-09-12T18:33:25.686947+0000","last_peered":"2024-09-12T18:33:25.686947+0000","last_clean":"2024-09-12T18:33:25.686947+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:33:25.686947+0000","last_undegraded":"2024-09-12T18:33:25.686947+0000","last_fullsized":"2024-09-12T18:33:25.686947+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'858","last_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_deep_scrub":"262'858","last_deep_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.686759+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:21.725139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'339","reported_seq":1142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.669828+0000","last_change":"2024-09-12T18:33:19.669828+0000","last_active":"2024-09-12T18:33:19.669828+0000","last_peered":"2024-09-12T18:33:19.669828+0000","last_clean":"2024-09-12T18:33:19.669828+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:33:19.669828+0000","last_undegraded":"2024-09-12T18:33:19.669828+0000","last_fullsized":"2024-09-12T18:33:19.669828+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.669637+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:57.288656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287593,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":903,"num_read_kb":42337,"num_write":1288,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2415,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.356822+0000","last_change":"2024-09-12T18:33:31.356822+0000","last_active":"2024-09-12T18:33:31.356822+0000","last_peered":"2024-09-12T18:33:31.356822+0000","last_clean":"2024-09-12T18:33:31.356822+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:33:31.356822+0000","last_undegraded":"2024-09-12T18:33:31.356822+0000","last_fullsized":"2024-09-12T18:33:31.356822+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'786","last_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_deep_scrub":"262'786","last_deep_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.356710+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:49.539854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'359","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.952233+0000","last_change":"2024-09-12T18:33:20.952233+0000","last_active":"2024-09-12T18:33:20.952233+0000","last_peered":"2024-09-12T18:33:20.952233+0000","last_clean":"2024-09-12T18:33:20.952233+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:33:20.952233+0000","last_undegraded":"2024-09-12T18:33:20.952233+0000","last_fullsized":"2024-09-12T18:33:20.952233+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.952116+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.745872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170843,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":26409,"num_write":1171,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'466","reported_seq":1971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.600741+0000","last_change":"2024-09-12T18:33:29.600741+0000","last_active":"2024-09-12T18:33:29.600741+0000","last_peered":"2024-09-12T18:33:29.600741+0000","last_clean":"2024-09-12T18:33:29.600741+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:33:29.600741+0000","last_undegraded":"2024-09-12T18:33:29.600741+0000","last_fullsized":"2024-09-12T18:33:29.600741+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'466","last_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_deep_scrub":"262'466","last_deep_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.600661+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:52.255182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'400","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.292029+0000","last_change":"2024-09-12T18:33:22.292029+0000","last_active":"2024-09-12T18:33:22.292029+0000","last_peered":"2024-09-12T18:33:22.292029+0000","last_clean":"2024-09-12T18:33:22.292029+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:33:22.292029+0000","last_undegraded":"2024-09-12T18:33:22.292029+0000","last_fullsized":"2024-09-12T18:33:22.292029+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'400","last_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_deep_scrub":"262'400","last_deep_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.291796+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:58.671981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":10679,"num_write":1254,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'487","reported_seq":2074,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.075118+0000","last_change":"2024-09-12T18:33:21.075118+0000","last_active":"2024-09-12T18:33:21.075118+0000","last_peered":"2024-09-12T18:33:21.075118+0000","last_clean":"2024-09-12T18:33:21.075118+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:33:21.075118+0000","last_undegraded":"2024-09-12T18:33:21.075118+0000","last_fullsized":"2024-09-12T18:33:21.075118+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.075019+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:54.397374+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.300808+0000","last_change":"2024-09-12T18:33:28.300808+0000","last_active":"2024-09-12T18:33:28.300808+0000","last_peered":"2024-09-12T18:33:28.300808+0000","last_clean":"2024-09-12T18:33:28.300808+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:33:28.300808+0000","last_undegraded":"2024-09-12T18:33:28.300808+0000","last_fullsized":"2024-09-12T18:33:28.300808+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'760","last_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_deep_scrub":"262'760","last_deep_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.300716+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:14.805759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'355","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.957389+0000","last_change":"2024-09-12T18:33:19.957318+0000","last_active":"2024-09-12T18:33:19.957389+0000","last_peered":"2024-09-12T18:33:19.957389+0000","last_clean":"2024-09-12T18:33:19.957389+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:33:19.957389+0000","last_undegraded":"2024-09-12T18:33:19.957389+0000","last_fullsized":"2024-09-12T18:33:19.957389+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'355","last_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_deep_scrub":"262'355","last_deep_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.957207+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:43.487020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":71616,"num_write":1141,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'420","reported_seq":1943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.032588+0000","last_change":"2024-09-12T18:33:26.032588+0000","last_active":"2024-09-12T18:33:26.032588+0000","last_peered":"2024-09-12T18:33:26.032588+0000","last_clean":"2024-09-12T18:33:26.032588+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:33:26.032588+0000","last_undegraded":"2024-09-12T18:33:26.032588+0000","last_fullsized":"2024-09-12T18:33:26.032588+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.032490+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.483514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'319","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.672779+0000","last_change":"2024-09-12T18:33:18.672682+0000","last_active":"2024-09-12T18:33:18.672779+0000","last_peered":"2024-09-12T18:33:18.672779+0000","last_clean":"2024-09-12T18:33:18.672779+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:33:18.672779+0000","last_undegraded":"2024-09-12T18:33:18.672779+0000","last_fullsized":"2024-09-12T18:33:18.672779+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'319","last_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_deep_scrub":"262'319","last_deep_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.672393+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:47.254680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49172,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":3270,"num_write":1020,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'872","reported_seq":2493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.641379+0000","last_change":"2024-09-12T18:33:26.641379+0000","last_active":"2024-09-12T18:33:26.641379+0000","last_peered":"2024-09-12T18:33:26.641379+0000","last_clean":"2024-09-12T18:33:26.641379+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:33:26.641379+0000","last_undegraded":"2024-09-12T18:33:26.641379+0000","last_fullsized":"2024-09-12T18:33:26.641379+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'872","last_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_deep_scrub":"262'872","last_deep_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.641291+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.568382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'387","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.697556+0000","last_change":"2024-09-12T18:33:17.697469+0000","last_active":"2024-09-12T18:33:17.697556+0000","last_peered":"2024-09-12T18:33:17.697556+0000","last_clean":"2024-09-12T18:33:17.697556+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:33:17.697556+0000","last_undegraded":"2024-09-12T18:33:17.697556+0000","last_fullsized":"2024-09-12T18:33:17.697556+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'387","last_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_deep_scrub":"262'387","last_deep_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.697260+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:05.335710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":65942,"num_write":1264,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1106","reported_seq":2620,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.099467+0000","last_change":"2024-09-12T18:33:19.099374+0000","last_active":"2024-09-12T18:33:19.099467+0000","last_peered":"2024-09-12T18:33:19.099467+0000","last_clean":"2024-09-12T18:33:19.099467+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:33:19.099467+0000","last_undegraded":"2024-09-12T18:33:19.099467+0000","last_fullsized":"2024-09-12T18:33:19.099467+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1106","last_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_deep_scrub":"262'1106","last_deep_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.099250+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":1000,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:44.344091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'292","reported_seq":1067,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.238977+0000","last_change":"2024-09-12T18:33:15.238905+0000","last_active":"2024-09-12T18:33:15.238977+0000","last_peered":"2024-09-12T18:33:15.238977+0000","last_clean":"2024-09-12T18:33:15.238977+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:15.238977+0000","last_undegraded":"2024-09-12T18:33:15.238977+0000","last_fullsized":"2024-09-12T18:33:15.238977+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.238775+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.181757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":760,"num_read_kb":33658,"num_write":1067,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'615","reported_seq":2390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.104238+0000","last_change":"2024-09-12T18:33:20.104176+0000","last_active":"2024-09-12T18:33:20.104238+0000","last_peered":"2024-09-12T18:33:20.104238+0000","last_clean":"2024-09-12T18:33:20.104238+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:33:20.104238+0000","last_undegraded":"2024-09-12T18:33:20.104238+0000","last_fullsized":"2024-09-12T18:33:20.104238+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'615","last_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_deep_scrub":"262'615","last_deep_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.104093+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:14.426305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3278,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'324","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.256820+0000","last_change":"2024-09-12T18:33:21.256705+0000","last_active":"2024-09-12T18:33:21.256820+0000","last_peered":"2024-09-12T18:33:21.256820+0000","last_clean":"2024-09-12T18:33:21.256820+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:33:21.256820+0000","last_undegraded":"2024-09-12T18:33:21.256820+0000","last_fullsized":"2024-09-12T18:33:21.256820+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.256481+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:27.688415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452413,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":42765,"num_write":983,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'308","reported_seq":1690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.287422+0000","last_change":"2024-09-12T18:33:29.287368+0000","last_active":"2024-09-12T18:33:29.287422+0000","last_peered":"2024-09-12T18:33:29.287422+0000","last_clean":"2024-09-12T18:33:29.287422+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:33:29.287422+0000","last_undegraded":"2024-09-12T18:33:29.287422+0000","last_fullsized":"2024-09-12T18:33:29.287422+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'308","last_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_deep_scrub":"262'308","last_deep_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.287289+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.869873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'376","reported_seq":1069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.613356+0000","last_change":"2024-09-12T18:33:15.613356+0000","last_active":"2024-09-12T18:33:15.613356+0000","last_peered":"2024-09-12T18:33:15.613356+0000","last_clean":"2024-09-12T18:33:15.613356+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:33:15.613356+0000","last_undegraded":"2024-09-12T18:33:15.613356+0000","last_fullsized":"2024-09-12T18:33:15.613356+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.613239+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:10.394785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5481568,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":590,"num_read_kb":95728,"num_write":1139,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'131","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.436104+0000","last_change":"2024-09-12T18:33:46.435999+0000","last_active":"2024-09-12T18:33:46.436104+0000","last_peered":"2024-09-12T18:33:46.436104+0000","last_clean":"2024-09-12T18:33:46.436104+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:33:46.436104+0000","last_undegraded":"2024-09-12T18:33:46.436104+0000","last_fullsized":"2024-09-12T18:33:46.436104+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.435880+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:52.500901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'777","reported_seq":2379,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.354132+0000","last_change":"2024-09-12T18:33:31.354132+0000","last_active":"2024-09-12T18:33:31.354132+0000","last_peered":"2024-09-12T18:33:31.354132+0000","last_clean":"2024-09-12T18:33:31.354132+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:33:31.354132+0000","last_undegraded":"2024-09-12T18:33:31.354132+0000","last_fullsized":"2024-09-12T18:33:31.354132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'777","last_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_deep_scrub":"262'777","last_deep_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.354052+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.571288+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'350","reported_seq":1124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.989242+0000","last_change":"2024-09-12T18:33:16.989242+0000","last_active":"2024-09-12T18:33:16.989242+0000","last_peered":"2024-09-12T18:33:16.989242+0000","last_clean":"2024-09-12T18:33:16.989242+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:33:16.989242+0000","last_undegraded":"2024-09-12T18:33:16.989242+0000","last_fullsized":"2024-09-12T18:33:16.989242+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'350","last_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_deep_scrub":"262'350","last_deep_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.989082+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.856138+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424710,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":775,"num_read_kb":10756,"num_write":1135,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.608311+0000","last_change":"2024-09-12T18:33:32.608235+0000","last_active":"2024-09-12T18:33:32.608311+0000","last_peered":"2024-09-12T18:33:32.608311+0000","last_clean":"2024-09-12T18:33:32.608311+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:33:32.608311+0000","last_undegraded":"2024-09-12T18:33:32.608311+0000","last_fullsized":"2024-09-12T18:33:32.608311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.608146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:01.224220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'345","reported_seq":958,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.658758+0000","last_change":"2024-09-12T18:33:32.658656+0000","last_active":"2024-09-12T18:33:32.658758+0000","last_peered":"2024-09-12T18:33:32.658758+0000","last_clean":"2024-09-12T18:33:32.658758+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:33:32.658758+0000","last_undegraded":"2024-09-12T18:33:32.658758+0000","last_fullsized":"2024-09-12T18:33:32.658758+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.658547+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:56.181606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1162,"num_write":438,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.090112+0000","last_change":"2024-09-12T18:33:41.090051+0000","last_active":"2024-09-12T18:33:41.090112+0000","last_peered":"2024-09-12T18:33:41.090112+0000","last_clean":"2024-09-12T18:33:41.090112+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:33:41.090112+0000","last_undegraded":"2024-09-12T18:33:41.090112+0000","last_fullsized":"2024-09-12T18:33:41.090112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.089965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:10.358903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'162","reported_seq":719,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.710192+0000","last_change":"2024-09-12T18:33:45.710192+0000","last_active":"2024-09-12T18:33:45.710192+0000","last_peered":"2024-09-12T18:33:45.710192+0000","last_clean":"2024-09-12T18:33:45.710192+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:33:45.710192+0000","last_undegraded":"2024-09-12T18:33:45.710192+0000","last_fullsized":"2024-09-12T18:33:45.710192+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.710098+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:46.772373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'480","reported_seq":2076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.693703+0000","last_change":"2024-09-12T18:33:23.693653+0000","last_active":"2024-09-12T18:33:23.693703+0000","last_peered":"2024-09-12T18:33:23.693703+0000","last_clean":"2024-09-12T18:33:23.693703+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:33:23.693703+0000","last_undegraded":"2024-09-12T18:33:23.693703+0000","last_fullsized":"2024-09-12T18:33:23.693703+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'480","last_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_deep_scrub":"262'480","last_deep_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.693570+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:07.678162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'420","reported_seq":1116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.540174+0000","last_change":"2024-09-12T18:33:11.540174+0000","last_active":"2024-09-12T18:33:11.540174+0000","last_peered":"2024-09-12T18:33:11.540174+0000","last_clean":"2024-09-12T18:33:11.540174+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:33:11.540174+0000","last_undegraded":"2024-09-12T18:33:11.540174+0000","last_fullsized":"2024-09-12T18:33:11.540174+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.540056+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:31.139934+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468829,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":675,"num_read_kb":80579,"num_write":1292,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.341205+0000","last_change":"2024-09-12T18:33:38.341205+0000","last_active":"2024-09-12T18:33:38.341205+0000","last_peered":"2024-09-12T18:33:38.341205+0000","last_clean":"2024-09-12T18:33:38.341205+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:33:38.341205+0000","last_undegraded":"2024-09-12T18:33:38.341205+0000","last_fullsized":"2024-09-12T18:33:38.341205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.341117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:17.987429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'92","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.290482+0000","last_change":"2024-09-12T18:33:38.290382+0000","last_active":"2024-09-12T18:33:38.290482+0000","last_peered":"2024-09-12T18:33:38.290482+0000","last_clean":"2024-09-12T18:33:38.290482+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:33:38.290482+0000","last_undegraded":"2024-09-12T18:33:38.290482+0000","last_fullsized":"2024-09-12T18:33:38.290482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'92","last_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_deep_scrub":"262'92","last_deep_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.290283+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:04.859768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.338961+0000","last_change":"2024-09-12T18:33:42.338879+0000","last_active":"2024-09-12T18:33:42.338961+0000","last_peered":"2024-09-12T18:33:42.338961+0000","last_clean":"2024-09-12T18:33:42.338961+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:33:42.338961+0000","last_undegraded":"2024-09-12T18:33:42.338961+0000","last_fullsized":"2024-09-12T18:33:42.338961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.338782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:35.618694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'176","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.740708+0000","last_change":"2024-09-12T18:33:46.740708+0000","last_active":"2024-09-12T18:33:46.740708+0000","last_peered":"2024-09-12T18:33:46.740708+0000","last_clean":"2024-09-12T18:33:46.740708+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:33:46.740708+0000","last_undegraded":"2024-09-12T18:33:46.740708+0000","last_fullsized":"2024-09-12T18:33:46.740708+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.740623+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:29.705946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1215","reported_seq":2944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.625377+0000","last_change":"2024-09-12T18:33:21.625322+0000","last_active":"2024-09-12T18:33:21.625377+0000","last_peered":"2024-09-12T18:33:21.625377+0000","last_clean":"2024-09-12T18:33:21.625377+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:33:21.625377+0000","last_undegraded":"2024-09-12T18:33:21.625377+0000","last_fullsized":"2024-09-12T18:33:21.625377+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1215","last_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_deep_scrub":"262'1215","last_deep_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.625227+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.877851+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'399","reported_seq":1053,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.013929+0000","last_change":"2024-09-12T18:33:15.013929+0000","last_active":"2024-09-12T18:33:15.013929+0000","last_peered":"2024-09-12T18:33:15.013929+0000","last_clean":"2024-09-12T18:33:15.013929+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:33:15.013929+0000","last_undegraded":"2024-09-12T18:33:15.013929+0000","last_fullsized":"2024-09-12T18:33:15.013929+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.013801+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:15.692669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386468,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":554,"num_read_kb":8447,"num_write":1280,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.356723+0000","last_change":"2024-09-12T18:33:36.356617+0000","last_active":"2024-09-12T18:33:36.356723+0000","last_peered":"2024-09-12T18:33:36.356723+0000","last_clean":"2024-09-12T18:33:36.356723+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:33:36.356723+0000","last_undegraded":"2024-09-12T18:33:36.356723+0000","last_fullsized":"2024-09-12T18:33:36.356723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.356499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'127","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.152071+0000","last_change":"2024-09-12T18:33:29.152071+0000","last_active":"2024-09-12T18:33:29.152071+0000","last_peered":"2024-09-12T18:33:29.152071+0000","last_clean":"2024-09-12T18:33:29.152071+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:33:29.152071+0000","last_undegraded":"2024-09-12T18:33:29.152071+0000","last_fullsized":"2024-09-12T18:33:29.152071+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.151970+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:49.592865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'764","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.112566+0000","last_change":"2024-09-12T18:33:40.112474+0000","last_active":"2024-09-12T18:33:40.112566+0000","last_peered":"2024-09-12T18:33:40.112566+0000","last_clean":"2024-09-12T18:33:40.112566+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:33:40.112566+0000","last_undegraded":"2024-09-12T18:33:40.112566+0000","last_fullsized":"2024-09-12T18:33:40.112566+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'764","last_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_deep_scrub":"262'764","last_deep_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.112394+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:40.492683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'232","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.439968+0000","last_change":"2024-09-12T18:33:48.439968+0000","last_active":"2024-09-12T18:33:48.439968+0000","last_peered":"2024-09-12T18:33:48.439968+0000","last_clean":"2024-09-12T18:33:48.439968+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:33:48.439968+0000","last_undegraded":"2024-09-12T18:33:48.439968+0000","last_fullsized":"2024-09-12T18:33:48.439968+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.439884+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:58.280243+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'673","reported_seq":2094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.396572+0000","last_change":"2024-09-12T18:33:27.396515+0000","last_active":"2024-09-12T18:33:27.396572+0000","last_peered":"2024-09-12T18:33:27.396572+0000","last_clean":"2024-09-12T18:33:27.396572+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:33:27.396572+0000","last_undegraded":"2024-09-12T18:33:27.396572+0000","last_fullsized":"2024-09-12T18:33:27.396572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'673","last_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_deep_scrub":"262'673","last_deep_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.396425+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:51.901322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'341","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.715413+0000","last_change":"2024-09-12T18:33:14.715413+0000","last_active":"2024-09-12T18:33:14.715413+0000","last_peered":"2024-09-12T18:33:14.715413+0000","last_clean":"2024-09-12T18:33:14.715413+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:33:14.715413+0000","last_undegraded":"2024-09-12T18:33:14.715413+0000","last_fullsized":"2024-09-12T18:33:14.715413+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.715259+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:05.915818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399179,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":57705,"num_write":1124,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.621558+0000","last_change":"2024-09-12T18:33:33.621485+0000","last_active":"2024-09-12T18:33:33.621558+0000","last_peered":"2024-09-12T18:33:33.621558+0000","last_clean":"2024-09-12T18:33:33.621558+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:33:33.621558+0000","last_undegraded":"2024-09-12T18:33:33.621558+0000","last_fullsized":"2024-09-12T18:33:33.621558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.621371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:49.117251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'282","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.181143+0000","last_change":"2024-09-12T18:33:37.181082+0000","last_active":"2024-09-12T18:33:37.181143+0000","last_peered":"2024-09-12T18:33:37.181143+0000","last_clean":"2024-09-12T18:33:37.181143+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:33:37.181143+0000","last_undegraded":"2024-09-12T18:33:37.181143+0000","last_fullsized":"2024-09-12T18:33:37.181143+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.180990+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:25.430774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1082,"num_write":378,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'819","reported_seq":2362,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.348692+0000","last_change":"2024-09-12T18:33:47.348692+0000","last_active":"2024-09-12T18:33:47.348692+0000","last_peered":"2024-09-12T18:33:47.348692+0000","last_clean":"2024-09-12T18:33:47.348692+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:33:47.348692+0000","last_undegraded":"2024-09-12T18:33:47.348692+0000","last_fullsized":"2024-09-12T18:33:47.348692+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.348609+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.230213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'542","reported_seq":2120,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.657751+0000","last_change":"2024-09-12T18:33:24.657751+0000","last_active":"2024-09-12T18:33:24.657751+0000","last_peered":"2024-09-12T18:33:24.657751+0000","last_clean":"2024-09-12T18:33:24.657751+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:33:24.657751+0000","last_undegraded":"2024-09-12T18:33:24.657751+0000","last_fullsized":"2024-09-12T18:33:24.657751+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.657662+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:53.428163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2021,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'394","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.039545+0000","last_change":"2024-09-12T18:33:14.039545+0000","last_active":"2024-09-12T18:33:14.039545+0000","last_peered":"2024-09-12T18:33:14.039545+0000","last_clean":"2024-09-12T18:33:14.039545+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:33:14.039545+0000","last_undegraded":"2024-09-12T18:33:14.039545+0000","last_fullsized":"2024-09-12T18:33:14.039545+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.039390+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:37.692448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512425,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":23815,"num_write":1238,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.090664+0000","last_change":"2024-09-12T18:33:28.090664+0000","last_active":"2024-09-12T18:33:28.090664+0000","last_peered":"2024-09-12T18:33:28.090664+0000","last_clean":"2024-09-12T18:33:28.090664+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:33:28.090664+0000","last_undegraded":"2024-09-12T18:33:28.090664+0000","last_fullsized":"2024-09-12T18:33:28.090664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.090568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:48.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'375","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.647244+0000","last_change":"2024-09-12T18:33:36.647244+0000","last_active":"2024-09-12T18:33:36.647244+0000","last_peered":"2024-09-12T18:33:36.647244+0000","last_clean":"2024-09-12T18:33:36.647244+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:33:36.647244+0000","last_undegraded":"2024-09-12T18:33:36.647244+0000","last_fullsized":"2024-09-12T18:33:36.647244+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.647139+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:42.082985+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45931,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":1150,"num_write":454,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.611701+0000","last_change":"2024-09-12T18:33:31.611701+0000","last_active":"2024-09-12T18:33:31.611701+0000","last_peered":"2024-09-12T18:33:31.611701+0000","last_clean":"2024-09-12T18:33:31.611701+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:33:31.611701+0000","last_undegraded":"2024-09-12T18:33:31.611701+0000","last_fullsized":"2024-09-12T18:33:31.611701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.611583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.249892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'588","reported_seq":1448,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.673311+0000","last_change":"2024-09-12T18:33:43.673311+0000","last_active":"2024-09-12T18:33:43.673311+0000","last_peered":"2024-09-12T18:33:43.673311+0000","last_clean":"2024-09-12T18:33:43.673311+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:33:43.673311+0000","last_undegraded":"2024-09-12T18:33:43.673311+0000","last_fullsized":"2024-09-12T18:33:43.673311+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'588","last_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_deep_scrub":"262'588","last_deep_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.673226+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.941746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'544","reported_seq":2028,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.216806+0000","last_change":"2024-09-12T18:33:17.216806+0000","last_active":"2024-09-12T18:33:17.216806+0000","last_peered":"2024-09-12T18:33:17.216806+0000","last_clean":"2024-09-12T18:33:17.216806+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:33:17.216806+0000","last_undegraded":"2024-09-12T18:33:17.216806+0000","last_fullsized":"2024-09-12T18:33:17.216806+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'544","last_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_deep_scrub":"262'544","last_deep_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.216707+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.670785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'393","reported_seq":1039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.215990+0000","last_change":"2024-09-12T18:33:15.215990+0000","last_active":"2024-09-12T18:33:15.215990+0000","last_peered":"2024-09-12T18:33:15.215990+0000","last_clean":"2024-09-12T18:33:15.215990+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:33:15.215990+0000","last_undegraded":"2024-09-12T18:33:15.215990+0000","last_fullsized":"2024-09-12T18:33:15.215990+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'393","last_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_deep_scrub":"262'393","last_deep_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.215872+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:55.176918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":15948,"num_write":1231,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.079381+0000","last_change":"2024-09-12T18:33:26.079381+0000","last_active":"2024-09-12T18:33:26.079381+0000","last_peered":"2024-09-12T18:33:26.079381+0000","last_clean":"2024-09-12T18:33:26.079381+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:33:26.079381+0000","last_undegraded":"2024-09-12T18:33:26.079381+0000","last_fullsized":"2024-09-12T18:33:26.079381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.079288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:46.736637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'277","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.369936+0000","last_change":"2024-09-12T18:33:37.369936+0000","last_active":"2024-09-12T18:33:37.369936+0000","last_peered":"2024-09-12T18:33:37.369936+0000","last_clean":"2024-09-12T18:33:37.369936+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:33:37.369936+0000","last_undegraded":"2024-09-12T18:33:37.369936+0000","last_fullsized":"2024-09-12T18:33:37.369936+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.369842+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:52.872806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47879,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1045,"num_write":366,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.319279+0000","last_change":"2024-09-12T18:33:48.319279+0000","last_active":"2024-09-12T18:33:48.319279+0000","last_peered":"2024-09-12T18:33:48.319279+0000","last_clean":"2024-09-12T18:33:48.319279+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:33:48.319279+0000","last_undegraded":"2024-09-12T18:33:48.319279+0000","last_fullsized":"2024-09-12T18:33:48.319279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.319179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:54.098870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2400","reported_seq":4245,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.748814+0000","last_change":"2024-09-12T18:33:33.748814+0000","last_active":"2024-09-12T18:33:33.748814+0000","last_peered":"2024-09-12T18:33:33.748814+0000","last_clean":"2024-09-12T18:33:33.748814+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:33:33.748814+0000","last_undegraded":"2024-09-12T18:33:33.748814+0000","last_fullsized":"2024-09-12T18:33:33.748814+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2400","last_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_deep_scrub":"262'2400","last_deep_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.748704+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:42.848648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1123","reported_seq":2592,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.691930+0000","last_change":"2024-09-12T18:33:21.691930+0000","last_active":"2024-09-12T18:33:21.691930+0000","last_peered":"2024-09-12T18:33:21.691930+0000","last_clean":"2024-09-12T18:33:21.691930+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:33:21.691930+0000","last_undegraded":"2024-09-12T18:33:21.691930+0000","last_fullsized":"2024-09-12T18:33:21.691930+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1123","last_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_deep_scrub":"262'1123","last_deep_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.691845+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":1100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:09.232918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'336","reported_seq":1014,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.086221+0000","last_change":"2024-09-12T18:33:12.086221+0000","last_active":"2024-09-12T18:33:12.086221+0000","last_peered":"2024-09-12T18:33:12.086221+0000","last_clean":"2024-09-12T18:33:12.086221+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:33:12.086221+0000","last_undegraded":"2024-09-12T18:33:12.086221+0000","last_fullsized":"2024-09-12T18:33:12.086221+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.086103+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:25.986928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4614985,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":185869,"num_write":1150,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.088545+0000","last_change":"2024-09-12T18:33:27.088545+0000","last_active":"2024-09-12T18:33:27.088545+0000","last_peered":"2024-09-12T18:33:27.088545+0000","last_clean":"2024-09-12T18:33:27.088545+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:33:27.088545+0000","last_undegraded":"2024-09-12T18:33:27.088545+0000","last_fullsized":"2024-09-12T18:33:27.088545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.088448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:18.854173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'331","reported_seq":925,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.118752+0000","last_change":"2024-09-12T18:33:32.118752+0000","last_active":"2024-09-12T18:33:32.118752+0000","last_peered":"2024-09-12T18:33:32.118752+0000","last_clean":"2024-09-12T18:33:32.118752+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:33:32.118752+0000","last_undegraded":"2024-09-12T18:33:32.118752+0000","last_fullsized":"2024-09-12T18:33:32.118752+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.118640+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:59.747985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49626,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":529,"num_read_kb":1160,"num_write":428,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'791","reported_seq":4767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.808463+0000","last_change":"2024-09-12T18:33:37.808463+0000","last_active":"2024-09-12T18:33:37.808463+0000","last_peered":"2024-09-12T18:33:37.808463+0000","last_clean":"2024-09-12T18:33:37.808463+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:33:37.808463+0000","last_undegraded":"2024-09-12T18:33:37.808463+0000","last_fullsized":"2024-09-12T18:33:37.808463+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'791","last_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_deep_scrub":"262'791","last_deep_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.808355+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.046104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'118","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.708437+0000","last_change":"2024-09-12T18:33:43.708437+0000","last_active":"2024-09-12T18:33:43.708437+0000","last_peered":"2024-09-12T18:33:43.708437+0000","last_clean":"2024-09-12T18:33:43.708437+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:33:43.708437+0000","last_undegraded":"2024-09-12T18:33:43.708437+0000","last_fullsized":"2024-09-12T18:33:43.708437+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.708371+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:01.056983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'520","reported_seq":2169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.619048+0000","last_change":"2024-09-12T18:33:25.619048+0000","last_active":"2024-09-12T18:33:25.619048+0000","last_peered":"2024-09-12T18:33:25.619048+0000","last_clean":"2024-09-12T18:33:25.619048+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:33:25.619048+0000","last_undegraded":"2024-09-12T18:33:25.619048+0000","last_fullsized":"2024-09-12T18:33:25.619048+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'520","last_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_deep_scrub":"262'520","last_deep_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.618938+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.541602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'349","reported_seq":1050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.659128+0000","last_change":"2024-09-12T18:33:15.659128+0000","last_active":"2024-09-12T18:33:15.659128+0000","last_peered":"2024-09-12T18:33:15.659128+0000","last_clean":"2024-09-12T18:33:15.659128+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:33:15.659128+0000","last_undegraded":"2024-09-12T18:33:15.659128+0000","last_fullsized":"2024-09-12T18:33:15.659128+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'349","last_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_deep_scrub":"262'349","last_deep_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.658993+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:57.692359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399009,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":648,"num_read_kb":11855,"num_write":1224,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.132737+0000","last_change":"2024-09-12T18:33:24.132737+0000","last_active":"2024-09-12T18:33:24.132737+0000","last_peered":"2024-09-12T18:33:24.132737+0000","last_clean":"2024-09-12T18:33:24.132737+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:33:24.132737+0000","last_undegraded":"2024-09-12T18:33:24.132737+0000","last_fullsized":"2024-09-12T18:33:24.132737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.132652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:47.476929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'483","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.697675+0000","last_change":"2024-09-12T18:33:31.697675+0000","last_active":"2024-09-12T18:33:31.697675+0000","last_peered":"2024-09-12T18:33:31.697675+0000","last_clean":"2024-09-12T18:33:31.697675+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:33:31.697675+0000","last_undegraded":"2024-09-12T18:33:31.697675+0000","last_fullsized":"2024-09-12T18:33:31.697675+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.697587+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:36.471785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":2056,"num_write":694,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.118962+0000","last_change":"2024-09-12T18:33:33.118962+0000","last_active":"2024-09-12T18:33:33.118962+0000","last_peered":"2024-09-12T18:33:33.118962+0000","last_clean":"2024-09-12T18:33:33.118962+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:33:33.118962+0000","last_undegraded":"2024-09-12T18:33:33.118962+0000","last_fullsized":"2024-09-12T18:33:33.118962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.118887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:16.556316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'165","reported_seq":696,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.564112+0000","last_change":"2024-09-12T18:33:38.564112+0000","last_active":"2024-09-12T18:33:38.564112+0000","last_peered":"2024-09-12T18:33:38.564112+0000","last_clean":"2024-09-12T18:33:38.564112+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:33:38.564112+0000","last_undegraded":"2024-09-12T18:33:38.564112+0000","last_fullsized":"2024-09-12T18:33:38.564112+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.564022+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:01.761974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'555","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.239412+0000","last_change":"2024-09-12T18:33:19.239412+0000","last_active":"2024-09-12T18:33:19.239412+0000","last_peered":"2024-09-12T18:33:19.239412+0000","last_clean":"2024-09-12T18:33:19.239412+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:33:19.239412+0000","last_undegraded":"2024-09-12T18:33:19.239412+0000","last_fullsized":"2024-09-12T18:33:19.239412+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'555","last_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_deep_scrub":"262'555","last_deep_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.239331+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:45.930298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'381","reported_seq":1210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.171237+0000","last_change":"2024-09-12T18:33:14.171237+0000","last_active":"2024-09-12T18:33:14.171237+0000","last_peered":"2024-09-12T18:33:14.171237+0000","last_clean":"2024-09-12T18:33:14.171237+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:33:14.171237+0000","last_undegraded":"2024-09-12T18:33:14.171237+0000","last_fullsized":"2024-09-12T18:33:14.171237+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'381","last_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_deep_scrub":"262'381","last_deep_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.171043+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:04.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":952,"num_read_kb":1817,"num_write":1243,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.119518+0000","last_change":"2024-09-12T18:33:25.119518+0000","last_active":"2024-09-12T18:33:25.119518+0000","last_peered":"2024-09-12T18:33:25.119518+0000","last_clean":"2024-09-12T18:33:25.119518+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:33:25.119518+0000","last_undegraded":"2024-09-12T18:33:25.119518+0000","last_fullsized":"2024-09-12T18:33:25.119518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.119405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:06.087705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'298","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.275377+0000","last_change":"2024-09-12T18:33:37.275377+0000","last_active":"2024-09-12T18:33:37.275377+0000","last_peered":"2024-09-12T18:33:37.275377+0000","last_clean":"2024-09-12T18:33:37.275377+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:33:37.275377+0000","last_undegraded":"2024-09-12T18:33:37.275377+0000","last_fullsized":"2024-09-12T18:33:37.275377+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.275279+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:10.198848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47571,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1071,"num_write":444,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.769070+0000","last_change":"2024-09-12T18:33:38.769070+0000","last_active":"2024-09-12T18:33:38.769070+0000","last_peered":"2024-09-12T18:33:38.769070+0000","last_clean":"2024-09-12T18:33:38.769070+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:33:38.769070+0000","last_undegraded":"2024-09-12T18:33:38.769070+0000","last_fullsized":"2024-09-12T18:33:38.769070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.768975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:12.755941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'97","reported_seq":592,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.288112+0000","last_change":"2024-09-12T18:33:51.288112+0000","last_active":"2024-09-12T18:33:51.288112+0000","last_peered":"2024-09-12T18:33:51.288112+0000","last_clean":"2024-09-12T18:33:51.288112+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:33:51.288112+0000","last_undegraded":"2024-09-12T18:33:51.288112+0000","last_fullsized":"2024-09-12T18:33:51.288112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'97","last_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_deep_scrub":"262'97","last_deep_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.288022+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:57.163162+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'574","reported_seq":2088,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.219164+0000","last_change":"2024-09-12T18:33:18.219164+0000","last_active":"2024-09-12T18:33:18.219164+0000","last_peered":"2024-09-12T18:33:18.219164+0000","last_clean":"2024-09-12T18:33:18.219164+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:33:18.219164+0000","last_undegraded":"2024-09-12T18:33:18.219164+0000","last_fullsized":"2024-09-12T18:33:18.219164+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.219044+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.862000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'374","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.728566+0000","last_change":"2024-09-12T18:33:13.728566+0000","last_active":"2024-09-12T18:33:13.728566+0000","last_peered":"2024-09-12T18:33:13.728566+0000","last_clean":"2024-09-12T18:33:13.728566+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:33:13.728566+0000","last_undegraded":"2024-09-12T18:33:13.728566+0000","last_fullsized":"2024-09-12T18:33:13.728566+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'374","last_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_deep_scrub":"262'374","last_deep_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.728424+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:02.902426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30147,"num_write":1155,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"262'6","reported_seq":986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.630372+0000","last_change":"2024-09-12T18:33:25.630372+0000","last_active":"2024-09-12T18:33:25.630372+0000","last_peered":"2024-09-12T18:33:25.630372+0000","last_clean":"2024-09-12T18:33:25.630372+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:33:25.630372+0000","last_undegraded":"2024-09-12T18:33:25.630372+0000","last_fullsized":"2024-09-12T18:33:25.630372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.630267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:05.121838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'320","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.109281+0000","last_change":"2024-09-12T18:33:28.109281+0000","last_active":"2024-09-12T18:33:28.109281+0000","last_peered":"2024-09-12T18:33:28.109281+0000","last_clean":"2024-09-12T18:33:28.109281+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:33:28.109281+0000","last_undegraded":"2024-09-12T18:33:28.109281+0000","last_fullsized":"2024-09-12T18:33:28.109281+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'320","last_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_deep_scrub":"262'320","last_deep_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.109177+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:16.884085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1126,"num_write":412,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'741","reported_seq":2539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.102053+0000","last_change":"2024-09-12T18:33:30.102053+0000","last_active":"2024-09-12T18:33:30.102053+0000","last_peered":"2024-09-12T18:33:30.102053+0000","last_clean":"2024-09-12T18:33:30.102053+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:33:30.102053+0000","last_undegraded":"2024-09-12T18:33:30.102053+0000","last_fullsized":"2024-09-12T18:33:30.102053+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'741","last_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_deep_scrub":"262'741","last_deep_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.101923+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:48.452566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.609114+0000","last_change":"2024-09-12T18:33:36.609114+0000","last_active":"2024-09-12T18:33:36.609114+0000","last_peered":"2024-09-12T18:33:36.609114+0000","last_clean":"2024-09-12T18:33:36.609114+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:33:36.609114+0000","last_undegraded":"2024-09-12T18:33:36.609114+0000","last_fullsized":"2024-09-12T18:33:36.609114+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.609016+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:23.806384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'392","reported_seq":1819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.266301+0000","last_change":"2024-09-12T18:33:20.266301+0000","last_active":"2024-09-12T18:33:20.266301+0000","last_peered":"2024-09-12T18:33:20.266301+0000","last_clean":"2024-09-12T18:33:20.266301+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:33:20.266301+0000","last_undegraded":"2024-09-12T18:33:20.266301+0000","last_fullsized":"2024-09-12T18:33:20.266301+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.266203+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:44.161180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'343","reported_seq":994,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.228696+0000","last_change":"2024-09-12T18:33:14.228696+0000","last_active":"2024-09-12T18:33:14.228696+0000","last_peered":"2024-09-12T18:33:14.228696+0000","last_clean":"2024-09-12T18:33:14.228696+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:14.228696+0000","last_undegraded":"2024-09-12T18:33:14.228696+0000","last_fullsized":"2024-09-12T18:33:14.228696+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'343","last_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_deep_scrub":"262'343","last_deep_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.228588+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.850074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":4238,"num_write":1153,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.577388+0000","last_change":"2024-09-12T18:33:31.577388+0000","last_active":"2024-09-12T18:33:31.577388+0000","last_peered":"2024-09-12T18:33:31.577388+0000","last_clean":"2024-09-12T18:33:31.577388+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:33:31.577388+0000","last_undegraded":"2024-09-12T18:33:31.577388+0000","last_fullsized":"2024-09-12T18:33:31.577388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.577293+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:13.603685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'100","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.309087+0000","last_change":"2024-09-12T18:33:43.309087+0000","last_active":"2024-09-12T18:33:43.309087+0000","last_peered":"2024-09-12T18:33:43.309087+0000","last_clean":"2024-09-12T18:33:43.309087+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:33:43.309087+0000","last_undegraded":"2024-09-12T18:33:43.309087+0000","last_fullsized":"2024-09-12T18:33:43.309087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.308986+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:25.653762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'780","reported_seq":2610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.729528+0000","last_change":"2024-09-12T18:33:30.729528+0000","last_active":"2024-09-12T18:33:30.729528+0000","last_peered":"2024-09-12T18:33:30.729528+0000","last_clean":"2024-09-12T18:33:30.729528+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:33:30.729528+0000","last_undegraded":"2024-09-12T18:33:30.729528+0000","last_fullsized":"2024-09-12T18:33:30.729528+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'780","last_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_deep_scrub":"262'780","last_deep_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.729444+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:31.980020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'109","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.378623+0000","last_change":"2024-09-12T18:33:44.378623+0000","last_active":"2024-09-12T18:33:44.378623+0000","last_peered":"2024-09-12T18:33:44.378623+0000","last_clean":"2024-09-12T18:33:44.378623+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:33:44.378623+0000","last_undegraded":"2024-09-12T18:33:44.378623+0000","last_fullsized":"2024-09-12T18:33:44.378623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.378497+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.199226+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'457","reported_seq":2059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.674992+0000","last_change":"2024-09-12T18:33:24.674992+0000","last_active":"2024-09-12T18:33:24.674992+0000","last_peered":"2024-09-12T18:33:24.674992+0000","last_clean":"2024-09-12T18:33:24.674992+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:33:24.674992+0000","last_undegraded":"2024-09-12T18:33:24.674992+0000","last_fullsized":"2024-09-12T18:33:24.674992+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.674869+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:09.706871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'370","reported_seq":1124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.177644+0000","last_change":"2024-09-12T18:33:11.177644+0000","last_active":"2024-09-12T18:33:11.177644+0000","last_peered":"2024-09-12T18:33:11.177644+0000","last_clean":"2024-09-12T18:33:11.177644+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:33:11.177644+0000","last_undegraded":"2024-09-12T18:33:11.177644+0000","last_fullsized":"2024-09-12T18:33:11.177644+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.177401+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:34.320877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":622,"num_read_kb":18794,"num_write":1042,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.355707+0000","last_change":"2024-09-12T18:33:33.355707+0000","last_active":"2024-09-12T18:33:33.355707+0000","last_peered":"2024-09-12T18:33:33.355707+0000","last_clean":"2024-09-12T18:33:33.355707+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:33:33.355707+0000","last_undegraded":"2024-09-12T18:33:33.355707+0000","last_fullsized":"2024-09-12T18:33:33.355707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.355619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:16.546019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'359","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.632679+0000","last_change":"2024-09-12T18:33:37.632679+0000","last_active":"2024-09-12T18:33:37.632679+0000","last_peered":"2024-09-12T18:33:37.632679+0000","last_clean":"2024-09-12T18:33:37.632679+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:33:37.632679+0000","last_undegraded":"2024-09-12T18:33:37.632679+0000","last_fullsized":"2024-09-12T18:33:37.632679+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.632556+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.327875+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1185,"num_write":448,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.692945+0000","last_change":"2024-09-12T18:33:29.692945+0000","last_active":"2024-09-12T18:33:29.692945+0000","last_peered":"2024-09-12T18:33:29.692945+0000","last_clean":"2024-09-12T18:33:29.692945+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:33:29.692945+0000","last_undegraded":"2024-09-12T18:33:29.692945+0000","last_fullsized":"2024-09-12T18:33:29.692945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.692847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:00.807529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'125","reported_seq":627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.607363+0000","last_change":"2024-09-12T18:33:37.607363+0000","last_active":"2024-09-12T18:33:37.607363+0000","last_peered":"2024-09-12T18:33:37.607363+0000","last_clean":"2024-09-12T18:33:37.607363+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:33:37.607363+0000","last_undegraded":"2024-09-12T18:33:37.607363+0000","last_fullsized":"2024-09-12T18:33:37.607363+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.607260+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.329098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'928","reported_seq":2667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.649116+0000","last_change":"2024-09-12T18:33:22.649116+0000","last_active":"2024-09-12T18:33:22.649116+0000","last_peered":"2024-09-12T18:33:22.649116+0000","last_clean":"2024-09-12T18:33:22.649116+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:33:22.649116+0000","last_undegraded":"2024-09-12T18:33:22.649116+0000","last_fullsized":"2024-09-12T18:33:22.649116+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'928","last_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_deep_scrub":"262'928","last_deep_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.648951+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:49.317398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.024561+0000","last_change":"2024-09-12T18:33:13.024500+0000","last_active":"2024-09-12T18:33:13.024561+0000","last_peered":"2024-09-12T18:33:13.024561+0000","last_clean":"2024-09-12T18:33:13.024561+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:33:13.024561+0000","last_undegraded":"2024-09-12T18:33:13.024561+0000","last_fullsized":"2024-09-12T18:33:13.024561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.024409+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.444574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":532,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.699824+0000","last_change":"2024-09-12T18:33:13.699741+0000","last_active":"2024-09-12T18:33:13.699824+0000","last_peered":"2024-09-12T18:33:13.699824+0000","last_clean":"2024-09-12T18:33:13.699824+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:33:13.699824+0000","last_undegraded":"2024-09-12T18:33:13.699824+0000","last_fullsized":"2024-09-12T18:33:13.699824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.699652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.289929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'314","reported_seq":955,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.163437+0000","last_change":"2024-09-12T18:33:12.163437+0000","last_active":"2024-09-12T18:33:12.163437+0000","last_peered":"2024-09-12T18:33:12.163437+0000","last_clean":"2024-09-12T18:33:12.163437+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:33:12.163437+0000","last_undegraded":"2024-09-12T18:33:12.163437+0000","last_fullsized":"2024-09-12T18:33:12.163437+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.163325+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:48.898263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":16545,"num_write":1010,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.096831+0000","last_change":"2024-09-12T18:33:29.096831+0000","last_active":"2024-09-12T18:33:29.096831+0000","last_peered":"2024-09-12T18:33:29.096831+0000","last_clean":"2024-09-12T18:33:29.096831+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:33:29.096831+0000","last_undegraded":"2024-09-12T18:33:29.096831+0000","last_fullsized":"2024-09-12T18:33:29.096831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.096728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:58.036440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'730","reported_seq":1438,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.603889+0000","last_change":"2024-09-12T18:33:35.603889+0000","last_active":"2024-09-12T18:33:35.603889+0000","last_peered":"2024-09-12T18:33:35.603889+0000","last_clean":"2024-09-12T18:33:35.603889+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:33:35.603889+0000","last_undegraded":"2024-09-12T18:33:35.603889+0000","last_fullsized":"2024-09-12T18:33:35.603889+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'730","last_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_deep_scrub":"262'730","last_deep_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.603786+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:41.577909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141929,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1422,"num_read_kb":3270,"num_write":1334,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89062,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.772578+0000","last_change":"2024-09-12T18:33:36.772578+0000","last_active":"2024-09-12T18:33:36.772578+0000","last_peered":"2024-09-12T18:33:36.772578+0000","last_clean":"2024-09-12T18:33:36.772578+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:33:36.772578+0000","last_undegraded":"2024-09-12T18:33:36.772578+0000","last_fullsized":"2024-09-12T18:33:36.772578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.772490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:45.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'188","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.751069+0000","last_change":"2024-09-12T18:33:35.751069+0000","last_active":"2024-09-12T18:33:35.751069+0000","last_peered":"2024-09-12T18:33:35.751069+0000","last_clean":"2024-09-12T18:33:35.751069+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:33:35.751069+0000","last_undegraded":"2024-09-12T18:33:35.751069+0000","last_fullsized":"2024-09-12T18:33:35.751069+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.750947+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.223486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'774","reported_seq":2228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.642138+0000","last_change":"2024-09-12T18:33:18.642138+0000","last_active":"2024-09-12T18:33:18.642138+0000","last_peered":"2024-09-12T18:33:18.642138+0000","last_clean":"2024-09-12T18:33:18.642138+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:33:18.642138+0000","last_undegraded":"2024-09-12T18:33:18.642138+0000","last_fullsized":"2024-09-12T18:33:18.642138+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.642044+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:43.372937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.980769+0000","last_change":"2024-09-12T18:33:13.980705+0000","last_active":"2024-09-12T18:33:13.980769+0000","last_peered":"2024-09-12T18:33:13.980769+0000","last_clean":"2024-09-12T18:33:13.980769+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:33:13.980769+0000","last_undegraded":"2024-09-12T18:33:13.980769+0000","last_fullsized":"2024-09-12T18:33:13.980769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.980562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:37.681267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'360","reported_seq":1008,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.526881+0000","last_change":"2024-09-12T18:33:10.526881+0000","last_active":"2024-09-12T18:33:10.526881+0000","last_peered":"2024-09-12T18:33:10.526881+0000","last_clean":"2024-09-12T18:33:10.526881+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:33:10.526881+0000","last_undegraded":"2024-09-12T18:33:10.526881+0000","last_fullsized":"2024-09-12T18:33:10.526881+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'360","last_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_deep_scrub":"262'360","last_deep_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.526734+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:39.807485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493074,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":8966,"num_write":1133,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.623233+0000","last_change":"2024-09-12T18:33:30.623233+0000","last_active":"2024-09-12T18:33:30.623233+0000","last_peered":"2024-09-12T18:33:30.623233+0000","last_clean":"2024-09-12T18:33:30.623233+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:33:30.623233+0000","last_undegraded":"2024-09-12T18:33:30.623233+0000","last_fullsized":"2024-09-12T18:33:30.623233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.623129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:40.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1313","reported_seq":2943,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.641646+0000","last_change":"2024-09-12T18:33:30.641646+0000","last_active":"2024-09-12T18:33:30.641646+0000","last_peered":"2024-09-12T18:33:30.641646+0000","last_clean":"2024-09-12T18:33:30.641646+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:33:30.641646+0000","last_undegraded":"2024-09-12T18:33:30.641646+0000","last_fullsized":"2024-09-12T18:33:30.641646+0000","mapping_epoch":30,"log_start":"262'1300","ondisk_log_start":"262'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1313","last_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_deep_scrub":"262'1313","last_deep_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.641550+0000","objects_scrubbed":11,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:54.537058+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2069,"num_read_kb":3913,"num_write":1176,"num_write_kb":1005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.140324+0000","last_change":"2024-09-12T18:33:39.140324+0000","last_active":"2024-09-12T18:33:39.140324+0000","last_peered":"2024-09-12T18:33:39.140324+0000","last_clean":"2024-09-12T18:33:39.140324+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:33:39.140324+0000","last_undegraded":"2024-09-12T18:33:39.140324+0000","last_fullsized":"2024-09-12T18:33:39.140324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.140223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:37.908935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'255","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.582810+0000","last_change":"2024-09-12T18:33:39.582810+0000","last_active":"2024-09-12T18:33:39.582810+0000","last_peered":"2024-09-12T18:33:39.582810+0000","last_clean":"2024-09-12T18:33:39.582810+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:33:39.582810+0000","last_undegraded":"2024-09-12T18:33:39.582810+0000","last_fullsized":"2024-09-12T18:33:39.582810+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'255","last_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_deep_scrub":"262'255","last_deep_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.582714+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:12.204164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'492","reported_seq":2077,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.577961+0000","last_change":"2024-09-12T18:33:19.577961+0000","last_active":"2024-09-12T18:33:19.577961+0000","last_peered":"2024-09-12T18:33:19.577961+0000","last_clean":"2024-09-12T18:33:19.577961+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:33:19.577961+0000","last_undegraded":"2024-09-12T18:33:19.577961+0000","last_fullsized":"2024-09-12T18:33:19.577961+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'492","last_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_deep_scrub":"262'492","last_deep_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.577829+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:20.823502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.033844+0000","last_change":"2024-09-12T18:33:11.033801+0000","last_active":"2024-09-12T18:33:11.033844+0000","last_peered":"2024-09-12T18:33:11.033844+0000","last_clean":"2024-09-12T18:33:11.033844+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:33:11.033844+0000","last_undegraded":"2024-09-12T18:33:11.033844+0000","last_fullsized":"2024-09-12T18:33:11.033844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.033735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:58.231249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'331","reported_seq":964,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.619922+0000","last_change":"2024-09-12T18:33:11.619922+0000","last_active":"2024-09-12T18:33:11.619922+0000","last_peered":"2024-09-12T18:33:11.619922+0000","last_clean":"2024-09-12T18:33:11.619922+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:33:11.619922+0000","last_undegraded":"2024-09-12T18:33:11.619922+0000","last_fullsized":"2024-09-12T18:33:11.619922+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.619798+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.863692+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":5597,"num_write":1146,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.139449+0000","last_change":"2024-09-12T18:33:23.139449+0000","last_active":"2024-09-12T18:33:23.139449+0000","last_peered":"2024-09-12T18:33:23.139449+0000","last_clean":"2024-09-12T18:33:23.139449+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:33:23.139449+0000","last_undegraded":"2024-09-12T18:33:23.139449+0000","last_fullsized":"2024-09-12T18:33:23.139449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.139366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:40.988736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'270","reported_seq":1504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.160919+0000","last_change":"2024-09-12T18:33:33.160919+0000","last_active":"2024-09-12T18:33:33.160919+0000","last_peered":"2024-09-12T18:33:33.160919+0000","last_clean":"2024-09-12T18:33:33.160919+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:33:33.160919+0000","last_undegraded":"2024-09-12T18:33:33.160919+0000","last_fullsized":"2024-09-12T18:33:33.160919+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.160821+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:28.353872+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.734478+0000","last_change":"2024-09-12T18:33:35.734478+0000","last_active":"2024-09-12T18:33:35.734478+0000","last_peered":"2024-09-12T18:33:35.734478+0000","last_clean":"2024-09-12T18:33:35.734478+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:33:35.734478+0000","last_undegraded":"2024-09-12T18:33:35.734478+0000","last_fullsized":"2024-09-12T18:33:35.734478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.734345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.078776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'286","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.322388+0000","last_change":"2024-09-12T18:33:49.322388+0000","last_active":"2024-09-12T18:33:49.322388+0000","last_peered":"2024-09-12T18:33:49.322388+0000","last_clean":"2024-09-12T18:33:49.322388+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:33:49.322388+0000","last_undegraded":"2024-09-12T18:33:49.322388+0000","last_fullsized":"2024-09-12T18:33:49.322388+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'286","last_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_deep_scrub":"262'286","last_deep_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.322271+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:03.810804+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.585034+0000","last_change":"2024-09-12T18:33:15.585034+0000","last_active":"2024-09-12T18:33:15.585034+0000","last_peered":"2024-09-12T18:33:15.585034+0000","last_clean":"2024-09-12T18:33:15.585034+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:33:15.585034+0000","last_undegraded":"2024-09-12T18:33:15.585034+0000","last_fullsized":"2024-09-12T18:33:15.585034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.584923+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:08.823358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.668532+0000","last_change":"2024-09-12T18:33:12.668450+0000","last_active":"2024-09-12T18:33:12.668532+0000","last_peered":"2024-09-12T18:33:12.668532+0000","last_clean":"2024-09-12T18:33:12.668532+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:33:12.668532+0000","last_undegraded":"2024-09-12T18:33:12.668532+0000","last_fullsized":"2024-09-12T18:33:12.668532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.668348+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:16.360994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'318","reported_seq":963,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.277484+0000","last_change":"2024-09-12T18:33:11.277484+0000","last_active":"2024-09-12T18:33:11.277484+0000","last_peered":"2024-09-12T18:33:11.277484+0000","last_clean":"2024-09-12T18:33:11.277484+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:11.277484+0000","last_undegraded":"2024-09-12T18:33:11.277484+0000","last_fullsized":"2024-09-12T18:33:11.277484+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'318","last_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_deep_scrub":"262'318","last_deep_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.277353+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.314572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524430,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":24675,"num_write":1010,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.642978+0000","last_change":"2024-09-12T18:33:28.642978+0000","last_active":"2024-09-12T18:33:28.642978+0000","last_peered":"2024-09-12T18:33:28.642978+0000","last_clean":"2024-09-12T18:33:28.642978+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:33:28.642978+0000","last_undegraded":"2024-09-12T18:33:28.642978+0000","last_fullsized":"2024-09-12T18:33:28.642978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.642877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:30.605913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'134","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.359405+0000","last_change":"2024-09-12T18:33:40.359405+0000","last_active":"2024-09-12T18:33:40.359405+0000","last_peered":"2024-09-12T18:33:40.359405+0000","last_clean":"2024-09-12T18:33:40.359405+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:33:40.359405+0000","last_undegraded":"2024-09-12T18:33:40.359405+0000","last_fullsized":"2024-09-12T18:33:40.359405+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.359314+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:16.651907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.713622+0000","last_change":"2024-09-12T18:33:28.713622+0000","last_active":"2024-09-12T18:33:28.713622+0000","last_peered":"2024-09-12T18:33:28.713622+0000","last_clean":"2024-09-12T18:33:28.713622+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:33:28.713622+0000","last_undegraded":"2024-09-12T18:33:28.713622+0000","last_fullsized":"2024-09-12T18:33:28.713622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.713538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:28.237723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'124","reported_seq":682,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.674395+0000","last_change":"2024-09-12T18:33:41.674395+0000","last_active":"2024-09-12T18:33:41.674395+0000","last_peered":"2024-09-12T18:33:41.674395+0000","last_clean":"2024-09-12T18:33:41.674395+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:33:41.674395+0000","last_undegraded":"2024-09-12T18:33:41.674395+0000","last_fullsized":"2024-09-12T18:33:41.674395+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.674307+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:10.525733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'754","reported_seq":2211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.610690+0000","last_change":"2024-09-12T18:33:16.610690+0000","last_active":"2024-09-12T18:33:16.610690+0000","last_peered":"2024-09-12T18:33:16.610690+0000","last_clean":"2024-09-12T18:33:16.610690+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:33:16.610690+0000","last_undegraded":"2024-09-12T18:33:16.610690+0000","last_fullsized":"2024-09-12T18:33:16.610690+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'754","last_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_deep_scrub":"262'754","last_deep_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.610589+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:33.968420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'326","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.624372+0000","last_change":"2024-09-12T18:33:11.624372+0000","last_active":"2024-09-12T18:33:11.624372+0000","last_peered":"2024-09-12T18:33:11.624372+0000","last_clean":"2024-09-12T18:33:11.624372+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:33:11.624372+0000","last_undegraded":"2024-09-12T18:33:11.624372+0000","last_fullsized":"2024-09-12T18:33:11.624372+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'326","last_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_deep_scrub":"262'326","last_deep_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.624231+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:49.428871+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":16635,"num_write":1112,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.624608+0000","last_change":"2024-09-12T18:33:10.624559+0000","last_active":"2024-09-12T18:33:10.624608+0000","last_peered":"2024-09-12T18:33:10.624608+0000","last_clean":"2024-09-12T18:33:10.624608+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:33:10.624608+0000","last_undegraded":"2024-09-12T18:33:10.624608+0000","last_fullsized":"2024-09-12T18:33:10.624608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.624487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:45.146624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.683023+0000","last_change":"2024-09-12T18:33:27.683023+0000","last_active":"2024-09-12T18:33:27.683023+0000","last_peered":"2024-09-12T18:33:27.683023+0000","last_clean":"2024-09-12T18:33:27.683023+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:33:27.683023+0000","last_undegraded":"2024-09-12T18:33:27.683023+0000","last_fullsized":"2024-09-12T18:33:27.683023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.682917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.162425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'575","reported_seq":1254,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.671234+0000","last_change":"2024-09-12T18:33:29.671171+0000","last_active":"2024-09-12T18:33:29.671234+0000","last_peered":"2024-09-12T18:33:29.671234+0000","last_clean":"2024-09-12T18:33:29.671234+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:33:29.671234+0000","last_undegraded":"2024-09-12T18:33:29.671234+0000","last_fullsized":"2024-09-12T18:33:29.671234+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'575","last_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_deep_scrub":"262'575","last_deep_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.671062+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:47.544425+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1576,"num_read_kb":2723,"num_write":2042,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.306515+0000","last_change":"2024-09-12T18:33:41.306515+0000","last_active":"2024-09-12T18:33:41.306515+0000","last_peered":"2024-09-12T18:33:41.306515+0000","last_clean":"2024-09-12T18:33:41.306515+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:33:41.306515+0000","last_undegraded":"2024-09-12T18:33:41.306515+0000","last_fullsized":"2024-09-12T18:33:41.306515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.306424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:48.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'112","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.735660+0000","last_change":"2024-09-12T18:33:44.735660+0000","last_active":"2024-09-12T18:33:44.735660+0000","last_peered":"2024-09-12T18:33:44.735660+0000","last_clean":"2024-09-12T18:33:44.735660+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:33:44.735660+0000","last_undegraded":"2024-09-12T18:33:44.735660+0000","last_fullsized":"2024-09-12T18:33:44.735660+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.735567+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:53.162317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1008","reported_seq":2578,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.613529+0000","last_change":"2024-09-12T18:33:19.613529+0000","last_active":"2024-09-12T18:33:19.613529+0000","last_peered":"2024-09-12T18:33:19.613529+0000","last_clean":"2024-09-12T18:33:19.613529+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:33:19.613529+0000","last_undegraded":"2024-09-12T18:33:19.613529+0000","last_fullsized":"2024-09-12T18:33:19.613529+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1008","last_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_deep_scrub":"262'1008","last_deep_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.613439+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:00.782809+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'378","reported_seq":1064,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.566857+0000","last_change":"2024-09-12T18:33:17.566857+0000","last_active":"2024-09-12T18:33:17.566857+0000","last_peered":"2024-09-12T18:33:17.566857+0000","last_clean":"2024-09-12T18:33:17.566857+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:33:17.566857+0000","last_undegraded":"2024-09-12T18:33:17.566857+0000","last_fullsized":"2024-09-12T18:33:17.566857+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.566746+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:24.317944+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820443,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":48347,"num_write":1175,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.966167+0000","last_change":"2024-09-12T18:33:15.966167+0000","last_active":"2024-09-12T18:33:15.966167+0000","last_peered":"2024-09-12T18:33:15.966167+0000","last_clean":"2024-09-12T18:33:15.966167+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:33:15.966167+0000","last_undegraded":"2024-09-12T18:33:15.966167+0000","last_fullsized":"2024-09-12T18:33:15.966167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.966071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.134360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.689372+0000","last_change":"2024-09-12T18:33:23.689372+0000","last_active":"2024-09-12T18:33:23.689372+0000","last_peered":"2024-09-12T18:33:23.689372+0000","last_clean":"2024-09-12T18:33:23.689372+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:33:23.689372+0000","last_undegraded":"2024-09-12T18:33:23.689372+0000","last_fullsized":"2024-09-12T18:33:23.689372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.689279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:38.802520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'209","reported_seq":786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.622114+0000","last_change":"2024-09-12T18:33:29.622114+0000","last_active":"2024-09-12T18:33:29.622114+0000","last_peered":"2024-09-12T18:33:29.622114+0000","last_clean":"2024-09-12T18:33:29.622114+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:33:29.622114+0000","last_undegraded":"2024-09-12T18:33:29.622114+0000","last_fullsized":"2024-09-12T18:33:29.622114+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.622018+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:47.767617+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'787","reported_seq":2486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.600687+0000","last_change":"2024-09-12T18:33:38.600687+0000","last_active":"2024-09-12T18:33:38.600687+0000","last_peered":"2024-09-12T18:33:38.600687+0000","last_clean":"2024-09-12T18:33:38.600687+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:33:38.600687+0000","last_undegraded":"2024-09-12T18:33:38.600687+0000","last_fullsized":"2024-09-12T18:33:38.600687+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'787","last_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_deep_scrub":"262'787","last_deep_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.600601+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:11.236866+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'109","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.436745+0000","last_change":"2024-09-12T17:35:51.345260+0000","last_active":"2024-09-12T18:32:22.436745+0000","last_peered":"2024-09-12T18:32:22.436745+0000","last_clean":"2024-09-12T18:32:22.436745+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:32:22.436745+0000","last_undegraded":"2024-09-12T18:32:22.436745+0000","last_fullsized":"2024-09-12T18:32:22.436745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'444","reported_seq":1988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.284074+0000","last_change":"2024-09-12T18:33:23.284074+0000","last_active":"2024-09-12T18:33:23.284074+0000","last_peered":"2024-09-12T18:33:23.284074+0000","last_clean":"2024-09-12T18:33:23.284074+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:33:23.284074+0000","last_undegraded":"2024-09-12T18:33:23.284074+0000","last_fullsized":"2024-09-12T18:33:23.284074+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.283986+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.932404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'361","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.141754+0000","last_change":"2024-09-12T18:33:13.141754+0000","last_active":"2024-09-12T18:33:13.141754+0000","last_peered":"2024-09-12T18:33:13.141754+0000","last_clean":"2024-09-12T18:33:13.141754+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:33:13.141754+0000","last_undegraded":"2024-09-12T18:33:13.141754+0000","last_fullsized":"2024-09-12T18:33:13.141754+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.141659+0000","objects_scrubbed":8,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:39.600554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":50118,"num_write":1078,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.639195+0000","last_change":"2024-09-12T18:33:22.639195+0000","last_active":"2024-09-12T18:33:22.639195+0000","last_peered":"2024-09-12T18:33:22.639195+0000","last_clean":"2024-09-12T18:33:22.639195+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:33:22.639195+0000","last_undegraded":"2024-09-12T18:33:22.639195+0000","last_fullsized":"2024-09-12T18:33:22.639195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.639106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:28.364727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.333034+0000","last_change":"2024-09-12T18:33:32.333034+0000","last_active":"2024-09-12T18:33:32.333034+0000","last_peered":"2024-09-12T18:33:32.333034+0000","last_clean":"2024-09-12T18:33:32.333034+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:33:32.333034+0000","last_undegraded":"2024-09-12T18:33:32.333034+0000","last_fullsized":"2024-09-12T18:33:32.333034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.332939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:24.535431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'118","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.295611+0000","last_change":"2024-09-12T18:33:36.295611+0000","last_active":"2024-09-12T18:33:36.295611+0000","last_peered":"2024-09-12T18:33:36.295611+0000","last_clean":"2024-09-12T18:33:36.295611+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:33:36.295611+0000","last_undegraded":"2024-09-12T18:33:36.295611+0000","last_fullsized":"2024-09-12T18:33:36.295611+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.295511+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:50.229082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'819","reported_seq":2754,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.318998+0000","last_change":"2024-09-12T18:33:44.318998+0000","last_active":"2024-09-12T18:33:44.318998+0000","last_peered":"2024-09-12T18:33:44.318998+0000","last_clean":"2024-09-12T18:33:44.318998+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:33:44.318998+0000","last_undegraded":"2024-09-12T18:33:44.318998+0000","last_fullsized":"2024-09-12T18:33:44.318998+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.318903+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:11.329999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'188","reported_seq":701,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.757850+0000","last_change":"2024-09-12T18:33:42.757850+0000","last_active":"2024-09-12T18:33:42.757850+0000","last_peered":"2024-09-12T18:33:42.757850+0000","last_clean":"2024-09-12T18:33:42.757850+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:33:42.757850+0000","last_undegraded":"2024-09-12T18:33:42.757850+0000","last_fullsized":"2024-09-12T18:33:42.757850+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.757762+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:52.059548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'541","reported_seq":2153,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.238244+0000","last_change":"2024-09-12T18:33:16.238244+0000","last_active":"2024-09-12T18:33:16.238244+0000","last_peered":"2024-09-12T18:33:16.238244+0000","last_clean":"2024-09-12T18:33:16.238244+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:33:16.238244+0000","last_undegraded":"2024-09-12T18:33:16.238244+0000","last_fullsized":"2024-09-12T18:33:16.238244+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.238154+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.758872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'301","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.484120+0000","last_change":"2024-09-12T18:33:09.484120+0000","last_active":"2024-09-12T18:33:09.484120+0000","last_peered":"2024-09-12T18:33:09.484120+0000","last_clean":"2024-09-12T18:33:09.484120+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:33:09.484120+0000","last_undegraded":"2024-09-12T18:33:09.484120+0000","last_fullsized":"2024-09-12T18:33:09.484120+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'301","last_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_deep_scrub":"262'301","last_deep_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_clean_scrub_stamp":"2024-09-12T18:33:09.484014+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:09.383970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":18058,"num_write":1049,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.699204+0000","last_change":"2024-09-12T18:33:12.699204+0000","last_active":"2024-09-12T18:33:12.699204+0000","last_peered":"2024-09-12T18:33:12.699204+0000","last_clean":"2024-09-12T18:33:12.699204+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:33:12.699204+0000","last_undegraded":"2024-09-12T18:33:12.699204+0000","last_fullsized":"2024-09-12T18:33:12.699204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.699122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.717334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.430244+0000","last_change":"2024-09-12T18:33:33.430244+0000","last_active":"2024-09-12T18:33:33.430244+0000","last_peered":"2024-09-12T18:33:33.430244+0000","last_clean":"2024-09-12T18:33:33.430244+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:33:33.430244+0000","last_undegraded":"2024-09-12T18:33:33.430244+0000","last_fullsized":"2024-09-12T18:33:33.430244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.430169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.537046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'727","reported_seq":1453,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.151989+0000","last_change":"2024-09-12T18:33:36.151989+0000","last_active":"2024-09-12T18:33:36.151989+0000","last_peered":"2024-09-12T18:33:36.151989+0000","last_clean":"2024-09-12T18:33:36.151989+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:33:36.151989+0000","last_undegraded":"2024-09-12T18:33:36.151989+0000","last_fullsized":"2024-09-12T18:33:36.151989+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'727","last_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_deep_scrub":"262'727","last_deep_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.151761+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.853655+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":3013,"num_write":1042,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.392777+0000","last_change":"2024-09-12T18:33:46.392777+0000","last_active":"2024-09-12T18:33:46.392777+0000","last_peered":"2024-09-12T18:33:46.392777+0000","last_clean":"2024-09-12T18:33:46.392777+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:33:46.392777+0000","last_undegraded":"2024-09-12T18:33:46.392777+0000","last_fullsized":"2024-09-12T18:33:46.392777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.392690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.346518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'132","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.642288+0000","last_change":"2024-09-12T18:33:42.642288+0000","last_active":"2024-09-12T18:33:42.642288+0000","last_peered":"2024-09-12T18:33:42.642288+0000","last_clean":"2024-09-12T18:33:42.642288+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:33:42.642288+0000","last_undegraded":"2024-09-12T18:33:42.642288+0000","last_fullsized":"2024-09-12T18:33:42.642288+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.642175+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:14.865789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'131","reported_seq":711,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.666901+0000","last_change":"2024-09-12T18:33:49.666901+0000","last_active":"2024-09-12T18:33:49.666901+0000","last_peered":"2024-09-12T18:33:49.666901+0000","last_clean":"2024-09-12T18:33:49.666901+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:33:49.666901+0000","last_undegraded":"2024-09-12T18:33:49.666901+0000","last_fullsized":"2024-09-12T18:33:49.666901+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.666810+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:28.057997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'397","reported_seq":1908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.247025+0000","last_change":"2024-09-12T18:33:21.247025+0000","last_active":"2024-09-12T18:33:21.247025+0000","last_peered":"2024-09-12T18:33:21.247025+0000","last_clean":"2024-09-12T18:33:21.247025+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:33:21.247025+0000","last_undegraded":"2024-09-12T18:33:21.247025+0000","last_fullsized":"2024-09-12T18:33:21.247025+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'397","last_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_deep_scrub":"262'397","last_deep_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.246937+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:02.793084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'323","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.235775+0000","last_change":"2024-09-12T18:33:12.235775+0000","last_active":"2024-09-12T18:33:12.235775+0000","last_peered":"2024-09-12T18:33:12.235775+0000","last_clean":"2024-09-12T18:33:12.235775+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:12.235775+0000","last_undegraded":"2024-09-12T18:33:12.235775+0000","last_fullsized":"2024-09-12T18:33:12.235775+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.235626+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:59.915198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":63909,"num_write":1001,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.626695+0000","last_change":"2024-09-12T18:33:23.626695+0000","last_active":"2024-09-12T18:33:23.626695+0000","last_peered":"2024-09-12T18:33:23.626695+0000","last_clean":"2024-09-12T18:33:23.626695+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:33:23.626695+0000","last_undegraded":"2024-09-12T18:33:23.626695+0000","last_fullsized":"2024-09-12T18:33:23.626695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.626609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:00.714762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'267","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.389784+0000","last_change":"2024-09-12T18:33:39.389784+0000","last_active":"2024-09-12T18:33:39.389784+0000","last_peered":"2024-09-12T18:33:39.389784+0000","last_clean":"2024-09-12T18:33:39.389784+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:33:39.389784+0000","last_undegraded":"2024-09-12T18:33:39.389784+0000","last_fullsized":"2024-09-12T18:33:39.389784+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'267","last_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_deep_scrub":"262'267","last_deep_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.389682+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:45.899532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":1008,"num_write":356,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.343989+0000","last_change":"2024-09-12T18:33:45.343989+0000","last_active":"2024-09-12T18:33:45.343989+0000","last_peered":"2024-09-12T18:33:45.343989+0000","last_clean":"2024-09-12T18:33:45.343989+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:33:45.343989+0000","last_undegraded":"2024-09-12T18:33:45.343989+0000","last_fullsized":"2024-09-12T18:33:45.343989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.343882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:12.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'138","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:28.357809+0000","last_change":"2024-09-12T17:35:50.915328+0000","last_active":"2024-09-12T18:31:28.357809+0000","last_peered":"2024-09-12T18:31:28.357809+0000","last_clean":"2024-09-12T18:31:28.357809+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:31:28.357809+0000","last_undegraded":"2024-09-12T18:31:28.357809+0000","last_fullsized":"2024-09-12T18:31:28.357809+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.663316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'977","reported_seq":2465,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.612697+0000","last_change":"2024-09-12T18:33:20.612697+0000","last_active":"2024-09-12T18:33:20.612697+0000","last_peered":"2024-09-12T18:33:20.612697+0000","last_clean":"2024-09-12T18:33:20.612697+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:33:20.612697+0000","last_undegraded":"2024-09-12T18:33:20.612697+0000","last_fullsized":"2024-09-12T18:33:20.612697+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'977","last_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_deep_scrub":"262'977","last_deep_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.612589+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":900,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:51.536947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'391","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.958442+0000","last_change":"2024-09-12T18:33:17.958378+0000","last_active":"2024-09-12T18:33:17.958442+0000","last_peered":"2024-09-12T18:33:17.958442+0000","last_clean":"2024-09-12T18:33:17.958442+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:33:17.958442+0000","last_undegraded":"2024-09-12T18:33:17.958442+0000","last_fullsized":"2024-09-12T18:33:17.958442+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'391","last_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_deep_scrub":"262'391","last_deep_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.958248+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:10.190084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079946,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":8296,"num_write":1132,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"262'4","reported_seq":982,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.361447+0000","last_change":"2024-09-12T18:33:35.361447+0000","last_active":"2024-09-12T18:33:35.361447+0000","last_peered":"2024-09-12T18:33:35.361447+0000","last_clean":"2024-09-12T18:33:35.361447+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:33:35.361447+0000","last_undegraded":"2024-09-12T18:33:35.361447+0000","last_fullsized":"2024-09-12T18:33:35.361447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.361353+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:39.149109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'58","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.690280+0000","last_change":"2024-09-12T18:33:33.690280+0000","last_active":"2024-09-12T18:33:33.690280+0000","last_peered":"2024-09-12T18:33:33.690280+0000","last_clean":"2024-09-12T18:33:33.690280+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:33:33.690280+0000","last_undegraded":"2024-09-12T18:33:33.690280+0000","last_fullsized":"2024-09-12T18:33:33.690280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.690203+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:57.510406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.159733+0000","last_change":"2024-09-12T18:33:38.159733+0000","last_active":"2024-09-12T18:33:38.159733+0000","last_peered":"2024-09-12T18:33:38.159733+0000","last_clean":"2024-09-12T18:33:38.159733+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:33:38.159733+0000","last_undegraded":"2024-09-12T18:33:38.159733+0000","last_fullsized":"2024-09-12T18:33:38.159733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.159640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.092462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.769766+0000","last_change":"2024-09-12T18:33:45.769766+0000","last_active":"2024-09-12T18:33:45.769766+0000","last_peered":"2024-09-12T18:33:45.769766+0000","last_clean":"2024-09-12T18:33:45.769766+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:33:45.769766+0000","last_undegraded":"2024-09-12T18:33:45.769766+0000","last_fullsized":"2024-09-12T18:33:45.769766+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.769648+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.982175+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'556","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.319941+0000","last_change":"2024-09-12T18:33:25.319941+0000","last_active":"2024-09-12T18:33:25.319941+0000","last_peered":"2024-09-12T18:33:25.319941+0000","last_clean":"2024-09-12T18:33:25.319941+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:33:25.319941+0000","last_undegraded":"2024-09-12T18:33:25.319941+0000","last_fullsized":"2024-09-12T18:33:25.319941+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'556","last_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_deep_scrub":"262'556","last_deep_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.319848+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:58.204185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'368","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.702588+0000","last_change":"2024-09-12T18:33:14.702522+0000","last_active":"2024-09-12T18:33:14.702588+0000","last_peered":"2024-09-12T18:33:14.702588+0000","last_clean":"2024-09-12T18:33:14.702588+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:33:14.702588+0000","last_undegraded":"2024-09-12T18:33:14.702588+0000","last_fullsized":"2024-09-12T18:33:14.702588+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'368","last_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_deep_scrub":"262'368","last_deep_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.702321+0000","objects_scrubbed":11,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:33.790945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350736,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":674,"num_read_kb":8078,"num_write":1180,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.113931+0000","last_change":"2024-09-12T18:33:30.113931+0000","last_active":"2024-09-12T18:33:30.113931+0000","last_peered":"2024-09-12T18:33:30.113931+0000","last_clean":"2024-09-12T18:33:30.113931+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:33:30.113931+0000","last_undegraded":"2024-09-12T18:33:30.113931+0000","last_fullsized":"2024-09-12T18:33:30.113931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.113831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:05.941190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'324","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.326761+0000","last_change":"2024-09-12T18:33:41.326761+0000","last_active":"2024-09-12T18:33:41.326761+0000","last_peered":"2024-09-12T18:33:41.326761+0000","last_clean":"2024-09-12T18:33:41.326761+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:33:41.326761+0000","last_undegraded":"2024-09-12T18:33:41.326761+0000","last_fullsized":"2024-09-12T18:33:41.326761+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.326666+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:22.806748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48623,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1190,"num_write":438,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.747999+0000","last_change":"2024-09-12T18:33:31.747999+0000","last_active":"2024-09-12T18:33:31.747999+0000","last_peered":"2024-09-12T18:33:31.747999+0000","last_clean":"2024-09-12T18:33:31.747999+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:33:31.747999+0000","last_undegraded":"2024-09-12T18:33:31.747999+0000","last_fullsized":"2024-09-12T18:33:31.747999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.747908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:11.279329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'99","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.682050+0000","last_change":"2024-09-12T18:33:46.682050+0000","last_active":"2024-09-12T18:33:46.682050+0000","last_peered":"2024-09-12T18:33:46.682050+0000","last_clean":"2024-09-12T18:33:46.682050+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:33:46.682050+0000","last_undegraded":"2024-09-12T18:33:46.682050+0000","last_fullsized":"2024-09-12T18:33:46.682050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'99","last_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_deep_scrub":"262'99","last_deep_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.681959+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:42.683159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1027","reported_seq":2674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.355171+0000","last_change":"2024-09-12T18:33:26.355171+0000","last_active":"2024-09-12T18:33:26.355171+0000","last_peered":"2024-09-12T18:33:26.355171+0000","last_clean":"2024-09-12T18:33:26.355171+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:33:26.355171+0000","last_undegraded":"2024-09-12T18:33:26.355171+0000","last_fullsized":"2024-09-12T18:33:26.355171+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1027","last_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_deep_scrub":"262'1027","last_deep_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.355090+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:15.967085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'378","reported_seq":1007,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.546254+0000","last_change":"2024-09-12T18:33:13.546149+0000","last_active":"2024-09-12T18:33:13.546254+0000","last_peered":"2024-09-12T18:33:13.546254+0000","last_clean":"2024-09-12T18:33:13.546254+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:33:13.546254+0000","last_undegraded":"2024-09-12T18:33:13.546254+0000","last_fullsized":"2024-09-12T18:33:13.546254+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.546033+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:18.615258+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":38183,"num_write":1089,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.720977+0000","last_change":"2024-09-12T18:33:26.720977+0000","last_active":"2024-09-12T18:33:26.720977+0000","last_peered":"2024-09-12T18:33:26.720977+0000","last_clean":"2024-09-12T18:33:26.720977+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:33:26.720977+0000","last_undegraded":"2024-09-12T18:33:26.720977+0000","last_fullsized":"2024-09-12T18:33:26.720977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.720886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:00.916187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'279","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.187275+0000","last_change":"2024-09-12T18:33:34.187275+0000","last_active":"2024-09-12T18:33:34.187275+0000","last_peered":"2024-09-12T18:33:34.187275+0000","last_clean":"2024-09-12T18:33:34.187275+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:33:34.187275+0000","last_undegraded":"2024-09-12T18:33:34.187275+0000","last_fullsized":"2024-09-12T18:33:34.187275+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'279","last_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_deep_scrub":"262'279","last_deep_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.187165+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.540694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54427,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1013,"num_write":368,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.747900+0000","last_change":"2024-09-12T18:33:40.747900+0000","last_active":"2024-09-12T18:33:40.747900+0000","last_peered":"2024-09-12T18:33:40.747900+0000","last_clean":"2024-09-12T18:33:40.747900+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:33:40.747900+0000","last_undegraded":"2024-09-12T18:33:40.747900+0000","last_fullsized":"2024-09-12T18:33:40.747900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.747780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.596415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'862","reported_seq":2492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.706522+0000","last_change":"2024-09-12T18:33:20.706522+0000","last_active":"2024-09-12T18:33:20.706522+0000","last_peered":"2024-09-12T18:33:20.706522+0000","last_clean":"2024-09-12T18:33:20.706522+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:33:20.706522+0000","last_undegraded":"2024-09-12T18:33:20.706522+0000","last_fullsized":"2024-09-12T18:33:20.706522+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.706397+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:46.363194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'357","reported_seq":1093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.251831+0000","last_change":"2024-09-12T18:33:16.251755+0000","last_active":"2024-09-12T18:33:16.251831+0000","last_peered":"2024-09-12T18:33:16.251831+0000","last_clean":"2024-09-12T18:33:16.251831+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:33:16.251831+0000","last_undegraded":"2024-09-12T18:33:16.251831+0000","last_fullsized":"2024-09-12T18:33:16.251831+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.251595+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.014047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080042,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":5768,"num_write":997,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.655171+0000","last_change":"2024-09-12T18:33:30.655090+0000","last_active":"2024-09-12T18:33:30.655171+0000","last_peered":"2024-09-12T18:33:30.655171+0000","last_clean":"2024-09-12T18:33:30.655171+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:33:30.655171+0000","last_undegraded":"2024-09-12T18:33:30.655171+0000","last_fullsized":"2024-09-12T18:33:30.655171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.654984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.034356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'502","reported_seq":1141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.569019+0000","last_change":"2024-09-12T18:33:33.569019+0000","last_active":"2024-09-12T18:33:33.569019+0000","last_peered":"2024-09-12T18:33:33.569019+0000","last_clean":"2024-09-12T18:33:33.569019+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:33:33.569019+0000","last_undegraded":"2024-09-12T18:33:33.569019+0000","last_fullsized":"2024-09-12T18:33:33.569019+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'502","last_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_deep_scrub":"262'502","last_deep_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.568933+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:22.637750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110948,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":875,"num_read_kb":2101,"num_write":752,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.630432+0000","last_change":"2024-09-12T18:33:40.630432+0000","last_active":"2024-09-12T18:33:40.630432+0000","last_peered":"2024-09-12T18:33:40.630432+0000","last_clean":"2024-09-12T18:33:40.630432+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:33:40.630432+0000","last_undegraded":"2024-09-12T18:33:40.630432+0000","last_fullsized":"2024-09-12T18:33:40.630432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.630343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:27.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'166","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.327186+0000","last_change":"2024-09-12T18:33:52.327186+0000","last_active":"2024-09-12T18:33:52.327186+0000","last_peered":"2024-09-12T18:33:52.327186+0000","last_clean":"2024-09-12T18:33:52.327186+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:33:52.327186+0000","last_undegraded":"2024-09-12T18:33:52.327186+0000","last_fullsized":"2024-09-12T18:33:52.327186+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'166","last_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_deep_scrub":"262'166","last_deep_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.327070+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.676098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'776","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.637392+0000","last_change":"2024-09-12T18:33:23.637333+0000","last_active":"2024-09-12T18:33:23.637392+0000","last_peered":"2024-09-12T18:33:23.637392+0000","last_clean":"2024-09-12T18:33:23.637392+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:33:23.637392+0000","last_undegraded":"2024-09-12T18:33:23.637392+0000","last_fullsized":"2024-09-12T18:33:23.637392+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'776","last_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_deep_scrub":"262'776","last_deep_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.637244+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:07.717470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'292","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.609610+0000","last_change":"2024-09-12T18:33:12.609610+0000","last_active":"2024-09-12T18:33:12.609610+0000","last_peered":"2024-09-12T18:33:12.609610+0000","last_clean":"2024-09-12T18:33:12.609610+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:33:12.609610+0000","last_undegraded":"2024-09-12T18:33:12.609610+0000","last_fullsized":"2024-09-12T18:33:12.609610+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.609480+0000","objects_scrubbed":9,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:33.114173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694644,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":28092,"num_write":983,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.710107+0000","last_change":"2024-09-12T18:33:27.710107+0000","last_active":"2024-09-12T18:33:27.710107+0000","last_peered":"2024-09-12T18:33:27.710107+0000","last_clean":"2024-09-12T18:33:27.710107+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:33:27.710107+0000","last_undegraded":"2024-09-12T18:33:27.710107+0000","last_fullsized":"2024-09-12T18:33:27.710107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.710016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:39.343506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'333","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.193064+0000","last_change":"2024-09-12T18:33:35.193064+0000","last_active":"2024-09-12T18:33:35.193064+0000","last_peered":"2024-09-12T18:33:35.193064+0000","last_clean":"2024-09-12T18:33:35.193064+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:33:35.193064+0000","last_undegraded":"2024-09-12T18:33:35.193064+0000","last_fullsized":"2024-09-12T18:33:35.193064+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.192953+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:49.112579+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56643,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1253,"num_write":470,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.568479+0000","last_change":"2024-09-12T18:33:34.568479+0000","last_active":"2024-09-12T18:33:34.568479+0000","last_peered":"2024-09-12T18:33:34.568479+0000","last_clean":"2024-09-12T18:33:34.568479+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:33:34.568479+0000","last_undegraded":"2024-09-12T18:33:34.568479+0000","last_fullsized":"2024-09-12T18:33:34.568479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.568388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:39.847789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'203","reported_seq":1082,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.763133+0000","last_change":"2024-09-12T18:33:36.763133+0000","last_active":"2024-09-12T18:33:36.763133+0000","last_peered":"2024-09-12T18:33:36.763133+0000","last_clean":"2024-09-12T18:33:36.763133+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:33:36.763133+0000","last_undegraded":"2024-09-12T18:33:36.763133+0000","last_fullsized":"2024-09-12T18:33:36.763133+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.763046+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:59.513801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1297","reported_seq":2877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.376494+0000","last_change":"2024-09-12T18:33:29.376494+0000","last_active":"2024-09-12T18:33:29.376494+0000","last_peered":"2024-09-12T18:33:29.376494+0000","last_clean":"2024-09-12T18:33:29.376494+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:33:29.376494+0000","last_undegraded":"2024-09-12T18:33:29.376494+0000","last_fullsized":"2024-09-12T18:33:29.376494+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1297","last_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_deep_scrub":"262'1297","last_deep_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.376406+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":1200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:02.948818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'314","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.214145+0000","last_change":"2024-09-12T18:33:13.214086+0000","last_active":"2024-09-12T18:33:13.214145+0000","last_peered":"2024-09-12T18:33:13.214145+0000","last_clean":"2024-09-12T18:33:13.214145+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:13.214145+0000","last_undegraded":"2024-09-12T18:33:13.214145+0000","last_fullsized":"2024-09-12T18:33:13.214145+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.213966+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:52.702345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":10892,"num_write":984,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.333184+0000","last_change":"2024-09-12T18:33:35.333184+0000","last_active":"2024-09-12T18:33:35.333184+0000","last_peered":"2024-09-12T18:33:35.333184+0000","last_clean":"2024-09-12T18:33:35.333184+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:33:35.333184+0000","last_undegraded":"2024-09-12T18:33:35.333184+0000","last_fullsized":"2024-09-12T18:33:35.333184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.333097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:34.166308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'296","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.323374+0000","last_change":"2024-09-12T18:33:50.323374+0000","last_active":"2024-09-12T18:33:50.323374+0000","last_peered":"2024-09-12T18:33:50.323374+0000","last_clean":"2024-09-12T18:33:50.323374+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:33:50.323374+0000","last_undegraded":"2024-09-12T18:33:50.323374+0000","last_fullsized":"2024-09-12T18:33:50.323374+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'296","last_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_deep_scrub":"262'296","last_deep_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.323277+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:05.895027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48414,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":1088,"num_write":394,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.562025+0000","last_change":"2024-09-12T18:33:35.562025+0000","last_active":"2024-09-12T18:33:35.562025+0000","last_peered":"2024-09-12T18:33:35.562025+0000","last_clean":"2024-09-12T18:33:35.562025+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:33:35.562025+0000","last_undegraded":"2024-09-12T18:33:35.562025+0000","last_fullsized":"2024-09-12T18:33:35.562025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.561926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:05.612440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'137","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.672537+0000","last_change":"2024-09-12T18:33:44.672537+0000","last_active":"2024-09-12T18:33:44.672537+0000","last_peered":"2024-09-12T18:33:44.672537+0000","last_clean":"2024-09-12T18:33:44.672537+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:33:44.672537+0000","last_undegraded":"2024-09-12T18:33:44.672537+0000","last_fullsized":"2024-09-12T18:33:44.672537+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.672419+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:11.144320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'552","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.071677+0000","last_change":"2024-09-12T18:33:17.071677+0000","last_active":"2024-09-12T18:33:17.071677+0000","last_peered":"2024-09-12T18:33:17.071677+0000","last_clean":"2024-09-12T18:33:17.071677+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:33:17.071677+0000","last_undegraded":"2024-09-12T18:33:17.071677+0000","last_fullsized":"2024-09-12T18:33:17.071677+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'552","last_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_deep_scrub":"262'552","last_deep_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.071573+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:16.342863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'359","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.585198+0000","last_change":"2024-09-12T18:33:12.585151+0000","last_active":"2024-09-12T18:33:12.585198+0000","last_peered":"2024-09-12T18:33:12.585198+0000","last_clean":"2024-09-12T18:33:12.585198+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:33:12.585198+0000","last_undegraded":"2024-09-12T18:33:12.585198+0000","last_fullsized":"2024-09-12T18:33:12.585198+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.585060+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:16.468003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":50516,"num_write":1214,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.654924+0000","last_change":"2024-09-12T18:33:27.654924+0000","last_active":"2024-09-12T18:33:27.654924+0000","last_peered":"2024-09-12T18:33:27.654924+0000","last_clean":"2024-09-12T18:33:27.654924+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:33:27.654924+0000","last_undegraded":"2024-09-12T18:33:27.654924+0000","last_fullsized":"2024-09-12T18:33:27.654924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.654837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.335485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'111","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.302961+0000","last_change":"2024-09-12T18:33:40.302961+0000","last_active":"2024-09-12T18:33:40.302961+0000","last_peered":"2024-09-12T18:33:40.302961+0000","last_clean":"2024-09-12T18:33:40.302961+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:33:40.302961+0000","last_undegraded":"2024-09-12T18:33:40.302961+0000","last_fullsized":"2024-09-12T18:33:40.302961+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.302865+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:11.629757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18924,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'779","reported_seq":4149,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.779080+0000","last_change":"2024-09-12T18:33:32.779080+0000","last_active":"2024-09-12T18:33:32.779080+0000","last_peered":"2024-09-12T18:33:32.779080+0000","last_clean":"2024-09-12T18:33:32.779080+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:33:32.779080+0000","last_undegraded":"2024-09-12T18:33:32.779080+0000","last_fullsized":"2024-09-12T18:33:32.779080+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'779","last_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_deep_scrub":"262'779","last_deep_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.778980+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:29.517178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.076207+0000","last_change":"2024-09-12T18:33:42.076207+0000","last_active":"2024-09-12T18:33:42.076207+0000","last_peered":"2024-09-12T18:33:42.076207+0000","last_clean":"2024-09-12T18:33:42.076207+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:33:42.076207+0000","last_undegraded":"2024-09-12T18:33:42.076207+0000","last_fullsized":"2024-09-12T18:33:42.076207+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.076124+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:59.699672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'766","reported_seq":2352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.332245+0000","last_change":"2024-09-12T18:33:24.332245+0000","last_active":"2024-09-12T18:33:24.332245+0000","last_peered":"2024-09-12T18:33:24.332245+0000","last_clean":"2024-09-12T18:33:24.332245+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:33:24.332245+0000","last_undegraded":"2024-09-12T18:33:24.332245+0000","last_fullsized":"2024-09-12T18:33:24.332245+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'766","last_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_deep_scrub":"262'766","last_deep_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.332108+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:12.983708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'337","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.052970+0000","last_change":"2024-09-12T18:33:13.052912+0000","last_active":"2024-09-12T18:33:13.052970+0000","last_peered":"2024-09-12T18:33:13.052970+0000","last_clean":"2024-09-12T18:33:13.052970+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:33:13.052970+0000","last_undegraded":"2024-09-12T18:33:13.052970+0000","last_fullsized":"2024-09-12T18:33:13.052970+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'337","last_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_deep_scrub":"262'337","last_deep_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.052825+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:55.171930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":50614,"num_write":1066,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.118009+0000","last_change":"2024-09-12T18:33:31.118009+0000","last_active":"2024-09-12T18:33:31.118009+0000","last_peered":"2024-09-12T18:33:31.118009+0000","last_clean":"2024-09-12T18:33:31.118009+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:33:31.118009+0000","last_undegraded":"2024-09-12T18:33:31.118009+0000","last_fullsized":"2024-09-12T18:33:31.118009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.117914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:57.868096+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'316","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.605929+0000","last_change":"2024-09-12T18:33:39.605871+0000","last_active":"2024-09-12T18:33:39.605929+0000","last_peered":"2024-09-12T18:33:39.605929+0000","last_clean":"2024-09-12T18:33:39.605929+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:33:39.605929+0000","last_undegraded":"2024-09-12T18:33:39.605929+0000","last_fullsized":"2024-09-12T18:33:39.605929+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'316","last_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_deep_scrub":"262'316","last_deep_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.605754+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.157337+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44344,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":1104,"num_write":414,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.720938+0000","last_change":"2024-09-12T18:33:39.720865+0000","last_active":"2024-09-12T18:33:39.720938+0000","last_peered":"2024-09-12T18:33:39.720938+0000","last_clean":"2024-09-12T18:33:39.720938+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:33:39.720938+0000","last_undegraded":"2024-09-12T18:33:39.720938+0000","last_fullsized":"2024-09-12T18:33:39.720938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.720781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:42.326695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'124","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.111229+0000","last_change":"2024-09-12T18:33:44.111164+0000","last_active":"2024-09-12T18:33:44.111229+0000","last_peered":"2024-09-12T18:33:44.111229+0000","last_clean":"2024-09-12T18:33:44.111229+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:33:44.111229+0000","last_undegraded":"2024-09-12T18:33:44.111229+0000","last_fullsized":"2024-09-12T18:33:44.111229+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.111077+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:13.157135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'399","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.327113+0000","last_change":"2024-09-12T18:33:23.327113+0000","last_active":"2024-09-12T18:33:23.327113+0000","last_peered":"2024-09-12T18:33:23.327113+0000","last_clean":"2024-09-12T18:33:23.327113+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:33:23.327113+0000","last_undegraded":"2024-09-12T18:33:23.327113+0000","last_fullsized":"2024-09-12T18:33:23.327113+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.326995+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:31.607912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3241,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'346","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.675047+0000","last_change":"2024-09-12T18:33:17.675047+0000","last_active":"2024-09-12T18:33:17.675047+0000","last_peered":"2024-09-12T18:33:17.675047+0000","last_clean":"2024-09-12T18:33:17.675047+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:33:17.675047+0000","last_undegraded":"2024-09-12T18:33:17.675047+0000","last_fullsized":"2024-09-12T18:33:17.675047+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.674867+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:20.180450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5819619,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":36012,"num_write":1062,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.607212+0000","last_change":"2024-09-12T18:33:34.607212+0000","last_active":"2024-09-12T18:33:34.607212+0000","last_peered":"2024-09-12T18:33:34.607212+0000","last_clean":"2024-09-12T18:33:34.607212+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:33:34.607212+0000","last_undegraded":"2024-09-12T18:33:34.607212+0000","last_fullsized":"2024-09-12T18:33:34.607212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.607121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:13.500998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'291","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.740254+0000","last_change":"2024-09-12T18:33:34.740198+0000","last_active":"2024-09-12T18:33:34.740254+0000","last_peered":"2024-09-12T18:33:34.740254+0000","last_clean":"2024-09-12T18:33:34.740254+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:33:34.740254+0000","last_undegraded":"2024-09-12T18:33:34.740254+0000","last_fullsized":"2024-09-12T18:33:34.740254+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.740115+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:01.234210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53785,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1068,"num_write":382,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.775581+0000","last_change":"2024-09-12T18:33:34.775581+0000","last_active":"2024-09-12T18:33:34.775581+0000","last_peered":"2024-09-12T18:33:34.775581+0000","last_clean":"2024-09-12T18:33:34.775581+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:33:34.775581+0000","last_undegraded":"2024-09-12T18:33:34.775581+0000","last_fullsized":"2024-09-12T18:33:34.775581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.775485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:45.097880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'194","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:31:29.122371+0000","last_change":"2024-09-12T17:35:51.347809+0000","last_active":"2024-09-12T18:31:29.122371+0000","last_peered":"2024-09-12T18:31:29.122371+0000","last_clean":"2024-09-12T18:31:29.122371+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:31:29.122371+0000","last_undegraded":"2024-09-12T18:31:29.122371+0000","last_fullsized":"2024-09-12T18:31:29.122371+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:35:49.887701+0000","last_clean_scrub_stamp":"2024-09-12T17:35:49.887701+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'541","reported_seq":2100,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.367911+0000","last_change":"2024-09-12T18:33:28.367911+0000","last_active":"2024-09-12T18:33:28.367911+0000","last_peered":"2024-09-12T18:33:28.367911+0000","last_clean":"2024-09-12T18:33:28.367911+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:33:28.367911+0000","last_undegraded":"2024-09-12T18:33:28.367911+0000","last_fullsized":"2024-09-12T18:33:28.367911+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.367828+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:11.552948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'389","reported_seq":1064,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.172964+0000","last_change":"2024-09-12T18:33:19.172964+0000","last_active":"2024-09-12T18:33:19.172964+0000","last_peered":"2024-09-12T18:33:19.172964+0000","last_clean":"2024-09-12T18:33:19.172964+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:33:19.172964+0000","last_undegraded":"2024-09-12T18:33:19.172964+0000","last_fullsized":"2024-09-12T18:33:19.172964+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.172834+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:19.523494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":33965,"num_write":1123,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.352053+0000","last_change":"2024-09-12T18:33:34.351970+0000","last_active":"2024-09-12T18:33:34.352053+0000","last_peered":"2024-09-12T18:33:34.352053+0000","last_clean":"2024-09-12T18:33:34.352053+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:33:34.352053+0000","last_undegraded":"2024-09-12T18:33:34.352053+0000","last_fullsized":"2024-09-12T18:33:34.352053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.351852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:35.670667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'272","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.291517+0000","last_change":"2024-09-12T18:33:42.291517+0000","last_active":"2024-09-12T18:33:42.291517+0000","last_peered":"2024-09-12T18:33:42.291517+0000","last_clean":"2024-09-12T18:33:42.291517+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:33:42.291517+0000","last_undegraded":"2024-09-12T18:33:42.291517+0000","last_fullsized":"2024-09-12T18:33:42.291517+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'272","last_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_deep_scrub":"262'272","last_deep_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.291430+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:36.563443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":1159,"num_write":392,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.332413+0000","last_change":"2024-09-12T18:33:43.332413+0000","last_active":"2024-09-12T18:33:43.332413+0000","last_peered":"2024-09-12T18:33:43.332413+0000","last_clean":"2024-09-12T18:33:43.332413+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:33:43.332413+0000","last_undegraded":"2024-09-12T18:33:43.332413+0000","last_fullsized":"2024-09-12T18:33:43.332413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.332323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.398841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'147","reported_seq":1258,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.089519+0000","last_change":"2024-09-12T18:33:43.089460+0000","last_active":"2024-09-12T18:33:43.089519+0000","last_peered":"2024-09-12T18:33:43.089519+0000","last_clean":"2024-09-12T18:33:43.089519+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:33:43.089519+0000","last_undegraded":"2024-09-12T18:33:43.089519+0000","last_fullsized":"2024-09-12T18:33:43.089519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.089371+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:04.809899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'496","reported_seq":2060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.275373+0000","last_change":"2024-09-12T18:33:22.275302+0000","last_active":"2024-09-12T18:33:22.275373+0000","last_peered":"2024-09-12T18:33:22.275373+0000","last_clean":"2024-09-12T18:33:22.275373+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:33:22.275373+0000","last_undegraded":"2024-09-12T18:33:22.275373+0000","last_fullsized":"2024-09-12T18:33:22.275373+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.275213+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:50.196779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'370","reported_seq":1037,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.586776+0000","last_change":"2024-09-12T18:33:14.586776+0000","last_active":"2024-09-12T18:33:14.586776+0000","last_peered":"2024-09-12T18:33:14.586776+0000","last_clean":"2024-09-12T18:33:14.586776+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:33:14.586776+0000","last_undegraded":"2024-09-12T18:33:14.586776+0000","last_fullsized":"2024-09-12T18:33:14.586776+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.586592+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:48.010872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":31832,"num_write":1234,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.624383+0000","last_change":"2024-09-12T18:33:28.624383+0000","last_active":"2024-09-12T18:33:28.624383+0000","last_peered":"2024-09-12T18:33:28.624383+0000","last_clean":"2024-09-12T18:33:28.624383+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:33:28.624383+0000","last_undegraded":"2024-09-12T18:33:28.624383+0000","last_fullsized":"2024-09-12T18:33:28.624383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.624288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:54.829284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'310","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.269145+0000","last_change":"2024-09-12T18:33:39.269145+0000","last_active":"2024-09-12T18:33:39.269145+0000","last_peered":"2024-09-12T18:33:39.269145+0000","last_clean":"2024-09-12T18:33:39.269145+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:33:39.269145+0000","last_undegraded":"2024-09-12T18:33:39.269145+0000","last_fullsized":"2024-09-12T18:33:39.269145+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'310","last_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_deep_scrub":"262'310","last_deep_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.269054+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:43.874202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58480,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":1106,"num_write":388,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.760760+0000","last_change":"2024-09-12T18:33:41.760760+0000","last_active":"2024-09-12T18:33:41.760760+0000","last_peered":"2024-09-12T18:33:41.760760+0000","last_clean":"2024-09-12T18:33:41.760760+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:33:41.760760+0000","last_undegraded":"2024-09-12T18:33:41.760760+0000","last_fullsized":"2024-09-12T18:33:41.760760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.760663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:29.356520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'131","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.397186+0000","last_change":"2024-09-12T18:33:45.397186+0000","last_active":"2024-09-12T18:33:45.397186+0000","last_peered":"2024-09-12T18:33:45.397186+0000","last_clean":"2024-09-12T18:33:45.397186+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:33:45.397186+0000","last_undegraded":"2024-09-12T18:33:45.397186+0000","last_fullsized":"2024-09-12T18:33:45.397186+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.397098+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:38.251960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'471","reported_seq":2186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.650462+0000","last_change":"2024-09-12T18:33:26.650462+0000","last_active":"2024-09-12T18:33:26.650462+0000","last_peered":"2024-09-12T18:33:26.650462+0000","last_clean":"2024-09-12T18:33:26.650462+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:33:26.650462+0000","last_undegraded":"2024-09-12T18:33:26.650462+0000","last_fullsized":"2024-09-12T18:33:26.650462+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'471","last_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_deep_scrub":"262'471","last_deep_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.650376+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.061452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'394","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.702575+0000","last_change":"2024-09-12T18:33:19.702575+0000","last_active":"2024-09-12T18:33:19.702575+0000","last_peered":"2024-09-12T18:33:19.702575+0000","last_clean":"2024-09-12T18:33:19.702575+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:33:19.702575+0000","last_undegraded":"2024-09-12T18:33:19.702575+0000","last_fullsized":"2024-09-12T18:33:19.702575+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.702403+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:43.504939+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":20627,"num_write":1276,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'530","reported_seq":2077,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.602618+0000","last_change":"2024-09-12T18:33:32.602618+0000","last_active":"2024-09-12T18:33:32.602618+0000","last_peered":"2024-09-12T18:33:32.602618+0000","last_clean":"2024-09-12T18:33:32.602618+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:33:32.602618+0000","last_undegraded":"2024-09-12T18:33:32.602618+0000","last_fullsized":"2024-09-12T18:33:32.602618+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'530","last_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_deep_scrub":"262'530","last_deep_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.602521+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:10.838673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'405","reported_seq":1096,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.030355+0000","last_change":"2024-09-12T18:33:15.030355+0000","last_active":"2024-09-12T18:33:15.030355+0000","last_peered":"2024-09-12T18:33:15.030355+0000","last_clean":"2024-09-12T18:33:15.030355+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:33:15.030355+0000","last_undegraded":"2024-09-12T18:33:15.030355+0000","last_fullsized":"2024-09-12T18:33:15.030355+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.030175+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:29.411062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":58921,"num_write":1278,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'936","reported_seq":2530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.628715+0000","last_change":"2024-09-12T18:33:25.628715+0000","last_active":"2024-09-12T18:33:25.628715+0000","last_peered":"2024-09-12T18:33:25.628715+0000","last_clean":"2024-09-12T18:33:25.628715+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:33:25.628715+0000","last_undegraded":"2024-09-12T18:33:25.628715+0000","last_fullsized":"2024-09-12T18:33:25.628715+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'936","last_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_deep_scrub":"262'936","last_deep_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.628616+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:44.784169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'375","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.707536+0000","last_change":"2024-09-12T18:33:20.707536+0000","last_active":"2024-09-12T18:33:20.707536+0000","last_peered":"2024-09-12T18:33:20.707536+0000","last_clean":"2024-09-12T18:33:20.707536+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:33:20.707536+0000","last_undegraded":"2024-09-12T18:33:20.707536+0000","last_fullsized":"2024-09-12T18:33:20.707536+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.707383+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.729608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1189379,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":34034,"num_write":1140,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'762","reported_seq":2339,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.612612+0000","last_change":"2024-09-12T18:33:21.612612+0000","last_active":"2024-09-12T18:33:21.612612+0000","last_peered":"2024-09-12T18:33:21.612612+0000","last_clean":"2024-09-12T18:33:21.612612+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:33:21.612612+0000","last_undegraded":"2024-09-12T18:33:21.612612+0000","last_fullsized":"2024-09-12T18:33:21.612612+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'762","last_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_deep_scrub":"262'762","last_deep_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.612531+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.677937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'384","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.645224+0000","last_change":"2024-09-12T18:33:17.645224+0000","last_active":"2024-09-12T18:33:17.645224+0000","last_peered":"2024-09-12T18:33:17.645224+0000","last_clean":"2024-09-12T18:33:17.645224+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:33:17.645224+0000","last_undegraded":"2024-09-12T18:33:17.645224+0000","last_fullsized":"2024-09-12T18:33:17.645224+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.645107+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.274616+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":12325,"num_write":1129,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1938,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.401142+0000","last_change":"2024-09-12T18:33:32.401142+0000","last_active":"2024-09-12T18:33:32.401142+0000","last_peered":"2024-09-12T18:33:32.401142+0000","last_clean":"2024-09-12T18:33:32.401142+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:33:32.401142+0000","last_undegraded":"2024-09-12T18:33:32.401142+0000","last_fullsized":"2024-09-12T18:33:32.401142+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'439","last_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_deep_scrub":"262'439","last_deep_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.401058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.885116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'389","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.203831+0000","last_change":"2024-09-12T18:33:20.203831+0000","last_active":"2024-09-12T18:33:20.203831+0000","last_peered":"2024-09-12T18:33:20.203831+0000","last_clean":"2024-09-12T18:33:20.203831+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:33:20.203831+0000","last_undegraded":"2024-09-12T18:33:20.203831+0000","last_fullsized":"2024-09-12T18:33:20.203831+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.203681+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.448871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190223,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":50386,"num_write":1084,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'483","reported_seq":2233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.286445+0000","last_change":"2024-09-12T18:33:25.286445+0000","last_active":"2024-09-12T18:33:25.286445+0000","last_peered":"2024-09-12T18:33:25.286445+0000","last_clean":"2024-09-12T18:33:25.286445+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:33:25.286445+0000","last_undegraded":"2024-09-12T18:33:25.286445+0000","last_fullsized":"2024-09-12T18:33:25.286445+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.286332+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.078569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3572,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'331","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.626160+0000","last_change":"2024-09-12T18:33:14.626160+0000","last_active":"2024-09-12T18:33:14.626160+0000","last_peered":"2024-09-12T18:33:14.626160+0000","last_clean":"2024-09-12T18:33:14.626160+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:33:14.626160+0000","last_undegraded":"2024-09-12T18:33:14.626160+0000","last_fullsized":"2024-09-12T18:33:14.626160+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.625987+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:07.872404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":699027,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":70299,"num_write":1012,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'482","reported_seq":2105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.357008+0000","last_change":"2024-09-12T18:33:30.357008+0000","last_active":"2024-09-12T18:33:30.357008+0000","last_peered":"2024-09-12T18:33:30.357008+0000","last_clean":"2024-09-12T18:33:30.357008+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:33:30.357008+0000","last_undegraded":"2024-09-12T18:33:30.357008+0000","last_fullsized":"2024-09-12T18:33:30.357008+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'482","last_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_deep_scrub":"262'482","last_deep_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.356905+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:21.805515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":975,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'341","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.696096+0000","last_change":"2024-09-12T18:33:15.696096+0000","last_active":"2024-09-12T18:33:15.696096+0000","last_peered":"2024-09-12T18:33:15.696096+0000","last_clean":"2024-09-12T18:33:15.696096+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:33:15.696096+0000","last_undegraded":"2024-09-12T18:33:15.696096+0000","last_fullsized":"2024-09-12T18:33:15.696096+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.695906+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.837354+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1407190,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":51065,"num_write":1119,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'542","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.691024+0000","last_change":"2024-09-12T18:33:24.691024+0000","last_active":"2024-09-12T18:33:24.691024+0000","last_peered":"2024-09-12T18:33:24.691024+0000","last_clean":"2024-09-12T18:33:24.691024+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:33:24.691024+0000","last_undegraded":"2024-09-12T18:33:24.691024+0000","last_fullsized":"2024-09-12T18:33:24.691024+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.690944+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:08.527284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'284","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.232418+0000","last_change":"2024-09-12T18:33:17.232418+0000","last_active":"2024-09-12T18:33:17.232418+0000","last_peered":"2024-09-12T18:33:17.232418+0000","last_clean":"2024-09-12T18:33:17.232418+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:33:17.232418+0000","last_undegraded":"2024-09-12T18:33:17.232418+0000","last_fullsized":"2024-09-12T18:33:17.232418+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.232228+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:12.380580+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511862,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":37901,"num_write":823,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'587","reported_seq":2418,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.620643+0000","last_change":"2024-09-12T18:33:22.620643+0000","last_active":"2024-09-12T18:33:22.620643+0000","last_peered":"2024-09-12T18:33:22.620643+0000","last_clean":"2024-09-12T18:33:22.620643+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:33:22.620643+0000","last_undegraded":"2024-09-12T18:33:22.620643+0000","last_fullsized":"2024-09-12T18:33:22.620643+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'587","last_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_deep_scrub":"262'587","last_deep_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.620530+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:42.505857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6001,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'376","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.635997+0000","last_change":"2024-09-12T18:33:16.635997+0000","last_active":"2024-09-12T18:33:16.635997+0000","last_peered":"2024-09-12T18:33:16.635997+0000","last_clean":"2024-09-12T18:33:16.635997+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:33:16.635997+0000","last_undegraded":"2024-09-12T18:33:16.635997+0000","last_fullsized":"2024-09-12T18:33:16.635997+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.635865+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:02.528484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":34152,"num_write":1143,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1181","reported_seq":2818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.253053+0000","last_change":"2024-09-12T18:33:27.253053+0000","last_active":"2024-09-12T18:33:27.253053+0000","last_peered":"2024-09-12T18:33:27.253053+0000","last_clean":"2024-09-12T18:33:27.253053+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:33:27.253053+0000","last_undegraded":"2024-09-12T18:33:27.253053+0000","last_fullsized":"2024-09-12T18:33:27.253053+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1181","last_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_deep_scrub":"262'1181","last_deep_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.252969+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":1100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:53.177342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'384","reported_seq":1094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.196517+0000","last_change":"2024-09-12T18:33:18.196517+0000","last_active":"2024-09-12T18:33:18.196517+0000","last_peered":"2024-09-12T18:33:18.196517+0000","last_clean":"2024-09-12T18:33:18.196517+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:33:18.196517+0000","last_undegraded":"2024-09-12T18:33:18.196517+0000","last_fullsized":"2024-09-12T18:33:18.196517+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.196285+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:32.438997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":17939,"num_write":1185,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'781","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.057074+0000","last_change":"2024-09-12T18:33:18.057074+0000","last_active":"2024-09-12T18:33:18.057074+0000","last_peered":"2024-09-12T18:33:18.057074+0000","last_clean":"2024-09-12T18:33:18.057074+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:33:18.057074+0000","last_undegraded":"2024-09-12T18:33:18.057074+0000","last_fullsized":"2024-09-12T18:33:18.057074+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'781","last_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_deep_scrub":"262'781","last_deep_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.056988+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:37.444745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'498","reported_seq":1219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.074483+0000","last_change":"2024-09-12T18:33:16.074483+0000","last_active":"2024-09-12T18:33:16.074483+0000","last_peered":"2024-09-12T18:33:16.074483+0000","last_clean":"2024-09-12T18:33:16.074483+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:33:16.074483+0000","last_undegraded":"2024-09-12T18:33:16.074483+0000","last_fullsized":"2024-09-12T18:33:16.074483+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'498","last_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_deep_scrub":"262'498","last_deep_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.074328+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:08.965353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355583,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":996,"num_read_kb":22424,"num_write":1615,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'511","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.297878+0000","last_change":"2024-09-12T18:33:26.297878+0000","last_active":"2024-09-12T18:33:26.297878+0000","last_peered":"2024-09-12T18:33:26.297878+0000","last_clean":"2024-09-12T18:33:26.297878+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:33:26.297878+0000","last_undegraded":"2024-09-12T18:33:26.297878+0000","last_fullsized":"2024-09-12T18:33:26.297878+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'511","last_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_deep_scrub":"262'511","last_deep_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.297768+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:12.130346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'323","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.616656+0000","last_change":"2024-09-12T18:33:16.616656+0000","last_active":"2024-09-12T18:33:16.616656+0000","last_peered":"2024-09-12T18:33:16.616656+0000","last_clean":"2024-09-12T18:33:16.616656+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:33:16.616656+0000","last_undegraded":"2024-09-12T18:33:16.616656+0000","last_fullsized":"2024-09-12T18:33:16.616656+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.616520+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.598136+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270110,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":8170,"num_write":997,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'785","reported_seq":2232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.000801+0000","last_change":"2024-09-12T18:33:25.000801+0000","last_active":"2024-09-12T18:33:25.000801+0000","last_peered":"2024-09-12T18:33:25.000801+0000","last_clean":"2024-09-12T18:33:25.000801+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:33:25.000801+0000","last_undegraded":"2024-09-12T18:33:25.000801+0000","last_fullsized":"2024-09-12T18:33:25.000801+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'785","last_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_deep_scrub":"262'785","last_deep_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.000690+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.295948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'333","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.699288+0000","last_change":"2024-09-12T18:33:16.699288+0000","last_active":"2024-09-12T18:33:16.699288+0000","last_peered":"2024-09-12T18:33:16.699288+0000","last_clean":"2024-09-12T18:33:16.699288+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:33:16.699288+0000","last_undegraded":"2024-09-12T18:33:16.699288+0000","last_fullsized":"2024-09-12T18:33:16.699288+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.699173+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:06.503747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652723,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":483,"num_read_kb":27896,"num_write":1098,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'571","reported_seq":2188,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.654838+0000","last_change":"2024-09-12T18:33:20.654838+0000","last_active":"2024-09-12T18:33:20.654838+0000","last_peered":"2024-09-12T18:33:20.654838+0000","last_clean":"2024-09-12T18:33:20.654838+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:33:20.654838+0000","last_undegraded":"2024-09-12T18:33:20.654838+0000","last_fullsized":"2024-09-12T18:33:20.654838+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'571","last_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_deep_scrub":"262'571","last_deep_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.654735+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:00.197882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'290","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.991759+0000","last_change":"2024-09-12T18:33:18.991759+0000","last_active":"2024-09-12T18:33:18.991759+0000","last_peered":"2024-09-12T18:33:18.991759+0000","last_clean":"2024-09-12T18:33:18.991759+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:33:18.991759+0000","last_undegraded":"2024-09-12T18:33:18.991759+0000","last_fullsized":"2024-09-12T18:33:18.991759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'290","last_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_deep_scrub":"262'290","last_deep_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.991570+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.511173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":4469,"num_write":888,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'521","reported_seq":2064,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.398228+0000","last_change":"2024-09-12T18:33:34.398228+0000","last_active":"2024-09-12T18:33:34.398228+0000","last_peered":"2024-09-12T18:33:34.398228+0000","last_clean":"2024-09-12T18:33:34.398228+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:33:34.398228+0000","last_undegraded":"2024-09-12T18:33:34.398228+0000","last_fullsized":"2024-09-12T18:33:34.398228+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'521","last_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_deep_scrub":"262'521","last_deep_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.398139+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:39.160645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'317","reported_seq":944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.101698+0000","last_change":"2024-09-12T18:33:22.101698+0000","last_active":"2024-09-12T18:33:22.101698+0000","last_peered":"2024-09-12T18:33:22.101698+0000","last_clean":"2024-09-12T18:33:22.101698+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:33:22.101698+0000","last_undegraded":"2024-09-12T18:33:22.101698+0000","last_fullsized":"2024-09-12T18:33:22.101698+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'317","last_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_deep_scrub":"262'317","last_deep_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.101570+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:04.807102+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":27660,"num_write":1072,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'392","reported_seq":1875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.957476+0000","last_change":"2024-09-12T18:33:23.957476+0000","last_active":"2024-09-12T18:33:23.957476+0000","last_peered":"2024-09-12T18:33:23.957476+0000","last_clean":"2024-09-12T18:33:23.957476+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:33:23.957476+0000","last_undegraded":"2024-09-12T18:33:23.957476+0000","last_fullsized":"2024-09-12T18:33:23.957476+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.957391+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:40.123662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'345","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.705741+0000","last_change":"2024-09-12T18:33:21.705741+0000","last_active":"2024-09-12T18:33:21.705741+0000","last_peered":"2024-09-12T18:33:21.705741+0000","last_clean":"2024-09-12T18:33:21.705741+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:33:21.705741+0000","last_undegraded":"2024-09-12T18:33:21.705741+0000","last_fullsized":"2024-09-12T18:33:21.705741+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.705579+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.131383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":34548,"num_write":1063,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'376","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.680955+0000","last_change":"2024-09-12T18:33:18.680955+0000","last_active":"2024-09-12T18:33:18.680955+0000","last_peered":"2024-09-12T18:33:18.680955+0000","last_clean":"2024-09-12T18:33:18.680955+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:33:18.680955+0000","last_undegraded":"2024-09-12T18:33:18.680955+0000","last_fullsized":"2024-09-12T18:33:18.680955+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.680862+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:43.127892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052945,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":6964,"num_write":1129,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1473","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.668688+0000","last_change":"2024-09-12T18:33:26.668632+0000","last_active":"2024-09-12T18:33:26.668688+0000","last_peered":"2024-09-12T18:33:26.668688+0000","last_clean":"2024-09-12T18:33:26.668688+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:33:26.668688+0000","last_undegraded":"2024-09-12T18:33:26.668688+0000","last_fullsized":"2024-09-12T18:33:26.668688+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1473","last_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_deep_scrub":"262'1473","last_deep_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.668544+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:30.893522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'298","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.589172+0000","last_change":"2024-09-12T18:33:13.589172+0000","last_active":"2024-09-12T18:33:13.589172+0000","last_peered":"2024-09-12T18:33:13.589172+0000","last_clean":"2024-09-12T18:33:13.589172+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:33:13.589172+0000","last_undegraded":"2024-09-12T18:33:13.589172+0000","last_fullsized":"2024-09-12T18:33:13.589172+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.589042+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.715072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":8217,"num_write":971,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1017","reported_seq":2993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.623685+0000","last_change":"2024-09-12T18:33:27.623624+0000","last_active":"2024-09-12T18:33:27.623685+0000","last_peered":"2024-09-12T18:33:27.623685+0000","last_clean":"2024-09-12T18:33:27.623685+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:33:27.623685+0000","last_undegraded":"2024-09-12T18:33:27.623685+0000","last_fullsized":"2024-09-12T18:33:27.623685+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1017","last_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_deep_scrub":"262'1017","last_deep_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.623520+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.482416+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5285,"num_omap_keys":21,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1929,"ondisk_log_size":1929,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1571818,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17916,"num_read_kb":37265,"num_write":15035,"num_write_kb":11780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":681712,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43805,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3986,"ondisk_log_size":3986,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":68589489,"num_objects":377,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":36438,"num_read_kb":2030723,"num_write":72188,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93863936,"data_stored":93863936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":184607,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":188613,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575554,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144872,"kb_used_data":15128,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226968,"statfs":{"total":96636764160,"available":96488415232,"internally_reserved":0,"allocated":15491072,"data_stored":13570247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575554,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333508,"kb_used_data":13556,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038332,"statfs":{"total":96636764160,"available":96295251968,"internally_reserved":0,"allocated":13881344,"data_stored":11918715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575553,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":18096,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":18530304,"data_stored":16608104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575555,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172368,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94199472,"statfs":{"total":96636764160,"available":96460259328,"internally_reserved":0,"allocated":19529728,"data_stored":17538028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575553,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":13664,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":13991936,"data_stored":12011933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575555,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123832,"kb_used_data":12136,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94248008,"statfs":{"total":96636764160,"available":96509960192,"internally_reserved":0,"allocated":12427264,"data_stored":10520336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575553,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191932,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94179908,"statfs":{"total":96636764160,"available":96440225792,"internally_reserved":0,"allocated":16822272,"data_stored":14877078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575556,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295952,"kb_used_data":17664,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94075888,"statfs":{"total":96636764160,"available":96333709312,"internally_reserved":0,"allocated":18087936,"data_stored":16087657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13234176,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12615680,"data_stored":12615680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":8261632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11309056,"data_stored":11309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15278080,"data_stored":15278080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14348288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9068544,"data_stored":9068544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:33:53.716 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.717 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.718 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.719 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.720 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.721 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.722 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:50:13.814350+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.723 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:53:11.120010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.724 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:53:14.140235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.726 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.726 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.727 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:35:49.887701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:33:53.728 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:34:13.729 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:34:14.065 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:34:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:34:14.079 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":2020,"stamp":"2024-09-12T18:34:13.591828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70768882,"num_objects":845,"num_object_clones":0,"num_object_copies":2444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":845,"num_whiteouts":0,"num_read":292045,"num_read_kb":2658521,"num_write":161680,"num_write_kb":2423567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734130,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13587,"ondisk_log_size":13587,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1870256,"kb_used_data":125744,"kb_used_omap":12,"kb_used_meta":1744371,"kb_avail":753104464,"statfs":{"total":773094113280,"available":771178971136,"internally_reserved":0,"allocated":128761856,"data_stored":113132098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1786236464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005206"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.603005+0000","last_change":"2024-09-12T18:33:57.603005+0000","last_active":"2024-09-12T18:33:57.603005+0000","last_peered":"2024-09-12T18:33:57.603005+0000","last_clean":"2024-09-12T18:33:57.603005+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:33:57.603005+0000","last_undegraded":"2024-09-12T18:33:57.603005+0000","last_fullsized":"2024-09-12T18:33:57.603005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:57.602917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:57.602917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.602917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:26.937561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.656240+0000","last_change":"2024-09-12T18:33:54.656240+0000","last_active":"2024-09-12T18:33:54.656240+0000","last_peered":"2024-09-12T18:33:54.656240+0000","last_clean":"2024-09-12T18:33:54.656240+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:33:54.656240+0000","last_undegraded":"2024-09-12T18:33:54.656240+0000","last_fullsized":"2024-09-12T18:33:54.656240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:54.656138+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:54.656138+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.656138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:03.846883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.278771+0000","last_change":"2024-09-12T18:34:06.278771+0000","last_active":"2024-09-12T18:34:06.278771+0000","last_peered":"2024-09-12T18:34:06.278771+0000","last_clean":"2024-09-12T18:34:06.278771+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:34:06.278771+0000","last_undegraded":"2024-09-12T18:34:06.278771+0000","last_fullsized":"2024-09-12T18:34:06.278771+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:34:06.278682+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:34:06.278682+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.278682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:39.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.634930+0000","last_change":"2024-09-12T18:33:56.634831+0000","last_active":"2024-09-12T18:33:56.634930+0000","last_peered":"2024-09-12T18:33:56.634930+0000","last_clean":"2024-09-12T18:33:56.634930+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:33:56.634930+0000","last_undegraded":"2024-09-12T18:33:56.634930+0000","last_fullsized":"2024-09-12T18:33:56.634930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-12T18:33:56.634724+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-12T18:33:56.634724+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.634724+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:50.359137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.080856+0000","last_change":"2024-09-12T18:33:41.080793+0000","last_active":"2024-09-12T18:33:41.080856+0000","last_peered":"2024-09-12T18:33:41.080856+0000","last_clean":"2024-09-12T18:33:41.080856+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:33:41.080856+0000","last_undegraded":"2024-09-12T18:33:41.080856+0000","last_fullsized":"2024-09-12T18:33:41.080856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.080701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:10.660771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.286984+0000","last_change":"2024-09-12T18:33:58.286984+0000","last_active":"2024-09-12T18:33:58.286984+0000","last_peered":"2024-09-12T18:33:58.286984+0000","last_clean":"2024-09-12T18:33:58.286984+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:33:58.286984+0000","last_undegraded":"2024-09-12T18:33:58.286984+0000","last_fullsized":"2024-09-12T18:33:58.286984+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:58.286894+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:58.286894+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.286894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:35.359079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.571618+0000","last_change":"2024-09-12T18:33:44.571618+0000","last_active":"2024-09-12T18:33:44.571618+0000","last_peered":"2024-09-12T18:33:44.571618+0000","last_clean":"2024-09-12T18:33:44.571618+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:33:44.571618+0000","last_undegraded":"2024-09-12T18:33:44.571618+0000","last_fullsized":"2024-09-12T18:33:44.571618+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.571533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:16.885149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.116829+0000","last_change":"2024-09-12T18:33:34.116829+0000","last_active":"2024-09-12T18:33:34.116829+0000","last_peered":"2024-09-12T18:33:34.116829+0000","last_clean":"2024-09-12T18:33:34.116829+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:33:34.116829+0000","last_undegraded":"2024-09-12T18:33:34.116829+0000","last_fullsized":"2024-09-12T18:33:34.116829+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.116716+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:54.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.785662+0000","last_change":"2024-09-12T18:33:49.785662+0000","last_active":"2024-09-12T18:33:49.785662+0000","last_peered":"2024-09-12T18:33:49.785662+0000","last_clean":"2024-09-12T18:33:49.785662+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:33:49.785662+0000","last_undegraded":"2024-09-12T18:33:49.785662+0000","last_fullsized":"2024-09-12T18:33:49.785662+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.785575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:17.247986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.668636+0000","last_change":"2024-09-12T18:34:07.668636+0000","last_active":"2024-09-12T18:34:07.668636+0000","last_peered":"2024-09-12T18:34:07.668636+0000","last_clean":"2024-09-12T18:34:07.668636+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:34:07.668636+0000","last_undegraded":"2024-09-12T18:34:07.668636+0000","last_fullsized":"2024-09-12T18:34:07.668636+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:07.668546+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:07.668546+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.668546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:49.670045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.089410+0000","last_change":"2024-09-12T18:33:40.089410+0000","last_active":"2024-09-12T18:33:40.089410+0000","last_peered":"2024-09-12T18:33:40.089410+0000","last_clean":"2024-09-12T18:33:40.089410+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:33:40.089410+0000","last_undegraded":"2024-09-12T18:33:40.089410+0000","last_fullsized":"2024-09-12T18:33:40.089410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.089298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:47.053837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.671382+0000","last_change":"2024-09-12T18:33:52.671382+0000","last_active":"2024-09-12T18:33:52.671382+0000","last_peered":"2024-09-12T18:33:52.671382+0000","last_clean":"2024-09-12T18:33:52.671382+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:33:52.671382+0000","last_undegraded":"2024-09-12T18:33:52.671382+0000","last_fullsized":"2024-09-12T18:33:52.671382+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.671265+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:55.226775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:37.422322+0000","last_change":"2024-09-12T18:08:44.181346+0000","last_active":"2024-09-12T18:30:37.422322+0000","last_peered":"2024-09-12T18:30:37.422322+0000","last_clean":"2024-09-12T18:30:37.422322+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:30:37.422322+0000","last_undegraded":"2024-09-12T18:30:37.422322+0000","last_fullsized":"2024-09-12T18:30:37.422322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:51.105444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:10.234175+0000","last_change":"2024-09-12T18:34:10.234175+0000","last_active":"2024-09-12T18:34:10.234175+0000","last_peered":"2024-09-12T18:34:10.234175+0000","last_clean":"2024-09-12T18:34:10.234175+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:34:10.234175+0000","last_undegraded":"2024-09-12T18:34:10.234175+0000","last_fullsized":"2024-09-12T18:34:10.234175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:10.234069+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:10.234069+0000","last_clean_scrub_stamp":"2024-09-12T18:34:10.234069+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:24.268565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2101,"num_write":12,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.395840+0000","last_change":"2024-09-12T18:33:54.395840+0000","last_active":"2024-09-12T18:33:54.395840+0000","last_peered":"2024-09-12T18:33:54.395840+0000","last_clean":"2024-09-12T18:33:54.395840+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:33:54.395840+0000","last_undegraded":"2024-09-12T18:33:54.395840+0000","last_fullsized":"2024-09-12T18:33:54.395840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:54.395741+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:54.395741+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.395741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.004623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.287301+0000","last_change":"2024-09-12T18:34:01.287301+0000","last_active":"2024-09-12T18:34:01.287301+0000","last_peered":"2024-09-12T18:34:01.287301+0000","last_clean":"2024-09-12T18:34:01.287301+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:34:01.287301+0000","last_undegraded":"2024-09-12T18:34:01.287301+0000","last_fullsized":"2024-09-12T18:34:01.287301+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'48","last_scrub_stamp":"2024-09-12T18:34:01.287213+0000","last_deep_scrub":"262'48","last_deep_scrub_stamp":"2024-09-12T18:34:01.287213+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.287213+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:21.398616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:52.424317+0000","last_change":"2024-09-12T18:08:44.187162+0000","last_active":"2024-09-12T18:30:52.424317+0000","last_peered":"2024-09-12T18:30:52.424317+0000","last_clean":"2024-09-12T18:30:52.424317+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:30:52.424317+0000","last_undegraded":"2024-09-12T18:30:52.424317+0000","last_fullsized":"2024-09-12T18:30:52.424317+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.678534+0000","last_change":"2024-09-12T18:33:53.678534+0000","last_active":"2024-09-12T18:33:53.678534+0000","last_peered":"2024-09-12T18:33:53.678534+0000","last_clean":"2024-09-12T18:33:53.678534+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:33:53.678534+0000","last_undegraded":"2024-09-12T18:33:53.678534+0000","last_fullsized":"2024-09-12T18:33:53.678534+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:53.678438+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:53.678438+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.678438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:56.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'7","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.646180+0000","last_change":"2024-09-12T18:34:01.646180+0000","last_active":"2024-09-12T18:34:01.646180+0000","last_peered":"2024-09-12T18:34:01.646180+0000","last_clean":"2024-09-12T18:34:01.646180+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:34:01.646180+0000","last_undegraded":"2024-09-12T18:34:01.646180+0000","last_fullsized":"2024-09-12T18:34:01.646180+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:01.646079+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:01.646079+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.646079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:10.825669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4114,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.322890+0000","last_change":"2024-09-12T18:33:59.322890+0000","last_active":"2024-09-12T18:33:59.322890+0000","last_peered":"2024-09-12T18:33:59.322890+0000","last_clean":"2024-09-12T18:33:59.322890+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:33:59.322890+0000","last_undegraded":"2024-09-12T18:33:59.322890+0000","last_fullsized":"2024-09-12T18:33:59.322890+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:59.322761+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:59.322761+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.322761+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:34.404899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.639864+0000","last_change":"2024-09-12T18:33:53.639864+0000","last_active":"2024-09-12T18:33:53.639864+0000","last_peered":"2024-09-12T18:33:53.639864+0000","last_clean":"2024-09-12T18:33:53.639864+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:33:53.639864+0000","last_undegraded":"2024-09-12T18:33:53.639864+0000","last_fullsized":"2024-09-12T18:33:53.639864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:53.639777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:53.639777+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.639777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:55.361489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'11","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.748051+0000","last_change":"2024-09-12T18:33:46.748051+0000","last_active":"2024-09-12T18:33:46.748051+0000","last_peered":"2024-09-12T18:33:46.748051+0000","last_clean":"2024-09-12T18:33:46.748051+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:33:46.748051+0000","last_undegraded":"2024-09-12T18:33:46.748051+0000","last_fullsized":"2024-09-12T18:33:46.748051+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.747953+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:04.571236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16462,"num_write":16,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'9","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.437205+0000","last_change":"2024-09-12T18:33:52.437205+0000","last_active":"2024-09-12T18:33:52.437205+0000","last_peered":"2024-09-12T18:33:52.437205+0000","last_clean":"2024-09-12T18:33:52.437205+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:33:52.437205+0000","last_undegraded":"2024-09-12T18:33:52.437205+0000","last_fullsized":"2024-09-12T18:33:52.437205+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.437104+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:19.574310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13304,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":227,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.792015+0000","last_change":"2024-09-12T18:33:41.792015+0000","last_active":"2024-09-12T18:33:41.792015+0000","last_peered":"2024-09-12T18:33:41.792015+0000","last_clean":"2024-09-12T18:33:41.792015+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:33:41.792015+0000","last_undegraded":"2024-09-12T18:33:41.792015+0000","last_fullsized":"2024-09-12T18:33:41.792015+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.791915+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:48.494958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.315181+0000","last_change":"2024-09-12T18:34:06.315181+0000","last_active":"2024-09-12T18:34:06.315181+0000","last_peered":"2024-09-12T18:34:06.315181+0000","last_clean":"2024-09-12T18:34:06.315181+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:34:06.315181+0000","last_undegraded":"2024-09-12T18:34:06.315181+0000","last_fullsized":"2024-09-12T18:34:06.315181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:06.315106+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:06.315106+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.315106+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:14.370639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'6","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.760894+0000","last_change":"2024-09-12T18:33:47.760894+0000","last_active":"2024-09-12T18:33:47.760894+0000","last_peered":"2024-09-12T18:33:47.760894+0000","last_clean":"2024-09-12T18:33:47.760894+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:33:47.760894+0000","last_undegraded":"2024-09-12T18:33:47.760894+0000","last_fullsized":"2024-09-12T18:33:47.760894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.760785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:14.666756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6178,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.420818+0000","last_change":"2024-09-12T18:33:53.420818+0000","last_active":"2024-09-12T18:33:53.420818+0000","last_peered":"2024-09-12T18:33:53.420818+0000","last_clean":"2024-09-12T18:33:53.420818+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:33:53.420818+0000","last_undegraded":"2024-09-12T18:33:53.420818+0000","last_fullsized":"2024-09-12T18:33:53.420818+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.420697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.359186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":86,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.658368+0000","last_change":"2024-09-12T18:33:58.658368+0000","last_active":"2024-09-12T18:33:58.658368+0000","last_peered":"2024-09-12T18:33:58.658368+0000","last_clean":"2024-09-12T18:33:58.658368+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:33:58.658368+0000","last_undegraded":"2024-09-12T18:33:58.658368+0000","last_fullsized":"2024-09-12T18:33:58.658368+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-12T18:33:58.658273+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-12T18:33:58.658273+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.658273+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.818482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.310385+0000","last_change":"2024-09-12T18:34:07.310385+0000","last_active":"2024-09-12T18:34:07.310385+0000","last_peered":"2024-09-12T18:34:07.310385+0000","last_clean":"2024-09-12T18:34:07.310385+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:34:07.310385+0000","last_undegraded":"2024-09-12T18:34:07.310385+0000","last_fullsized":"2024-09-12T18:34:07.310385+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:07.310272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:07.310272+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.310272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:14.093943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:08.201028+0000","last_change":"2024-09-12T18:34:08.201028+0000","last_active":"2024-09-12T18:34:08.201028+0000","last_peered":"2024-09-12T18:34:08.201028+0000","last_clean":"2024-09-12T18:34:08.201028+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:34:08.201028+0000","last_undegraded":"2024-09-12T18:34:08.201028+0000","last_fullsized":"2024-09-12T18:34:08.201028+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:08.200914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:08.200914+0000","last_clean_scrub_stamp":"2024-09-12T18:34:08.200914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:59.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'8","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.616132+0000","last_change":"2024-09-12T18:33:59.616132+0000","last_active":"2024-09-12T18:33:59.616132+0000","last_peered":"2024-09-12T18:33:59.616132+0000","last_clean":"2024-09-12T18:33:59.616132+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:33:59.616132+0000","last_undegraded":"2024-09-12T18:33:59.616132+0000","last_fullsized":"2024-09-12T18:33:59.616132+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T18:33:59.616050+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T18:33:59.616050+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.616050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:47.330582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15356,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.562571+0000","last_change":"2024-09-12T18:33:43.562477+0000","last_active":"2024-09-12T18:33:43.562571+0000","last_peered":"2024-09-12T18:33:43.562571+0000","last_clean":"2024-09-12T18:33:43.562571+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:33:43.562571+0000","last_undegraded":"2024-09-12T18:33:43.562571+0000","last_fullsized":"2024-09-12T18:33:43.562571+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.562352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.656097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.595331+0000","last_change":"2024-09-12T18:33:50.595331+0000","last_active":"2024-09-12T18:33:50.595331+0000","last_peered":"2024-09-12T18:33:50.595331+0000","last_clean":"2024-09-12T18:33:50.595331+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:33:50.595331+0000","last_undegraded":"2024-09-12T18:33:50.595331+0000","last_fullsized":"2024-09-12T18:33:50.595331+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.595231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:05.062592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.290633+0000","last_change":"2024-09-12T18:34:05.290633+0000","last_active":"2024-09-12T18:34:05.290633+0000","last_peered":"2024-09-12T18:34:05.290633+0000","last_clean":"2024-09-12T18:34:05.290633+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:34:05.290633+0000","last_undegraded":"2024-09-12T18:34:05.290633+0000","last_fullsized":"2024-09-12T18:34:05.290633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:05.290539+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:05.290539+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.290539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:21.088516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.654412+0000","last_change":"2024-09-12T18:33:51.654412+0000","last_active":"2024-09-12T18:33:51.654412+0000","last_peered":"2024-09-12T18:33:51.654412+0000","last_clean":"2024-09-12T18:33:51.654412+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:33:51.654412+0000","last_undegraded":"2024-09-12T18:33:51.654412+0000","last_fullsized":"2024-09-12T18:33:51.654412+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.654316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.697352+0000","last_change":"2024-09-12T18:33:51.697352+0000","last_active":"2024-09-12T18:33:51.697352+0000","last_peered":"2024-09-12T18:33:51.697352+0000","last_clean":"2024-09-12T18:33:51.697352+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:33:51.697352+0000","last_undegraded":"2024-09-12T18:33:51.697352+0000","last_fullsized":"2024-09-12T18:33:51.697352+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.697203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:21.639036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.118463+0000","last_change":"2024-09-12T18:33:39.118463+0000","last_active":"2024-09-12T18:33:39.118463+0000","last_peered":"2024-09-12T18:33:39.118463+0000","last_clean":"2024-09-12T18:33:39.118463+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:33:39.118463+0000","last_undegraded":"2024-09-12T18:33:39.118463+0000","last_fullsized":"2024-09-12T18:33:39.118463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.118340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:21.575993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.624900+0000","last_change":"2024-09-12T18:34:02.624900+0000","last_active":"2024-09-12T18:34:02.624900+0000","last_peered":"2024-09-12T18:34:02.624900+0000","last_clean":"2024-09-12T18:34:02.624900+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:34:02.624900+0000","last_undegraded":"2024-09-12T18:34:02.624900+0000","last_fullsized":"2024-09-12T18:34:02.624900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T18:34:02.624813+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T18:34:02.624813+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.624813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:45.338660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.148294+0000","last_change":"2024-09-12T18:33:55.148294+0000","last_active":"2024-09-12T18:33:55.148294+0000","last_peered":"2024-09-12T18:33:55.148294+0000","last_clean":"2024-09-12T18:33:55.148294+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:33:55.148294+0000","last_undegraded":"2024-09-12T18:33:55.148294+0000","last_fullsized":"2024-09-12T18:33:55.148294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:55.148192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:55.148192+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.148192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:11.052999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.332386+0000","last_change":"2024-09-12T18:33:58.332386+0000","last_active":"2024-09-12T18:33:58.332386+0000","last_peered":"2024-09-12T18:33:58.332386+0000","last_clean":"2024-09-12T18:33:58.332386+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:33:58.332386+0000","last_undegraded":"2024-09-12T18:33:58.332386+0000","last_fullsized":"2024-09-12T18:33:58.332386+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:58.332299+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:58.332299+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.332299+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.387219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.304376+0000","last_change":"2024-09-12T18:34:05.304376+0000","last_active":"2024-09-12T18:34:05.304376+0000","last_peered":"2024-09-12T18:34:05.304376+0000","last_clean":"2024-09-12T18:34:05.304376+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:34:05.304376+0000","last_undegraded":"2024-09-12T18:34:05.304376+0000","last_fullsized":"2024-09-12T18:34:05.304376+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:05.304275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:05.304275+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.304275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:57.259609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'7","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.239940+0000","last_change":"2024-09-12T18:34:07.239940+0000","last_active":"2024-09-12T18:34:07.239940+0000","last_peered":"2024-09-12T18:34:07.239940+0000","last_clean":"2024-09-12T18:34:07.239940+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:34:07.239940+0000","last_undegraded":"2024-09-12T18:34:07.239940+0000","last_fullsized":"2024-09-12T18:34:07.239940+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:07.239851+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:07.239851+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.239851+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:20.384844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20478,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.030992+0000","last_change":"2024-09-12T18:33:37.030992+0000","last_active":"2024-09-12T18:33:37.030992+0000","last_peered":"2024-09-12T18:33:37.030992+0000","last_clean":"2024-09-12T18:33:37.030992+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:33:37.030992+0000","last_undegraded":"2024-09-12T18:33:37.030992+0000","last_fullsized":"2024-09-12T18:33:37.030992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.030874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.608998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4132,"num_write":4,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.131760+0000","last_change":"2024-09-12T18:33:31.131681+0000","last_active":"2024-09-12T18:33:31.131760+0000","last_peered":"2024-09-12T18:33:31.131760+0000","last_clean":"2024-09-12T18:33:31.131760+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:33:31.131760+0000","last_undegraded":"2024-09-12T18:33:31.131760+0000","last_fullsized":"2024-09-12T18:33:31.131760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.131587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.722593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.607963+0000","last_change":"2024-09-12T18:33:56.607963+0000","last_active":"2024-09-12T18:33:56.607963+0000","last_peered":"2024-09-12T18:33:56.607963+0000","last_clean":"2024-09-12T18:33:56.607963+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:33:56.607963+0000","last_undegraded":"2024-09-12T18:33:56.607963+0000","last_fullsized":"2024-09-12T18:33:56.607963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:56.607878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:56.607878+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.607878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:15.303254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.255614+0000","last_change":"2024-09-12T18:33:59.255614+0000","last_active":"2024-09-12T18:33:59.255614+0000","last_peered":"2024-09-12T18:33:59.255614+0000","last_clean":"2024-09-12T18:33:59.255614+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:33:59.255614+0000","last_undegraded":"2024-09-12T18:33:59.255614+0000","last_fullsized":"2024-09-12T18:33:59.255614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:59.255496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:59.255496+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.255496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:30.467073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.667044+0000","last_change":"2024-09-12T18:33:57.667044+0000","last_active":"2024-09-12T18:33:57.667044+0000","last_peered":"2024-09-12T18:33:57.667044+0000","last_clean":"2024-09-12T18:33:57.667044+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:33:57.667044+0000","last_undegraded":"2024-09-12T18:33:57.667044+0000","last_fullsized":"2024-09-12T18:33:57.667044+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:57.666942+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.666942+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.666942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:19.965742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'69","reported_seq":317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.117485+0000","last_change":"2024-09-12T18:33:49.117485+0000","last_active":"2024-09-12T18:33:49.117485+0000","last_peered":"2024-09-12T18:33:49.117485+0000","last_clean":"2024-09-12T18:33:49.117485+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:33:49.117485+0000","last_undegraded":"2024-09-12T18:33:49.117485+0000","last_fullsized":"2024-09-12T18:33:49.117485+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'69","last_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_deep_scrub":"262'69","last_deep_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.117387+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:26.470549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2510,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421842+0000","last_change":"2024-09-12T18:08:44.188294+0000","last_active":"2024-09-12T18:30:32.421842+0000","last_peered":"2024-09-12T18:30:32.421842+0000","last_clean":"2024-09-12T18:30:32.421842+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:30:32.421842+0000","last_undegraded":"2024-09-12T18:30:32.421842+0000","last_fullsized":"2024-09-12T18:30:32.421842+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.967013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.562587+0000","last_change":"2024-09-12T18:33:49.562587+0000","last_active":"2024-09-12T18:33:49.562587+0000","last_peered":"2024-09-12T18:33:49.562587+0000","last_clean":"2024-09-12T18:33:49.562587+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:33:49.562587+0000","last_undegraded":"2024-09-12T18:33:49.562587+0000","last_fullsized":"2024-09-12T18:33:49.562587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.562461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:32.217105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.479709+0000","last_change":"2024-09-12T18:33:50.479709+0000","last_active":"2024-09-12T18:33:50.479709+0000","last_peered":"2024-09-12T18:33:50.479709+0000","last_clean":"2024-09-12T18:33:50.479709+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:33:50.479709+0000","last_undegraded":"2024-09-12T18:33:50.479709+0000","last_fullsized":"2024-09-12T18:33:50.479709+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.479625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:19.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":306,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.068448+0000","last_change":"2024-09-12T18:33:48.068448+0000","last_active":"2024-09-12T18:33:48.068448+0000","last_peered":"2024-09-12T18:33:48.068448+0000","last_clean":"2024-09-12T18:33:48.068448+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:33:48.068448+0000","last_undegraded":"2024-09-12T18:33:48.068448+0000","last_fullsized":"2024-09-12T18:33:48.068448+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'86","last_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_deep_scrub":"262'86","last_deep_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.068336+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:23.878729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.708962+0000","last_change":"2024-09-12T18:34:09.708962+0000","last_active":"2024-09-12T18:34:09.708962+0000","last_peered":"2024-09-12T18:34:09.708962+0000","last_clean":"2024-09-12T18:34:09.708962+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:34:09.708962+0000","last_undegraded":"2024-09-12T18:34:09.708962+0000","last_fullsized":"2024-09-12T18:34:09.708962+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:09.708863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:09.708863+0000","last_clean_scrub_stamp":"2024-09-12T18:34:09.708863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:31.980918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.549641+0000","last_change":"2024-09-12T18:33:48.549641+0000","last_active":"2024-09-12T18:33:48.549641+0000","last_peered":"2024-09-12T18:33:48.549641+0000","last_clean":"2024-09-12T18:33:48.549641+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:33:48.549641+0000","last_undegraded":"2024-09-12T18:33:48.549641+0000","last_fullsized":"2024-09-12T18:33:48.549641+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.549549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:57.676603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.328787+0000","last_change":"2024-09-12T18:34:00.328787+0000","last_active":"2024-09-12T18:34:00.328787+0000","last_peered":"2024-09-12T18:34:00.328787+0000","last_clean":"2024-09-12T18:34:00.328787+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:34:00.328787+0000","last_undegraded":"2024-09-12T18:34:00.328787+0000","last_fullsized":"2024-09-12T18:34:00.328787+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:34:00.328701+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:34:00.328701+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.328701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:29.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.688319+0000","last_change":"2024-09-12T18:33:48.688319+0000","last_active":"2024-09-12T18:33:48.688319+0000","last_peered":"2024-09-12T18:33:48.688319+0000","last_clean":"2024-09-12T18:33:48.688319+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:33:48.688319+0000","last_undegraded":"2024-09-12T18:33:48.688319+0000","last_fullsized":"2024-09-12T18:33:48.688319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.688232+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:31.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.704802+0000","last_change":"2024-09-12T18:34:06.704802+0000","last_active":"2024-09-12T18:34:06.704802+0000","last_peered":"2024-09-12T18:34:06.704802+0000","last_clean":"2024-09-12T18:34:06.704802+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:34:06.704802+0000","last_undegraded":"2024-09-12T18:34:06.704802+0000","last_fullsized":"2024-09-12T18:34:06.704802+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:06.704718+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:06.704718+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.704718+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:07.410479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.309905+0000","last_change":"2024-09-12T18:34:04.309905+0000","last_active":"2024-09-12T18:34:04.309905+0000","last_peered":"2024-09-12T18:34:04.309905+0000","last_clean":"2024-09-12T18:34:04.309905+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:34:04.309905+0000","last_undegraded":"2024-09-12T18:34:04.309905+0000","last_fullsized":"2024-09-12T18:34:04.309905+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:04.309777+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:04.309777+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.309777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.083897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.750115+0000","last_change":"2024-09-12T18:33:43.750115+0000","last_active":"2024-09-12T18:33:43.750115+0000","last_peered":"2024-09-12T18:33:43.750115+0000","last_clean":"2024-09-12T18:33:43.750115+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:33:43.750115+0000","last_undegraded":"2024-09-12T18:33:43.750115+0000","last_fullsized":"2024-09-12T18:33:43.750115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.750030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:15.962557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16370,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":149,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.435189+0000","last_change":"2024-09-12T18:33:51.435189+0000","last_active":"2024-09-12T18:33:51.435189+0000","last_peered":"2024-09-12T18:33:51.435189+0000","last_clean":"2024-09-12T18:33:51.435189+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:33:51.435189+0000","last_undegraded":"2024-09-12T18:33:51.435189+0000","last_fullsized":"2024-09-12T18:33:51.435189+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.435102+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:43.729892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":24,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:30:32.421823+0000","last_change":"2024-09-12T18:08:44.182779+0000","last_active":"2024-09-12T18:30:32.421823+0000","last_peered":"2024-09-12T18:30:32.421823+0000","last_clean":"2024-09-12T18:30:32.421823+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:30:32.421823+0000","last_undegraded":"2024-09-12T18:30:32.421823+0000","last_fullsized":"2024-09-12T18:30:32.421823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.154567+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.154567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:54.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.776324+0000","last_change":"2024-09-12T18:33:45.776324+0000","last_active":"2024-09-12T18:33:45.776324+0000","last_peered":"2024-09-12T18:33:45.776324+0000","last_clean":"2024-09-12T18:33:45.776324+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:33:45.776324+0000","last_undegraded":"2024-09-12T18:33:45.776324+0000","last_fullsized":"2024-09-12T18:33:45.776324+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.776236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.587480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.733575+0000","last_change":"2024-09-12T18:33:49.733575+0000","last_active":"2024-09-12T18:33:49.733575+0000","last_peered":"2024-09-12T18:33:49.733575+0000","last_clean":"2024-09-12T18:33:49.733575+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:33:49.733575+0000","last_undegraded":"2024-09-12T18:33:49.733575+0000","last_fullsized":"2024-09-12T18:33:49.733575+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.733492+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:11.435583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":91,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.216930+0000","last_change":"2024-09-12T18:34:11.216930+0000","last_active":"2024-09-12T18:34:11.216930+0000","last_peered":"2024-09-12T18:34:11.216930+0000","last_clean":"2024-09-12T18:34:11.216930+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:34:11.216930+0000","last_undegraded":"2024-09-12T18:34:11.216930+0000","last_fullsized":"2024-09-12T18:34:11.216930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-12T18:34:11.216830+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-12T18:34:11.216830+0000","last_clean_scrub_stamp":"2024-09-12T18:34:11.216830+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:23.607051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.077276+0000","last_change":"2024-09-12T18:33:38.077276+0000","last_active":"2024-09-12T18:33:38.077276+0000","last_peered":"2024-09-12T18:33:38.077276+0000","last_clean":"2024-09-12T18:33:38.077276+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:33:38.077276+0000","last_undegraded":"2024-09-12T18:33:38.077276+0000","last_fullsized":"2024-09-12T18:33:38.077276+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.077154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:15.304159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.298206+0000","last_change":"2024-09-12T18:34:02.298206+0000","last_active":"2024-09-12T18:34:02.298206+0000","last_peered":"2024-09-12T18:34:02.298206+0000","last_clean":"2024-09-12T18:34:02.298206+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:34:02.298206+0000","last_undegraded":"2024-09-12T18:34:02.298206+0000","last_fullsized":"2024-09-12T18:34:02.298206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:02.298114+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:02.298114+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.298114+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:26.016355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.157624+0000","last_change":"2024-09-12T18:33:54.157624+0000","last_active":"2024-09-12T18:33:54.157624+0000","last_peered":"2024-09-12T18:33:54.157624+0000","last_clean":"2024-09-12T18:33:54.157624+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:33:54.157624+0000","last_undegraded":"2024-09-12T18:33:54.157624+0000","last_fullsized":"2024-09-12T18:33:54.157624+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:54.157540+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:54.157540+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.157540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:11.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.330603+0000","last_change":"2024-09-12T18:33:57.330603+0000","last_active":"2024-09-12T18:33:57.330603+0000","last_peered":"2024-09-12T18:33:57.330603+0000","last_clean":"2024-09-12T18:33:57.330603+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:33:57.330603+0000","last_undegraded":"2024-09-12T18:33:57.330603+0000","last_fullsized":"2024-09-12T18:33:57.330603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-12T18:33:57.330521+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-12T18:33:57.330521+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.330521+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:51.818049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.177927+0000","last_change":"2024-09-12T18:34:02.177927+0000","last_active":"2024-09-12T18:34:02.177927+0000","last_peered":"2024-09-12T18:34:02.177927+0000","last_clean":"2024-09-12T18:34:02.177927+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:34:02.177927+0000","last_undegraded":"2024-09-12T18:34:02.177927+0000","last_fullsized":"2024-09-12T18:34:02.177927+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:02.177809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:02.177809+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.177809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:33.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.203337+0000","last_change":"2024-09-12T18:34:09.203337+0000","last_active":"2024-09-12T18:34:09.203337+0000","last_peered":"2024-09-12T18:34:09.203337+0000","last_clean":"2024-09-12T18:34:09.203337+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:34:09.203337+0000","last_undegraded":"2024-09-12T18:34:09.203337+0000","last_fullsized":"2024-09-12T18:34:09.203337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:34:09.203248+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:34:09.203248+0000","last_clean_scrub_stamp":"2024-09-12T18:34:09.203248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:48.064161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.059842+0000","last_change":"2024-09-12T18:33:36.059779+0000","last_active":"2024-09-12T18:33:36.059842+0000","last_peered":"2024-09-12T18:33:36.059842+0000","last_clean":"2024-09-12T18:33:36.059842+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:33:36.059842+0000","last_undegraded":"2024-09-12T18:33:36.059842+0000","last_fullsized":"2024-09-12T18:33:36.059842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.059690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.315136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7180,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.710357+0000","last_change":"2024-09-12T18:33:48.710357+0000","last_active":"2024-09-12T18:33:48.710357+0000","last_peered":"2024-09-12T18:33:48.710357+0000","last_clean":"2024-09-12T18:33:48.710357+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:33:48.710357+0000","last_undegraded":"2024-09-12T18:33:48.710357+0000","last_fullsized":"2024-09-12T18:33:48.710357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'39","last_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_deep_scrub":"262'39","last_deep_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.710256+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:19.803857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.796099+0000","last_change":"2024-09-12T18:33:48.796099+0000","last_active":"2024-09-12T18:33:48.796099+0000","last_peered":"2024-09-12T18:33:48.796099+0000","last_clean":"2024-09-12T18:33:48.796099+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:33:48.796099+0000","last_undegraded":"2024-09-12T18:33:48.796099+0000","last_fullsized":"2024-09-12T18:33:48.796099+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.796012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:53.301486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.506111+0000","last_change":"2024-09-12T18:33:46.506056+0000","last_active":"2024-09-12T18:33:46.506111+0000","last_peered":"2024-09-12T18:33:46.506111+0000","last_clean":"2024-09-12T18:33:46.506111+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:33:46.506111+0000","last_undegraded":"2024-09-12T18:33:46.506111+0000","last_fullsized":"2024-09-12T18:33:46.506111+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.505974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:34.339593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8190,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'7","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.650248+0000","last_change":"2024-09-12T18:33:54.650248+0000","last_active":"2024-09-12T18:33:54.650248+0000","last_peered":"2024-09-12T18:33:54.650248+0000","last_clean":"2024-09-12T18:33:54.650248+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:33:54.650248+0000","last_undegraded":"2024-09-12T18:33:54.650248+0000","last_fullsized":"2024-09-12T18:33:54.650248+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:54.650160+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:54.650160+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.650160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:51.167384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":12,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.785539+0000","last_change":"2024-09-12T18:33:40.785539+0000","last_active":"2024-09-12T18:33:40.785539+0000","last_peered":"2024-09-12T18:33:40.785539+0000","last_clean":"2024-09-12T18:33:40.785539+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:33:40.785539+0000","last_undegraded":"2024-09-12T18:33:40.785539+0000","last_fullsized":"2024-09-12T18:33:40.785539+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.785448+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.888653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.171731+0000","last_change":"2024-09-12T18:34:01.171731+0000","last_active":"2024-09-12T18:34:01.171731+0000","last_peered":"2024-09-12T18:34:01.171731+0000","last_clean":"2024-09-12T18:34:01.171731+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:34:01.171731+0000","last_undegraded":"2024-09-12T18:34:01.171731+0000","last_fullsized":"2024-09-12T18:34:01.171731+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:01.171642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:01.171642+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.171642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:50.344534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.286838+0000","last_change":"2024-09-12T18:34:03.286838+0000","last_active":"2024-09-12T18:34:03.286838+0000","last_peered":"2024-09-12T18:34:03.286838+0000","last_clean":"2024-09-12T18:34:03.286838+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:34:03.286838+0000","last_undegraded":"2024-09-12T18:34:03.286838+0000","last_fullsized":"2024-09-12T18:34:03.286838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:03.286747+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:03.286747+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.286747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:06.956604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.533567+0000","last_change":"2024-09-12T18:33:45.533486+0000","last_active":"2024-09-12T18:33:45.533567+0000","last_peered":"2024-09-12T18:33:45.533567+0000","last_clean":"2024-09-12T18:33:45.533567+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:33:45.533567+0000","last_undegraded":"2024-09-12T18:33:45.533567+0000","last_fullsized":"2024-09-12T18:33:45.533567+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.533395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:25.583217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":129,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.126504+0000","last_change":"2024-09-12T18:33:32.126504+0000","last_active":"2024-09-12T18:33:32.126504+0000","last_peered":"2024-09-12T18:33:32.126504+0000","last_clean":"2024-09-12T18:33:32.126504+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:33:32.126504+0000","last_undegraded":"2024-09-12T18:33:32.126504+0000","last_fullsized":"2024-09-12T18:33:32.126504+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.126421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:07.003050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:12.216358+0000","last_change":"2024-09-12T18:34:12.216358+0000","last_active":"2024-09-12T18:34:12.216358+0000","last_peered":"2024-09-12T18:34:12.216358+0000","last_clean":"2024-09-12T18:34:12.216358+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:34:12.216358+0000","last_undegraded":"2024-09-12T18:34:12.216358+0000","last_fullsized":"2024-09-12T18:34:12.216358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:12.216264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:12.216264+0000","last_clean_scrub_stamp":"2024-09-12T18:34:12.216264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:07.942311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.277123+0000","last_change":"2024-09-12T18:33:57.277123+0000","last_active":"2024-09-12T18:33:57.277123+0000","last_peered":"2024-09-12T18:33:57.277123+0000","last_clean":"2024-09-12T18:33:57.277123+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:33:57.277123+0000","last_undegraded":"2024-09-12T18:33:57.277123+0000","last_fullsized":"2024-09-12T18:33:57.277123+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:57.277040+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.277040+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.277040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:35.099600+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.670539+0000","last_change":"2024-09-12T18:33:55.670539+0000","last_active":"2024-09-12T18:33:55.670539+0000","last_peered":"2024-09-12T18:33:55.670539+0000","last_clean":"2024-09-12T18:33:55.670539+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:33:55.670539+0000","last_undegraded":"2024-09-12T18:33:55.670539+0000","last_fullsized":"2024-09-12T18:33:55.670539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:55.670447+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:55.670447+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.670447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:37.900786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'84","reported_seq":361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.726698+0000","last_change":"2024-09-12T18:33:47.726698+0000","last_active":"2024-09-12T18:33:47.726698+0000","last_peered":"2024-09-12T18:33:47.726698+0000","last_clean":"2024-09-12T18:33:47.726698+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:33:47.726698+0000","last_undegraded":"2024-09-12T18:33:47.726698+0000","last_fullsized":"2024-09-12T18:33:47.726698+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'84","last_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_deep_scrub":"262'84","last_deep_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.726617+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:13.084915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.254406+0000","last_change":"2024-09-12T18:34:04.254406+0000","last_active":"2024-09-12T18:34:04.254406+0000","last_peered":"2024-09-12T18:34:04.254406+0000","last_clean":"2024-09-12T18:34:04.254406+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:34:04.254406+0000","last_undegraded":"2024-09-12T18:34:04.254406+0000","last_fullsized":"2024-09-12T18:34:04.254406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:04.254316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:04.254316+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.254316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:15.882484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.143012+0000","last_change":"2024-09-12T18:33:56.143012+0000","last_active":"2024-09-12T18:33:56.143012+0000","last_peered":"2024-09-12T18:33:56.143012+0000","last_clean":"2024-09-12T18:33:56.143012+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:33:56.143012+0000","last_undegraded":"2024-09-12T18:33:56.143012+0000","last_fullsized":"2024-09-12T18:33:56.143012+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:56.142906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:56.142906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.142906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:14.497993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.540924+0000","last_change":"2024-09-12T18:33:42.540924+0000","last_active":"2024-09-12T18:33:42.540924+0000","last_peered":"2024-09-12T18:33:42.540924+0000","last_clean":"2024-09-12T18:33:42.540924+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:33:42.540924+0000","last_undegraded":"2024-09-12T18:33:42.540924+0000","last_fullsized":"2024-09-12T18:33:42.540924+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.540836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:50.406845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2093,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":216,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.101232+0000","last_change":"2024-09-12T18:33:47.101176+0000","last_active":"2024-09-12T18:33:47.101232+0000","last_peered":"2024-09-12T18:33:47.101232+0000","last_clean":"2024-09-12T18:33:47.101232+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:33:47.101232+0000","last_undegraded":"2024-09-12T18:33:47.101232+0000","last_fullsized":"2024-09-12T18:33:47.101232+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.101091+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:51.288656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.206340+0000","last_change":"2024-09-12T18:34:03.206340+0000","last_active":"2024-09-12T18:34:03.206340+0000","last_peered":"2024-09-12T18:34:03.206340+0000","last_clean":"2024-09-12T18:34:03.206340+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:34:03.206340+0000","last_undegraded":"2024-09-12T18:34:03.206340+0000","last_fullsized":"2024-09-12T18:34:03.206340+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:03.206241+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:03.206241+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.206241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:22.591761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.578293+0000","last_change":"2024-09-12T18:33:51.578293+0000","last_active":"2024-09-12T18:33:51.578293+0000","last_peered":"2024-09-12T18:33:51.578293+0000","last_clean":"2024-09-12T18:33:51.578293+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:33:51.578293+0000","last_undegraded":"2024-09-12T18:33:51.578293+0000","last_fullsized":"2024-09-12T18:33:51.578293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.578175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.289043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.670112+0000","last_change":"2024-09-12T18:33:53.670112+0000","last_active":"2024-09-12T18:33:53.670112+0000","last_peered":"2024-09-12T18:33:53.670112+0000","last_clean":"2024-09-12T18:33:53.670112+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:33:53.670112+0000","last_undegraded":"2024-09-12T18:33:53.670112+0000","last_fullsized":"2024-09-12T18:33:53.670112+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-12T18:33:53.670042+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-12T18:33:53.670042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.670042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:40.935315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.289361+0000","last_change":"2024-09-12T18:33:56.289361+0000","last_active":"2024-09-12T18:33:56.289361+0000","last_peered":"2024-09-12T18:33:56.289361+0000","last_clean":"2024-09-12T18:33:56.289361+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:33:56.289361+0000","last_undegraded":"2024-09-12T18:33:56.289361+0000","last_fullsized":"2024-09-12T18:33:56.289361+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'15","last_scrub_stamp":"2024-09-12T18:33:56.289258+0000","last_deep_scrub":"262'15","last_deep_scrub_stamp":"2024-09-12T18:33:56.289258+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.289258+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.706219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.659712+0000","last_change":"2024-09-12T18:34:05.659712+0000","last_active":"2024-09-12T18:34:05.659712+0000","last_peered":"2024-09-12T18:34:05.659712+0000","last_clean":"2024-09-12T18:34:05.659712+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:34:05.659712+0000","last_undegraded":"2024-09-12T18:34:05.659712+0000","last_fullsized":"2024-09-12T18:34:05.659712+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:05.659624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:05.659624+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.659624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:40.915862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'7","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.062486+0000","last_change":"2024-09-12T18:33:58.062486+0000","last_active":"2024-09-12T18:33:58.062486+0000","last_peered":"2024-09-12T18:33:58.062486+0000","last_clean":"2024-09-12T18:33:58.062486+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:33:58.062486+0000","last_undegraded":"2024-09-12T18:33:58.062486+0000","last_fullsized":"2024-09-12T18:33:58.062486+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:58.062381+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:58.062381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.062381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:47.376420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":12,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.483317+0000","last_change":"2024-09-12T18:33:49.483317+0000","last_active":"2024-09-12T18:33:49.483317+0000","last_peered":"2024-09-12T18:33:49.483317+0000","last_clean":"2024-09-12T18:33:49.483317+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:33:49.483317+0000","last_undegraded":"2024-09-12T18:33:49.483317+0000","last_fullsized":"2024-09-12T18:33:49.483317+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.483230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:14.375303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.742508+0000","last_change":"2024-09-12T18:33:39.742508+0000","last_active":"2024-09-12T18:33:39.742508+0000","last_peered":"2024-09-12T18:33:39.742508+0000","last_clean":"2024-09-12T18:33:39.742508+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:33:39.742508+0000","last_undegraded":"2024-09-12T18:33:39.742508+0000","last_fullsized":"2024-09-12T18:33:39.742508+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.742414+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.937032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.135521+0000","last_change":"2024-09-12T18:34:00.135521+0000","last_active":"2024-09-12T18:34:00.135521+0000","last_peered":"2024-09-12T18:34:00.135521+0000","last_clean":"2024-09-12T18:34:00.135521+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:34:00.135521+0000","last_undegraded":"2024-09-12T18:34:00.135521+0000","last_fullsized":"2024-09-12T18:34:00.135521+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.135407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.135407+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.135407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:28.404131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.653640+0000","last_change":"2024-09-12T18:34:03.653640+0000","last_active":"2024-09-12T18:34:03.653640+0000","last_peered":"2024-09-12T18:34:03.653640+0000","last_clean":"2024-09-12T18:34:03.653640+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:34:03.653640+0000","last_undegraded":"2024-09-12T18:34:03.653640+0000","last_fullsized":"2024-09-12T18:34:03.653640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-12T18:34:03.653506+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-12T18:34:03.653506+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.653506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:23.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.129011+0000","last_change":"2024-09-12T18:33:51.129011+0000","last_active":"2024-09-12T18:33:51.129011+0000","last_peered":"2024-09-12T18:33:51.129011+0000","last_clean":"2024-09-12T18:33:51.129011+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:33:51.129011+0000","last_undegraded":"2024-09-12T18:33:51.129011+0000","last_fullsized":"2024-09-12T18:33:51.129011+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.128916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:09.750403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.684159+0000","last_change":"2024-09-12T18:33:50.684159+0000","last_active":"2024-09-12T18:33:50.684159+0000","last_peered":"2024-09-12T18:33:50.684159+0000","last_clean":"2024-09-12T18:33:50.684159+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:33:50.684159+0000","last_undegraded":"2024-09-12T18:33:50.684159+0000","last_fullsized":"2024-09-12T18:33:50.684159+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'43","last_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_deep_scrub":"262'43","last_deep_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.684073+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:13.128231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.643660+0000","last_change":"2024-09-12T18:33:55.643660+0000","last_active":"2024-09-12T18:33:55.643660+0000","last_peered":"2024-09-12T18:33:55.643660+0000","last_clean":"2024-09-12T18:33:55.643660+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:33:55.643660+0000","last_undegraded":"2024-09-12T18:33:55.643660+0000","last_fullsized":"2024-09-12T18:33:55.643660+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:55.643552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:55.643552+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.643552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.038750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.621929+0000","last_change":"2024-09-12T18:34:00.621929+0000","last_active":"2024-09-12T18:34:00.621929+0000","last_peered":"2024-09-12T18:34:00.621929+0000","last_clean":"2024-09-12T18:34:00.621929+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:34:00.621929+0000","last_undegraded":"2024-09-12T18:34:00.621929+0000","last_fullsized":"2024-09-12T18:34:00.621929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.621842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.621842+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.621842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:53.443577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.072762+0000","last_change":"2024-09-12T18:33:35.072762+0000","last_active":"2024-09-12T18:33:35.072762+0000","last_peered":"2024-09-12T18:33:35.072762+0000","last_clean":"2024-09-12T18:33:35.072762+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:33:35.072762+0000","last_undegraded":"2024-09-12T18:33:35.072762+0000","last_fullsized":"2024-09-12T18:33:35.072762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.072666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:25.314427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.790476+0000","last_change":"2024-09-12T18:33:38.790476+0000","last_active":"2024-09-12T18:33:38.790476+0000","last_peered":"2024-09-12T18:33:38.790476+0000","last_clean":"2024-09-12T18:33:38.790476+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:33:38.790476+0000","last_undegraded":"2024-09-12T18:33:38.790476+0000","last_fullsized":"2024-09-12T18:33:38.790476+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'20","last_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_deep_scrub":"262'20","last_deep_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.790391+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:37.347221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.625450+0000","last_change":"2024-09-12T18:33:52.625450+0000","last_active":"2024-09-12T18:33:52.625450+0000","last_peered":"2024-09-12T18:33:52.625450+0000","last_clean":"2024-09-12T18:33:52.625450+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:33:52.625450+0000","last_undegraded":"2024-09-12T18:33:52.625450+0000","last_fullsized":"2024-09-12T18:33:52.625450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.625356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:27.503484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.100164+0000","last_change":"2024-09-12T18:33:57.100164+0000","last_active":"2024-09-12T18:33:57.100164+0000","last_peered":"2024-09-12T18:33:57.100164+0000","last_clean":"2024-09-12T18:33:57.100164+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:33:57.100164+0000","last_undegraded":"2024-09-12T18:33:57.100164+0000","last_fullsized":"2024-09-12T18:33:57.100164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:57.100053+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.100053+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.100053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:10.839810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'7","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.693090+0000","last_change":"2024-09-12T18:33:50.693090+0000","last_active":"2024-09-12T18:33:50.693090+0000","last_peered":"2024-09-12T18:33:50.693090+0000","last_clean":"2024-09-12T18:33:50.693090+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:33:50.693090+0000","last_undegraded":"2024-09-12T18:33:50.693090+0000","last_fullsized":"2024-09-12T18:33:50.693090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.692996+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:25.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":163,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.052887+0000","last_change":"2024-09-12T18:33:46.052767+0000","last_active":"2024-09-12T18:33:46.052887+0000","last_peered":"2024-09-12T18:33:46.052887+0000","last_clean":"2024-09-12T18:33:46.052887+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:33:46.052887+0000","last_undegraded":"2024-09-12T18:33:46.052887+0000","last_fullsized":"2024-09-12T18:33:46.052887+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.052674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:08.793575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.293661+0000","last_change":"2024-09-12T18:34:00.293661+0000","last_active":"2024-09-12T18:34:00.293661+0000","last_peered":"2024-09-12T18:34:00.293661+0000","last_clean":"2024-09-12T18:34:00.293661+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:34:00.293661+0000","last_undegraded":"2024-09-12T18:34:00.293661+0000","last_fullsized":"2024-09-12T18:34:00.293661+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.293574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.293574+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.293574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:18.050085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'7","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.325325+0000","last_change":"2024-09-12T18:33:56.325325+0000","last_active":"2024-09-12T18:33:56.325325+0000","last_peered":"2024-09-12T18:33:56.325325+0000","last_clean":"2024-09-12T18:33:56.325325+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:33:56.325325+0000","last_undegraded":"2024-09-12T18:33:56.325325+0000","last_fullsized":"2024-09-12T18:33:56.325325+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:56.325233+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:56.325233+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.325233+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:18.970965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.125508+0000","last_change":"2024-09-12T18:33:53.125508+0000","last_active":"2024-09-12T18:33:53.125508+0000","last_peered":"2024-09-12T18:33:53.125508+0000","last_clean":"2024-09-12T18:33:53.125508+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:33:53.125508+0000","last_undegraded":"2024-09-12T18:33:53.125508+0000","last_fullsized":"2024-09-12T18:33:53.125508+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-12T18:33:53.125359+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-12T18:33:53.125359+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.125359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:57.895933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.559275+0000","last_change":"2024-09-12T18:33:40.559181+0000","last_active":"2024-09-12T18:33:40.559275+0000","last_peered":"2024-09-12T18:33:40.559275+0000","last_clean":"2024-09-12T18:33:40.559275+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:33:40.559275+0000","last_undegraded":"2024-09-12T18:33:40.559275+0000","last_fullsized":"2024-09-12T18:33:40.559275+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.559081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:57.983997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.073004+0000","last_change":"2024-09-12T18:33:42.073004+0000","last_active":"2024-09-12T18:33:42.073004+0000","last_peered":"2024-09-12T18:33:42.073004+0000","last_clean":"2024-09-12T18:33:42.073004+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:33:42.073004+0000","last_undegraded":"2024-09-12T18:33:42.073004+0000","last_fullsized":"2024-09-12T18:33:42.073004+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.072907+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:31.992134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'9","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.551587+0000","last_change":"2024-09-12T18:33:47.551587+0000","last_active":"2024-09-12T18:33:47.551587+0000","last_peered":"2024-09-12T18:33:47.551587+0000","last_clean":"2024-09-12T18:33:47.551587+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:33:47.551587+0000","last_undegraded":"2024-09-12T18:33:47.551587+0000","last_fullsized":"2024-09-12T18:33:47.551587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.551500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:34.296392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":21492,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.142147+0000","last_change":"2024-09-12T18:33:50.142147+0000","last_active":"2024-09-12T18:33:50.142147+0000","last_peered":"2024-09-12T18:33:50.142147+0000","last_clean":"2024-09-12T18:33:50.142147+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:33:50.142147+0000","last_undegraded":"2024-09-12T18:33:50.142147+0000","last_fullsized":"2024-09-12T18:33:50.142147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.142028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.397527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":229,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.667526+0000","last_change":"2024-09-12T18:33:47.667434+0000","last_active":"2024-09-12T18:33:47.667526+0000","last_peered":"2024-09-12T18:33:47.667526+0000","last_clean":"2024-09-12T18:33:47.667526+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:33:47.667526+0000","last_undegraded":"2024-09-12T18:33:47.667526+0000","last_fullsized":"2024-09-12T18:33:47.667526+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'63","last_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_deep_scrub":"262'63","last_deep_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.667339+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:42.294995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:08.678599+0000","last_change":"2024-09-12T18:34:08.678599+0000","last_active":"2024-09-12T18:34:08.678599+0000","last_peered":"2024-09-12T18:34:08.678599+0000","last_clean":"2024-09-12T18:34:08.678599+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:34:08.678599+0000","last_undegraded":"2024-09-12T18:34:08.678599+0000","last_fullsized":"2024-09-12T18:34:08.678599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:08.678510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:08.678510+0000","last_clean_scrub_stamp":"2024-09-12T18:34:08.678510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:51.760983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'4","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.701536+0000","last_change":"2024-09-12T18:33:52.701536+0000","last_active":"2024-09-12T18:33:52.701536+0000","last_peered":"2024-09-12T18:33:52.701536+0000","last_clean":"2024-09-12T18:33:52.701536+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:33:52.701536+0000","last_undegraded":"2024-09-12T18:33:52.701536+0000","last_fullsized":"2024-09-12T18:33:52.701536+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:52.701450+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:52.701450+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.701450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:55.312962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":4,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.137464+0000","last_change":"2024-09-12T18:33:52.137464+0000","last_active":"2024-09-12T18:33:52.137464+0000","last_peered":"2024-09-12T18:33:52.137464+0000","last_clean":"2024-09-12T18:33:52.137464+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:33:52.137464+0000","last_undegraded":"2024-09-12T18:33:52.137464+0000","last_fullsized":"2024-09-12T18:33:52.137464+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.137345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:19.251983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.410686+0000","last_change":"2024-09-12T18:33:47.410627+0000","last_active":"2024-09-12T18:33:47.410686+0000","last_peered":"2024-09-12T18:33:47.410686+0000","last_clean":"2024-09-12T18:33:47.410686+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:33:47.410686+0000","last_undegraded":"2024-09-12T18:33:47.410686+0000","last_fullsized":"2024-09-12T18:33:47.410686+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.410546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:13.633680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.633381+0000","last_change":"2024-09-12T18:34:04.633381+0000","last_active":"2024-09-12T18:34:04.633381+0000","last_peered":"2024-09-12T18:34:04.633381+0000","last_clean":"2024-09-12T18:34:04.633381+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:34:04.633381+0000","last_undegraded":"2024-09-12T18:34:04.633381+0000","last_fullsized":"2024-09-12T18:34:04.633381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:04.633261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:04.633261+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.633261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:18.388540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.746737+0000","last_change":"2024-09-12T18:33:44.746737+0000","last_active":"2024-09-12T18:33:44.746737+0000","last_peered":"2024-09-12T18:33:44.746737+0000","last_clean":"2024-09-12T18:33:44.746737+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:33:44.746737+0000","last_undegraded":"2024-09-12T18:33:44.746737+0000","last_fullsized":"2024-09-12T18:33:44.746737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.746644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:18.534212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.527686+0000","last_change":"2024-09-12T18:33:41.527686+0000","last_active":"2024-09-12T18:33:41.527686+0000","last_peered":"2024-09-12T18:33:41.527686+0000","last_clean":"2024-09-12T18:33:41.527686+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:33:41.527686+0000","last_undegraded":"2024-09-12T18:33:41.527686+0000","last_fullsized":"2024-09-12T18:33:41.527686+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.527572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:40.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.802501+0000","last_change":"2024-09-12T18:33:37.802441+0000","last_active":"2024-09-12T18:33:37.802501+0000","last_peered":"2024-09-12T18:33:37.802501+0000","last_clean":"2024-09-12T18:33:37.802501+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:33:37.802501+0000","last_undegraded":"2024-09-12T18:33:37.802501+0000","last_fullsized":"2024-09-12T18:33:37.802501+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'52","last_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_deep_scrub":"262'52","last_deep_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.802357+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:54.223569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.111458+0000","last_change":"2024-09-12T18:33:59.111458+0000","last_active":"2024-09-12T18:33:59.111458+0000","last_peered":"2024-09-12T18:33:59.111458+0000","last_clean":"2024-09-12T18:33:59.111458+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:33:59.111458+0000","last_undegraded":"2024-09-12T18:33:59.111458+0000","last_fullsized":"2024-09-12T18:33:59.111458+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:59.111334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:59.111334+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.111334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:07.084191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.373207+0000","last_change":"2024-09-12T18:33:55.373207+0000","last_active":"2024-09-12T18:33:55.373207+0000","last_peered":"2024-09-12T18:33:55.373207+0000","last_clean":"2024-09-12T18:33:55.373207+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:33:55.373207+0000","last_undegraded":"2024-09-12T18:33:55.373207+0000","last_fullsized":"2024-09-12T18:33:55.373207+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:55.373123+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:55.373123+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.373123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:35.554496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.749770+0000","last_change":"2024-09-12T18:33:42.749770+0000","last_active":"2024-09-12T18:33:42.749770+0000","last_peered":"2024-09-12T18:33:42.749770+0000","last_clean":"2024-09-12T18:33:42.749770+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:33:42.749770+0000","last_undegraded":"2024-09-12T18:33:42.749770+0000","last_fullsized":"2024-09-12T18:33:42.749770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.749692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.877571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.076246+0000","last_change":"2024-09-12T18:33:45.076246+0000","last_active":"2024-09-12T18:33:45.076246+0000","last_peered":"2024-09-12T18:33:45.076246+0000","last_clean":"2024-09-12T18:33:45.076246+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:33:45.076246+0000","last_undegraded":"2024-09-12T18:33:45.076246+0000","last_fullsized":"2024-09-12T18:33:45.076246+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.076154+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:12.368273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'356","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.002581+0000","last_change":"2024-09-12T18:33:23.002517+0000","last_active":"2024-09-12T18:33:23.002581+0000","last_peered":"2024-09-12T18:33:23.002581+0000","last_clean":"2024-09-12T18:33:23.002581+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:33:23.002581+0000","last_undegraded":"2024-09-12T18:33:23.002581+0000","last_fullsized":"2024-09-12T18:33:23.002581+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'356","last_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_deep_scrub":"262'356","last_deep_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.002381+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:15.336304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":13512,"num_write":1124,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'539","reported_seq":1959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.650205+0000","last_change":"2024-09-12T18:33:28.650205+0000","last_active":"2024-09-12T18:33:28.650205+0000","last_peered":"2024-09-12T18:33:28.650205+0000","last_clean":"2024-09-12T18:33:28.650205+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:33:28.650205+0000","last_undegraded":"2024-09-12T18:33:28.650205+0000","last_fullsized":"2024-09-12T18:33:28.650205+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'539","last_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_deep_scrub":"262'539","last_deep_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.650119+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:52.021435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":773,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'418","reported_seq":1206,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.544344+0000","last_change":"2024-09-12T18:33:18.544275+0000","last_active":"2024-09-12T18:33:18.544344+0000","last_peered":"2024-09-12T18:33:18.544344+0000","last_clean":"2024-09-12T18:33:18.544344+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:33:18.544344+0000","last_undegraded":"2024-09-12T18:33:18.544344+0000","last_fullsized":"2024-09-12T18:33:18.544344+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'418","last_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_deep_scrub":"262'418","last_deep_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.544159+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:31.620304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342084,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":23039,"num_write":1345,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'487","reported_seq":2080,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.047086+0000","last_change":"2024-09-12T18:33:27.047086+0000","last_active":"2024-09-12T18:33:27.047086+0000","last_peered":"2024-09-12T18:33:27.047086+0000","last_clean":"2024-09-12T18:33:27.047086+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:33:27.047086+0000","last_undegraded":"2024-09-12T18:33:27.047086+0000","last_fullsized":"2024-09-12T18:33:27.047086+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.047001+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:35.965293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'386","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.295051+0000","last_change":"2024-09-12T18:33:24.295051+0000","last_active":"2024-09-12T18:33:24.295051+0000","last_peered":"2024-09-12T18:33:24.295051+0000","last_clean":"2024-09-12T18:33:24.295051+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:33:24.295051+0000","last_undegraded":"2024-09-12T18:33:24.295051+0000","last_fullsized":"2024-09-12T18:33:24.295051+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'386","last_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_deep_scrub":"262'386","last_deep_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.294831+0000","objects_scrubbed":9,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:26.207847+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342186,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":764,"num_read_kb":32762,"num_write":1205,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'420","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.309452+0000","last_change":"2024-09-12T18:33:30.309452+0000","last_active":"2024-09-12T18:33:30.309452+0000","last_peered":"2024-09-12T18:33:30.309452+0000","last_clean":"2024-09-12T18:33:30.309452+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:33:30.309452+0000","last_undegraded":"2024-09-12T18:33:30.309452+0000","last_fullsized":"2024-09-12T18:33:30.309452+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.309353+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.906318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'347","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.680429+0000","last_change":"2024-09-12T18:33:22.680367+0000","last_active":"2024-09-12T18:33:22.680429+0000","last_peered":"2024-09-12T18:33:22.680429+0000","last_clean":"2024-09-12T18:33:22.680429+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:33:22.680429+0000","last_undegraded":"2024-09-12T18:33:22.680429+0000","last_fullsized":"2024-09-12T18:33:22.680429+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'347","last_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_deep_scrub":"262'347","last_deep_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.680245+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:30.990184+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":25007,"num_write":1079,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'463","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.634928+0000","last_change":"2024-09-12T18:33:24.634928+0000","last_active":"2024-09-12T18:33:24.634928+0000","last_peered":"2024-09-12T18:33:24.634928+0000","last_clean":"2024-09-12T18:33:24.634928+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:33:24.634928+0000","last_undegraded":"2024-09-12T18:33:24.634928+0000","last_fullsized":"2024-09-12T18:33:24.634928+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'463","last_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_deep_scrub":"262'463","last_deep_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.634835+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.682588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'325","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.976983+0000","last_change":"2024-09-12T18:33:21.976983+0000","last_active":"2024-09-12T18:33:21.976983+0000","last_peered":"2024-09-12T18:33:21.976983+0000","last_clean":"2024-09-12T18:33:21.976983+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:33:21.976983+0000","last_undegraded":"2024-09-12T18:33:21.976983+0000","last_fullsized":"2024-09-12T18:33:21.976983+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.976849+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:40.343209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":10934,"num_write":1041,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'858","reported_seq":2391,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.686947+0000","last_change":"2024-09-12T18:33:25.686890+0000","last_active":"2024-09-12T18:33:25.686947+0000","last_peered":"2024-09-12T18:33:25.686947+0000","last_clean":"2024-09-12T18:33:25.686947+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:33:25.686947+0000","last_undegraded":"2024-09-12T18:33:25.686947+0000","last_fullsized":"2024-09-12T18:33:25.686947+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'858","last_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_deep_scrub":"262'858","last_deep_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.686759+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:21.725139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'339","reported_seq":1142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.669828+0000","last_change":"2024-09-12T18:33:19.669828+0000","last_active":"2024-09-12T18:33:19.669828+0000","last_peered":"2024-09-12T18:33:19.669828+0000","last_clean":"2024-09-12T18:33:19.669828+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:33:19.669828+0000","last_undegraded":"2024-09-12T18:33:19.669828+0000","last_fullsized":"2024-09-12T18:33:19.669828+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.669637+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:57.288656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287593,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":903,"num_read_kb":42337,"num_write":1288,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2416,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.356890+0000","last_change":"2024-09-12T18:33:31.356822+0000","last_active":"2024-09-12T18:33:31.356890+0000","last_peered":"2024-09-12T18:33:31.356890+0000","last_clean":"2024-09-12T18:33:31.356890+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:33:31.356890+0000","last_undegraded":"2024-09-12T18:33:31.356890+0000","last_fullsized":"2024-09-12T18:33:31.356890+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'786","last_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_deep_scrub":"262'786","last_deep_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.356710+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:49.539854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'359","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.952233+0000","last_change":"2024-09-12T18:33:20.952233+0000","last_active":"2024-09-12T18:33:20.952233+0000","last_peered":"2024-09-12T18:33:20.952233+0000","last_clean":"2024-09-12T18:33:20.952233+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:33:20.952233+0000","last_undegraded":"2024-09-12T18:33:20.952233+0000","last_fullsized":"2024-09-12T18:33:20.952233+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.952116+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.745872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170843,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":26409,"num_write":1171,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'466","reported_seq":1972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.600823+0000","last_change":"2024-09-12T18:33:29.600741+0000","last_active":"2024-09-12T18:33:29.600823+0000","last_peered":"2024-09-12T18:33:29.600823+0000","last_clean":"2024-09-12T18:33:29.600823+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:33:29.600823+0000","last_undegraded":"2024-09-12T18:33:29.600823+0000","last_fullsized":"2024-09-12T18:33:29.600823+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'466","last_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_deep_scrub":"262'466","last_deep_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.600661+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:52.255182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'400","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.292029+0000","last_change":"2024-09-12T18:33:22.292029+0000","last_active":"2024-09-12T18:33:22.292029+0000","last_peered":"2024-09-12T18:33:22.292029+0000","last_clean":"2024-09-12T18:33:22.292029+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:33:22.292029+0000","last_undegraded":"2024-09-12T18:33:22.292029+0000","last_fullsized":"2024-09-12T18:33:22.292029+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'400","last_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_deep_scrub":"262'400","last_deep_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.291796+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:58.671981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":10679,"num_write":1254,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'487","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.075176+0000","last_change":"2024-09-12T18:33:21.075118+0000","last_active":"2024-09-12T18:33:21.075176+0000","last_peered":"2024-09-12T18:33:21.075176+0000","last_clean":"2024-09-12T18:33:21.075176+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:33:21.075176+0000","last_undegraded":"2024-09-12T18:33:21.075176+0000","last_fullsized":"2024-09-12T18:33:21.075176+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.075019+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:54.397374+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.300873+0000","last_change":"2024-09-12T18:33:28.300808+0000","last_active":"2024-09-12T18:33:28.300873+0000","last_peered":"2024-09-12T18:33:28.300873+0000","last_clean":"2024-09-12T18:33:28.300873+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:33:28.300873+0000","last_undegraded":"2024-09-12T18:33:28.300873+0000","last_fullsized":"2024-09-12T18:33:28.300873+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'760","last_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_deep_scrub":"262'760","last_deep_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.300716+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:14.805759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'355","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.957389+0000","last_change":"2024-09-12T18:33:19.957318+0000","last_active":"2024-09-12T18:33:19.957389+0000","last_peered":"2024-09-12T18:33:19.957389+0000","last_clean":"2024-09-12T18:33:19.957389+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:33:19.957389+0000","last_undegraded":"2024-09-12T18:33:19.957389+0000","last_fullsized":"2024-09-12T18:33:19.957389+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'355","last_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_deep_scrub":"262'355","last_deep_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.957207+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:43.487020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":71616,"num_write":1141,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'420","reported_seq":1944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.032683+0000","last_change":"2024-09-12T18:33:26.032588+0000","last_active":"2024-09-12T18:33:26.032683+0000","last_peered":"2024-09-12T18:33:26.032683+0000","last_clean":"2024-09-12T18:33:26.032683+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:33:26.032683+0000","last_undegraded":"2024-09-12T18:33:26.032683+0000","last_fullsized":"2024-09-12T18:33:26.032683+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.032490+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.483514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'319","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.672779+0000","last_change":"2024-09-12T18:33:18.672682+0000","last_active":"2024-09-12T18:33:18.672779+0000","last_peered":"2024-09-12T18:33:18.672779+0000","last_clean":"2024-09-12T18:33:18.672779+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:33:18.672779+0000","last_undegraded":"2024-09-12T18:33:18.672779+0000","last_fullsized":"2024-09-12T18:33:18.672779+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'319","last_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_deep_scrub":"262'319","last_deep_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.672393+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:47.254680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49172,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":3270,"num_write":1020,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'872","reported_seq":2494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.641439+0000","last_change":"2024-09-12T18:33:26.641379+0000","last_active":"2024-09-12T18:33:26.641439+0000","last_peered":"2024-09-12T18:33:26.641439+0000","last_clean":"2024-09-12T18:33:26.641439+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:33:26.641439+0000","last_undegraded":"2024-09-12T18:33:26.641439+0000","last_fullsized":"2024-09-12T18:33:26.641439+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'872","last_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_deep_scrub":"262'872","last_deep_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.641291+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.568382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'387","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.697556+0000","last_change":"2024-09-12T18:33:17.697469+0000","last_active":"2024-09-12T18:33:17.697556+0000","last_peered":"2024-09-12T18:33:17.697556+0000","last_clean":"2024-09-12T18:33:17.697556+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:33:17.697556+0000","last_undegraded":"2024-09-12T18:33:17.697556+0000","last_fullsized":"2024-09-12T18:33:17.697556+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'387","last_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_deep_scrub":"262'387","last_deep_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.697260+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:05.335710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":65942,"num_write":1264,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1106","reported_seq":2620,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.099467+0000","last_change":"2024-09-12T18:33:19.099374+0000","last_active":"2024-09-12T18:33:19.099467+0000","last_peered":"2024-09-12T18:33:19.099467+0000","last_clean":"2024-09-12T18:33:19.099467+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:33:19.099467+0000","last_undegraded":"2024-09-12T18:33:19.099467+0000","last_fullsized":"2024-09-12T18:33:19.099467+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1106","last_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_deep_scrub":"262'1106","last_deep_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.099250+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":1000,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:44.344091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'292","reported_seq":1067,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.238977+0000","last_change":"2024-09-12T18:33:15.238905+0000","last_active":"2024-09-12T18:33:15.238977+0000","last_peered":"2024-09-12T18:33:15.238977+0000","last_clean":"2024-09-12T18:33:15.238977+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:15.238977+0000","last_undegraded":"2024-09-12T18:33:15.238977+0000","last_fullsized":"2024-09-12T18:33:15.238977+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.238775+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.181757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":760,"num_read_kb":33658,"num_write":1067,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'615","reported_seq":2390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.104238+0000","last_change":"2024-09-12T18:33:20.104176+0000","last_active":"2024-09-12T18:33:20.104238+0000","last_peered":"2024-09-12T18:33:20.104238+0000","last_clean":"2024-09-12T18:33:20.104238+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:33:20.104238+0000","last_undegraded":"2024-09-12T18:33:20.104238+0000","last_fullsized":"2024-09-12T18:33:20.104238+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'615","last_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_deep_scrub":"262'615","last_deep_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.104093+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:14.426305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3278,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'324","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.256820+0000","last_change":"2024-09-12T18:33:21.256705+0000","last_active":"2024-09-12T18:33:21.256820+0000","last_peered":"2024-09-12T18:33:21.256820+0000","last_clean":"2024-09-12T18:33:21.256820+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:33:21.256820+0000","last_undegraded":"2024-09-12T18:33:21.256820+0000","last_fullsized":"2024-09-12T18:33:21.256820+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.256481+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:27.688415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452413,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":42765,"num_write":983,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'308","reported_seq":1690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.287422+0000","last_change":"2024-09-12T18:33:29.287368+0000","last_active":"2024-09-12T18:33:29.287422+0000","last_peered":"2024-09-12T18:33:29.287422+0000","last_clean":"2024-09-12T18:33:29.287422+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:33:29.287422+0000","last_undegraded":"2024-09-12T18:33:29.287422+0000","last_fullsized":"2024-09-12T18:33:29.287422+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'308","last_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_deep_scrub":"262'308","last_deep_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.287289+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.869873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'376","reported_seq":1070,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.613430+0000","last_change":"2024-09-12T18:33:15.613356+0000","last_active":"2024-09-12T18:33:15.613430+0000","last_peered":"2024-09-12T18:33:15.613430+0000","last_clean":"2024-09-12T18:33:15.613430+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:33:15.613430+0000","last_undegraded":"2024-09-12T18:33:15.613430+0000","last_fullsized":"2024-09-12T18:33:15.613430+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.613239+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:10.394785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5481568,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":590,"num_read_kb":95728,"num_write":1139,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'131","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.436104+0000","last_change":"2024-09-12T18:33:46.435999+0000","last_active":"2024-09-12T18:33:46.436104+0000","last_peered":"2024-09-12T18:33:46.436104+0000","last_clean":"2024-09-12T18:33:46.436104+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:33:46.436104+0000","last_undegraded":"2024-09-12T18:33:46.436104+0000","last_fullsized":"2024-09-12T18:33:46.436104+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.435880+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:52.500901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'777","reported_seq":2379,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.354132+0000","last_change":"2024-09-12T18:33:31.354132+0000","last_active":"2024-09-12T18:33:31.354132+0000","last_peered":"2024-09-12T18:33:31.354132+0000","last_clean":"2024-09-12T18:33:31.354132+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:33:31.354132+0000","last_undegraded":"2024-09-12T18:33:31.354132+0000","last_fullsized":"2024-09-12T18:33:31.354132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'777","last_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_deep_scrub":"262'777","last_deep_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.354052+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.571288+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'350","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.989308+0000","last_change":"2024-09-12T18:33:16.989242+0000","last_active":"2024-09-12T18:33:16.989308+0000","last_peered":"2024-09-12T18:33:16.989308+0000","last_clean":"2024-09-12T18:33:16.989308+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:33:16.989308+0000","last_undegraded":"2024-09-12T18:33:16.989308+0000","last_fullsized":"2024-09-12T18:33:16.989308+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'350","last_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_deep_scrub":"262'350","last_deep_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.989082+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.856138+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424710,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":775,"num_read_kb":10756,"num_write":1135,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.608311+0000","last_change":"2024-09-12T18:33:32.608235+0000","last_active":"2024-09-12T18:33:32.608311+0000","last_peered":"2024-09-12T18:33:32.608311+0000","last_clean":"2024-09-12T18:33:32.608311+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:33:32.608311+0000","last_undegraded":"2024-09-12T18:33:32.608311+0000","last_fullsized":"2024-09-12T18:33:32.608311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.608146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:01.224220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'345","reported_seq":958,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.658758+0000","last_change":"2024-09-12T18:33:32.658656+0000","last_active":"2024-09-12T18:33:32.658758+0000","last_peered":"2024-09-12T18:33:32.658758+0000","last_clean":"2024-09-12T18:33:32.658758+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:33:32.658758+0000","last_undegraded":"2024-09-12T18:33:32.658758+0000","last_fullsized":"2024-09-12T18:33:32.658758+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.658547+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:56.181606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1162,"num_write":438,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.090112+0000","last_change":"2024-09-12T18:33:41.090051+0000","last_active":"2024-09-12T18:33:41.090112+0000","last_peered":"2024-09-12T18:33:41.090112+0000","last_clean":"2024-09-12T18:33:41.090112+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:33:41.090112+0000","last_undegraded":"2024-09-12T18:33:41.090112+0000","last_fullsized":"2024-09-12T18:33:41.090112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.089965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:10.358903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'162","reported_seq":720,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.710251+0000","last_change":"2024-09-12T18:33:45.710192+0000","last_active":"2024-09-12T18:33:45.710251+0000","last_peered":"2024-09-12T18:33:45.710251+0000","last_clean":"2024-09-12T18:33:45.710251+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:33:45.710251+0000","last_undegraded":"2024-09-12T18:33:45.710251+0000","last_fullsized":"2024-09-12T18:33:45.710251+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.710098+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:46.772373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'480","reported_seq":2076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.693703+0000","last_change":"2024-09-12T18:33:23.693653+0000","last_active":"2024-09-12T18:33:23.693703+0000","last_peered":"2024-09-12T18:33:23.693703+0000","last_clean":"2024-09-12T18:33:23.693703+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:33:23.693703+0000","last_undegraded":"2024-09-12T18:33:23.693703+0000","last_fullsized":"2024-09-12T18:33:23.693703+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'480","last_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_deep_scrub":"262'480","last_deep_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.693570+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:07.678162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'420","reported_seq":1117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.540227+0000","last_change":"2024-09-12T18:33:11.540174+0000","last_active":"2024-09-12T18:33:11.540227+0000","last_peered":"2024-09-12T18:33:11.540227+0000","last_clean":"2024-09-12T18:33:11.540227+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:33:11.540227+0000","last_undegraded":"2024-09-12T18:33:11.540227+0000","last_fullsized":"2024-09-12T18:33:11.540227+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.540056+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:31.139934+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468829,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":675,"num_read_kb":80579,"num_write":1292,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.341205+0000","last_change":"2024-09-12T18:33:38.341205+0000","last_active":"2024-09-12T18:33:38.341205+0000","last_peered":"2024-09-12T18:33:38.341205+0000","last_clean":"2024-09-12T18:33:38.341205+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:33:38.341205+0000","last_undegraded":"2024-09-12T18:33:38.341205+0000","last_fullsized":"2024-09-12T18:33:38.341205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.341117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:17.987429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'92","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.290482+0000","last_change":"2024-09-12T18:33:38.290382+0000","last_active":"2024-09-12T18:33:38.290482+0000","last_peered":"2024-09-12T18:33:38.290482+0000","last_clean":"2024-09-12T18:33:38.290482+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:33:38.290482+0000","last_undegraded":"2024-09-12T18:33:38.290482+0000","last_fullsized":"2024-09-12T18:33:38.290482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'92","last_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_deep_scrub":"262'92","last_deep_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.290283+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:04.859768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.338961+0000","last_change":"2024-09-12T18:33:42.338879+0000","last_active":"2024-09-12T18:33:42.338961+0000","last_peered":"2024-09-12T18:33:42.338961+0000","last_clean":"2024-09-12T18:33:42.338961+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:33:42.338961+0000","last_undegraded":"2024-09-12T18:33:42.338961+0000","last_fullsized":"2024-09-12T18:33:42.338961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.338782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:35.618694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'176","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.740708+0000","last_change":"2024-09-12T18:33:46.740708+0000","last_active":"2024-09-12T18:33:46.740708+0000","last_peered":"2024-09-12T18:33:46.740708+0000","last_clean":"2024-09-12T18:33:46.740708+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:33:46.740708+0000","last_undegraded":"2024-09-12T18:33:46.740708+0000","last_fullsized":"2024-09-12T18:33:46.740708+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.740623+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:29.705946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1215","reported_seq":2944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.625377+0000","last_change":"2024-09-12T18:33:21.625322+0000","last_active":"2024-09-12T18:33:21.625377+0000","last_peered":"2024-09-12T18:33:21.625377+0000","last_clean":"2024-09-12T18:33:21.625377+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:33:21.625377+0000","last_undegraded":"2024-09-12T18:33:21.625377+0000","last_fullsized":"2024-09-12T18:33:21.625377+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1215","last_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_deep_scrub":"262'1215","last_deep_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.625227+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.877851+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'399","reported_seq":1054,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.014002+0000","last_change":"2024-09-12T18:33:15.013929+0000","last_active":"2024-09-12T18:33:15.014002+0000","last_peered":"2024-09-12T18:33:15.014002+0000","last_clean":"2024-09-12T18:33:15.014002+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:33:15.014002+0000","last_undegraded":"2024-09-12T18:33:15.014002+0000","last_fullsized":"2024-09-12T18:33:15.014002+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.013801+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:15.692669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386468,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":554,"num_read_kb":8447,"num_write":1280,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.356723+0000","last_change":"2024-09-12T18:33:36.356617+0000","last_active":"2024-09-12T18:33:36.356723+0000","last_peered":"2024-09-12T18:33:36.356723+0000","last_clean":"2024-09-12T18:33:36.356723+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:33:36.356723+0000","last_undegraded":"2024-09-12T18:33:36.356723+0000","last_fullsized":"2024-09-12T18:33:36.356723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.356499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'127","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.152071+0000","last_change":"2024-09-12T18:33:29.152071+0000","last_active":"2024-09-12T18:33:29.152071+0000","last_peered":"2024-09-12T18:33:29.152071+0000","last_clean":"2024-09-12T18:33:29.152071+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:33:29.152071+0000","last_undegraded":"2024-09-12T18:33:29.152071+0000","last_fullsized":"2024-09-12T18:33:29.152071+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.151970+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:49.592865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'764","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.112566+0000","last_change":"2024-09-12T18:33:40.112474+0000","last_active":"2024-09-12T18:33:40.112566+0000","last_peered":"2024-09-12T18:33:40.112566+0000","last_clean":"2024-09-12T18:33:40.112566+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:33:40.112566+0000","last_undegraded":"2024-09-12T18:33:40.112566+0000","last_fullsized":"2024-09-12T18:33:40.112566+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'764","last_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_deep_scrub":"262'764","last_deep_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.112394+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:40.492683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'232","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.439968+0000","last_change":"2024-09-12T18:33:48.439968+0000","last_active":"2024-09-12T18:33:48.439968+0000","last_peered":"2024-09-12T18:33:48.439968+0000","last_clean":"2024-09-12T18:33:48.439968+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:33:48.439968+0000","last_undegraded":"2024-09-12T18:33:48.439968+0000","last_fullsized":"2024-09-12T18:33:48.439968+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.439884+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:58.280243+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'673","reported_seq":2094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.396572+0000","last_change":"2024-09-12T18:33:27.396515+0000","last_active":"2024-09-12T18:33:27.396572+0000","last_peered":"2024-09-12T18:33:27.396572+0000","last_clean":"2024-09-12T18:33:27.396572+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:33:27.396572+0000","last_undegraded":"2024-09-12T18:33:27.396572+0000","last_fullsized":"2024-09-12T18:33:27.396572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'673","last_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_deep_scrub":"262'673","last_deep_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.396425+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:51.901322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'341","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.715500+0000","last_change":"2024-09-12T18:33:14.715413+0000","last_active":"2024-09-12T18:33:14.715500+0000","last_peered":"2024-09-12T18:33:14.715500+0000","last_clean":"2024-09-12T18:33:14.715500+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:33:14.715500+0000","last_undegraded":"2024-09-12T18:33:14.715500+0000","last_fullsized":"2024-09-12T18:33:14.715500+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.715259+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:05.915818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399179,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":57705,"num_write":1124,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.621558+0000","last_change":"2024-09-12T18:33:33.621485+0000","last_active":"2024-09-12T18:33:33.621558+0000","last_peered":"2024-09-12T18:33:33.621558+0000","last_clean":"2024-09-12T18:33:33.621558+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:33:33.621558+0000","last_undegraded":"2024-09-12T18:33:33.621558+0000","last_fullsized":"2024-09-12T18:33:33.621558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.621371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:49.117251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'282","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.181143+0000","last_change":"2024-09-12T18:33:37.181082+0000","last_active":"2024-09-12T18:33:37.181143+0000","last_peered":"2024-09-12T18:33:37.181143+0000","last_clean":"2024-09-12T18:33:37.181143+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:33:37.181143+0000","last_undegraded":"2024-09-12T18:33:37.181143+0000","last_fullsized":"2024-09-12T18:33:37.181143+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.180990+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:25.430774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1082,"num_write":378,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'819","reported_seq":2362,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.348692+0000","last_change":"2024-09-12T18:33:47.348692+0000","last_active":"2024-09-12T18:33:47.348692+0000","last_peered":"2024-09-12T18:33:47.348692+0000","last_clean":"2024-09-12T18:33:47.348692+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:33:47.348692+0000","last_undegraded":"2024-09-12T18:33:47.348692+0000","last_fullsized":"2024-09-12T18:33:47.348692+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.348609+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.230213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'542","reported_seq":2121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.657819+0000","last_change":"2024-09-12T18:33:24.657751+0000","last_active":"2024-09-12T18:33:24.657819+0000","last_peered":"2024-09-12T18:33:24.657819+0000","last_clean":"2024-09-12T18:33:24.657819+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:33:24.657819+0000","last_undegraded":"2024-09-12T18:33:24.657819+0000","last_fullsized":"2024-09-12T18:33:24.657819+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.657662+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:53.428163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2021,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'394","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.039545+0000","last_change":"2024-09-12T18:33:14.039545+0000","last_active":"2024-09-12T18:33:14.039545+0000","last_peered":"2024-09-12T18:33:14.039545+0000","last_clean":"2024-09-12T18:33:14.039545+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:33:14.039545+0000","last_undegraded":"2024-09-12T18:33:14.039545+0000","last_fullsized":"2024-09-12T18:33:14.039545+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.039390+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:37.692448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512425,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":23815,"num_write":1238,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.090664+0000","last_change":"2024-09-12T18:33:28.090664+0000","last_active":"2024-09-12T18:33:28.090664+0000","last_peered":"2024-09-12T18:33:28.090664+0000","last_clean":"2024-09-12T18:33:28.090664+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:33:28.090664+0000","last_undegraded":"2024-09-12T18:33:28.090664+0000","last_fullsized":"2024-09-12T18:33:28.090664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.090568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:48.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'375","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.647244+0000","last_change":"2024-09-12T18:33:36.647244+0000","last_active":"2024-09-12T18:33:36.647244+0000","last_peered":"2024-09-12T18:33:36.647244+0000","last_clean":"2024-09-12T18:33:36.647244+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:33:36.647244+0000","last_undegraded":"2024-09-12T18:33:36.647244+0000","last_fullsized":"2024-09-12T18:33:36.647244+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.647139+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:42.082985+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45931,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":1150,"num_write":454,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.611701+0000","last_change":"2024-09-12T18:33:31.611701+0000","last_active":"2024-09-12T18:33:31.611701+0000","last_peered":"2024-09-12T18:33:31.611701+0000","last_clean":"2024-09-12T18:33:31.611701+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:33:31.611701+0000","last_undegraded":"2024-09-12T18:33:31.611701+0000","last_fullsized":"2024-09-12T18:33:31.611701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.611583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.249892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'588","reported_seq":1449,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.673375+0000","last_change":"2024-09-12T18:33:43.673311+0000","last_active":"2024-09-12T18:33:43.673375+0000","last_peered":"2024-09-12T18:33:43.673375+0000","last_clean":"2024-09-12T18:33:43.673375+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:33:43.673375+0000","last_undegraded":"2024-09-12T18:33:43.673375+0000","last_fullsized":"2024-09-12T18:33:43.673375+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'588","last_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_deep_scrub":"262'588","last_deep_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.673226+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.941746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'544","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.216879+0000","last_change":"2024-09-12T18:33:17.216806+0000","last_active":"2024-09-12T18:33:17.216879+0000","last_peered":"2024-09-12T18:33:17.216879+0000","last_clean":"2024-09-12T18:33:17.216879+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:33:17.216879+0000","last_undegraded":"2024-09-12T18:33:17.216879+0000","last_fullsized":"2024-09-12T18:33:17.216879+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'544","last_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_deep_scrub":"262'544","last_deep_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.216707+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.670785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'393","reported_seq":1039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.215990+0000","last_change":"2024-09-12T18:33:15.215990+0000","last_active":"2024-09-12T18:33:15.215990+0000","last_peered":"2024-09-12T18:33:15.215990+0000","last_clean":"2024-09-12T18:33:15.215990+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:33:15.215990+0000","last_undegraded":"2024-09-12T18:33:15.215990+0000","last_fullsized":"2024-09-12T18:33:15.215990+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'393","last_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_deep_scrub":"262'393","last_deep_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.215872+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:55.176918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":15948,"num_write":1231,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.079381+0000","last_change":"2024-09-12T18:33:26.079381+0000","last_active":"2024-09-12T18:33:26.079381+0000","last_peered":"2024-09-12T18:33:26.079381+0000","last_clean":"2024-09-12T18:33:26.079381+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:33:26.079381+0000","last_undegraded":"2024-09-12T18:33:26.079381+0000","last_fullsized":"2024-09-12T18:33:26.079381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.079288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:46.736637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'277","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.369936+0000","last_change":"2024-09-12T18:33:37.369936+0000","last_active":"2024-09-12T18:33:37.369936+0000","last_peered":"2024-09-12T18:33:37.369936+0000","last_clean":"2024-09-12T18:33:37.369936+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:33:37.369936+0000","last_undegraded":"2024-09-12T18:33:37.369936+0000","last_fullsized":"2024-09-12T18:33:37.369936+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.369842+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:52.872806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47879,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1045,"num_write":366,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.319279+0000","last_change":"2024-09-12T18:33:48.319279+0000","last_active":"2024-09-12T18:33:48.319279+0000","last_peered":"2024-09-12T18:33:48.319279+0000","last_clean":"2024-09-12T18:33:48.319279+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:33:48.319279+0000","last_undegraded":"2024-09-12T18:33:48.319279+0000","last_fullsized":"2024-09-12T18:33:48.319279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.319179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:54.098870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2400","reported_seq":4245,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.748814+0000","last_change":"2024-09-12T18:33:33.748814+0000","last_active":"2024-09-12T18:33:33.748814+0000","last_peered":"2024-09-12T18:33:33.748814+0000","last_clean":"2024-09-12T18:33:33.748814+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:33:33.748814+0000","last_undegraded":"2024-09-12T18:33:33.748814+0000","last_fullsized":"2024-09-12T18:33:33.748814+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2400","last_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_deep_scrub":"262'2400","last_deep_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.748704+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:42.848648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1123","reported_seq":2592,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.691930+0000","last_change":"2024-09-12T18:33:21.691930+0000","last_active":"2024-09-12T18:33:21.691930+0000","last_peered":"2024-09-12T18:33:21.691930+0000","last_clean":"2024-09-12T18:33:21.691930+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:33:21.691930+0000","last_undegraded":"2024-09-12T18:33:21.691930+0000","last_fullsized":"2024-09-12T18:33:21.691930+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1123","last_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_deep_scrub":"262'1123","last_deep_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.691845+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":1100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:09.232918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'336","reported_seq":1014,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.086221+0000","last_change":"2024-09-12T18:33:12.086221+0000","last_active":"2024-09-12T18:33:12.086221+0000","last_peered":"2024-09-12T18:33:12.086221+0000","last_clean":"2024-09-12T18:33:12.086221+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:33:12.086221+0000","last_undegraded":"2024-09-12T18:33:12.086221+0000","last_fullsized":"2024-09-12T18:33:12.086221+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.086103+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:25.986928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4614985,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":185869,"num_write":1150,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.088545+0000","last_change":"2024-09-12T18:33:27.088545+0000","last_active":"2024-09-12T18:33:27.088545+0000","last_peered":"2024-09-12T18:33:27.088545+0000","last_clean":"2024-09-12T18:33:27.088545+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:33:27.088545+0000","last_undegraded":"2024-09-12T18:33:27.088545+0000","last_fullsized":"2024-09-12T18:33:27.088545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.088448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:18.854173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'331","reported_seq":925,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.118752+0000","last_change":"2024-09-12T18:33:32.118752+0000","last_active":"2024-09-12T18:33:32.118752+0000","last_peered":"2024-09-12T18:33:32.118752+0000","last_clean":"2024-09-12T18:33:32.118752+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:33:32.118752+0000","last_undegraded":"2024-09-12T18:33:32.118752+0000","last_fullsized":"2024-09-12T18:33:32.118752+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.118640+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:59.747985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49626,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":529,"num_read_kb":1160,"num_write":428,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'791","reported_seq":4767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.808463+0000","last_change":"2024-09-12T18:33:37.808463+0000","last_active":"2024-09-12T18:33:37.808463+0000","last_peered":"2024-09-12T18:33:37.808463+0000","last_clean":"2024-09-12T18:33:37.808463+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:33:37.808463+0000","last_undegraded":"2024-09-12T18:33:37.808463+0000","last_fullsized":"2024-09-12T18:33:37.808463+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'791","last_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_deep_scrub":"262'791","last_deep_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.808355+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.046104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'118","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.708437+0000","last_change":"2024-09-12T18:33:43.708437+0000","last_active":"2024-09-12T18:33:43.708437+0000","last_peered":"2024-09-12T18:33:43.708437+0000","last_clean":"2024-09-12T18:33:43.708437+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:33:43.708437+0000","last_undegraded":"2024-09-12T18:33:43.708437+0000","last_fullsized":"2024-09-12T18:33:43.708437+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.708371+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:01.056983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'520","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.619106+0000","last_change":"2024-09-12T18:33:25.619048+0000","last_active":"2024-09-12T18:33:25.619106+0000","last_peered":"2024-09-12T18:33:25.619106+0000","last_clean":"2024-09-12T18:33:25.619106+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:33:25.619106+0000","last_undegraded":"2024-09-12T18:33:25.619106+0000","last_fullsized":"2024-09-12T18:33:25.619106+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'520","last_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_deep_scrub":"262'520","last_deep_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.618938+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.541602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'349","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.659217+0000","last_change":"2024-09-12T18:33:15.659128+0000","last_active":"2024-09-12T18:33:15.659217+0000","last_peered":"2024-09-12T18:33:15.659217+0000","last_clean":"2024-09-12T18:33:15.659217+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:33:15.659217+0000","last_undegraded":"2024-09-12T18:33:15.659217+0000","last_fullsized":"2024-09-12T18:33:15.659217+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'349","last_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_deep_scrub":"262'349","last_deep_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.658993+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:57.692359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399009,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":648,"num_read_kb":11855,"num_write":1224,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.132737+0000","last_change":"2024-09-12T18:33:24.132737+0000","last_active":"2024-09-12T18:33:24.132737+0000","last_peered":"2024-09-12T18:33:24.132737+0000","last_clean":"2024-09-12T18:33:24.132737+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:33:24.132737+0000","last_undegraded":"2024-09-12T18:33:24.132737+0000","last_fullsized":"2024-09-12T18:33:24.132737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.132652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:47.476929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'483","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.697675+0000","last_change":"2024-09-12T18:33:31.697675+0000","last_active":"2024-09-12T18:33:31.697675+0000","last_peered":"2024-09-12T18:33:31.697675+0000","last_clean":"2024-09-12T18:33:31.697675+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:33:31.697675+0000","last_undegraded":"2024-09-12T18:33:31.697675+0000","last_fullsized":"2024-09-12T18:33:31.697675+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.697587+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:36.471785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":2056,"num_write":694,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.118962+0000","last_change":"2024-09-12T18:33:33.118962+0000","last_active":"2024-09-12T18:33:33.118962+0000","last_peered":"2024-09-12T18:33:33.118962+0000","last_clean":"2024-09-12T18:33:33.118962+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:33:33.118962+0000","last_undegraded":"2024-09-12T18:33:33.118962+0000","last_fullsized":"2024-09-12T18:33:33.118962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.118887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:16.556316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'165","reported_seq":696,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.564112+0000","last_change":"2024-09-12T18:33:38.564112+0000","last_active":"2024-09-12T18:33:38.564112+0000","last_peered":"2024-09-12T18:33:38.564112+0000","last_clean":"2024-09-12T18:33:38.564112+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:33:38.564112+0000","last_undegraded":"2024-09-12T18:33:38.564112+0000","last_fullsized":"2024-09-12T18:33:38.564112+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.564022+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:01.761974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'555","reported_seq":2203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.239491+0000","last_change":"2024-09-12T18:33:19.239412+0000","last_active":"2024-09-12T18:33:19.239491+0000","last_peered":"2024-09-12T18:33:19.239491+0000","last_clean":"2024-09-12T18:33:19.239491+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:33:19.239491+0000","last_undegraded":"2024-09-12T18:33:19.239491+0000","last_fullsized":"2024-09-12T18:33:19.239491+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'555","last_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_deep_scrub":"262'555","last_deep_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.239331+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:45.930298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'381","reported_seq":1211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.171387+0000","last_change":"2024-09-12T18:33:14.171237+0000","last_active":"2024-09-12T18:33:14.171387+0000","last_peered":"2024-09-12T18:33:14.171387+0000","last_clean":"2024-09-12T18:33:14.171387+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:33:14.171387+0000","last_undegraded":"2024-09-12T18:33:14.171387+0000","last_fullsized":"2024-09-12T18:33:14.171387+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'381","last_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_deep_scrub":"262'381","last_deep_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.171043+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:04.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":952,"num_read_kb":1817,"num_write":1243,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.119518+0000","last_change":"2024-09-12T18:33:25.119518+0000","last_active":"2024-09-12T18:33:25.119518+0000","last_peered":"2024-09-12T18:33:25.119518+0000","last_clean":"2024-09-12T18:33:25.119518+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:33:25.119518+0000","last_undegraded":"2024-09-12T18:33:25.119518+0000","last_fullsized":"2024-09-12T18:33:25.119518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.119405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:06.087705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'298","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.275377+0000","last_change":"2024-09-12T18:33:37.275377+0000","last_active":"2024-09-12T18:33:37.275377+0000","last_peered":"2024-09-12T18:33:37.275377+0000","last_clean":"2024-09-12T18:33:37.275377+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:33:37.275377+0000","last_undegraded":"2024-09-12T18:33:37.275377+0000","last_fullsized":"2024-09-12T18:33:37.275377+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.275279+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:10.198848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47571,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1071,"num_write":444,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.769070+0000","last_change":"2024-09-12T18:33:38.769070+0000","last_active":"2024-09-12T18:33:38.769070+0000","last_peered":"2024-09-12T18:33:38.769070+0000","last_clean":"2024-09-12T18:33:38.769070+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:33:38.769070+0000","last_undegraded":"2024-09-12T18:33:38.769070+0000","last_fullsized":"2024-09-12T18:33:38.769070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.768975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:12.755941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'97","reported_seq":593,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.288176+0000","last_change":"2024-09-12T18:33:51.288112+0000","last_active":"2024-09-12T18:33:51.288176+0000","last_peered":"2024-09-12T18:33:51.288176+0000","last_clean":"2024-09-12T18:33:51.288176+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:33:51.288176+0000","last_undegraded":"2024-09-12T18:33:51.288176+0000","last_fullsized":"2024-09-12T18:33:51.288176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'97","last_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_deep_scrub":"262'97","last_deep_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.288022+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:57.163162+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'574","reported_seq":2089,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.219222+0000","last_change":"2024-09-12T18:33:18.219164+0000","last_active":"2024-09-12T18:33:18.219222+0000","last_peered":"2024-09-12T18:33:18.219222+0000","last_clean":"2024-09-12T18:33:18.219222+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:33:18.219222+0000","last_undegraded":"2024-09-12T18:33:18.219222+0000","last_fullsized":"2024-09-12T18:33:18.219222+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.219044+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.862000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'374","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.728566+0000","last_change":"2024-09-12T18:33:13.728566+0000","last_active":"2024-09-12T18:33:13.728566+0000","last_peered":"2024-09-12T18:33:13.728566+0000","last_clean":"2024-09-12T18:33:13.728566+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:33:13.728566+0000","last_undegraded":"2024-09-12T18:33:13.728566+0000","last_fullsized":"2024-09-12T18:33:13.728566+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'374","last_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_deep_scrub":"262'374","last_deep_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.728424+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:02.902426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30147,"num_write":1155,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"262'6","reported_seq":986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.630372+0000","last_change":"2024-09-12T18:33:25.630372+0000","last_active":"2024-09-12T18:33:25.630372+0000","last_peered":"2024-09-12T18:33:25.630372+0000","last_clean":"2024-09-12T18:33:25.630372+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:33:25.630372+0000","last_undegraded":"2024-09-12T18:33:25.630372+0000","last_fullsized":"2024-09-12T18:33:25.630372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.630267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:05.121838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'320","reported_seq":918,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.109281+0000","last_change":"2024-09-12T18:33:28.109281+0000","last_active":"2024-09-12T18:33:28.109281+0000","last_peered":"2024-09-12T18:33:28.109281+0000","last_clean":"2024-09-12T18:33:28.109281+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:33:28.109281+0000","last_undegraded":"2024-09-12T18:33:28.109281+0000","last_fullsized":"2024-09-12T18:33:28.109281+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'320","last_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_deep_scrub":"262'320","last_deep_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.109177+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:16.884085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1126,"num_write":412,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'741","reported_seq":2539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.102053+0000","last_change":"2024-09-12T18:33:30.102053+0000","last_active":"2024-09-12T18:33:30.102053+0000","last_peered":"2024-09-12T18:33:30.102053+0000","last_clean":"2024-09-12T18:33:30.102053+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:33:30.102053+0000","last_undegraded":"2024-09-12T18:33:30.102053+0000","last_fullsized":"2024-09-12T18:33:30.102053+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'741","last_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_deep_scrub":"262'741","last_deep_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.101923+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:48.452566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.609173+0000","last_change":"2024-09-12T18:33:36.609114+0000","last_active":"2024-09-12T18:33:36.609173+0000","last_peered":"2024-09-12T18:33:36.609173+0000","last_clean":"2024-09-12T18:33:36.609173+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:33:36.609173+0000","last_undegraded":"2024-09-12T18:33:36.609173+0000","last_fullsized":"2024-09-12T18:33:36.609173+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.609016+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:23.806384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'392","reported_seq":1820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.266415+0000","last_change":"2024-09-12T18:33:20.266301+0000","last_active":"2024-09-12T18:33:20.266415+0000","last_peered":"2024-09-12T18:33:20.266415+0000","last_clean":"2024-09-12T18:33:20.266415+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:33:20.266415+0000","last_undegraded":"2024-09-12T18:33:20.266415+0000","last_fullsized":"2024-09-12T18:33:20.266415+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.266203+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:44.161180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'343","reported_seq":995,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.228767+0000","last_change":"2024-09-12T18:33:14.228696+0000","last_active":"2024-09-12T18:33:14.228767+0000","last_peered":"2024-09-12T18:33:14.228767+0000","last_clean":"2024-09-12T18:33:14.228767+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:14.228767+0000","last_undegraded":"2024-09-12T18:33:14.228767+0000","last_fullsized":"2024-09-12T18:33:14.228767+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'343","last_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_deep_scrub":"262'343","last_deep_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.228588+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.850074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":4238,"num_write":1153,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.577388+0000","last_change":"2024-09-12T18:33:31.577388+0000","last_active":"2024-09-12T18:33:31.577388+0000","last_peered":"2024-09-12T18:33:31.577388+0000","last_clean":"2024-09-12T18:33:31.577388+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:33:31.577388+0000","last_undegraded":"2024-09-12T18:33:31.577388+0000","last_fullsized":"2024-09-12T18:33:31.577388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.577293+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:13.603685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'100","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.309087+0000","last_change":"2024-09-12T18:33:43.309087+0000","last_active":"2024-09-12T18:33:43.309087+0000","last_peered":"2024-09-12T18:33:43.309087+0000","last_clean":"2024-09-12T18:33:43.309087+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:33:43.309087+0000","last_undegraded":"2024-09-12T18:33:43.309087+0000","last_fullsized":"2024-09-12T18:33:43.309087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.308986+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:25.653762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'780","reported_seq":2610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.729528+0000","last_change":"2024-09-12T18:33:30.729528+0000","last_active":"2024-09-12T18:33:30.729528+0000","last_peered":"2024-09-12T18:33:30.729528+0000","last_clean":"2024-09-12T18:33:30.729528+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:33:30.729528+0000","last_undegraded":"2024-09-12T18:33:30.729528+0000","last_fullsized":"2024-09-12T18:33:30.729528+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'780","last_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_deep_scrub":"262'780","last_deep_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.729444+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:31.980020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'109","reported_seq":619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.378689+0000","last_change":"2024-09-12T18:33:44.378623+0000","last_active":"2024-09-12T18:33:44.378689+0000","last_peered":"2024-09-12T18:33:44.378689+0000","last_clean":"2024-09-12T18:33:44.378689+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:33:44.378689+0000","last_undegraded":"2024-09-12T18:33:44.378689+0000","last_fullsized":"2024-09-12T18:33:44.378689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.378497+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.199226+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'457","reported_seq":2059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.674992+0000","last_change":"2024-09-12T18:33:24.674992+0000","last_active":"2024-09-12T18:33:24.674992+0000","last_peered":"2024-09-12T18:33:24.674992+0000","last_clean":"2024-09-12T18:33:24.674992+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:33:24.674992+0000","last_undegraded":"2024-09-12T18:33:24.674992+0000","last_fullsized":"2024-09-12T18:33:24.674992+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.674869+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:09.706871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'370","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.177745+0000","last_change":"2024-09-12T18:33:11.177644+0000","last_active":"2024-09-12T18:33:11.177745+0000","last_peered":"2024-09-12T18:33:11.177745+0000","last_clean":"2024-09-12T18:33:11.177745+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:33:11.177745+0000","last_undegraded":"2024-09-12T18:33:11.177745+0000","last_fullsized":"2024-09-12T18:33:11.177745+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.177401+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:34.320877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":622,"num_read_kb":18794,"num_write":1042,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.355707+0000","last_change":"2024-09-12T18:33:33.355707+0000","last_active":"2024-09-12T18:33:33.355707+0000","last_peered":"2024-09-12T18:33:33.355707+0000","last_clean":"2024-09-12T18:33:33.355707+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:33:33.355707+0000","last_undegraded":"2024-09-12T18:33:33.355707+0000","last_fullsized":"2024-09-12T18:33:33.355707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.355619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:16.546019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'359","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.632679+0000","last_change":"2024-09-12T18:33:37.632679+0000","last_active":"2024-09-12T18:33:37.632679+0000","last_peered":"2024-09-12T18:33:37.632679+0000","last_clean":"2024-09-12T18:33:37.632679+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:33:37.632679+0000","last_undegraded":"2024-09-12T18:33:37.632679+0000","last_fullsized":"2024-09-12T18:33:37.632679+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.632556+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.327875+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1185,"num_write":448,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.692945+0000","last_change":"2024-09-12T18:33:29.692945+0000","last_active":"2024-09-12T18:33:29.692945+0000","last_peered":"2024-09-12T18:33:29.692945+0000","last_clean":"2024-09-12T18:33:29.692945+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:33:29.692945+0000","last_undegraded":"2024-09-12T18:33:29.692945+0000","last_fullsized":"2024-09-12T18:33:29.692945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.692847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:00.807529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'125","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.607461+0000","last_change":"2024-09-12T18:33:37.607363+0000","last_active":"2024-09-12T18:33:37.607461+0000","last_peered":"2024-09-12T18:33:37.607461+0000","last_clean":"2024-09-12T18:33:37.607461+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:33:37.607461+0000","last_undegraded":"2024-09-12T18:33:37.607461+0000","last_fullsized":"2024-09-12T18:33:37.607461+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.607260+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.329098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'928","reported_seq":2668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.649178+0000","last_change":"2024-09-12T18:33:22.649116+0000","last_active":"2024-09-12T18:33:22.649178+0000","last_peered":"2024-09-12T18:33:22.649178+0000","last_clean":"2024-09-12T18:33:22.649178+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:33:22.649178+0000","last_undegraded":"2024-09-12T18:33:22.649178+0000","last_fullsized":"2024-09-12T18:33:22.649178+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'928","last_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_deep_scrub":"262'928","last_deep_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.648951+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:49.317398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.024561+0000","last_change":"2024-09-12T18:33:13.024500+0000","last_active":"2024-09-12T18:33:13.024561+0000","last_peered":"2024-09-12T18:33:13.024561+0000","last_clean":"2024-09-12T18:33:13.024561+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:33:13.024561+0000","last_undegraded":"2024-09-12T18:33:13.024561+0000","last_fullsized":"2024-09-12T18:33:13.024561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.024409+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.444574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":532,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.699824+0000","last_change":"2024-09-12T18:33:13.699741+0000","last_active":"2024-09-12T18:33:13.699824+0000","last_peered":"2024-09-12T18:33:13.699824+0000","last_clean":"2024-09-12T18:33:13.699824+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:33:13.699824+0000","last_undegraded":"2024-09-12T18:33:13.699824+0000","last_fullsized":"2024-09-12T18:33:13.699824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.699652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.289929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'314","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.163489+0000","last_change":"2024-09-12T18:33:12.163437+0000","last_active":"2024-09-12T18:33:12.163489+0000","last_peered":"2024-09-12T18:33:12.163489+0000","last_clean":"2024-09-12T18:33:12.163489+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:33:12.163489+0000","last_undegraded":"2024-09-12T18:33:12.163489+0000","last_fullsized":"2024-09-12T18:33:12.163489+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.163325+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:48.898263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":16545,"num_write":1010,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.096910+0000","last_change":"2024-09-12T18:33:29.096831+0000","last_active":"2024-09-12T18:33:29.096910+0000","last_peered":"2024-09-12T18:33:29.096910+0000","last_clean":"2024-09-12T18:33:29.096910+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:33:29.096910+0000","last_undegraded":"2024-09-12T18:33:29.096910+0000","last_fullsized":"2024-09-12T18:33:29.096910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.096728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:58.036440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'730","reported_seq":1438,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.603889+0000","last_change":"2024-09-12T18:33:35.603889+0000","last_active":"2024-09-12T18:33:35.603889+0000","last_peered":"2024-09-12T18:33:35.603889+0000","last_clean":"2024-09-12T18:33:35.603889+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:33:35.603889+0000","last_undegraded":"2024-09-12T18:33:35.603889+0000","last_fullsized":"2024-09-12T18:33:35.603889+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'730","last_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_deep_scrub":"262'730","last_deep_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.603786+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:41.577909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141929,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1422,"num_read_kb":3270,"num_write":1334,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89062,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.772578+0000","last_change":"2024-09-12T18:33:36.772578+0000","last_active":"2024-09-12T18:33:36.772578+0000","last_peered":"2024-09-12T18:33:36.772578+0000","last_clean":"2024-09-12T18:33:36.772578+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:33:36.772578+0000","last_undegraded":"2024-09-12T18:33:36.772578+0000","last_fullsized":"2024-09-12T18:33:36.772578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.772490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:45.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'188","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.751069+0000","last_change":"2024-09-12T18:33:35.751069+0000","last_active":"2024-09-12T18:33:35.751069+0000","last_peered":"2024-09-12T18:33:35.751069+0000","last_clean":"2024-09-12T18:33:35.751069+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:33:35.751069+0000","last_undegraded":"2024-09-12T18:33:35.751069+0000","last_fullsized":"2024-09-12T18:33:35.751069+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.750947+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.223486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'774","reported_seq":2229,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.642199+0000","last_change":"2024-09-12T18:33:18.642138+0000","last_active":"2024-09-12T18:33:18.642199+0000","last_peered":"2024-09-12T18:33:18.642199+0000","last_clean":"2024-09-12T18:33:18.642199+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:33:18.642199+0000","last_undegraded":"2024-09-12T18:33:18.642199+0000","last_fullsized":"2024-09-12T18:33:18.642199+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.642044+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:43.372937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.980769+0000","last_change":"2024-09-12T18:33:13.980705+0000","last_active":"2024-09-12T18:33:13.980769+0000","last_peered":"2024-09-12T18:33:13.980769+0000","last_clean":"2024-09-12T18:33:13.980769+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:33:13.980769+0000","last_undegraded":"2024-09-12T18:33:13.980769+0000","last_fullsized":"2024-09-12T18:33:13.980769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.980562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:37.681267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'360","reported_seq":1009,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.527002+0000","last_change":"2024-09-12T18:33:10.526881+0000","last_active":"2024-09-12T18:33:10.527002+0000","last_peered":"2024-09-12T18:33:10.527002+0000","last_clean":"2024-09-12T18:33:10.527002+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:33:10.527002+0000","last_undegraded":"2024-09-12T18:33:10.527002+0000","last_fullsized":"2024-09-12T18:33:10.527002+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'360","last_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_deep_scrub":"262'360","last_deep_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.526734+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:39.807485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493074,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":8966,"num_write":1133,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.623233+0000","last_change":"2024-09-12T18:33:30.623233+0000","last_active":"2024-09-12T18:33:30.623233+0000","last_peered":"2024-09-12T18:33:30.623233+0000","last_clean":"2024-09-12T18:33:30.623233+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:33:30.623233+0000","last_undegraded":"2024-09-12T18:33:30.623233+0000","last_fullsized":"2024-09-12T18:33:30.623233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.623129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:40.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1313","reported_seq":2944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.641708+0000","last_change":"2024-09-12T18:33:30.641646+0000","last_active":"2024-09-12T18:33:30.641708+0000","last_peered":"2024-09-12T18:33:30.641708+0000","last_clean":"2024-09-12T18:33:30.641708+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:33:30.641708+0000","last_undegraded":"2024-09-12T18:33:30.641708+0000","last_fullsized":"2024-09-12T18:33:30.641708+0000","mapping_epoch":30,"log_start":"262'1300","ondisk_log_start":"262'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1313","last_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_deep_scrub":"262'1313","last_deep_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.641550+0000","objects_scrubbed":11,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:54.537058+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2069,"num_read_kb":3913,"num_write":1176,"num_write_kb":1005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.140324+0000","last_change":"2024-09-12T18:33:39.140324+0000","last_active":"2024-09-12T18:33:39.140324+0000","last_peered":"2024-09-12T18:33:39.140324+0000","last_clean":"2024-09-12T18:33:39.140324+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:33:39.140324+0000","last_undegraded":"2024-09-12T18:33:39.140324+0000","last_fullsized":"2024-09-12T18:33:39.140324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.140223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:37.908935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'255","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.582810+0000","last_change":"2024-09-12T18:33:39.582810+0000","last_active":"2024-09-12T18:33:39.582810+0000","last_peered":"2024-09-12T18:33:39.582810+0000","last_clean":"2024-09-12T18:33:39.582810+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:33:39.582810+0000","last_undegraded":"2024-09-12T18:33:39.582810+0000","last_fullsized":"2024-09-12T18:33:39.582810+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'255","last_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_deep_scrub":"262'255","last_deep_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.582714+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:12.204164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'492","reported_seq":2078,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.578069+0000","last_change":"2024-09-12T18:33:19.577961+0000","last_active":"2024-09-12T18:33:19.578069+0000","last_peered":"2024-09-12T18:33:19.578069+0000","last_clean":"2024-09-12T18:33:19.578069+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:33:19.578069+0000","last_undegraded":"2024-09-12T18:33:19.578069+0000","last_fullsized":"2024-09-12T18:33:19.578069+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'492","last_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_deep_scrub":"262'492","last_deep_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.577829+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:20.823502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.033844+0000","last_change":"2024-09-12T18:33:11.033801+0000","last_active":"2024-09-12T18:33:11.033844+0000","last_peered":"2024-09-12T18:33:11.033844+0000","last_clean":"2024-09-12T18:33:11.033844+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:33:11.033844+0000","last_undegraded":"2024-09-12T18:33:11.033844+0000","last_fullsized":"2024-09-12T18:33:11.033844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.033735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:58.231249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'331","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.619986+0000","last_change":"2024-09-12T18:33:11.619922+0000","last_active":"2024-09-12T18:33:11.619986+0000","last_peered":"2024-09-12T18:33:11.619986+0000","last_clean":"2024-09-12T18:33:11.619986+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:33:11.619986+0000","last_undegraded":"2024-09-12T18:33:11.619986+0000","last_fullsized":"2024-09-12T18:33:11.619986+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.619798+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.863692+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":5597,"num_write":1146,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.139449+0000","last_change":"2024-09-12T18:33:23.139449+0000","last_active":"2024-09-12T18:33:23.139449+0000","last_peered":"2024-09-12T18:33:23.139449+0000","last_clean":"2024-09-12T18:33:23.139449+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:33:23.139449+0000","last_undegraded":"2024-09-12T18:33:23.139449+0000","last_fullsized":"2024-09-12T18:33:23.139449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.139366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:40.988736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'270","reported_seq":1504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.160919+0000","last_change":"2024-09-12T18:33:33.160919+0000","last_active":"2024-09-12T18:33:33.160919+0000","last_peered":"2024-09-12T18:33:33.160919+0000","last_clean":"2024-09-12T18:33:33.160919+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:33:33.160919+0000","last_undegraded":"2024-09-12T18:33:33.160919+0000","last_fullsized":"2024-09-12T18:33:33.160919+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.160821+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:28.353872+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.734542+0000","last_change":"2024-09-12T18:33:35.734478+0000","last_active":"2024-09-12T18:33:35.734542+0000","last_peered":"2024-09-12T18:33:35.734542+0000","last_clean":"2024-09-12T18:33:35.734542+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:33:35.734542+0000","last_undegraded":"2024-09-12T18:33:35.734542+0000","last_fullsized":"2024-09-12T18:33:35.734542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.734345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.078776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'286","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.322388+0000","last_change":"2024-09-12T18:33:49.322388+0000","last_active":"2024-09-12T18:33:49.322388+0000","last_peered":"2024-09-12T18:33:49.322388+0000","last_clean":"2024-09-12T18:33:49.322388+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:33:49.322388+0000","last_undegraded":"2024-09-12T18:33:49.322388+0000","last_fullsized":"2024-09-12T18:33:49.322388+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'286","last_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_deep_scrub":"262'286","last_deep_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.322271+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:03.810804+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'396","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.585138+0000","last_change":"2024-09-12T18:33:15.585034+0000","last_active":"2024-09-12T18:33:15.585138+0000","last_peered":"2024-09-12T18:33:15.585138+0000","last_clean":"2024-09-12T18:33:15.585138+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:33:15.585138+0000","last_undegraded":"2024-09-12T18:33:15.585138+0000","last_fullsized":"2024-09-12T18:33:15.585138+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.584923+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:08.823358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.668532+0000","last_change":"2024-09-12T18:33:12.668450+0000","last_active":"2024-09-12T18:33:12.668532+0000","last_peered":"2024-09-12T18:33:12.668532+0000","last_clean":"2024-09-12T18:33:12.668532+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:33:12.668532+0000","last_undegraded":"2024-09-12T18:33:12.668532+0000","last_fullsized":"2024-09-12T18:33:12.668532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.668348+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:16.360994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'318","reported_seq":964,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.277548+0000","last_change":"2024-09-12T18:33:11.277484+0000","last_active":"2024-09-12T18:33:11.277548+0000","last_peered":"2024-09-12T18:33:11.277548+0000","last_clean":"2024-09-12T18:33:11.277548+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:11.277548+0000","last_undegraded":"2024-09-12T18:33:11.277548+0000","last_fullsized":"2024-09-12T18:33:11.277548+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'318","last_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_deep_scrub":"262'318","last_deep_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.277353+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.314572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524430,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":24675,"num_write":1010,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.643041+0000","last_change":"2024-09-12T18:33:28.642978+0000","last_active":"2024-09-12T18:33:28.643041+0000","last_peered":"2024-09-12T18:33:28.643041+0000","last_clean":"2024-09-12T18:33:28.643041+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:33:28.643041+0000","last_undegraded":"2024-09-12T18:33:28.643041+0000","last_fullsized":"2024-09-12T18:33:28.643041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.642877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:30.605913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'134","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.359405+0000","last_change":"2024-09-12T18:33:40.359405+0000","last_active":"2024-09-12T18:33:40.359405+0000","last_peered":"2024-09-12T18:33:40.359405+0000","last_clean":"2024-09-12T18:33:40.359405+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:33:40.359405+0000","last_undegraded":"2024-09-12T18:33:40.359405+0000","last_fullsized":"2024-09-12T18:33:40.359405+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.359314+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:16.651907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.713622+0000","last_change":"2024-09-12T18:33:28.713622+0000","last_active":"2024-09-12T18:33:28.713622+0000","last_peered":"2024-09-12T18:33:28.713622+0000","last_clean":"2024-09-12T18:33:28.713622+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:33:28.713622+0000","last_undegraded":"2024-09-12T18:33:28.713622+0000","last_fullsized":"2024-09-12T18:33:28.713622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.713538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:28.237723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'124","reported_seq":682,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.674395+0000","last_change":"2024-09-12T18:33:41.674395+0000","last_active":"2024-09-12T18:33:41.674395+0000","last_peered":"2024-09-12T18:33:41.674395+0000","last_clean":"2024-09-12T18:33:41.674395+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:33:41.674395+0000","last_undegraded":"2024-09-12T18:33:41.674395+0000","last_fullsized":"2024-09-12T18:33:41.674395+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.674307+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:10.525733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'754","reported_seq":2212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.610760+0000","last_change":"2024-09-12T18:33:16.610690+0000","last_active":"2024-09-12T18:33:16.610760+0000","last_peered":"2024-09-12T18:33:16.610760+0000","last_clean":"2024-09-12T18:33:16.610760+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:33:16.610760+0000","last_undegraded":"2024-09-12T18:33:16.610760+0000","last_fullsized":"2024-09-12T18:33:16.610760+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'754","last_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_deep_scrub":"262'754","last_deep_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.610589+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:33.968420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'326","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.624440+0000","last_change":"2024-09-12T18:33:11.624372+0000","last_active":"2024-09-12T18:33:11.624440+0000","last_peered":"2024-09-12T18:33:11.624440+0000","last_clean":"2024-09-12T18:33:11.624440+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:33:11.624440+0000","last_undegraded":"2024-09-12T18:33:11.624440+0000","last_fullsized":"2024-09-12T18:33:11.624440+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'326","last_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_deep_scrub":"262'326","last_deep_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.624231+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:49.428871+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":16635,"num_write":1112,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.624608+0000","last_change":"2024-09-12T18:33:10.624559+0000","last_active":"2024-09-12T18:33:10.624608+0000","last_peered":"2024-09-12T18:33:10.624608+0000","last_clean":"2024-09-12T18:33:10.624608+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:33:10.624608+0000","last_undegraded":"2024-09-12T18:33:10.624608+0000","last_fullsized":"2024-09-12T18:33:10.624608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.624487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:45.146624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.683081+0000","last_change":"2024-09-12T18:33:27.683023+0000","last_active":"2024-09-12T18:33:27.683081+0000","last_peered":"2024-09-12T18:33:27.683081+0000","last_clean":"2024-09-12T18:33:27.683081+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:33:27.683081+0000","last_undegraded":"2024-09-12T18:33:27.683081+0000","last_fullsized":"2024-09-12T18:33:27.683081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.682917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.162425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'575","reported_seq":1254,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.671234+0000","last_change":"2024-09-12T18:33:29.671171+0000","last_active":"2024-09-12T18:33:29.671234+0000","last_peered":"2024-09-12T18:33:29.671234+0000","last_clean":"2024-09-12T18:33:29.671234+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:33:29.671234+0000","last_undegraded":"2024-09-12T18:33:29.671234+0000","last_fullsized":"2024-09-12T18:33:29.671234+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'575","last_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_deep_scrub":"262'575","last_deep_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.671062+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:47.544425+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1576,"num_read_kb":2723,"num_write":2042,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.306634+0000","last_change":"2024-09-12T18:33:41.306515+0000","last_active":"2024-09-12T18:33:41.306634+0000","last_peered":"2024-09-12T18:33:41.306634+0000","last_clean":"2024-09-12T18:33:41.306634+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:33:41.306634+0000","last_undegraded":"2024-09-12T18:33:41.306634+0000","last_fullsized":"2024-09-12T18:33:41.306634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.306424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:48.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'112","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.735660+0000","last_change":"2024-09-12T18:33:44.735660+0000","last_active":"2024-09-12T18:33:44.735660+0000","last_peered":"2024-09-12T18:33:44.735660+0000","last_clean":"2024-09-12T18:33:44.735660+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:33:44.735660+0000","last_undegraded":"2024-09-12T18:33:44.735660+0000","last_fullsized":"2024-09-12T18:33:44.735660+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.735567+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:53.162317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1008","reported_seq":2579,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.613589+0000","last_change":"2024-09-12T18:33:19.613529+0000","last_active":"2024-09-12T18:33:19.613589+0000","last_peered":"2024-09-12T18:33:19.613589+0000","last_clean":"2024-09-12T18:33:19.613589+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:33:19.613589+0000","last_undegraded":"2024-09-12T18:33:19.613589+0000","last_fullsized":"2024-09-12T18:33:19.613589+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1008","last_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_deep_scrub":"262'1008","last_deep_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.613439+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:00.782809+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'378","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.566916+0000","last_change":"2024-09-12T18:33:17.566857+0000","last_active":"2024-09-12T18:33:17.566916+0000","last_peered":"2024-09-12T18:33:17.566916+0000","last_clean":"2024-09-12T18:33:17.566916+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:33:17.566916+0000","last_undegraded":"2024-09-12T18:33:17.566916+0000","last_fullsized":"2024-09-12T18:33:17.566916+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.566746+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:24.317944+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820443,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":48347,"num_write":1175,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.966235+0000","last_change":"2024-09-12T18:33:15.966167+0000","last_active":"2024-09-12T18:33:15.966235+0000","last_peered":"2024-09-12T18:33:15.966235+0000","last_clean":"2024-09-12T18:33:15.966235+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:33:15.966235+0000","last_undegraded":"2024-09-12T18:33:15.966235+0000","last_fullsized":"2024-09-12T18:33:15.966235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.966071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.134360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.689440+0000","last_change":"2024-09-12T18:33:23.689372+0000","last_active":"2024-09-12T18:33:23.689440+0000","last_peered":"2024-09-12T18:33:23.689440+0000","last_clean":"2024-09-12T18:33:23.689440+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:33:23.689440+0000","last_undegraded":"2024-09-12T18:33:23.689440+0000","last_fullsized":"2024-09-12T18:33:23.689440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.689279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:38.802520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'209","reported_seq":787,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.622174+0000","last_change":"2024-09-12T18:33:29.622114+0000","last_active":"2024-09-12T18:33:29.622174+0000","last_peered":"2024-09-12T18:33:29.622174+0000","last_clean":"2024-09-12T18:33:29.622174+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:33:29.622174+0000","last_undegraded":"2024-09-12T18:33:29.622174+0000","last_fullsized":"2024-09-12T18:33:29.622174+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.622018+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:47.767617+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'787","reported_seq":2487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.600739+0000","last_change":"2024-09-12T18:33:38.600687+0000","last_active":"2024-09-12T18:33:38.600739+0000","last_peered":"2024-09-12T18:33:38.600739+0000","last_clean":"2024-09-12T18:33:38.600739+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:33:38.600739+0000","last_undegraded":"2024-09-12T18:33:38.600739+0000","last_fullsized":"2024-09-12T18:33:38.600739+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'787","last_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_deep_scrub":"262'787","last_deep_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.600601+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:11.236866+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'113","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.301657+0000","last_change":"2024-09-12T18:33:53.301657+0000","last_active":"2024-09-12T18:33:53.301657+0000","last_peered":"2024-09-12T18:33:53.301657+0000","last_clean":"2024-09-12T18:33:53.301657+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:33:53.301657+0000","last_undegraded":"2024-09-12T18:33:53.301657+0000","last_fullsized":"2024-09-12T18:33:53.301657+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-12T18:33:53.301560+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-12T18:33:53.301560+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.301560+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:09.047130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'444","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.284135+0000","last_change":"2024-09-12T18:33:23.284074+0000","last_active":"2024-09-12T18:33:23.284135+0000","last_peered":"2024-09-12T18:33:23.284135+0000","last_clean":"2024-09-12T18:33:23.284135+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:33:23.284135+0000","last_undegraded":"2024-09-12T18:33:23.284135+0000","last_fullsized":"2024-09-12T18:33:23.284135+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.283986+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.932404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'361","reported_seq":1021,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.141815+0000","last_change":"2024-09-12T18:33:13.141754+0000","last_active":"2024-09-12T18:33:13.141815+0000","last_peered":"2024-09-12T18:33:13.141815+0000","last_clean":"2024-09-12T18:33:13.141815+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:33:13.141815+0000","last_undegraded":"2024-09-12T18:33:13.141815+0000","last_fullsized":"2024-09-12T18:33:13.141815+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.141659+0000","objects_scrubbed":8,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:39.600554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":50118,"num_write":1078,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.639195+0000","last_change":"2024-09-12T18:33:22.639195+0000","last_active":"2024-09-12T18:33:22.639195+0000","last_peered":"2024-09-12T18:33:22.639195+0000","last_clean":"2024-09-12T18:33:22.639195+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:33:22.639195+0000","last_undegraded":"2024-09-12T18:33:22.639195+0000","last_fullsized":"2024-09-12T18:33:22.639195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.639106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:28.364727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.333132+0000","last_change":"2024-09-12T18:33:32.333034+0000","last_active":"2024-09-12T18:33:32.333132+0000","last_peered":"2024-09-12T18:33:32.333132+0000","last_clean":"2024-09-12T18:33:32.333132+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:33:32.333132+0000","last_undegraded":"2024-09-12T18:33:32.333132+0000","last_fullsized":"2024-09-12T18:33:32.333132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.332939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:24.535431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'118","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.295676+0000","last_change":"2024-09-12T18:33:36.295611+0000","last_active":"2024-09-12T18:33:36.295676+0000","last_peered":"2024-09-12T18:33:36.295676+0000","last_clean":"2024-09-12T18:33:36.295676+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:33:36.295676+0000","last_undegraded":"2024-09-12T18:33:36.295676+0000","last_fullsized":"2024-09-12T18:33:36.295676+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.295511+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:50.229082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'819","reported_seq":2755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.319053+0000","last_change":"2024-09-12T18:33:44.318998+0000","last_active":"2024-09-12T18:33:44.319053+0000","last_peered":"2024-09-12T18:33:44.319053+0000","last_clean":"2024-09-12T18:33:44.319053+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:33:44.319053+0000","last_undegraded":"2024-09-12T18:33:44.319053+0000","last_fullsized":"2024-09-12T18:33:44.319053+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.318903+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:11.329999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'188","reported_seq":701,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.757850+0000","last_change":"2024-09-12T18:33:42.757850+0000","last_active":"2024-09-12T18:33:42.757850+0000","last_peered":"2024-09-12T18:33:42.757850+0000","last_clean":"2024-09-12T18:33:42.757850+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:33:42.757850+0000","last_undegraded":"2024-09-12T18:33:42.757850+0000","last_fullsized":"2024-09-12T18:33:42.757850+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.757762+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:52.059548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'541","reported_seq":2154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.238309+0000","last_change":"2024-09-12T18:33:16.238244+0000","last_active":"2024-09-12T18:33:16.238309+0000","last_peered":"2024-09-12T18:33:16.238309+0000","last_clean":"2024-09-12T18:33:16.238309+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:33:16.238309+0000","last_undegraded":"2024-09-12T18:33:16.238309+0000","last_fullsized":"2024-09-12T18:33:16.238309+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.238154+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.758872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'301","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.484174+0000","last_change":"2024-09-12T18:33:09.484120+0000","last_active":"2024-09-12T18:33:09.484174+0000","last_peered":"2024-09-12T18:33:09.484174+0000","last_clean":"2024-09-12T18:33:09.484174+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:33:09.484174+0000","last_undegraded":"2024-09-12T18:33:09.484174+0000","last_fullsized":"2024-09-12T18:33:09.484174+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'301","last_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_deep_scrub":"262'301","last_deep_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_clean_scrub_stamp":"2024-09-12T18:33:09.484014+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:09.383970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":18058,"num_write":1049,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.699256+0000","last_change":"2024-09-12T18:33:12.699204+0000","last_active":"2024-09-12T18:33:12.699256+0000","last_peered":"2024-09-12T18:33:12.699256+0000","last_clean":"2024-09-12T18:33:12.699256+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:33:12.699256+0000","last_undegraded":"2024-09-12T18:33:12.699256+0000","last_fullsized":"2024-09-12T18:33:12.699256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.699122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.717334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.430298+0000","last_change":"2024-09-12T18:33:33.430244+0000","last_active":"2024-09-12T18:33:33.430298+0000","last_peered":"2024-09-12T18:33:33.430298+0000","last_clean":"2024-09-12T18:33:33.430298+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:33:33.430298+0000","last_undegraded":"2024-09-12T18:33:33.430298+0000","last_fullsized":"2024-09-12T18:33:33.430298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.430169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.537046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'727","reported_seq":1454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.152053+0000","last_change":"2024-09-12T18:33:36.151989+0000","last_active":"2024-09-12T18:33:36.152053+0000","last_peered":"2024-09-12T18:33:36.152053+0000","last_clean":"2024-09-12T18:33:36.152053+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:33:36.152053+0000","last_undegraded":"2024-09-12T18:33:36.152053+0000","last_fullsized":"2024-09-12T18:33:36.152053+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'727","last_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_deep_scrub":"262'727","last_deep_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.151761+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.853655+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":3013,"num_write":1042,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.392851+0000","last_change":"2024-09-12T18:33:46.392777+0000","last_active":"2024-09-12T18:33:46.392851+0000","last_peered":"2024-09-12T18:33:46.392851+0000","last_clean":"2024-09-12T18:33:46.392851+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:33:46.392851+0000","last_undegraded":"2024-09-12T18:33:46.392851+0000","last_fullsized":"2024-09-12T18:33:46.392851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.392690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.346518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'132","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.642288+0000","last_change":"2024-09-12T18:33:42.642288+0000","last_active":"2024-09-12T18:33:42.642288+0000","last_peered":"2024-09-12T18:33:42.642288+0000","last_clean":"2024-09-12T18:33:42.642288+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:33:42.642288+0000","last_undegraded":"2024-09-12T18:33:42.642288+0000","last_fullsized":"2024-09-12T18:33:42.642288+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.642175+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:14.865789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'131","reported_seq":712,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.666991+0000","last_change":"2024-09-12T18:33:49.666901+0000","last_active":"2024-09-12T18:33:49.666991+0000","last_peered":"2024-09-12T18:33:49.666991+0000","last_clean":"2024-09-12T18:33:49.666991+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:33:49.666991+0000","last_undegraded":"2024-09-12T18:33:49.666991+0000","last_fullsized":"2024-09-12T18:33:49.666991+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.666810+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:28.057997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'397","reported_seq":1909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.247083+0000","last_change":"2024-09-12T18:33:21.247025+0000","last_active":"2024-09-12T18:33:21.247083+0000","last_peered":"2024-09-12T18:33:21.247083+0000","last_clean":"2024-09-12T18:33:21.247083+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:33:21.247083+0000","last_undegraded":"2024-09-12T18:33:21.247083+0000","last_fullsized":"2024-09-12T18:33:21.247083+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'397","last_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_deep_scrub":"262'397","last_deep_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.246937+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:02.793084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'323","reported_seq":998,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.235845+0000","last_change":"2024-09-12T18:33:12.235775+0000","last_active":"2024-09-12T18:33:12.235845+0000","last_peered":"2024-09-12T18:33:12.235845+0000","last_clean":"2024-09-12T18:33:12.235845+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:12.235845+0000","last_undegraded":"2024-09-12T18:33:12.235845+0000","last_fullsized":"2024-09-12T18:33:12.235845+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.235626+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:59.915198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":63909,"num_write":1001,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.626749+0000","last_change":"2024-09-12T18:33:23.626695+0000","last_active":"2024-09-12T18:33:23.626749+0000","last_peered":"2024-09-12T18:33:23.626749+0000","last_clean":"2024-09-12T18:33:23.626749+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:33:23.626749+0000","last_undegraded":"2024-09-12T18:33:23.626749+0000","last_fullsized":"2024-09-12T18:33:23.626749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.626609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:00.714762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'267","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.389853+0000","last_change":"2024-09-12T18:33:39.389784+0000","last_active":"2024-09-12T18:33:39.389853+0000","last_peered":"2024-09-12T18:33:39.389853+0000","last_clean":"2024-09-12T18:33:39.389853+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:33:39.389853+0000","last_undegraded":"2024-09-12T18:33:39.389853+0000","last_fullsized":"2024-09-12T18:33:39.389853+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'267","last_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_deep_scrub":"262'267","last_deep_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.389682+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:45.899532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":1008,"num_write":356,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.344063+0000","last_change":"2024-09-12T18:33:45.343989+0000","last_active":"2024-09-12T18:33:45.344063+0000","last_peered":"2024-09-12T18:33:45.344063+0000","last_clean":"2024-09-12T18:33:45.344063+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:33:45.344063+0000","last_undegraded":"2024-09-12T18:33:45.344063+0000","last_fullsized":"2024-09-12T18:33:45.344063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.343882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:12.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'139","reported_seq":643,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.263846+0000","last_change":"2024-09-12T18:33:55.263744+0000","last_active":"2024-09-12T18:33:55.263846+0000","last_peered":"2024-09-12T18:33:55.263846+0000","last_clean":"2024-09-12T18:33:55.263846+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:33:55.263846+0000","last_undegraded":"2024-09-12T18:33:55.263846+0000","last_fullsized":"2024-09-12T18:33:55.263846+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'139","last_scrub_stamp":"2024-09-12T18:33:55.263600+0000","last_deep_scrub":"262'139","last_deep_scrub_stamp":"2024-09-12T18:33:55.263600+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.263600+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:02.481985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'977","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.612807+0000","last_change":"2024-09-12T18:33:20.612697+0000","last_active":"2024-09-12T18:33:20.612807+0000","last_peered":"2024-09-12T18:33:20.612807+0000","last_clean":"2024-09-12T18:33:20.612807+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:33:20.612807+0000","last_undegraded":"2024-09-12T18:33:20.612807+0000","last_fullsized":"2024-09-12T18:33:20.612807+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'977","last_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_deep_scrub":"262'977","last_deep_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.612589+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":900,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:51.536947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'391","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.958442+0000","last_change":"2024-09-12T18:33:17.958378+0000","last_active":"2024-09-12T18:33:17.958442+0000","last_peered":"2024-09-12T18:33:17.958442+0000","last_clean":"2024-09-12T18:33:17.958442+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:33:17.958442+0000","last_undegraded":"2024-09-12T18:33:17.958442+0000","last_fullsized":"2024-09-12T18:33:17.958442+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'391","last_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_deep_scrub":"262'391","last_deep_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.958248+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:10.190084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079946,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":8296,"num_write":1132,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"262'4","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.361509+0000","last_change":"2024-09-12T18:33:35.361447+0000","last_active":"2024-09-12T18:33:35.361509+0000","last_peered":"2024-09-12T18:33:35.361509+0000","last_clean":"2024-09-12T18:33:35.361509+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:33:35.361509+0000","last_undegraded":"2024-09-12T18:33:35.361509+0000","last_fullsized":"2024-09-12T18:33:35.361509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.361353+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:39.149109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'58","reported_seq":571,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.690334+0000","last_change":"2024-09-12T18:33:33.690280+0000","last_active":"2024-09-12T18:33:33.690334+0000","last_peered":"2024-09-12T18:33:33.690334+0000","last_clean":"2024-09-12T18:33:33.690334+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:33:33.690334+0000","last_undegraded":"2024-09-12T18:33:33.690334+0000","last_fullsized":"2024-09-12T18:33:33.690334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.690203+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:57.510406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.159845+0000","last_change":"2024-09-12T18:33:38.159733+0000","last_active":"2024-09-12T18:33:38.159845+0000","last_peered":"2024-09-12T18:33:38.159845+0000","last_clean":"2024-09-12T18:33:38.159845+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:33:38.159845+0000","last_undegraded":"2024-09-12T18:33:38.159845+0000","last_fullsized":"2024-09-12T18:33:38.159845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.159640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.092462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.769766+0000","last_change":"2024-09-12T18:33:45.769766+0000","last_active":"2024-09-12T18:33:45.769766+0000","last_peered":"2024-09-12T18:33:45.769766+0000","last_clean":"2024-09-12T18:33:45.769766+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:33:45.769766+0000","last_undegraded":"2024-09-12T18:33:45.769766+0000","last_fullsized":"2024-09-12T18:33:45.769766+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.769648+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.982175+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'556","reported_seq":2190,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.320005+0000","last_change":"2024-09-12T18:33:25.319941+0000","last_active":"2024-09-12T18:33:25.320005+0000","last_peered":"2024-09-12T18:33:25.320005+0000","last_clean":"2024-09-12T18:33:25.320005+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:33:25.320005+0000","last_undegraded":"2024-09-12T18:33:25.320005+0000","last_fullsized":"2024-09-12T18:33:25.320005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'556","last_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_deep_scrub":"262'556","last_deep_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.319848+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:58.204185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'368","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.702588+0000","last_change":"2024-09-12T18:33:14.702522+0000","last_active":"2024-09-12T18:33:14.702588+0000","last_peered":"2024-09-12T18:33:14.702588+0000","last_clean":"2024-09-12T18:33:14.702588+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:33:14.702588+0000","last_undegraded":"2024-09-12T18:33:14.702588+0000","last_fullsized":"2024-09-12T18:33:14.702588+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'368","last_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_deep_scrub":"262'368","last_deep_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.702321+0000","objects_scrubbed":11,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:33.790945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350736,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":674,"num_read_kb":8078,"num_write":1180,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.114024+0000","last_change":"2024-09-12T18:33:30.113931+0000","last_active":"2024-09-12T18:33:30.114024+0000","last_peered":"2024-09-12T18:33:30.114024+0000","last_clean":"2024-09-12T18:33:30.114024+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:33:30.114024+0000","last_undegraded":"2024-09-12T18:33:30.114024+0000","last_fullsized":"2024-09-12T18:33:30.114024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.113831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:05.941190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'324","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.326821+0000","last_change":"2024-09-12T18:33:41.326761+0000","last_active":"2024-09-12T18:33:41.326821+0000","last_peered":"2024-09-12T18:33:41.326821+0000","last_clean":"2024-09-12T18:33:41.326821+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:33:41.326821+0000","last_undegraded":"2024-09-12T18:33:41.326821+0000","last_fullsized":"2024-09-12T18:33:41.326821+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.326666+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:22.806748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48623,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1190,"num_write":438,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.748116+0000","last_change":"2024-09-12T18:33:31.747999+0000","last_active":"2024-09-12T18:33:31.748116+0000","last_peered":"2024-09-12T18:33:31.748116+0000","last_clean":"2024-09-12T18:33:31.748116+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:33:31.748116+0000","last_undegraded":"2024-09-12T18:33:31.748116+0000","last_fullsized":"2024-09-12T18:33:31.748116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.747908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:11.279329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'99","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.682050+0000","last_change":"2024-09-12T18:33:46.682050+0000","last_active":"2024-09-12T18:33:46.682050+0000","last_peered":"2024-09-12T18:33:46.682050+0000","last_clean":"2024-09-12T18:33:46.682050+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:33:46.682050+0000","last_undegraded":"2024-09-12T18:33:46.682050+0000","last_fullsized":"2024-09-12T18:33:46.682050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'99","last_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_deep_scrub":"262'99","last_deep_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.681959+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:42.683159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1027","reported_seq":2675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.355236+0000","last_change":"2024-09-12T18:33:26.355171+0000","last_active":"2024-09-12T18:33:26.355236+0000","last_peered":"2024-09-12T18:33:26.355236+0000","last_clean":"2024-09-12T18:33:26.355236+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:33:26.355236+0000","last_undegraded":"2024-09-12T18:33:26.355236+0000","last_fullsized":"2024-09-12T18:33:26.355236+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1027","last_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_deep_scrub":"262'1027","last_deep_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.355090+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:15.967085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'378","reported_seq":1007,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.546254+0000","last_change":"2024-09-12T18:33:13.546149+0000","last_active":"2024-09-12T18:33:13.546254+0000","last_peered":"2024-09-12T18:33:13.546254+0000","last_clean":"2024-09-12T18:33:13.546254+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:33:13.546254+0000","last_undegraded":"2024-09-12T18:33:13.546254+0000","last_fullsized":"2024-09-12T18:33:13.546254+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.546033+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:18.615258+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":38183,"num_write":1089,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.721094+0000","last_change":"2024-09-12T18:33:26.720977+0000","last_active":"2024-09-12T18:33:26.721094+0000","last_peered":"2024-09-12T18:33:26.721094+0000","last_clean":"2024-09-12T18:33:26.721094+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:33:26.721094+0000","last_undegraded":"2024-09-12T18:33:26.721094+0000","last_fullsized":"2024-09-12T18:33:26.721094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.720886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:00.916187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'279","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.187372+0000","last_change":"2024-09-12T18:33:34.187275+0000","last_active":"2024-09-12T18:33:34.187372+0000","last_peered":"2024-09-12T18:33:34.187372+0000","last_clean":"2024-09-12T18:33:34.187372+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:33:34.187372+0000","last_undegraded":"2024-09-12T18:33:34.187372+0000","last_fullsized":"2024-09-12T18:33:34.187372+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'279","last_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_deep_scrub":"262'279","last_deep_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.187165+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.540694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54427,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1013,"num_write":368,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.747990+0000","last_change":"2024-09-12T18:33:40.747900+0000","last_active":"2024-09-12T18:33:40.747990+0000","last_peered":"2024-09-12T18:33:40.747990+0000","last_clean":"2024-09-12T18:33:40.747990+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:33:40.747990+0000","last_undegraded":"2024-09-12T18:33:40.747990+0000","last_fullsized":"2024-09-12T18:33:40.747990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.747780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.596415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'862","reported_seq":2493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.706620+0000","last_change":"2024-09-12T18:33:20.706522+0000","last_active":"2024-09-12T18:33:20.706620+0000","last_peered":"2024-09-12T18:33:20.706620+0000","last_clean":"2024-09-12T18:33:20.706620+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:33:20.706620+0000","last_undegraded":"2024-09-12T18:33:20.706620+0000","last_fullsized":"2024-09-12T18:33:20.706620+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.706397+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:46.363194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'357","reported_seq":1093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.251831+0000","last_change":"2024-09-12T18:33:16.251755+0000","last_active":"2024-09-12T18:33:16.251831+0000","last_peered":"2024-09-12T18:33:16.251831+0000","last_clean":"2024-09-12T18:33:16.251831+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:33:16.251831+0000","last_undegraded":"2024-09-12T18:33:16.251831+0000","last_fullsized":"2024-09-12T18:33:16.251831+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.251595+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.014047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080042,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":5768,"num_write":997,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.655171+0000","last_change":"2024-09-12T18:33:30.655090+0000","last_active":"2024-09-12T18:33:30.655171+0000","last_peered":"2024-09-12T18:33:30.655171+0000","last_clean":"2024-09-12T18:33:30.655171+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:33:30.655171+0000","last_undegraded":"2024-09-12T18:33:30.655171+0000","last_fullsized":"2024-09-12T18:33:30.655171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.654984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.034356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'502","reported_seq":1141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.569019+0000","last_change":"2024-09-12T18:33:33.569019+0000","last_active":"2024-09-12T18:33:33.569019+0000","last_peered":"2024-09-12T18:33:33.569019+0000","last_clean":"2024-09-12T18:33:33.569019+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:33:33.569019+0000","last_undegraded":"2024-09-12T18:33:33.569019+0000","last_fullsized":"2024-09-12T18:33:33.569019+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'502","last_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_deep_scrub":"262'502","last_deep_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.568933+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:22.637750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110948,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":875,"num_read_kb":2101,"num_write":752,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.630432+0000","last_change":"2024-09-12T18:33:40.630432+0000","last_active":"2024-09-12T18:33:40.630432+0000","last_peered":"2024-09-12T18:33:40.630432+0000","last_clean":"2024-09-12T18:33:40.630432+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:33:40.630432+0000","last_undegraded":"2024-09-12T18:33:40.630432+0000","last_fullsized":"2024-09-12T18:33:40.630432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.630343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:27.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'166","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.327303+0000","last_change":"2024-09-12T18:33:52.327186+0000","last_active":"2024-09-12T18:33:52.327303+0000","last_peered":"2024-09-12T18:33:52.327303+0000","last_clean":"2024-09-12T18:33:52.327303+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:33:52.327303+0000","last_undegraded":"2024-09-12T18:33:52.327303+0000","last_fullsized":"2024-09-12T18:33:52.327303+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'166","last_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_deep_scrub":"262'166","last_deep_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.327070+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.676098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'776","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.637392+0000","last_change":"2024-09-12T18:33:23.637333+0000","last_active":"2024-09-12T18:33:23.637392+0000","last_peered":"2024-09-12T18:33:23.637392+0000","last_clean":"2024-09-12T18:33:23.637392+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:33:23.637392+0000","last_undegraded":"2024-09-12T18:33:23.637392+0000","last_fullsized":"2024-09-12T18:33:23.637392+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'776","last_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_deep_scrub":"262'776","last_deep_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.637244+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:07.717470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'292","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.609676+0000","last_change":"2024-09-12T18:33:12.609610+0000","last_active":"2024-09-12T18:33:12.609676+0000","last_peered":"2024-09-12T18:33:12.609676+0000","last_clean":"2024-09-12T18:33:12.609676+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:33:12.609676+0000","last_undegraded":"2024-09-12T18:33:12.609676+0000","last_fullsized":"2024-09-12T18:33:12.609676+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.609480+0000","objects_scrubbed":9,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:33.114173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694644,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":28092,"num_write":983,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.710176+0000","last_change":"2024-09-12T18:33:27.710107+0000","last_active":"2024-09-12T18:33:27.710176+0000","last_peered":"2024-09-12T18:33:27.710176+0000","last_clean":"2024-09-12T18:33:27.710176+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:33:27.710176+0000","last_undegraded":"2024-09-12T18:33:27.710176+0000","last_fullsized":"2024-09-12T18:33:27.710176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.710016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:39.343506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'333","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.193064+0000","last_change":"2024-09-12T18:33:35.193064+0000","last_active":"2024-09-12T18:33:35.193064+0000","last_peered":"2024-09-12T18:33:35.193064+0000","last_clean":"2024-09-12T18:33:35.193064+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:33:35.193064+0000","last_undegraded":"2024-09-12T18:33:35.193064+0000","last_fullsized":"2024-09-12T18:33:35.193064+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.192953+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:49.112579+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56643,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1253,"num_write":470,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.568479+0000","last_change":"2024-09-12T18:33:34.568479+0000","last_active":"2024-09-12T18:33:34.568479+0000","last_peered":"2024-09-12T18:33:34.568479+0000","last_clean":"2024-09-12T18:33:34.568479+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:33:34.568479+0000","last_undegraded":"2024-09-12T18:33:34.568479+0000","last_fullsized":"2024-09-12T18:33:34.568479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.568388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:39.847789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'203","reported_seq":1083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.763194+0000","last_change":"2024-09-12T18:33:36.763133+0000","last_active":"2024-09-12T18:33:36.763194+0000","last_peered":"2024-09-12T18:33:36.763194+0000","last_clean":"2024-09-12T18:33:36.763194+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:33:36.763194+0000","last_undegraded":"2024-09-12T18:33:36.763194+0000","last_fullsized":"2024-09-12T18:33:36.763194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.763046+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:59.513801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1297","reported_seq":2877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.376494+0000","last_change":"2024-09-12T18:33:29.376494+0000","last_active":"2024-09-12T18:33:29.376494+0000","last_peered":"2024-09-12T18:33:29.376494+0000","last_clean":"2024-09-12T18:33:29.376494+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:33:29.376494+0000","last_undegraded":"2024-09-12T18:33:29.376494+0000","last_fullsized":"2024-09-12T18:33:29.376494+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1297","last_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_deep_scrub":"262'1297","last_deep_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.376406+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":1200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:02.948818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'314","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.214145+0000","last_change":"2024-09-12T18:33:13.214086+0000","last_active":"2024-09-12T18:33:13.214145+0000","last_peered":"2024-09-12T18:33:13.214145+0000","last_clean":"2024-09-12T18:33:13.214145+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:13.214145+0000","last_undegraded":"2024-09-12T18:33:13.214145+0000","last_fullsized":"2024-09-12T18:33:13.214145+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.213966+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:52.702345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":10892,"num_write":984,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.333184+0000","last_change":"2024-09-12T18:33:35.333184+0000","last_active":"2024-09-12T18:33:35.333184+0000","last_peered":"2024-09-12T18:33:35.333184+0000","last_clean":"2024-09-12T18:33:35.333184+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:33:35.333184+0000","last_undegraded":"2024-09-12T18:33:35.333184+0000","last_fullsized":"2024-09-12T18:33:35.333184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.333097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:34.166308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'296","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.323430+0000","last_change":"2024-09-12T18:33:50.323374+0000","last_active":"2024-09-12T18:33:50.323430+0000","last_peered":"2024-09-12T18:33:50.323430+0000","last_clean":"2024-09-12T18:33:50.323430+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:33:50.323430+0000","last_undegraded":"2024-09-12T18:33:50.323430+0000","last_fullsized":"2024-09-12T18:33:50.323430+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'296","last_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_deep_scrub":"262'296","last_deep_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.323277+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:05.895027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48414,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":1088,"num_write":394,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.562086+0000","last_change":"2024-09-12T18:33:35.562025+0000","last_active":"2024-09-12T18:33:35.562086+0000","last_peered":"2024-09-12T18:33:35.562086+0000","last_clean":"2024-09-12T18:33:35.562086+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:33:35.562086+0000","last_undegraded":"2024-09-12T18:33:35.562086+0000","last_fullsized":"2024-09-12T18:33:35.562086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.561926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:05.612440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'137","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.672636+0000","last_change":"2024-09-12T18:33:44.672537+0000","last_active":"2024-09-12T18:33:44.672636+0000","last_peered":"2024-09-12T18:33:44.672636+0000","last_clean":"2024-09-12T18:33:44.672636+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:33:44.672636+0000","last_undegraded":"2024-09-12T18:33:44.672636+0000","last_fullsized":"2024-09-12T18:33:44.672636+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.672419+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:11.144320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'552","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.071677+0000","last_change":"2024-09-12T18:33:17.071677+0000","last_active":"2024-09-12T18:33:17.071677+0000","last_peered":"2024-09-12T18:33:17.071677+0000","last_clean":"2024-09-12T18:33:17.071677+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:33:17.071677+0000","last_undegraded":"2024-09-12T18:33:17.071677+0000","last_fullsized":"2024-09-12T18:33:17.071677+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'552","last_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_deep_scrub":"262'552","last_deep_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.071573+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:16.342863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'359","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.585198+0000","last_change":"2024-09-12T18:33:12.585151+0000","last_active":"2024-09-12T18:33:12.585198+0000","last_peered":"2024-09-12T18:33:12.585198+0000","last_clean":"2024-09-12T18:33:12.585198+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:33:12.585198+0000","last_undegraded":"2024-09-12T18:33:12.585198+0000","last_fullsized":"2024-09-12T18:33:12.585198+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.585060+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:16.468003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":50516,"num_write":1214,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.654924+0000","last_change":"2024-09-12T18:33:27.654924+0000","last_active":"2024-09-12T18:33:27.654924+0000","last_peered":"2024-09-12T18:33:27.654924+0000","last_clean":"2024-09-12T18:33:27.654924+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:33:27.654924+0000","last_undegraded":"2024-09-12T18:33:27.654924+0000","last_fullsized":"2024-09-12T18:33:27.654924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.654837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.335485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'111","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.303021+0000","last_change":"2024-09-12T18:33:40.302961+0000","last_active":"2024-09-12T18:33:40.303021+0000","last_peered":"2024-09-12T18:33:40.303021+0000","last_clean":"2024-09-12T18:33:40.303021+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:33:40.303021+0000","last_undegraded":"2024-09-12T18:33:40.303021+0000","last_fullsized":"2024-09-12T18:33:40.303021+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.302865+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:11.629757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18924,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'779","reported_seq":4150,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.779177+0000","last_change":"2024-09-12T18:33:32.779080+0000","last_active":"2024-09-12T18:33:32.779177+0000","last_peered":"2024-09-12T18:33:32.779177+0000","last_clean":"2024-09-12T18:33:32.779177+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:33:32.779177+0000","last_undegraded":"2024-09-12T18:33:32.779177+0000","last_fullsized":"2024-09-12T18:33:32.779177+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'779","last_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_deep_scrub":"262'779","last_deep_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.778980+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:29.517178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.076262+0000","last_change":"2024-09-12T18:33:42.076207+0000","last_active":"2024-09-12T18:33:42.076262+0000","last_peered":"2024-09-12T18:33:42.076262+0000","last_clean":"2024-09-12T18:33:42.076262+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:33:42.076262+0000","last_undegraded":"2024-09-12T18:33:42.076262+0000","last_fullsized":"2024-09-12T18:33:42.076262+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.076124+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:59.699672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'766","reported_seq":2352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.332245+0000","last_change":"2024-09-12T18:33:24.332245+0000","last_active":"2024-09-12T18:33:24.332245+0000","last_peered":"2024-09-12T18:33:24.332245+0000","last_clean":"2024-09-12T18:33:24.332245+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:33:24.332245+0000","last_undegraded":"2024-09-12T18:33:24.332245+0000","last_fullsized":"2024-09-12T18:33:24.332245+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'766","last_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_deep_scrub":"262'766","last_deep_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.332108+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:12.983708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'337","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.052970+0000","last_change":"2024-09-12T18:33:13.052912+0000","last_active":"2024-09-12T18:33:13.052970+0000","last_peered":"2024-09-12T18:33:13.052970+0000","last_clean":"2024-09-12T18:33:13.052970+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:33:13.052970+0000","last_undegraded":"2024-09-12T18:33:13.052970+0000","last_fullsized":"2024-09-12T18:33:13.052970+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'337","last_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_deep_scrub":"262'337","last_deep_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.052825+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:55.171930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":50614,"num_write":1066,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.118009+0000","last_change":"2024-09-12T18:33:31.118009+0000","last_active":"2024-09-12T18:33:31.118009+0000","last_peered":"2024-09-12T18:33:31.118009+0000","last_clean":"2024-09-12T18:33:31.118009+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:33:31.118009+0000","last_undegraded":"2024-09-12T18:33:31.118009+0000","last_fullsized":"2024-09-12T18:33:31.118009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.117914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:57.868096+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'316","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.605929+0000","last_change":"2024-09-12T18:33:39.605871+0000","last_active":"2024-09-12T18:33:39.605929+0000","last_peered":"2024-09-12T18:33:39.605929+0000","last_clean":"2024-09-12T18:33:39.605929+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:33:39.605929+0000","last_undegraded":"2024-09-12T18:33:39.605929+0000","last_fullsized":"2024-09-12T18:33:39.605929+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'316","last_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_deep_scrub":"262'316","last_deep_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.605754+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.157337+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44344,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":1104,"num_write":414,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.720938+0000","last_change":"2024-09-12T18:33:39.720865+0000","last_active":"2024-09-12T18:33:39.720938+0000","last_peered":"2024-09-12T18:33:39.720938+0000","last_clean":"2024-09-12T18:33:39.720938+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:33:39.720938+0000","last_undegraded":"2024-09-12T18:33:39.720938+0000","last_fullsized":"2024-09-12T18:33:39.720938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.720781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:42.326695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'124","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.111229+0000","last_change":"2024-09-12T18:33:44.111164+0000","last_active":"2024-09-12T18:33:44.111229+0000","last_peered":"2024-09-12T18:33:44.111229+0000","last_clean":"2024-09-12T18:33:44.111229+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:33:44.111229+0000","last_undegraded":"2024-09-12T18:33:44.111229+0000","last_fullsized":"2024-09-12T18:33:44.111229+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.111077+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:13.157135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'399","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.327113+0000","last_change":"2024-09-12T18:33:23.327113+0000","last_active":"2024-09-12T18:33:23.327113+0000","last_peered":"2024-09-12T18:33:23.327113+0000","last_clean":"2024-09-12T18:33:23.327113+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:33:23.327113+0000","last_undegraded":"2024-09-12T18:33:23.327113+0000","last_fullsized":"2024-09-12T18:33:23.327113+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.326995+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:31.607912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3241,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'346","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.675047+0000","last_change":"2024-09-12T18:33:17.675047+0000","last_active":"2024-09-12T18:33:17.675047+0000","last_peered":"2024-09-12T18:33:17.675047+0000","last_clean":"2024-09-12T18:33:17.675047+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:33:17.675047+0000","last_undegraded":"2024-09-12T18:33:17.675047+0000","last_fullsized":"2024-09-12T18:33:17.675047+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.674867+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:20.180450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5819619,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":36012,"num_write":1062,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.607212+0000","last_change":"2024-09-12T18:33:34.607212+0000","last_active":"2024-09-12T18:33:34.607212+0000","last_peered":"2024-09-12T18:33:34.607212+0000","last_clean":"2024-09-12T18:33:34.607212+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:33:34.607212+0000","last_undegraded":"2024-09-12T18:33:34.607212+0000","last_fullsized":"2024-09-12T18:33:34.607212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.607121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:13.500998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'291","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.740254+0000","last_change":"2024-09-12T18:33:34.740198+0000","last_active":"2024-09-12T18:33:34.740254+0000","last_peered":"2024-09-12T18:33:34.740254+0000","last_clean":"2024-09-12T18:33:34.740254+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:33:34.740254+0000","last_undegraded":"2024-09-12T18:33:34.740254+0000","last_fullsized":"2024-09-12T18:33:34.740254+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.740115+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:01.234210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53785,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1068,"num_write":382,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.775670+0000","last_change":"2024-09-12T18:33:34.775581+0000","last_active":"2024-09-12T18:33:34.775670+0000","last_peered":"2024-09-12T18:33:34.775670+0000","last_clean":"2024-09-12T18:33:34.775670+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:33:34.775670+0000","last_undegraded":"2024-09-12T18:33:34.775670+0000","last_fullsized":"2024-09-12T18:33:34.775670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.775485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:45.097880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'196","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.300433+0000","last_change":"2024-09-12T18:33:54.300433+0000","last_active":"2024-09-12T18:33:54.300433+0000","last_peered":"2024-09-12T18:33:54.300433+0000","last_clean":"2024-09-12T18:33:54.300433+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:33:54.300433+0000","last_undegraded":"2024-09-12T18:33:54.300433+0000","last_fullsized":"2024-09-12T18:33:54.300433+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-12T18:33:54.300324+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-12T18:33:54.300324+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.300324+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.443817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'541","reported_seq":2101,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.367979+0000","last_change":"2024-09-12T18:33:28.367911+0000","last_active":"2024-09-12T18:33:28.367979+0000","last_peered":"2024-09-12T18:33:28.367979+0000","last_clean":"2024-09-12T18:33:28.367979+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:33:28.367979+0000","last_undegraded":"2024-09-12T18:33:28.367979+0000","last_fullsized":"2024-09-12T18:33:28.367979+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.367828+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:11.552948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'389","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.173031+0000","last_change":"2024-09-12T18:33:19.172964+0000","last_active":"2024-09-12T18:33:19.173031+0000","last_peered":"2024-09-12T18:33:19.173031+0000","last_clean":"2024-09-12T18:33:19.173031+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:33:19.173031+0000","last_undegraded":"2024-09-12T18:33:19.173031+0000","last_fullsized":"2024-09-12T18:33:19.173031+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.172834+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:19.523494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":33965,"num_write":1123,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.352053+0000","last_change":"2024-09-12T18:33:34.351970+0000","last_active":"2024-09-12T18:33:34.352053+0000","last_peered":"2024-09-12T18:33:34.352053+0000","last_clean":"2024-09-12T18:33:34.352053+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:33:34.352053+0000","last_undegraded":"2024-09-12T18:33:34.352053+0000","last_fullsized":"2024-09-12T18:33:34.352053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.351852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:35.670667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'272","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.291517+0000","last_change":"2024-09-12T18:33:42.291517+0000","last_active":"2024-09-12T18:33:42.291517+0000","last_peered":"2024-09-12T18:33:42.291517+0000","last_clean":"2024-09-12T18:33:42.291517+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:33:42.291517+0000","last_undegraded":"2024-09-12T18:33:42.291517+0000","last_fullsized":"2024-09-12T18:33:42.291517+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'272","last_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_deep_scrub":"262'272","last_deep_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.291430+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:36.563443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":1159,"num_write":392,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.332413+0000","last_change":"2024-09-12T18:33:43.332413+0000","last_active":"2024-09-12T18:33:43.332413+0000","last_peered":"2024-09-12T18:33:43.332413+0000","last_clean":"2024-09-12T18:33:43.332413+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:33:43.332413+0000","last_undegraded":"2024-09-12T18:33:43.332413+0000","last_fullsized":"2024-09-12T18:33:43.332413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.332323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.398841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'147","reported_seq":1258,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.089519+0000","last_change":"2024-09-12T18:33:43.089460+0000","last_active":"2024-09-12T18:33:43.089519+0000","last_peered":"2024-09-12T18:33:43.089519+0000","last_clean":"2024-09-12T18:33:43.089519+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:33:43.089519+0000","last_undegraded":"2024-09-12T18:33:43.089519+0000","last_fullsized":"2024-09-12T18:33:43.089519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.089371+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:04.809899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'496","reported_seq":2060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.275373+0000","last_change":"2024-09-12T18:33:22.275302+0000","last_active":"2024-09-12T18:33:22.275373+0000","last_peered":"2024-09-12T18:33:22.275373+0000","last_clean":"2024-09-12T18:33:22.275373+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:33:22.275373+0000","last_undegraded":"2024-09-12T18:33:22.275373+0000","last_fullsized":"2024-09-12T18:33:22.275373+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.275213+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:50.196779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'370","reported_seq":1038,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.586921+0000","last_change":"2024-09-12T18:33:14.586776+0000","last_active":"2024-09-12T18:33:14.586921+0000","last_peered":"2024-09-12T18:33:14.586921+0000","last_clean":"2024-09-12T18:33:14.586921+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:33:14.586921+0000","last_undegraded":"2024-09-12T18:33:14.586921+0000","last_fullsized":"2024-09-12T18:33:14.586921+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.586592+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:48.010872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":31832,"num_write":1234,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.624440+0000","last_change":"2024-09-12T18:33:28.624383+0000","last_active":"2024-09-12T18:33:28.624440+0000","last_peered":"2024-09-12T18:33:28.624440+0000","last_clean":"2024-09-12T18:33:28.624440+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:33:28.624440+0000","last_undegraded":"2024-09-12T18:33:28.624440+0000","last_fullsized":"2024-09-12T18:33:28.624440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.624288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:54.829284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'310","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.269145+0000","last_change":"2024-09-12T18:33:39.269145+0000","last_active":"2024-09-12T18:33:39.269145+0000","last_peered":"2024-09-12T18:33:39.269145+0000","last_clean":"2024-09-12T18:33:39.269145+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:33:39.269145+0000","last_undegraded":"2024-09-12T18:33:39.269145+0000","last_fullsized":"2024-09-12T18:33:39.269145+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'310","last_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_deep_scrub":"262'310","last_deep_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.269054+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:43.874202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58480,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":1106,"num_write":388,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.760760+0000","last_change":"2024-09-12T18:33:41.760760+0000","last_active":"2024-09-12T18:33:41.760760+0000","last_peered":"2024-09-12T18:33:41.760760+0000","last_clean":"2024-09-12T18:33:41.760760+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:33:41.760760+0000","last_undegraded":"2024-09-12T18:33:41.760760+0000","last_fullsized":"2024-09-12T18:33:41.760760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.760663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:29.356520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'131","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.397186+0000","last_change":"2024-09-12T18:33:45.397186+0000","last_active":"2024-09-12T18:33:45.397186+0000","last_peered":"2024-09-12T18:33:45.397186+0000","last_clean":"2024-09-12T18:33:45.397186+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:33:45.397186+0000","last_undegraded":"2024-09-12T18:33:45.397186+0000","last_fullsized":"2024-09-12T18:33:45.397186+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.397098+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:38.251960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'471","reported_seq":2187,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.650524+0000","last_change":"2024-09-12T18:33:26.650462+0000","last_active":"2024-09-12T18:33:26.650524+0000","last_peered":"2024-09-12T18:33:26.650524+0000","last_clean":"2024-09-12T18:33:26.650524+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:33:26.650524+0000","last_undegraded":"2024-09-12T18:33:26.650524+0000","last_fullsized":"2024-09-12T18:33:26.650524+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'471","last_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_deep_scrub":"262'471","last_deep_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.650376+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.061452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'394","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.702638+0000","last_change":"2024-09-12T18:33:19.702575+0000","last_active":"2024-09-12T18:33:19.702638+0000","last_peered":"2024-09-12T18:33:19.702638+0000","last_clean":"2024-09-12T18:33:19.702638+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:33:19.702638+0000","last_undegraded":"2024-09-12T18:33:19.702638+0000","last_fullsized":"2024-09-12T18:33:19.702638+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.702403+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:43.504939+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":20627,"num_write":1276,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'530","reported_seq":2078,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.602717+0000","last_change":"2024-09-12T18:33:32.602618+0000","last_active":"2024-09-12T18:33:32.602717+0000","last_peered":"2024-09-12T18:33:32.602717+0000","last_clean":"2024-09-12T18:33:32.602717+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:33:32.602717+0000","last_undegraded":"2024-09-12T18:33:32.602717+0000","last_fullsized":"2024-09-12T18:33:32.602717+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'530","last_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_deep_scrub":"262'530","last_deep_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.602521+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:10.838673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'405","reported_seq":1097,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.030455+0000","last_change":"2024-09-12T18:33:15.030355+0000","last_active":"2024-09-12T18:33:15.030455+0000","last_peered":"2024-09-12T18:33:15.030455+0000","last_clean":"2024-09-12T18:33:15.030455+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:33:15.030455+0000","last_undegraded":"2024-09-12T18:33:15.030455+0000","last_fullsized":"2024-09-12T18:33:15.030455+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.030175+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:29.411062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":58921,"num_write":1278,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'936","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.628775+0000","last_change":"2024-09-12T18:33:25.628715+0000","last_active":"2024-09-12T18:33:25.628775+0000","last_peered":"2024-09-12T18:33:25.628775+0000","last_clean":"2024-09-12T18:33:25.628775+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:33:25.628775+0000","last_undegraded":"2024-09-12T18:33:25.628775+0000","last_fullsized":"2024-09-12T18:33:25.628775+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'936","last_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_deep_scrub":"262'936","last_deep_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.628616+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:44.784169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'375","reported_seq":1044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.707611+0000","last_change":"2024-09-12T18:33:20.707536+0000","last_active":"2024-09-12T18:33:20.707611+0000","last_peered":"2024-09-12T18:33:20.707611+0000","last_clean":"2024-09-12T18:33:20.707611+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:33:20.707611+0000","last_undegraded":"2024-09-12T18:33:20.707611+0000","last_fullsized":"2024-09-12T18:33:20.707611+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.707383+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.729608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1189379,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":34034,"num_write":1140,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'762","reported_seq":2340,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.612686+0000","last_change":"2024-09-12T18:33:21.612612+0000","last_active":"2024-09-12T18:33:21.612686+0000","last_peered":"2024-09-12T18:33:21.612686+0000","last_clean":"2024-09-12T18:33:21.612686+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:33:21.612686+0000","last_undegraded":"2024-09-12T18:33:21.612686+0000","last_fullsized":"2024-09-12T18:33:21.612686+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'762","last_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_deep_scrub":"262'762","last_deep_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.612531+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.677937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'384","reported_seq":1025,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.645288+0000","last_change":"2024-09-12T18:33:17.645224+0000","last_active":"2024-09-12T18:33:17.645288+0000","last_peered":"2024-09-12T18:33:17.645288+0000","last_clean":"2024-09-12T18:33:17.645288+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:33:17.645288+0000","last_undegraded":"2024-09-12T18:33:17.645288+0000","last_fullsized":"2024-09-12T18:33:17.645288+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.645107+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.274616+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":12325,"num_write":1129,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1938,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.401142+0000","last_change":"2024-09-12T18:33:32.401142+0000","last_active":"2024-09-12T18:33:32.401142+0000","last_peered":"2024-09-12T18:33:32.401142+0000","last_clean":"2024-09-12T18:33:32.401142+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:33:32.401142+0000","last_undegraded":"2024-09-12T18:33:32.401142+0000","last_fullsized":"2024-09-12T18:33:32.401142+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'439","last_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_deep_scrub":"262'439","last_deep_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.401058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.885116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'389","reported_seq":1069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.203920+0000","last_change":"2024-09-12T18:33:20.203831+0000","last_active":"2024-09-12T18:33:20.203920+0000","last_peered":"2024-09-12T18:33:20.203920+0000","last_clean":"2024-09-12T18:33:20.203920+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:33:20.203920+0000","last_undegraded":"2024-09-12T18:33:20.203920+0000","last_fullsized":"2024-09-12T18:33:20.203920+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.203681+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.448871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190223,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":50386,"num_write":1084,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'483","reported_seq":2234,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.286536+0000","last_change":"2024-09-12T18:33:25.286445+0000","last_active":"2024-09-12T18:33:25.286536+0000","last_peered":"2024-09-12T18:33:25.286536+0000","last_clean":"2024-09-12T18:33:25.286536+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:33:25.286536+0000","last_undegraded":"2024-09-12T18:33:25.286536+0000","last_fullsized":"2024-09-12T18:33:25.286536+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.286332+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.078569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3572,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'331","reported_seq":1023,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.626226+0000","last_change":"2024-09-12T18:33:14.626160+0000","last_active":"2024-09-12T18:33:14.626226+0000","last_peered":"2024-09-12T18:33:14.626226+0000","last_clean":"2024-09-12T18:33:14.626226+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:33:14.626226+0000","last_undegraded":"2024-09-12T18:33:14.626226+0000","last_fullsized":"2024-09-12T18:33:14.626226+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.625987+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:07.872404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":699027,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":70299,"num_write":1012,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'482","reported_seq":2106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.357064+0000","last_change":"2024-09-12T18:33:30.357008+0000","last_active":"2024-09-12T18:33:30.357064+0000","last_peered":"2024-09-12T18:33:30.357064+0000","last_clean":"2024-09-12T18:33:30.357064+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:33:30.357064+0000","last_undegraded":"2024-09-12T18:33:30.357064+0000","last_fullsized":"2024-09-12T18:33:30.357064+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'482","last_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_deep_scrub":"262'482","last_deep_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.356905+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:21.805515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":975,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'341","reported_seq":994,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.696158+0000","last_change":"2024-09-12T18:33:15.696096+0000","last_active":"2024-09-12T18:33:15.696158+0000","last_peered":"2024-09-12T18:33:15.696158+0000","last_clean":"2024-09-12T18:33:15.696158+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:33:15.696158+0000","last_undegraded":"2024-09-12T18:33:15.696158+0000","last_fullsized":"2024-09-12T18:33:15.696158+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.695906+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.837354+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1407190,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":51065,"num_write":1119,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'542","reported_seq":2216,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.691089+0000","last_change":"2024-09-12T18:33:24.691024+0000","last_active":"2024-09-12T18:33:24.691089+0000","last_peered":"2024-09-12T18:33:24.691089+0000","last_clean":"2024-09-12T18:33:24.691089+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:33:24.691089+0000","last_undegraded":"2024-09-12T18:33:24.691089+0000","last_fullsized":"2024-09-12T18:33:24.691089+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.690944+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:08.527284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'284","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.232507+0000","last_change":"2024-09-12T18:33:17.232418+0000","last_active":"2024-09-12T18:33:17.232507+0000","last_peered":"2024-09-12T18:33:17.232507+0000","last_clean":"2024-09-12T18:33:17.232507+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:33:17.232507+0000","last_undegraded":"2024-09-12T18:33:17.232507+0000","last_fullsized":"2024-09-12T18:33:17.232507+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.232228+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:12.380580+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511862,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":37901,"num_write":823,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'587","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.620706+0000","last_change":"2024-09-12T18:33:22.620643+0000","last_active":"2024-09-12T18:33:22.620706+0000","last_peered":"2024-09-12T18:33:22.620706+0000","last_clean":"2024-09-12T18:33:22.620706+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:33:22.620706+0000","last_undegraded":"2024-09-12T18:33:22.620706+0000","last_fullsized":"2024-09-12T18:33:22.620706+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'587","last_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_deep_scrub":"262'587","last_deep_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.620530+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:42.505857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6001,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'376","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.635997+0000","last_change":"2024-09-12T18:33:16.635997+0000","last_active":"2024-09-12T18:33:16.635997+0000","last_peered":"2024-09-12T18:33:16.635997+0000","last_clean":"2024-09-12T18:33:16.635997+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:33:16.635997+0000","last_undegraded":"2024-09-12T18:33:16.635997+0000","last_fullsized":"2024-09-12T18:33:16.635997+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.635865+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:02.528484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":34152,"num_write":1143,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1181","reported_seq":2819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.253113+0000","last_change":"2024-09-12T18:33:27.253053+0000","last_active":"2024-09-12T18:33:27.253113+0000","last_peered":"2024-09-12T18:33:27.253113+0000","last_clean":"2024-09-12T18:33:27.253113+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:33:27.253113+0000","last_undegraded":"2024-09-12T18:33:27.253113+0000","last_fullsized":"2024-09-12T18:33:27.253113+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1181","last_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_deep_scrub":"262'1181","last_deep_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.252969+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":1100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:53.177342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'384","reported_seq":1095,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.196581+0000","last_change":"2024-09-12T18:33:18.196517+0000","last_active":"2024-09-12T18:33:18.196581+0000","last_peered":"2024-09-12T18:33:18.196581+0000","last_clean":"2024-09-12T18:33:18.196581+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:33:18.196581+0000","last_undegraded":"2024-09-12T18:33:18.196581+0000","last_fullsized":"2024-09-12T18:33:18.196581+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.196285+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:32.438997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":17939,"num_write":1185,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'781","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.057074+0000","last_change":"2024-09-12T18:33:18.057074+0000","last_active":"2024-09-12T18:33:18.057074+0000","last_peered":"2024-09-12T18:33:18.057074+0000","last_clean":"2024-09-12T18:33:18.057074+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:33:18.057074+0000","last_undegraded":"2024-09-12T18:33:18.057074+0000","last_fullsized":"2024-09-12T18:33:18.057074+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'781","last_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_deep_scrub":"262'781","last_deep_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.056988+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:37.444745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'498","reported_seq":1219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.074483+0000","last_change":"2024-09-12T18:33:16.074483+0000","last_active":"2024-09-12T18:33:16.074483+0000","last_peered":"2024-09-12T18:33:16.074483+0000","last_clean":"2024-09-12T18:33:16.074483+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:33:16.074483+0000","last_undegraded":"2024-09-12T18:33:16.074483+0000","last_fullsized":"2024-09-12T18:33:16.074483+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'498","last_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_deep_scrub":"262'498","last_deep_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.074328+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:08.965353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355583,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":996,"num_read_kb":22424,"num_write":1615,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'511","reported_seq":2184,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.297933+0000","last_change":"2024-09-12T18:33:26.297878+0000","last_active":"2024-09-12T18:33:26.297933+0000","last_peered":"2024-09-12T18:33:26.297933+0000","last_clean":"2024-09-12T18:33:26.297933+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:33:26.297933+0000","last_undegraded":"2024-09-12T18:33:26.297933+0000","last_fullsized":"2024-09-12T18:33:26.297933+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'511","last_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_deep_scrub":"262'511","last_deep_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.297768+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:12.130346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'323","reported_seq":949,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.616716+0000","last_change":"2024-09-12T18:33:16.616656+0000","last_active":"2024-09-12T18:33:16.616716+0000","last_peered":"2024-09-12T18:33:16.616716+0000","last_clean":"2024-09-12T18:33:16.616716+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:33:16.616716+0000","last_undegraded":"2024-09-12T18:33:16.616716+0000","last_fullsized":"2024-09-12T18:33:16.616716+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.616520+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.598136+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270110,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":8170,"num_write":997,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'785","reported_seq":2233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.000895+0000","last_change":"2024-09-12T18:33:25.000801+0000","last_active":"2024-09-12T18:33:25.000895+0000","last_peered":"2024-09-12T18:33:25.000895+0000","last_clean":"2024-09-12T18:33:25.000895+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:33:25.000895+0000","last_undegraded":"2024-09-12T18:33:25.000895+0000","last_fullsized":"2024-09-12T18:33:25.000895+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'785","last_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_deep_scrub":"262'785","last_deep_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.000690+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.295948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'333","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.699347+0000","last_change":"2024-09-12T18:33:16.699288+0000","last_active":"2024-09-12T18:33:16.699347+0000","last_peered":"2024-09-12T18:33:16.699347+0000","last_clean":"2024-09-12T18:33:16.699347+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:33:16.699347+0000","last_undegraded":"2024-09-12T18:33:16.699347+0000","last_fullsized":"2024-09-12T18:33:16.699347+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.699173+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:06.503747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652723,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":483,"num_read_kb":27896,"num_write":1098,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'571","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.654938+0000","last_change":"2024-09-12T18:33:20.654838+0000","last_active":"2024-09-12T18:33:20.654938+0000","last_peered":"2024-09-12T18:33:20.654938+0000","last_clean":"2024-09-12T18:33:20.654938+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:33:20.654938+0000","last_undegraded":"2024-09-12T18:33:20.654938+0000","last_fullsized":"2024-09-12T18:33:20.654938+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'571","last_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_deep_scrub":"262'571","last_deep_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.654735+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:00.197882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'290","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.991759+0000","last_change":"2024-09-12T18:33:18.991759+0000","last_active":"2024-09-12T18:33:18.991759+0000","last_peered":"2024-09-12T18:33:18.991759+0000","last_clean":"2024-09-12T18:33:18.991759+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:33:18.991759+0000","last_undegraded":"2024-09-12T18:33:18.991759+0000","last_fullsized":"2024-09-12T18:33:18.991759+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'290","last_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_deep_scrub":"262'290","last_deep_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.991570+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.511173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":4469,"num_write":888,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'521","reported_seq":2065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.398296+0000","last_change":"2024-09-12T18:33:34.398228+0000","last_active":"2024-09-12T18:33:34.398296+0000","last_peered":"2024-09-12T18:33:34.398296+0000","last_clean":"2024-09-12T18:33:34.398296+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:33:34.398296+0000","last_undegraded":"2024-09-12T18:33:34.398296+0000","last_fullsized":"2024-09-12T18:33:34.398296+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'521","last_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_deep_scrub":"262'521","last_deep_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.398139+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:39.160645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'317","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.101807+0000","last_change":"2024-09-12T18:33:22.101698+0000","last_active":"2024-09-12T18:33:22.101807+0000","last_peered":"2024-09-12T18:33:22.101807+0000","last_clean":"2024-09-12T18:33:22.101807+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:33:22.101807+0000","last_undegraded":"2024-09-12T18:33:22.101807+0000","last_fullsized":"2024-09-12T18:33:22.101807+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'317","last_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_deep_scrub":"262'317","last_deep_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.101570+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:04.807102+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":27660,"num_write":1072,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'392","reported_seq":1875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.957476+0000","last_change":"2024-09-12T18:33:23.957476+0000","last_active":"2024-09-12T18:33:23.957476+0000","last_peered":"2024-09-12T18:33:23.957476+0000","last_clean":"2024-09-12T18:33:23.957476+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:33:23.957476+0000","last_undegraded":"2024-09-12T18:33:23.957476+0000","last_fullsized":"2024-09-12T18:33:23.957476+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.957391+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:40.123662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'345","reported_seq":990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.705806+0000","last_change":"2024-09-12T18:33:21.705741+0000","last_active":"2024-09-12T18:33:21.705806+0000","last_peered":"2024-09-12T18:33:21.705806+0000","last_clean":"2024-09-12T18:33:21.705806+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:33:21.705806+0000","last_undegraded":"2024-09-12T18:33:21.705806+0000","last_fullsized":"2024-09-12T18:33:21.705806+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.705579+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.131383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":34548,"num_write":1063,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'376","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.681028+0000","last_change":"2024-09-12T18:33:18.680955+0000","last_active":"2024-09-12T18:33:18.681028+0000","last_peered":"2024-09-12T18:33:18.681028+0000","last_clean":"2024-09-12T18:33:18.681028+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:33:18.681028+0000","last_undegraded":"2024-09-12T18:33:18.681028+0000","last_fullsized":"2024-09-12T18:33:18.681028+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.680862+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:43.127892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052945,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":6964,"num_write":1129,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1473","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.668688+0000","last_change":"2024-09-12T18:33:26.668632+0000","last_active":"2024-09-12T18:33:26.668688+0000","last_peered":"2024-09-12T18:33:26.668688+0000","last_clean":"2024-09-12T18:33:26.668688+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:33:26.668688+0000","last_undegraded":"2024-09-12T18:33:26.668688+0000","last_fullsized":"2024-09-12T18:33:26.668688+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1473","last_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_deep_scrub":"262'1473","last_deep_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.668544+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:30.893522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'298","reported_seq":938,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.589234+0000","last_change":"2024-09-12T18:33:13.589172+0000","last_active":"2024-09-12T18:33:13.589234+0000","last_peered":"2024-09-12T18:33:13.589234+0000","last_clean":"2024-09-12T18:33:13.589234+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:33:13.589234+0000","last_undegraded":"2024-09-12T18:33:13.589234+0000","last_fullsized":"2024-09-12T18:33:13.589234+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.589042+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.715072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":8217,"num_write":971,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1017","reported_seq":2993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.623685+0000","last_change":"2024-09-12T18:33:27.623624+0000","last_active":"2024-09-12T18:33:27.623685+0000","last_peered":"2024-09-12T18:33:27.623685+0000","last_clean":"2024-09-12T18:33:27.623685+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:33:27.623685+0000","last_undegraded":"2024-09-12T18:33:27.623685+0000","last_fullsized":"2024-09-12T18:33:27.623685+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1017","last_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_deep_scrub":"262'1017","last_deep_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.623520+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.482416+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5285,"num_omap_keys":21,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1836,"ondisk_log_size":1836,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1571818,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17916,"num_read_kb":37265,"num_write":15035,"num_write_kb":11780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":681712,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43805,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3986,"ondisk_log_size":3986,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":68589489,"num_objects":377,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":36438,"num_read_kb":2030723,"num_write":72188,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93863936,"data_stored":93863936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":184607,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":188613,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575558,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144872,"kb_used_data":15128,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226968,"statfs":{"total":96636764160,"available":96488415232,"internally_reserved":0,"allocated":15491072,"data_stored":13570247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575558,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333508,"kb_used_data":13556,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038332,"statfs":{"total":96636764160,"available":96295251968,"internally_reserved":0,"allocated":13881344,"data_stored":11918715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575557,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":18096,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":18530304,"data_stored":16608104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575559,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172368,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94199472,"statfs":{"total":96636764160,"available":96460259328,"internally_reserved":0,"allocated":19529728,"data_stored":17538028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575557,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":13664,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":13991936,"data_stored":12011933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575559,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123832,"kb_used_data":12136,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94248008,"statfs":{"total":96636764160,"available":96509960192,"internally_reserved":0,"allocated":12427264,"data_stored":10520336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575557,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191932,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94179908,"statfs":{"total":96636764160,"available":96440225792,"internally_reserved":0,"allocated":16822272,"data_stored":14877078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575560,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295952,"kb_used_data":17664,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94075888,"statfs":{"total":96636764160,"available":96333709312,"internally_reserved":0,"allocated":18087936,"data_stored":16087657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13234176,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12615680,"data_stored":12615680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":8261632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11309056,"data_stored":11309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15278080,"data_stored":15278080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14348288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9068544,"data_stored":9068544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:34:14.096 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:34:14.097 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:34:14.097 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:34:14.097 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:08:43.154567+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=33, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:34:14.101 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:34:34.102 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:34:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-12T18:34:34.448 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-12T18:34:34.450 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":2030,"stamp":"2024-09-12T18:34:33.600517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70768882,"num_objects":845,"num_object_clones":0,"num_object_copies":2444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":845,"num_whiteouts":0,"num_read":292045,"num_read_kb":2658521,"num_write":161680,"num_write_kb":2423567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734318,"num_omap_keys":1773,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13588,"ondisk_log_size":13588,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1870256,"kb_used_data":125744,"kb_used_omap":12,"kb_used_meta":1744371,"kb_avail":753104464,"statfs":{"total":773094113280,"available":771178971136,"internally_reserved":0,"allocated":128761856,"data_stored":113132098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1786236464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004618"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.603005+0000","last_change":"2024-09-12T18:33:57.603005+0000","last_active":"2024-09-12T18:33:57.603005+0000","last_peered":"2024-09-12T18:33:57.603005+0000","last_clean":"2024-09-12T18:33:57.603005+0000","last_became_active":"2024-09-12T18:08:44.173507+0000","last_became_peered":"2024-09-12T18:08:44.173507+0000","last_unstale":"2024-09-12T18:33:57.603005+0000","last_undegraded":"2024-09-12T18:33:57.603005+0000","last_fullsized":"2024-09-12T18:33:57.603005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:57.602917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:57.602917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.602917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:26.937561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.656240+0000","last_change":"2024-09-12T18:33:54.656240+0000","last_active":"2024-09-12T18:33:54.656240+0000","last_peered":"2024-09-12T18:33:54.656240+0000","last_clean":"2024-09-12T18:33:54.656240+0000","last_became_active":"2024-09-12T17:53:15.157192+0000","last_became_peered":"2024-09-12T17:53:15.157192+0000","last_unstale":"2024-09-12T18:33:54.656240+0000","last_undegraded":"2024-09-12T18:33:54.656240+0000","last_fullsized":"2024-09-12T18:33:54.656240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:54.656138+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:54.656138+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.656138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:03.846883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.278771+0000","last_change":"2024-09-12T18:34:06.278771+0000","last_active":"2024-09-12T18:34:06.278771+0000","last_peered":"2024-09-12T18:34:06.278771+0000","last_clean":"2024-09-12T18:34:06.278771+0000","last_became_active":"2024-09-12T17:53:12.140861+0000","last_became_peered":"2024-09-12T17:53:12.140861+0000","last_unstale":"2024-09-12T18:34:06.278771+0000","last_undegraded":"2024-09-12T18:34:06.278771+0000","last_fullsized":"2024-09-12T18:34:06.278771+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:34:06.278682+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:34:06.278682+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.278682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:39.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'32","reported_seq":148,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.634930+0000","last_change":"2024-09-12T18:33:56.634831+0000","last_active":"2024-09-12T18:33:56.634930+0000","last_peered":"2024-09-12T18:33:56.634930+0000","last_clean":"2024-09-12T18:33:56.634930+0000","last_became_active":"2024-09-12T17:50:14.840328+0000","last_became_peered":"2024-09-12T17:50:14.840328+0000","last_unstale":"2024-09-12T18:33:56.634930+0000","last_undegraded":"2024-09-12T18:33:56.634930+0000","last_fullsized":"2024-09-12T18:33:56.634930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-12T18:33:56.634724+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-12T18:33:56.634724+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.634724+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:50.359137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":108,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.080856+0000","last_change":"2024-09-12T18:33:41.080793+0000","last_active":"2024-09-12T18:33:41.080856+0000","last_peered":"2024-09-12T18:33:41.080856+0000","last_clean":"2024-09-12T18:33:41.080856+0000","last_became_active":"2024-09-12T18:08:44.183363+0000","last_became_peered":"2024-09-12T18:08:44.183363+0000","last_unstale":"2024-09-12T18:33:41.080856+0000","last_undegraded":"2024-09-12T18:33:41.080856+0000","last_fullsized":"2024-09-12T18:33:41.080856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.080701+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.080701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:10.660771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"259'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.286984+0000","last_change":"2024-09-12T18:33:58.286984+0000","last_active":"2024-09-12T18:33:58.286984+0000","last_peered":"2024-09-12T18:33:58.286984+0000","last_clean":"2024-09-12T18:33:58.286984+0000","last_became_active":"2024-09-12T17:53:15.158437+0000","last_became_peered":"2024-09-12T17:53:15.158437+0000","last_unstale":"2024-09-12T18:33:58.286984+0000","last_undegraded":"2024-09-12T18:33:58.286984+0000","last_fullsized":"2024-09-12T18:33:58.286984+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:58.286894+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:58.286894+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.286894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:35.359079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.571618+0000","last_change":"2024-09-12T18:33:44.571618+0000","last_active":"2024-09-12T18:33:44.571618+0000","last_peered":"2024-09-12T18:33:44.571618+0000","last_clean":"2024-09-12T18:33:44.571618+0000","last_became_active":"2024-09-12T17:53:12.148254+0000","last_became_peered":"2024-09-12T17:53:12.148254+0000","last_unstale":"2024-09-12T18:33:44.571618+0000","last_undegraded":"2024-09-12T18:33:44.571618+0000","last_fullsized":"2024-09-12T18:33:44.571618+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.571533+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.571533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:16.885149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'11","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.116934+0000","last_change":"2024-09-12T18:33:34.116829+0000","last_active":"2024-09-12T18:33:34.116934+0000","last_peered":"2024-09-12T18:33:34.116934+0000","last_clean":"2024-09-12T18:33:34.116934+0000","last_became_active":"2024-09-12T17:50:14.836390+0000","last_became_peered":"2024-09-12T17:50:14.836390+0000","last_unstale":"2024-09-12T18:33:34.116934+0000","last_undegraded":"2024-09-12T18:33:34.116934+0000","last_fullsized":"2024-09-12T18:33:34.116934+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:34.116716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.116716+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:54.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.785662+0000","last_change":"2024-09-12T18:33:49.785662+0000","last_active":"2024-09-12T18:33:49.785662+0000","last_peered":"2024-09-12T18:33:49.785662+0000","last_clean":"2024-09-12T18:33:49.785662+0000","last_became_active":"2024-09-12T18:08:44.177705+0000","last_became_peered":"2024-09-12T18:08:44.177705+0000","last_unstale":"2024-09-12T18:33:49.785662+0000","last_undegraded":"2024-09-12T18:33:49.785662+0000","last_fullsized":"2024-09-12T18:33:49.785662+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.785575+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.785575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:17.247986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.668636+0000","last_change":"2024-09-12T18:34:07.668636+0000","last_active":"2024-09-12T18:34:07.668636+0000","last_peered":"2024-09-12T18:34:07.668636+0000","last_clean":"2024-09-12T18:34:07.668636+0000","last_became_active":"2024-09-12T17:53:15.152747+0000","last_became_peered":"2024-09-12T17:53:15.152747+0000","last_unstale":"2024-09-12T18:34:07.668636+0000","last_undegraded":"2024-09-12T18:34:07.668636+0000","last_fullsized":"2024-09-12T18:34:07.668636+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:07.668546+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:07.668546+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.668546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:49.670045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"259'7","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.089410+0000","last_change":"2024-09-12T18:33:40.089410+0000","last_active":"2024-09-12T18:33:40.089410+0000","last_peered":"2024-09-12T18:33:40.089410+0000","last_clean":"2024-09-12T18:33:40.089410+0000","last_became_active":"2024-09-12T17:53:12.145900+0000","last_became_peered":"2024-09-12T17:53:12.145900+0000","last_unstale":"2024-09-12T18:33:40.089410+0000","last_undegraded":"2024-09-12T18:33:40.089410+0000","last_fullsized":"2024-09-12T18:33:40.089410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-12T18:33:40.089298+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.089298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:47.053837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19466,"num_write":12,"num_write_kb":7176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'34","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.671382+0000","last_change":"2024-09-12T18:33:52.671382+0000","last_active":"2024-09-12T18:33:52.671382+0000","last_peered":"2024-09-12T18:33:52.671382+0000","last_clean":"2024-09-12T18:33:52.671382+0000","last_became_active":"2024-09-12T17:50:14.830423+0000","last_became_peered":"2024-09-12T17:50:14.830423+0000","last_unstale":"2024-09-12T18:33:52.671382+0000","last_undegraded":"2024-09-12T18:33:52.671382+0000","last_fullsized":"2024-09-12T18:33:52.671382+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-12T18:33:52.671265+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.671265+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:55.226775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.084117+0000","last_change":"2024-09-12T18:34:16.084117+0000","last_active":"2024-09-12T18:34:16.084117+0000","last_peered":"2024-09-12T18:34:16.084117+0000","last_clean":"2024-09-12T18:34:16.084117+0000","last_became_active":"2024-09-12T18:08:44.181104+0000","last_became_peered":"2024-09-12T18:08:44.181104+0000","last_unstale":"2024-09-12T18:34:16.084117+0000","last_undegraded":"2024-09-12T18:34:16.084117+0000","last_fullsized":"2024-09-12T18:34:16.084117+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:16.084032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:16.084032+0000","last_clean_scrub_stamp":"2024-09-12T18:34:16.084032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.119335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:10.234175+0000","last_change":"2024-09-12T18:34:10.234175+0000","last_active":"2024-09-12T18:34:10.234175+0000","last_peered":"2024-09-12T18:34:10.234175+0000","last_clean":"2024-09-12T18:34:10.234175+0000","last_became_active":"2024-09-12T17:53:15.164453+0000","last_became_peered":"2024-09-12T17:53:15.164453+0000","last_unstale":"2024-09-12T18:34:10.234175+0000","last_undegraded":"2024-09-12T18:34:10.234175+0000","last_fullsized":"2024-09-12T18:34:10.234175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:10.234069+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:10.234069+0000","last_clean_scrub_stamp":"2024-09-12T18:34:10.234069+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:24.268565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2101,"num_write":12,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.395840+0000","last_change":"2024-09-12T18:33:54.395840+0000","last_active":"2024-09-12T18:33:54.395840+0000","last_peered":"2024-09-12T18:33:54.395840+0000","last_clean":"2024-09-12T18:33:54.395840+0000","last_became_active":"2024-09-12T17:53:12.145316+0000","last_became_peered":"2024-09-12T17:53:12.145316+0000","last_unstale":"2024-09-12T18:33:54.395840+0000","last_undegraded":"2024-09-12T18:33:54.395840+0000","last_fullsized":"2024-09-12T18:33:54.395840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:54.395741+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:54.395741+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.395741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.004623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'48","reported_seq":194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.287301+0000","last_change":"2024-09-12T18:34:01.287301+0000","last_active":"2024-09-12T18:34:01.287301+0000","last_peered":"2024-09-12T18:34:01.287301+0000","last_clean":"2024-09-12T18:34:01.287301+0000","last_became_active":"2024-09-12T17:50:14.842381+0000","last_became_peered":"2024-09-12T17:50:14.842381+0000","last_unstale":"2024-09-12T18:34:01.287301+0000","last_undegraded":"2024-09-12T18:34:01.287301+0000","last_fullsized":"2024-09-12T18:34:01.287301+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'48","last_scrub_stamp":"2024-09-12T18:34:01.287213+0000","last_deep_scrub":"262'48","last_deep_scrub_stamp":"2024-09-12T18:34:01.287213+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.287213+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:21.398616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":180,"num_write":84,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.096515+0000","last_change":"2024-09-12T18:34:15.096515+0000","last_active":"2024-09-12T18:34:15.096515+0000","last_peered":"2024-09-12T18:34:15.096515+0000","last_clean":"2024-09-12T18:34:15.096515+0000","last_became_active":"2024-09-12T18:08:44.186873+0000","last_became_peered":"2024-09-12T18:08:44.186873+0000","last_unstale":"2024-09-12T18:34:15.096515+0000","last_undegraded":"2024-09-12T18:34:15.096515+0000","last_fullsized":"2024-09-12T18:34:15.096515+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:15.096425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:15.096425+0000","last_clean_scrub_stamp":"2024-09-12T18:34:15.096425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:10.688998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.678610+0000","last_change":"2024-09-12T18:33:53.678534+0000","last_active":"2024-09-12T18:33:53.678610+0000","last_peered":"2024-09-12T18:33:53.678610+0000","last_clean":"2024-09-12T18:33:53.678610+0000","last_became_active":"2024-09-12T17:53:15.165964+0000","last_became_peered":"2024-09-12T17:53:15.165964+0000","last_unstale":"2024-09-12T18:33:53.678610+0000","last_undegraded":"2024-09-12T18:33:53.678610+0000","last_fullsized":"2024-09-12T18:33:53.678610+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:53.678438+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:53.678438+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.678438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:56.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'7","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.646238+0000","last_change":"2024-09-12T18:34:01.646180+0000","last_active":"2024-09-12T18:34:01.646238+0000","last_peered":"2024-09-12T18:34:01.646238+0000","last_clean":"2024-09-12T18:34:01.646238+0000","last_became_active":"2024-09-12T17:53:12.141525+0000","last_became_peered":"2024-09-12T17:53:12.141525+0000","last_unstale":"2024-09-12T18:34:01.646238+0000","last_undegraded":"2024-09-12T18:34:01.646238+0000","last_fullsized":"2024-09-12T18:34:01.646238+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:01.646079+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:01.646079+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.646079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:10.825669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4114,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.322890+0000","last_change":"2024-09-12T18:33:59.322890+0000","last_active":"2024-09-12T18:33:59.322890+0000","last_peered":"2024-09-12T18:33:59.322890+0000","last_clean":"2024-09-12T18:33:59.322890+0000","last_became_active":"2024-09-12T17:50:14.840779+0000","last_became_peered":"2024-09-12T17:50:14.840779+0000","last_unstale":"2024-09-12T18:33:59.322890+0000","last_undegraded":"2024-09-12T18:33:59.322890+0000","last_fullsized":"2024-09-12T18:33:59.322890+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:59.322761+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:59.322761+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.322761+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:34.404899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":101,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.639864+0000","last_change":"2024-09-12T18:33:53.639864+0000","last_active":"2024-09-12T18:33:53.639864+0000","last_peered":"2024-09-12T18:33:53.639864+0000","last_clean":"2024-09-12T18:33:53.639864+0000","last_became_active":"2024-09-12T18:08:44.185986+0000","last_became_peered":"2024-09-12T18:08:44.185986+0000","last_unstale":"2024-09-12T18:33:53.639864+0000","last_undegraded":"2024-09-12T18:33:53.639864+0000","last_fullsized":"2024-09-12T18:33:53.639864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:53.639777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:53.639777+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.639777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:55.361489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'11","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.748151+0000","last_change":"2024-09-12T18:33:46.748051+0000","last_active":"2024-09-12T18:33:46.748151+0000","last_peered":"2024-09-12T18:33:46.748151+0000","last_clean":"2024-09-12T18:33:46.748151+0000","last_became_active":"2024-09-12T17:53:15.163761+0000","last_became_peered":"2024-09-12T17:53:15.163761+0000","last_unstale":"2024-09-12T18:33:46.748151+0000","last_undegraded":"2024-09-12T18:33:46.748151+0000","last_fullsized":"2024-09-12T18:33:46.748151+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-12T18:33:46.747953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.747953+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:04.571236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16462,"num_write":16,"num_write_kb":9252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'9","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.437274+0000","last_change":"2024-09-12T18:33:52.437205+0000","last_active":"2024-09-12T18:33:52.437274+0000","last_peered":"2024-09-12T18:33:52.437274+0000","last_clean":"2024-09-12T18:33:52.437274+0000","last_became_active":"2024-09-12T17:53:12.138815+0000","last_became_peered":"2024-09-12T17:53:12.138815+0000","last_unstale":"2024-09-12T18:33:52.437274+0000","last_undegraded":"2024-09-12T18:33:52.437274+0000","last_fullsized":"2024-09-12T18:33:52.437274+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:52.437104+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.437104+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:19.574310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13304,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'60","reported_seq":227,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.792015+0000","last_change":"2024-09-12T18:33:41.792015+0000","last_active":"2024-09-12T18:33:41.792015+0000","last_peered":"2024-09-12T18:33:41.792015+0000","last_clean":"2024-09-12T18:33:41.792015+0000","last_became_active":"2024-09-12T17:50:14.842695+0000","last_became_peered":"2024-09-12T17:50:14.842695+0000","last_unstale":"2024-09-12T18:33:41.792015+0000","last_undegraded":"2024-09-12T18:33:41.792015+0000","last_fullsized":"2024-09-12T18:33:41.792015+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-12T18:33:41.791915+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.791915+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:48.494958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":225,"num_write":118,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.315181+0000","last_change":"2024-09-12T18:34:06.315181+0000","last_active":"2024-09-12T18:34:06.315181+0000","last_peered":"2024-09-12T18:34:06.315181+0000","last_clean":"2024-09-12T18:34:06.315181+0000","last_became_active":"2024-09-12T18:08:44.184070+0000","last_became_peered":"2024-09-12T18:08:44.184070+0000","last_unstale":"2024-09-12T18:34:06.315181+0000","last_undegraded":"2024-09-12T18:34:06.315181+0000","last_fullsized":"2024-09-12T18:34:06.315181+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:06.315106+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:06.315106+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.315106+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:14.370639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'6","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.760894+0000","last_change":"2024-09-12T18:33:47.760894+0000","last_active":"2024-09-12T18:33:47.760894+0000","last_peered":"2024-09-12T18:33:47.760894+0000","last_clean":"2024-09-12T18:33:47.760894+0000","last_became_active":"2024-09-12T17:53:15.159105+0000","last_became_peered":"2024-09-12T17:53:15.159105+0000","last_unstale":"2024-09-12T18:33:47.760894+0000","last_undegraded":"2024-09-12T18:33:47.760894+0000","last_fullsized":"2024-09-12T18:33:47.760894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:47.760785+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.760785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:14.666756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6178,"num_write":6,"num_write_kb":2060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'2","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.420818+0000","last_change":"2024-09-12T18:33:53.420818+0000","last_active":"2024-09-12T18:33:53.420818+0000","last_peered":"2024-09-12T18:33:53.420818+0000","last_clean":"2024-09-12T18:33:53.420818+0000","last_became_active":"2024-09-12T17:53:12.146324+0000","last_became_peered":"2024-09-12T17:53:12.146324+0000","last_unstale":"2024-09-12T18:33:53.420818+0000","last_undegraded":"2024-09-12T18:33:53.420818+0000","last_fullsized":"2024-09-12T18:33:53.420818+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:53.420697+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.420697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.359186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'10","reported_seq":86,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.658368+0000","last_change":"2024-09-12T18:33:58.658368+0000","last_active":"2024-09-12T18:33:58.658368+0000","last_peered":"2024-09-12T18:33:58.658368+0000","last_clean":"2024-09-12T18:33:58.658368+0000","last_became_active":"2024-09-12T17:50:14.841639+0000","last_became_peered":"2024-09-12T17:50:14.841639+0000","last_unstale":"2024-09-12T18:33:58.658368+0000","last_undegraded":"2024-09-12T18:33:58.658368+0000","last_fullsized":"2024-09-12T18:33:58.658368+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-12T18:33:58.658273+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-12T18:33:58.658273+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.658273+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.818482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.310385+0000","last_change":"2024-09-12T18:34:07.310385+0000","last_active":"2024-09-12T18:34:07.310385+0000","last_peered":"2024-09-12T18:34:07.310385+0000","last_clean":"2024-09-12T18:34:07.310385+0000","last_became_active":"2024-09-12T18:08:44.186175+0000","last_became_peered":"2024-09-12T18:08:44.186175+0000","last_unstale":"2024-09-12T18:34:07.310385+0000","last_undegraded":"2024-09-12T18:34:07.310385+0000","last_fullsized":"2024-09-12T18:34:07.310385+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:07.310272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:07.310272+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.310272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:14.093943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:08.201028+0000","last_change":"2024-09-12T18:34:08.201028+0000","last_active":"2024-09-12T18:34:08.201028+0000","last_peered":"2024-09-12T18:34:08.201028+0000","last_clean":"2024-09-12T18:34:08.201028+0000","last_became_active":"2024-09-12T17:53:15.160029+0000","last_became_peered":"2024-09-12T17:53:15.160029+0000","last_unstale":"2024-09-12T18:34:08.201028+0000","last_undegraded":"2024-09-12T18:34:08.201028+0000","last_fullsized":"2024-09-12T18:34:08.201028+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:08.200914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:08.200914+0000","last_clean_scrub_stamp":"2024-09-12T18:34:08.200914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:59.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'8","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.616132+0000","last_change":"2024-09-12T18:33:59.616132+0000","last_active":"2024-09-12T18:33:59.616132+0000","last_peered":"2024-09-12T18:33:59.616132+0000","last_clean":"2024-09-12T18:33:59.616132+0000","last_became_active":"2024-09-12T17:53:12.141013+0000","last_became_peered":"2024-09-12T17:53:12.141013+0000","last_unstale":"2024-09-12T18:33:59.616132+0000","last_undegraded":"2024-09-12T18:33:59.616132+0000","last_fullsized":"2024-09-12T18:33:59.616132+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T18:33:59.616050+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T18:33:59.616050+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.616050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:47.330582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15356,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'23","reported_seq":121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.562571+0000","last_change":"2024-09-12T18:33:43.562477+0000","last_active":"2024-09-12T18:33:43.562571+0000","last_peered":"2024-09-12T18:33:43.562571+0000","last_clean":"2024-09-12T18:33:43.562571+0000","last_became_active":"2024-09-12T17:50:14.841059+0000","last_became_peered":"2024-09-12T17:50:14.841059+0000","last_unstale":"2024-09-12T18:33:43.562571+0000","last_undegraded":"2024-09-12T18:33:43.562571+0000","last_fullsized":"2024-09-12T18:33:43.562571+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-12T18:33:43.562352+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.562352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.656097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":78,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.595386+0000","last_change":"2024-09-12T18:33:50.595331+0000","last_active":"2024-09-12T18:33:50.595386+0000","last_peered":"2024-09-12T18:33:50.595386+0000","last_clean":"2024-09-12T18:33:50.595386+0000","last_became_active":"2024-09-12T18:08:44.184681+0000","last_became_peered":"2024-09-12T18:08:44.184681+0000","last_unstale":"2024-09-12T18:33:50.595386+0000","last_undegraded":"2024-09-12T18:33:50.595386+0000","last_fullsized":"2024-09-12T18:33:50.595386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:50.595231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.595231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:05.062592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.290690+0000","last_change":"2024-09-12T18:34:05.290633+0000","last_active":"2024-09-12T18:34:05.290690+0000","last_peered":"2024-09-12T18:34:05.290690+0000","last_clean":"2024-09-12T18:34:05.290690+0000","last_became_active":"2024-09-12T17:53:15.165288+0000","last_became_peered":"2024-09-12T17:53:15.165288+0000","last_unstale":"2024-09-12T18:34:05.290690+0000","last_undegraded":"2024-09-12T18:34:05.290690+0000","last_fullsized":"2024-09-12T18:34:05.290690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:05.290539+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:05.290539+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.290539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:21.088516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'6","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.654412+0000","last_change":"2024-09-12T18:33:51.654412+0000","last_active":"2024-09-12T18:33:51.654412+0000","last_peered":"2024-09-12T18:33:51.654412+0000","last_clean":"2024-09-12T18:33:51.654412+0000","last_became_active":"2024-09-12T17:53:12.143636+0000","last_became_peered":"2024-09-12T17:53:12.143636+0000","last_unstale":"2024-09-12T18:33:51.654412+0000","last_undegraded":"2024-09-12T18:33:51.654412+0000","last_fullsized":"2024-09-12T18:33:51.654412+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-12T18:33:51.654316+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.654316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8190,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'19","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.697352+0000","last_change":"2024-09-12T18:33:51.697352+0000","last_active":"2024-09-12T18:33:51.697352+0000","last_peered":"2024-09-12T18:33:51.697352+0000","last_clean":"2024-09-12T18:33:51.697352+0000","last_became_active":"2024-09-12T17:50:14.839204+0000","last_became_peered":"2024-09-12T17:50:14.839204+0000","last_unstale":"2024-09-12T18:33:51.697352+0000","last_undegraded":"2024-09-12T18:33:51.697352+0000","last_fullsized":"2024-09-12T18:33:51.697352+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:51.697203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.697203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:21.639036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.118563+0000","last_change":"2024-09-12T18:33:39.118463+0000","last_active":"2024-09-12T18:33:39.118563+0000","last_peered":"2024-09-12T18:33:39.118563+0000","last_clean":"2024-09-12T18:33:39.118563+0000","last_became_active":"2024-09-12T18:08:44.183668+0000","last_became_peered":"2024-09-12T18:08:44.183668+0000","last_unstale":"2024-09-12T18:33:39.118563+0000","last_undegraded":"2024-09-12T18:33:39.118563+0000","last_fullsized":"2024-09-12T18:33:39.118563+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:39.118340+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.118340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:21.575993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.624900+0000","last_change":"2024-09-12T18:34:02.624900+0000","last_active":"2024-09-12T18:34:02.624900+0000","last_peered":"2024-09-12T18:34:02.624900+0000","last_clean":"2024-09-12T18:34:02.624900+0000","last_became_active":"2024-09-12T17:54:16.780752+0000","last_became_peered":"2024-09-12T17:54:16.780752+0000","last_unstale":"2024-09-12T18:34:02.624900+0000","last_undegraded":"2024-09-12T18:34:02.624900+0000","last_fullsized":"2024-09-12T18:34:02.624900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T18:34:02.624813+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T18:34:02.624813+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.624813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:45.338660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.148412+0000","last_change":"2024-09-12T18:33:55.148294+0000","last_active":"2024-09-12T18:33:55.148412+0000","last_peered":"2024-09-12T18:33:55.148412+0000","last_clean":"2024-09-12T18:33:55.148412+0000","last_became_active":"2024-09-12T17:53:12.146494+0000","last_became_peered":"2024-09-12T17:53:12.146494+0000","last_unstale":"2024-09-12T18:33:55.148412+0000","last_undegraded":"2024-09-12T18:33:55.148412+0000","last_fullsized":"2024-09-12T18:33:55.148412+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:55.148192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:55.148192+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.148192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:11.052999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'24","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.332386+0000","last_change":"2024-09-12T18:33:58.332386+0000","last_active":"2024-09-12T18:33:58.332386+0000","last_peered":"2024-09-12T18:33:58.332386+0000","last_clean":"2024-09-12T18:33:58.332386+0000","last_became_active":"2024-09-12T17:50:14.840877+0000","last_became_peered":"2024-09-12T17:50:14.840877+0000","last_unstale":"2024-09-12T18:33:58.332386+0000","last_undegraded":"2024-09-12T18:33:58.332386+0000","last_fullsized":"2024-09-12T18:33:58.332386+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:58.332299+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:58.332299+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.332299+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:03.387219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.304484+0000","last_change":"2024-09-12T18:34:05.304376+0000","last_active":"2024-09-12T18:34:05.304484+0000","last_peered":"2024-09-12T18:34:05.304484+0000","last_clean":"2024-09-12T18:34:05.304484+0000","last_became_active":"2024-09-12T18:08:44.181675+0000","last_became_peered":"2024-09-12T18:08:44.181675+0000","last_unstale":"2024-09-12T18:34:05.304484+0000","last_undegraded":"2024-09-12T18:34:05.304484+0000","last_fullsized":"2024-09-12T18:34:05.304484+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:05.304275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:05.304275+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.304275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:57.259609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'7","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:07.240021+0000","last_change":"2024-09-12T18:34:07.239940+0000","last_active":"2024-09-12T18:34:07.240021+0000","last_peered":"2024-09-12T18:34:07.240021+0000","last_clean":"2024-09-12T18:34:07.240021+0000","last_became_active":"2024-09-12T17:53:15.164483+0000","last_became_peered":"2024-09-12T17:53:15.164483+0000","last_unstale":"2024-09-12T18:34:07.240021+0000","last_undegraded":"2024-09-12T18:34:07.240021+0000","last_fullsized":"2024-09-12T18:34:07.240021+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:07.239851+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:07.239851+0000","last_clean_scrub_stamp":"2024-09-12T18:34:07.239851+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:20.384844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20478,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.031082+0000","last_change":"2024-09-12T18:33:37.030992+0000","last_active":"2024-09-12T18:33:37.031082+0000","last_peered":"2024-09-12T18:33:37.031082+0000","last_clean":"2024-09-12T18:33:37.031082+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:33:37.031082+0000","last_undegraded":"2024-09-12T18:33:37.031082+0000","last_fullsized":"2024-09-12T18:33:37.031082+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:37.030874+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.030874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:11.608998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4132,"num_write":4,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'27","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.131760+0000","last_change":"2024-09-12T18:33:31.131681+0000","last_active":"2024-09-12T18:33:31.131760+0000","last_peered":"2024-09-12T18:33:31.131760+0000","last_clean":"2024-09-12T18:33:31.131760+0000","last_became_active":"2024-09-12T17:50:14.844792+0000","last_became_peered":"2024-09-12T17:50:14.844792+0000","last_unstale":"2024-09-12T18:33:31.131760+0000","last_undegraded":"2024-09-12T18:33:31.131760+0000","last_fullsized":"2024-09-12T18:33:31.131760+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:31.131587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.131587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.722593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":91,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.608041+0000","last_change":"2024-09-12T18:33:56.607963+0000","last_active":"2024-09-12T18:33:56.608041+0000","last_peered":"2024-09-12T18:33:56.608041+0000","last_clean":"2024-09-12T18:33:56.608041+0000","last_became_active":"2024-09-12T18:08:44.172780+0000","last_became_peered":"2024-09-12T18:08:44.172780+0000","last_unstale":"2024-09-12T18:33:56.608041+0000","last_undegraded":"2024-09-12T18:33:56.608041+0000","last_fullsized":"2024-09-12T18:33:56.608041+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:56.607878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:56.607878+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.607878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:15.303254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.255699+0000","last_change":"2024-09-12T18:33:59.255614+0000","last_active":"2024-09-12T18:33:59.255699+0000","last_peered":"2024-09-12T18:33:59.255699+0000","last_clean":"2024-09-12T18:33:59.255699+0000","last_became_active":"2024-09-12T17:53:15.159514+0000","last_became_peered":"2024-09-12T17:53:15.159514+0000","last_unstale":"2024-09-12T18:33:59.255699+0000","last_undegraded":"2024-09-12T18:33:59.255699+0000","last_fullsized":"2024-09-12T18:33:59.255699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:59.255496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:59.255496+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.255496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:30.467073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"259'4","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.667170+0000","last_change":"2024-09-12T18:33:57.667044+0000","last_active":"2024-09-12T18:33:57.667170+0000","last_peered":"2024-09-12T18:33:57.667170+0000","last_clean":"2024-09-12T18:33:57.667170+0000","last_became_active":"2024-09-12T17:53:12.143444+0000","last_became_peered":"2024-09-12T17:53:12.143444+0000","last_unstale":"2024-09-12T18:33:57.667170+0000","last_undegraded":"2024-09-12T18:33:57.667170+0000","last_fullsized":"2024-09-12T18:33:57.667170+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:57.666942+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.666942+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.666942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:19.965742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'69","reported_seq":317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.117485+0000","last_change":"2024-09-12T18:33:49.117485+0000","last_active":"2024-09-12T18:33:49.117485+0000","last_peered":"2024-09-12T18:33:49.117485+0000","last_clean":"2024-09-12T18:33:49.117485+0000","last_became_active":"2024-09-12T17:50:14.841644+0000","last_became_peered":"2024-09-12T17:50:14.841644+0000","last_unstale":"2024-09-12T18:33:49.117485+0000","last_undegraded":"2024-09-12T18:33:49.117485+0000","last_fullsized":"2024-09-12T18:33:49.117485+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'69","last_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_deep_scrub":"262'69","last_deep_scrub_stamp":"2024-09-12T18:33:49.117387+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.117387+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:26.470549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":505,"num_read_kb":341,"num_write":79,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2510,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:14.137016+0000","last_change":"2024-09-12T18:34:14.137016+0000","last_active":"2024-09-12T18:34:14.137016+0000","last_peered":"2024-09-12T18:34:14.137016+0000","last_clean":"2024-09-12T18:34:14.137016+0000","last_became_active":"2024-09-12T18:08:44.187992+0000","last_became_peered":"2024-09-12T18:08:44.187992+0000","last_unstale":"2024-09-12T18:34:14.137016+0000","last_undegraded":"2024-09-12T18:34:14.137016+0000","last_fullsized":"2024-09-12T18:34:14.137016+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:14.136939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:14.136939+0000","last_clean_scrub_stamp":"2024-09-12T18:34:14.136939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:30.662419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.562587+0000","last_change":"2024-09-12T18:33:49.562587+0000","last_active":"2024-09-12T18:33:49.562587+0000","last_peered":"2024-09-12T18:33:49.562587+0000","last_clean":"2024-09-12T18:33:49.562587+0000","last_became_active":"2024-09-12T17:53:15.159731+0000","last_became_peered":"2024-09-12T17:53:15.159731+0000","last_unstale":"2024-09-12T18:33:49.562587+0000","last_undegraded":"2024-09-12T18:33:49.562587+0000","last_fullsized":"2024-09-12T18:33:49.562587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.562461+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.562461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:32.217105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"259'4","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.479709+0000","last_change":"2024-09-12T18:33:50.479709+0000","last_active":"2024-09-12T18:33:50.479709+0000","last_peered":"2024-09-12T18:33:50.479709+0000","last_clean":"2024-09-12T18:33:50.479709+0000","last_became_active":"2024-09-12T17:53:12.137947+0000","last_became_peered":"2024-09-12T17:53:12.137947+0000","last_unstale":"2024-09-12T18:33:50.479709+0000","last_undegraded":"2024-09-12T18:33:50.479709+0000","last_fullsized":"2024-09-12T18:33:50.479709+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:50.479625+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.479625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:19.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'86","reported_seq":306,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.068448+0000","last_change":"2024-09-12T18:33:48.068448+0000","last_active":"2024-09-12T18:33:48.068448+0000","last_peered":"2024-09-12T18:33:48.068448+0000","last_clean":"2024-09-12T18:33:48.068448+0000","last_became_active":"2024-09-12T17:50:14.839234+0000","last_became_peered":"2024-09-12T17:50:14.839234+0000","last_unstale":"2024-09-12T18:33:48.068448+0000","last_undegraded":"2024-09-12T18:33:48.068448+0000","last_fullsized":"2024-09-12T18:33:48.068448+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'86","last_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_deep_scrub":"262'86","last_deep_scrub_stamp":"2024-09-12T18:33:48.068336+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.068336+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:23.878729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":347,"num_write":138,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.708962+0000","last_change":"2024-09-12T18:34:09.708962+0000","last_active":"2024-09-12T18:34:09.708962+0000","last_peered":"2024-09-12T18:34:09.708962+0000","last_clean":"2024-09-12T18:34:09.708962+0000","last_became_active":"2024-09-12T18:08:44.184487+0000","last_became_peered":"2024-09-12T18:08:44.184487+0000","last_unstale":"2024-09-12T18:34:09.708962+0000","last_undegraded":"2024-09-12T18:34:09.708962+0000","last_fullsized":"2024-09-12T18:34:09.708962+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:09.708863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:09.708863+0000","last_clean_scrub_stamp":"2024-09-12T18:34:09.708863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:31.980918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.549641+0000","last_change":"2024-09-12T18:33:48.549641+0000","last_active":"2024-09-12T18:33:48.549641+0000","last_peered":"2024-09-12T18:33:48.549641+0000","last_clean":"2024-09-12T18:33:48.549641+0000","last_became_active":"2024-09-12T17:53:15.161591+0000","last_became_peered":"2024-09-12T17:53:15.161591+0000","last_unstale":"2024-09-12T18:33:48.549641+0000","last_undegraded":"2024-09-12T18:33:48.549641+0000","last_fullsized":"2024-09-12T18:33:48.549641+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:48.549549+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.549549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:57.676603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.328787+0000","last_change":"2024-09-12T18:34:00.328787+0000","last_active":"2024-09-12T18:34:00.328787+0000","last_peered":"2024-09-12T18:34:00.328787+0000","last_clean":"2024-09-12T18:34:00.328787+0000","last_became_active":"2024-09-12T17:53:12.138538+0000","last_became_peered":"2024-09-12T17:53:12.138538+0000","last_unstale":"2024-09-12T18:34:00.328787+0000","last_undegraded":"2024-09-12T18:34:00.328787+0000","last_fullsized":"2024-09-12T18:34:00.328787+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:34:00.328701+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:34:00.328701+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.328701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:29.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'19","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.688319+0000","last_change":"2024-09-12T18:33:48.688319+0000","last_active":"2024-09-12T18:33:48.688319+0000","last_peered":"2024-09-12T18:33:48.688319+0000","last_clean":"2024-09-12T18:33:48.688319+0000","last_became_active":"2024-09-12T17:50:14.840351+0000","last_became_peered":"2024-09-12T17:50:14.840351+0000","last_unstale":"2024-09-12T18:33:48.688319+0000","last_undegraded":"2024-09-12T18:33:48.688319+0000","last_fullsized":"2024-09-12T18:33:48.688319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-12T18:33:48.688232+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.688232+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:31.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.704866+0000","last_change":"2024-09-12T18:34:06.704802+0000","last_active":"2024-09-12T18:34:06.704866+0000","last_peered":"2024-09-12T18:34:06.704866+0000","last_clean":"2024-09-12T18:34:06.704866+0000","last_became_active":"2024-09-12T18:08:44.182669+0000","last_became_peered":"2024-09-12T18:08:44.182669+0000","last_unstale":"2024-09-12T18:34:06.704866+0000","last_undegraded":"2024-09-12T18:34:06.704866+0000","last_fullsized":"2024-09-12T18:34:06.704866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:06.704718+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:06.704718+0000","last_clean_scrub_stamp":"2024-09-12T18:34:06.704718+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:07.410479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.309905+0000","last_change":"2024-09-12T18:34:04.309905+0000","last_active":"2024-09-12T18:34:04.309905+0000","last_peered":"2024-09-12T18:34:04.309905+0000","last_clean":"2024-09-12T18:34:04.309905+0000","last_became_active":"2024-09-12T17:53:15.165687+0000","last_became_peered":"2024-09-12T17:53:15.165687+0000","last_unstale":"2024-09-12T18:34:04.309905+0000","last_undegraded":"2024-09-12T18:34:04.309905+0000","last_fullsized":"2024-09-12T18:34:04.309905+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:04.309777+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:04.309777+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.309777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:09.083897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.750115+0000","last_change":"2024-09-12T18:33:43.750115+0000","last_active":"2024-09-12T18:33:43.750115+0000","last_peered":"2024-09-12T18:33:43.750115+0000","last_clean":"2024-09-12T18:33:43.750115+0000","last_became_active":"2024-09-12T17:53:12.148504+0000","last_became_peered":"2024-09-12T17:53:12.148504+0000","last_unstale":"2024-09-12T18:33:43.750115+0000","last_undegraded":"2024-09-12T18:33:43.750115+0000","last_fullsized":"2024-09-12T18:33:43.750115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:43.750030+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.750030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:15.962557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16370,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'30","reported_seq":149,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.435189+0000","last_change":"2024-09-12T18:33:51.435189+0000","last_active":"2024-09-12T18:33:51.435189+0000","last_peered":"2024-09-12T18:33:51.435189+0000","last_clean":"2024-09-12T18:33:51.435189+0000","last_became_active":"2024-09-12T17:50:14.841198+0000","last_became_peered":"2024-09-12T17:50:14.841198+0000","last_unstale":"2024-09-12T18:33:51.435189+0000","last_undegraded":"2024-09-12T18:33:51.435189+0000","last_fullsized":"2024-09-12T18:33:51.435189+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-12T18:33:51.435102+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.435102+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:43.729892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":118,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'2","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:13.175899+0000","last_change":"2024-09-12T18:34:13.175899+0000","last_active":"2024-09-12T18:34:13.175899+0000","last_peered":"2024-09-12T18:34:13.175899+0000","last_clean":"2024-09-12T18:34:13.175899+0000","last_became_active":"2024-09-12T18:08:44.182492+0000","last_became_peered":"2024-09-12T18:08:44.182492+0000","last_unstale":"2024-09-12T18:34:13.175899+0000","last_undegraded":"2024-09-12T18:34:13.175899+0000","last_fullsized":"2024-09-12T18:34:13.175899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:13.175806+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:13.175806+0000","last_clean_scrub_stamp":"2024-09-12T18:34:13.175806+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:05.126306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.776324+0000","last_change":"2024-09-12T18:33:45.776324+0000","last_active":"2024-09-12T18:33:45.776324+0000","last_peered":"2024-09-12T18:33:45.776324+0000","last_clean":"2024-09-12T18:33:45.776324+0000","last_became_active":"2024-09-12T17:53:15.158584+0000","last_became_peered":"2024-09-12T17:53:15.158584+0000","last_unstale":"2024-09-12T18:33:45.776324+0000","last_undegraded":"2024-09-12T18:33:45.776324+0000","last_fullsized":"2024-09-12T18:33:45.776324+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.776236+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.776236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.587480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.733575+0000","last_change":"2024-09-12T18:33:49.733575+0000","last_active":"2024-09-12T18:33:49.733575+0000","last_peered":"2024-09-12T18:33:49.733575+0000","last_clean":"2024-09-12T18:33:49.733575+0000","last_became_active":"2024-09-12T17:53:12.146310+0000","last_became_peered":"2024-09-12T17:53:12.146310+0000","last_unstale":"2024-09-12T18:33:49.733575+0000","last_undegraded":"2024-09-12T18:33:49.733575+0000","last_fullsized":"2024-09-12T18:33:49.733575+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:49.733492+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.733492+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:11.435583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":91,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.216930+0000","last_change":"2024-09-12T18:34:11.216930+0000","last_active":"2024-09-12T18:34:11.216930+0000","last_peered":"2024-09-12T18:34:11.216930+0000","last_clean":"2024-09-12T18:34:11.216930+0000","last_became_active":"2024-09-12T17:50:14.841802+0000","last_became_peered":"2024-09-12T17:50:14.841802+0000","last_unstale":"2024-09-12T18:34:11.216930+0000","last_undegraded":"2024-09-12T18:34:11.216930+0000","last_fullsized":"2024-09-12T18:34:11.216930+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-12T18:34:11.216830+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-12T18:34:11.216830+0000","last_clean_scrub_stamp":"2024-09-12T18:34:11.216830+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:23.607051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.077276+0000","last_change":"2024-09-12T18:33:38.077276+0000","last_active":"2024-09-12T18:33:38.077276+0000","last_peered":"2024-09-12T18:33:38.077276+0000","last_clean":"2024-09-12T18:33:38.077276+0000","last_became_active":"2024-09-12T18:08:44.180140+0000","last_became_peered":"2024-09-12T18:08:44.180140+0000","last_unstale":"2024-09-12T18:33:38.077276+0000","last_undegraded":"2024-09-12T18:33:38.077276+0000","last_fullsized":"2024-09-12T18:33:38.077276+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.077154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.077154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:15.304159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.298206+0000","last_change":"2024-09-12T18:34:02.298206+0000","last_active":"2024-09-12T18:34:02.298206+0000","last_peered":"2024-09-12T18:34:02.298206+0000","last_clean":"2024-09-12T18:34:02.298206+0000","last_became_active":"2024-09-12T17:53:15.164595+0000","last_became_peered":"2024-09-12T17:53:15.164595+0000","last_unstale":"2024-09-12T18:34:02.298206+0000","last_undegraded":"2024-09-12T18:34:02.298206+0000","last_fullsized":"2024-09-12T18:34:02.298206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:34:02.298114+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:34:02.298114+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.298114+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:26.016355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.157624+0000","last_change":"2024-09-12T18:33:54.157624+0000","last_active":"2024-09-12T18:33:54.157624+0000","last_peered":"2024-09-12T18:33:54.157624+0000","last_clean":"2024-09-12T18:33:54.157624+0000","last_became_active":"2024-09-12T17:53:12.144337+0000","last_became_peered":"2024-09-12T17:53:12.144337+0000","last_unstale":"2024-09-12T18:33:54.157624+0000","last_undegraded":"2024-09-12T18:33:54.157624+0000","last_fullsized":"2024-09-12T18:33:54.157624+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:54.157540+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:54.157540+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.157540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:11.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'33","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.330603+0000","last_change":"2024-09-12T18:33:57.330603+0000","last_active":"2024-09-12T18:33:57.330603+0000","last_peered":"2024-09-12T18:33:57.330603+0000","last_clean":"2024-09-12T18:33:57.330603+0000","last_became_active":"2024-09-12T17:50:14.843723+0000","last_became_peered":"2024-09-12T17:50:14.843723+0000","last_unstale":"2024-09-12T18:33:57.330603+0000","last_undegraded":"2024-09-12T18:33:57.330603+0000","last_fullsized":"2024-09-12T18:33:57.330603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-12T18:33:57.330521+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-12T18:33:57.330521+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.330521+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:51.818049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":97,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.177927+0000","last_change":"2024-09-12T18:34:02.177927+0000","last_active":"2024-09-12T18:34:02.177927+0000","last_peered":"2024-09-12T18:34:02.177927+0000","last_clean":"2024-09-12T18:34:02.177927+0000","last_became_active":"2024-09-12T18:08:44.186280+0000","last_became_peered":"2024-09-12T18:08:44.186280+0000","last_unstale":"2024-09-12T18:34:02.177927+0000","last_undegraded":"2024-09-12T18:34:02.177927+0000","last_fullsized":"2024-09-12T18:34:02.177927+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:02.177809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:02.177809+0000","last_clean_scrub_stamp":"2024-09-12T18:34:02.177809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:33.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"259'4","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.203337+0000","last_change":"2024-09-12T18:34:09.203337+0000","last_active":"2024-09-12T18:34:09.203337+0000","last_peered":"2024-09-12T18:34:09.203337+0000","last_clean":"2024-09-12T18:34:09.203337+0000","last_became_active":"2024-09-12T17:53:15.163192+0000","last_became_peered":"2024-09-12T17:53:15.163192+0000","last_unstale":"2024-09-12T18:34:09.203337+0000","last_undegraded":"2024-09-12T18:34:09.203337+0000","last_fullsized":"2024-09-12T18:34:09.203337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:34:09.203248+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:34:09.203248+0000","last_clean_scrub_stamp":"2024-09-12T18:34:09.203248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:48.064161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'6","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.059842+0000","last_change":"2024-09-12T18:33:36.059779+0000","last_active":"2024-09-12T18:33:36.059842+0000","last_peered":"2024-09-12T18:33:36.059842+0000","last_clean":"2024-09-12T18:33:36.059842+0000","last_became_active":"2024-09-12T17:53:12.142036+0000","last_became_peered":"2024-09-12T17:53:12.142036+0000","last_unstale":"2024-09-12T18:33:36.059842+0000","last_undegraded":"2024-09-12T18:33:36.059842+0000","last_fullsized":"2024-09-12T18:33:36.059842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:36.059690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.059690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.315136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7180,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'39","reported_seq":167,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.710357+0000","last_change":"2024-09-12T18:33:48.710357+0000","last_active":"2024-09-12T18:33:48.710357+0000","last_peered":"2024-09-12T18:33:48.710357+0000","last_clean":"2024-09-12T18:33:48.710357+0000","last_became_active":"2024-09-12T17:50:14.842480+0000","last_became_peered":"2024-09-12T17:50:14.842480+0000","last_unstale":"2024-09-12T18:33:48.710357+0000","last_undegraded":"2024-09-12T18:33:48.710357+0000","last_fullsized":"2024-09-12T18:33:48.710357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'39","last_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_deep_scrub":"262'39","last_deep_scrub_stamp":"2024-09-12T18:33:48.710256+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.710256+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:19.803857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":144,"num_write":65,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.796099+0000","last_change":"2024-09-12T18:33:48.796099+0000","last_active":"2024-09-12T18:33:48.796099+0000","last_peered":"2024-09-12T18:33:48.796099+0000","last_clean":"2024-09-12T18:33:48.796099+0000","last_became_active":"2024-09-12T18:08:44.182316+0000","last_became_peered":"2024-09-12T18:08:44.182316+0000","last_unstale":"2024-09-12T18:33:48.796099+0000","last_undegraded":"2024-09-12T18:33:48.796099+0000","last_fullsized":"2024-09-12T18:33:48.796099+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.796012+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.796012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:53.301486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.506111+0000","last_change":"2024-09-12T18:33:46.506056+0000","last_active":"2024-09-12T18:33:46.506111+0000","last_peered":"2024-09-12T18:33:46.506111+0000","last_clean":"2024-09-12T18:33:46.506111+0000","last_became_active":"2024-09-12T17:53:15.162699+0000","last_became_peered":"2024-09-12T17:53:15.162699+0000","last_unstale":"2024-09-12T18:33:46.506111+0000","last_undegraded":"2024-09-12T18:33:46.506111+0000","last_fullsized":"2024-09-12T18:33:46.506111+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:46.505974+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.505974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:34.339593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8190,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'7","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.650248+0000","last_change":"2024-09-12T18:33:54.650248+0000","last_active":"2024-09-12T18:33:54.650248+0000","last_peered":"2024-09-12T18:33:54.650248+0000","last_clean":"2024-09-12T18:33:54.650248+0000","last_became_active":"2024-09-12T17:53:12.146346+0000","last_became_peered":"2024-09-12T17:53:12.146346+0000","last_unstale":"2024-09-12T18:33:54.650248+0000","last_undegraded":"2024-09-12T18:33:54.650248+0000","last_fullsized":"2024-09-12T18:33:54.650248+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:54.650160+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:54.650160+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.650160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:51.167384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4146,"num_write":12,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'27","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.785539+0000","last_change":"2024-09-12T18:33:40.785539+0000","last_active":"2024-09-12T18:33:40.785539+0000","last_peered":"2024-09-12T18:33:40.785539+0000","last_clean":"2024-09-12T18:33:40.785539+0000","last_became_active":"2024-09-12T17:50:14.845225+0000","last_became_peered":"2024-09-12T17:50:14.845225+0000","last_unstale":"2024-09-12T18:33:40.785539+0000","last_undegraded":"2024-09-12T18:33:40.785539+0000","last_fullsized":"2024-09-12T18:33:40.785539+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:40.785448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.785448+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.888653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.171731+0000","last_change":"2024-09-12T18:34:01.171731+0000","last_active":"2024-09-12T18:34:01.171731+0000","last_peered":"2024-09-12T18:34:01.171731+0000","last_clean":"2024-09-12T18:34:01.171731+0000","last_became_active":"2024-09-12T18:08:44.181167+0000","last_became_peered":"2024-09-12T18:08:44.181167+0000","last_unstale":"2024-09-12T18:34:01.171731+0000","last_undegraded":"2024-09-12T18:34:01.171731+0000","last_fullsized":"2024-09-12T18:34:01.171731+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:01.171642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:01.171642+0000","last_clean_scrub_stamp":"2024-09-12T18:34:01.171642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:50.344534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.286838+0000","last_change":"2024-09-12T18:34:03.286838+0000","last_active":"2024-09-12T18:34:03.286838+0000","last_peered":"2024-09-12T18:34:03.286838+0000","last_clean":"2024-09-12T18:34:03.286838+0000","last_became_active":"2024-09-12T17:53:15.163904+0000","last_became_peered":"2024-09-12T17:53:15.163904+0000","last_unstale":"2024-09-12T18:34:03.286838+0000","last_undegraded":"2024-09-12T18:34:03.286838+0000","last_fullsized":"2024-09-12T18:34:03.286838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:03.286747+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:03.286747+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.286747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:06.956604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"259'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.533567+0000","last_change":"2024-09-12T18:33:45.533486+0000","last_active":"2024-09-12T18:33:45.533567+0000","last_peered":"2024-09-12T18:33:45.533567+0000","last_clean":"2024-09-12T18:33:45.533567+0000","last_became_active":"2024-09-12T17:53:12.149367+0000","last_became_peered":"2024-09-12T17:53:12.149367+0000","last_unstale":"2024-09-12T18:33:45.533567+0000","last_undegraded":"2024-09-12T18:33:45.533567+0000","last_fullsized":"2024-09-12T18:33:45.533567+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:45.533395+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.533395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:25.583217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'24","reported_seq":129,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.126504+0000","last_change":"2024-09-12T18:33:32.126504+0000","last_active":"2024-09-12T18:33:32.126504+0000","last_peered":"2024-09-12T18:33:32.126504+0000","last_clean":"2024-09-12T18:33:32.126504+0000","last_became_active":"2024-09-12T17:50:14.840551+0000","last_became_peered":"2024-09-12T17:50:14.840551+0000","last_unstale":"2024-09-12T18:33:32.126504+0000","last_undegraded":"2024-09-12T18:33:32.126504+0000","last_fullsized":"2024-09-12T18:33:32.126504+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:32.126421+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.126421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:07.003050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":49,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:12.216358+0000","last_change":"2024-09-12T18:34:12.216358+0000","last_active":"2024-09-12T18:34:12.216358+0000","last_peered":"2024-09-12T18:34:12.216358+0000","last_clean":"2024-09-12T18:34:12.216358+0000","last_became_active":"2024-09-12T18:08:44.186335+0000","last_became_peered":"2024-09-12T18:08:44.186335+0000","last_unstale":"2024-09-12T18:34:12.216358+0000","last_undegraded":"2024-09-12T18:34:12.216358+0000","last_fullsized":"2024-09-12T18:34:12.216358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:12.216264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:12.216264+0000","last_clean_scrub_stamp":"2024-09-12T18:34:12.216264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:07.942311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.277178+0000","last_change":"2024-09-12T18:33:57.277123+0000","last_active":"2024-09-12T18:33:57.277178+0000","last_peered":"2024-09-12T18:33:57.277178+0000","last_clean":"2024-09-12T18:33:57.277178+0000","last_became_active":"2024-09-12T17:53:15.165982+0000","last_became_peered":"2024-09-12T17:53:15.165982+0000","last_unstale":"2024-09-12T18:33:57.277178+0000","last_undegraded":"2024-09-12T18:33:57.277178+0000","last_fullsized":"2024-09-12T18:33:57.277178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:57.277040+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.277040+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.277040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:35.099600+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.670601+0000","last_change":"2024-09-12T18:33:55.670539+0000","last_active":"2024-09-12T18:33:55.670601+0000","last_peered":"2024-09-12T18:33:55.670601+0000","last_clean":"2024-09-12T18:33:55.670601+0000","last_became_active":"2024-09-12T17:53:12.146229+0000","last_became_peered":"2024-09-12T17:53:12.146229+0000","last_unstale":"2024-09-12T18:33:55.670601+0000","last_undegraded":"2024-09-12T18:33:55.670601+0000","last_fullsized":"2024-09-12T18:33:55.670601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:55.670447+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:55.670447+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.670447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:37.900786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'84","reported_seq":361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.726698+0000","last_change":"2024-09-12T18:33:47.726698+0000","last_active":"2024-09-12T18:33:47.726698+0000","last_peered":"2024-09-12T18:33:47.726698+0000","last_clean":"2024-09-12T18:33:47.726698+0000","last_became_active":"2024-09-12T17:50:14.838710+0000","last_became_peered":"2024-09-12T17:50:14.838710+0000","last_unstale":"2024-09-12T18:33:47.726698+0000","last_undegraded":"2024-09-12T18:33:47.726698+0000","last_fullsized":"2024-09-12T18:33:47.726698+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'84","last_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_deep_scrub":"262'84","last_deep_scrub_stamp":"2024-09-12T18:33:47.726617+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.726617+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:13.084915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":388,"num_write":101,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.254406+0000","last_change":"2024-09-12T18:34:04.254406+0000","last_active":"2024-09-12T18:34:04.254406+0000","last_peered":"2024-09-12T18:34:04.254406+0000","last_clean":"2024-09-12T18:34:04.254406+0000","last_became_active":"2024-09-12T18:08:44.184277+0000","last_became_peered":"2024-09-12T18:08:44.184277+0000","last_unstale":"2024-09-12T18:34:04.254406+0000","last_undegraded":"2024-09-12T18:34:04.254406+0000","last_fullsized":"2024-09-12T18:34:04.254406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:04.254316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:04.254316+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.254316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:15.882484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.143070+0000","last_change":"2024-09-12T18:33:56.143012+0000","last_active":"2024-09-12T18:33:56.143070+0000","last_peered":"2024-09-12T18:33:56.143070+0000","last_clean":"2024-09-12T18:33:56.143070+0000","last_became_active":"2024-09-12T17:53:15.161478+0000","last_became_peered":"2024-09-12T17:53:15.161478+0000","last_unstale":"2024-09-12T18:33:56.143070+0000","last_undegraded":"2024-09-12T18:33:56.143070+0000","last_fullsized":"2024-09-12T18:33:56.143070+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:56.142906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:56.142906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.142906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:14.497993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.540994+0000","last_change":"2024-09-12T18:33:42.540924+0000","last_active":"2024-09-12T18:33:42.540994+0000","last_peered":"2024-09-12T18:33:42.540994+0000","last_clean":"2024-09-12T18:33:42.540994+0000","last_became_active":"2024-09-12T17:53:12.148399+0000","last_became_peered":"2024-09-12T17:53:12.148399+0000","last_unstale":"2024-09-12T18:33:42.540994+0000","last_undegraded":"2024-09-12T18:33:42.540994+0000","last_fullsized":"2024-09-12T18:33:42.540994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:42.540836+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.540836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:50.406845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2093,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'58","reported_seq":216,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.101232+0000","last_change":"2024-09-12T18:33:47.101176+0000","last_active":"2024-09-12T18:33:47.101232+0000","last_peered":"2024-09-12T18:33:47.101232+0000","last_clean":"2024-09-12T18:33:47.101232+0000","last_became_active":"2024-09-12T17:50:14.841250+0000","last_became_peered":"2024-09-12T17:50:14.841250+0000","last_unstale":"2024-09-12T18:33:47.101232+0000","last_undegraded":"2024-09-12T18:33:47.101232+0000","last_fullsized":"2024-09-12T18:33:47.101232+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:47.101091+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.101091+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:51.288656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":203,"num_write":98,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.206340+0000","last_change":"2024-09-12T18:34:03.206340+0000","last_active":"2024-09-12T18:34:03.206340+0000","last_peered":"2024-09-12T18:34:03.206340+0000","last_clean":"2024-09-12T18:34:03.206340+0000","last_became_active":"2024-09-12T18:08:44.183770+0000","last_became_peered":"2024-09-12T18:08:44.183770+0000","last_unstale":"2024-09-12T18:34:03.206340+0000","last_undegraded":"2024-09-12T18:34:03.206340+0000","last_fullsized":"2024-09-12T18:34:03.206340+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:34:03.206241+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:34:03.206241+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.206241+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:22.591761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.578293+0000","last_change":"2024-09-12T18:33:51.578293+0000","last_active":"2024-09-12T18:33:51.578293+0000","last_peered":"2024-09-12T18:33:51.578293+0000","last_clean":"2024-09-12T18:33:51.578293+0000","last_became_active":"2024-09-12T17:53:15.161735+0000","last_became_peered":"2024-09-12T17:53:15.161735+0000","last_unstale":"2024-09-12T18:33:51.578293+0000","last_undegraded":"2024-09-12T18:33:51.578293+0000","last_fullsized":"2024-09-12T18:33:51.578293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:51.578175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.578175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.289043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"259'5","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.670169+0000","last_change":"2024-09-12T18:33:53.670112+0000","last_active":"2024-09-12T18:33:53.670169+0000","last_peered":"2024-09-12T18:33:53.670169+0000","last_clean":"2024-09-12T18:33:53.670169+0000","last_became_active":"2024-09-12T17:53:12.142793+0000","last_became_peered":"2024-09-12T17:53:12.142793+0000","last_unstale":"2024-09-12T18:33:53.670169+0000","last_undegraded":"2024-09-12T18:33:53.670169+0000","last_fullsized":"2024-09-12T18:33:53.670169+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-12T18:33:53.670042+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-12T18:33:53.670042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.670042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:40.935315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'15","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.289361+0000","last_change":"2024-09-12T18:33:56.289361+0000","last_active":"2024-09-12T18:33:56.289361+0000","last_peered":"2024-09-12T18:33:56.289361+0000","last_clean":"2024-09-12T18:33:56.289361+0000","last_became_active":"2024-09-12T17:50:14.838238+0000","last_became_peered":"2024-09-12T17:50:14.838238+0000","last_unstale":"2024-09-12T18:33:56.289361+0000","last_undegraded":"2024-09-12T18:33:56.289361+0000","last_fullsized":"2024-09-12T18:33:56.289361+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'15","last_scrub_stamp":"2024-09-12T18:33:56.289258+0000","last_deep_scrub":"262'15","last_deep_scrub_stamp":"2024-09-12T18:33:56.289258+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.289258+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:51.706219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":50,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.659712+0000","last_change":"2024-09-12T18:34:05.659712+0000","last_active":"2024-09-12T18:34:05.659712+0000","last_peered":"2024-09-12T18:34:05.659712+0000","last_clean":"2024-09-12T18:34:05.659712+0000","last_became_active":"2024-09-12T18:08:44.179054+0000","last_became_peered":"2024-09-12T18:08:44.179054+0000","last_unstale":"2024-09-12T18:34:05.659712+0000","last_undegraded":"2024-09-12T18:34:05.659712+0000","last_fullsized":"2024-09-12T18:34:05.659712+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:05.659624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:05.659624+0000","last_clean_scrub_stamp":"2024-09-12T18:34:05.659624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:40.915862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'7","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.062486+0000","last_change":"2024-09-12T18:33:58.062486+0000","last_active":"2024-09-12T18:33:58.062486+0000","last_peered":"2024-09-12T18:33:58.062486+0000","last_clean":"2024-09-12T18:33:58.062486+0000","last_became_active":"2024-09-12T17:53:15.165435+0000","last_became_peered":"2024-09-12T17:53:15.165435+0000","last_unstale":"2024-09-12T18:33:58.062486+0000","last_undegraded":"2024-09-12T18:33:58.062486+0000","last_fullsized":"2024-09-12T18:33:58.062486+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:58.062381+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:58.062381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:58.062381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:47.376420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":12,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.483317+0000","last_change":"2024-09-12T18:33:49.483317+0000","last_active":"2024-09-12T18:33:49.483317+0000","last_peered":"2024-09-12T18:33:49.483317+0000","last_clean":"2024-09-12T18:33:49.483317+0000","last_became_active":"2024-09-12T17:53:12.146697+0000","last_became_peered":"2024-09-12T17:53:12.146697+0000","last_unstale":"2024-09-12T18:33:49.483317+0000","last_undegraded":"2024-09-12T18:33:49.483317+0000","last_fullsized":"2024-09-12T18:33:49.483317+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:49.483230+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.483230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:14.375303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'32","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.742508+0000","last_change":"2024-09-12T18:33:39.742508+0000","last_active":"2024-09-12T18:33:39.742508+0000","last_peered":"2024-09-12T18:33:39.742508+0000","last_clean":"2024-09-12T18:33:39.742508+0000","last_became_active":"2024-09-12T17:50:14.844839+0000","last_became_peered":"2024-09-12T17:50:14.844839+0000","last_unstale":"2024-09-12T18:33:39.742508+0000","last_undegraded":"2024-09-12T18:33:39.742508+0000","last_fullsized":"2024-09-12T18:33:39.742508+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-12T18:33:39.742414+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.742414+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.937032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":103,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.135521+0000","last_change":"2024-09-12T18:34:00.135521+0000","last_active":"2024-09-12T18:34:00.135521+0000","last_peered":"2024-09-12T18:34:00.135521+0000","last_clean":"2024-09-12T18:34:00.135521+0000","last_became_active":"2024-09-12T18:08:44.182817+0000","last_became_peered":"2024-09-12T18:08:44.182817+0000","last_unstale":"2024-09-12T18:34:00.135521+0000","last_undegraded":"2024-09-12T18:34:00.135521+0000","last_fullsized":"2024-09-12T18:34:00.135521+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.135407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.135407+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.135407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:28.404131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"259'8","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:03.653640+0000","last_change":"2024-09-12T18:34:03.653640+0000","last_active":"2024-09-12T18:34:03.653640+0000","last_peered":"2024-09-12T18:34:03.653640+0000","last_clean":"2024-09-12T18:34:03.653640+0000","last_became_active":"2024-09-12T17:53:15.157315+0000","last_became_peered":"2024-09-12T17:53:15.157315+0000","last_unstale":"2024-09-12T18:34:03.653640+0000","last_undegraded":"2024-09-12T18:34:03.653640+0000","last_fullsized":"2024-09-12T18:34:03.653640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-12T18:34:03.653506+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-12T18:34:03.653506+0000","last_clean_scrub_stamp":"2024-09-12T18:34:03.653506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:23.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.129011+0000","last_change":"2024-09-12T18:33:51.129011+0000","last_active":"2024-09-12T18:33:51.129011+0000","last_peered":"2024-09-12T18:33:51.129011+0000","last_clean":"2024-09-12T18:33:51.129011+0000","last_became_active":"2024-09-12T17:53:12.146528+0000","last_became_peered":"2024-09-12T17:53:12.146528+0000","last_unstale":"2024-09-12T18:33:51.129011+0000","last_undegraded":"2024-09-12T18:33:51.129011+0000","last_fullsized":"2024-09-12T18:33:51.129011+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:51.128916+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.128916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:09.750403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'43","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.684159+0000","last_change":"2024-09-12T18:33:50.684159+0000","last_active":"2024-09-12T18:33:50.684159+0000","last_peered":"2024-09-12T18:33:50.684159+0000","last_clean":"2024-09-12T18:33:50.684159+0000","last_became_active":"2024-09-12T17:50:14.842942+0000","last_became_peered":"2024-09-12T17:50:14.842942+0000","last_unstale":"2024-09-12T18:33:50.684159+0000","last_undegraded":"2024-09-12T18:33:50.684159+0000","last_fullsized":"2024-09-12T18:33:50.684159+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'43","last_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_deep_scrub":"262'43","last_deep_scrub_stamp":"2024-09-12T18:33:50.684073+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.684073+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:13.128231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":96,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.643660+0000","last_change":"2024-09-12T18:33:55.643660+0000","last_active":"2024-09-12T18:33:55.643660+0000","last_peered":"2024-09-12T18:33:55.643660+0000","last_clean":"2024-09-12T18:33:55.643660+0000","last_became_active":"2024-09-12T18:08:44.183226+0000","last_became_peered":"2024-09-12T18:08:44.183226+0000","last_unstale":"2024-09-12T18:33:55.643660+0000","last_undegraded":"2024-09-12T18:33:55.643660+0000","last_fullsized":"2024-09-12T18:33:55.643660+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:55.643552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:55.643552+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.643552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.038750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.621929+0000","last_change":"2024-09-12T18:34:00.621929+0000","last_active":"2024-09-12T18:34:00.621929+0000","last_peered":"2024-09-12T18:34:00.621929+0000","last_clean":"2024-09-12T18:34:00.621929+0000","last_became_active":"2024-09-12T17:53:15.159793+0000","last_became_peered":"2024-09-12T17:53:15.159793+0000","last_unstale":"2024-09-12T18:34:00.621929+0000","last_undegraded":"2024-09-12T18:34:00.621929+0000","last_fullsized":"2024-09-12T18:34:00.621929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.621842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.621842+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.621842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:53.443577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.072762+0000","last_change":"2024-09-12T18:33:35.072762+0000","last_active":"2024-09-12T18:33:35.072762+0000","last_peered":"2024-09-12T18:33:35.072762+0000","last_clean":"2024-09-12T18:33:35.072762+0000","last_became_active":"2024-09-12T17:53:12.145018+0000","last_became_peered":"2024-09-12T17:53:12.145018+0000","last_unstale":"2024-09-12T18:33:35.072762+0000","last_undegraded":"2024-09-12T18:33:35.072762+0000","last_fullsized":"2024-09-12T18:33:35.072762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T18:33:35.072666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.072666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:25.314427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'20","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.790476+0000","last_change":"2024-09-12T18:33:38.790476+0000","last_active":"2024-09-12T18:33:38.790476+0000","last_peered":"2024-09-12T18:33:38.790476+0000","last_clean":"2024-09-12T18:33:38.790476+0000","last_became_active":"2024-09-12T17:50:14.845356+0000","last_became_peered":"2024-09-12T17:50:14.845356+0000","last_unstale":"2024-09-12T18:33:38.790476+0000","last_undegraded":"2024-09-12T18:33:38.790476+0000","last_fullsized":"2024-09-12T18:33:38.790476+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'20","last_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_deep_scrub":"262'20","last_deep_scrub_stamp":"2024-09-12T18:33:38.790391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.790391+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:37.347221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.625450+0000","last_change":"2024-09-12T18:33:52.625450+0000","last_active":"2024-09-12T18:33:52.625450+0000","last_peered":"2024-09-12T18:33:52.625450+0000","last_clean":"2024-09-12T18:33:52.625450+0000","last_became_active":"2024-09-12T18:08:44.179893+0000","last_became_peered":"2024-09-12T18:08:44.179893+0000","last_unstale":"2024-09-12T18:33:52.625450+0000","last_undegraded":"2024-09-12T18:33:52.625450+0000","last_fullsized":"2024-09-12T18:33:52.625450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:52.625356+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.625356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:27.503484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"259'4","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.100263+0000","last_change":"2024-09-12T18:33:57.100164+0000","last_active":"2024-09-12T18:33:57.100263+0000","last_peered":"2024-09-12T18:33:57.100263+0000","last_clean":"2024-09-12T18:33:57.100263+0000","last_became_active":"2024-09-12T17:53:15.161100+0000","last_became_peered":"2024-09-12T17:53:15.161100+0000","last_unstale":"2024-09-12T18:33:57.100263+0000","last_undegraded":"2024-09-12T18:33:57.100263+0000","last_fullsized":"2024-09-12T18:33:57.100263+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-12T18:33:57.100053+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-12T18:33:57.100053+0000","last_clean_scrub_stamp":"2024-09-12T18:33:57.100053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:10.839810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'7","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.693210+0000","last_change":"2024-09-12T18:33:50.693090+0000","last_active":"2024-09-12T18:33:50.693210+0000","last_peered":"2024-09-12T18:33:50.693210+0000","last_clean":"2024-09-12T18:33:50.693210+0000","last_became_active":"2024-09-12T17:53:12.147276+0000","last_became_peered":"2024-09-12T17:53:12.147276+0000","last_unstale":"2024-09-12T18:33:50.693210+0000","last_undegraded":"2024-09-12T18:33:50.693210+0000","last_fullsized":"2024-09-12T18:33:50.693210+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:50.692996+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.692996+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:25.897723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20468,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'36","reported_seq":163,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.052887+0000","last_change":"2024-09-12T18:33:46.052767+0000","last_active":"2024-09-12T18:33:46.052887+0000","last_peered":"2024-09-12T18:33:46.052887+0000","last_clean":"2024-09-12T18:33:46.052887+0000","last_became_active":"2024-09-12T17:50:14.842712+0000","last_became_peered":"2024-09-12T17:50:14.842712+0000","last_unstale":"2024-09-12T18:33:46.052887+0000","last_undegraded":"2024-09-12T18:33:46.052887+0000","last_fullsized":"2024-09-12T18:33:46.052887+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-12T18:33:46.052674+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.052674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:08.793575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":129,"num_write":67,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.293661+0000","last_change":"2024-09-12T18:34:00.293661+0000","last_active":"2024-09-12T18:34:00.293661+0000","last_peered":"2024-09-12T18:34:00.293661+0000","last_clean":"2024-09-12T18:34:00.293661+0000","last_became_active":"2024-09-12T18:08:44.186059+0000","last_became_peered":"2024-09-12T18:08:44.186059+0000","last_unstale":"2024-09-12T18:34:00.293661+0000","last_undegraded":"2024-09-12T18:34:00.293661+0000","last_fullsized":"2024-09-12T18:34:00.293661+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:00.293574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:00.293574+0000","last_clean_scrub_stamp":"2024-09-12T18:34:00.293574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:18.050085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'7","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.325385+0000","last_change":"2024-09-12T18:33:56.325325+0000","last_active":"2024-09-12T18:33:56.325385+0000","last_peered":"2024-09-12T18:33:56.325385+0000","last_clean":"2024-09-12T18:33:56.325385+0000","last_became_active":"2024-09-12T17:53:15.158131+0000","last_became_peered":"2024-09-12T17:53:15.158131+0000","last_unstale":"2024-09-12T18:33:56.325385+0000","last_undegraded":"2024-09-12T18:33:56.325385+0000","last_fullsized":"2024-09-12T18:33:56.325385+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T18:33:56.325233+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T18:33:56.325233+0000","last_clean_scrub_stamp":"2024-09-12T18:33:56.325233+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:18.970965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.125597+0000","last_change":"2024-09-12T18:33:53.125508+0000","last_active":"2024-09-12T18:33:53.125597+0000","last_peered":"2024-09-12T18:33:53.125597+0000","last_clean":"2024-09-12T18:33:53.125597+0000","last_became_active":"2024-09-12T17:53:12.144273+0000","last_became_peered":"2024-09-12T17:53:12.144273+0000","last_unstale":"2024-09-12T18:33:53.125597+0000","last_undegraded":"2024-09-12T18:33:53.125597+0000","last_fullsized":"2024-09-12T18:33:53.125597+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-12T18:33:53.125359+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-12T18:33:53.125359+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.125359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:57.895933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.559275+0000","last_change":"2024-09-12T18:33:40.559181+0000","last_active":"2024-09-12T18:33:40.559275+0000","last_peered":"2024-09-12T18:33:40.559275+0000","last_clean":"2024-09-12T18:33:40.559275+0000","last_became_active":"2024-09-12T17:50:14.843108+0000","last_became_peered":"2024-09-12T17:50:14.843108+0000","last_unstale":"2024-09-12T18:33:40.559275+0000","last_undegraded":"2024-09-12T18:33:40.559275+0000","last_fullsized":"2024-09-12T18:33:40.559275+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.559081+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.559081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:57.983997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.073004+0000","last_change":"2024-09-12T18:33:42.073004+0000","last_active":"2024-09-12T18:33:42.073004+0000","last_peered":"2024-09-12T18:33:42.073004+0000","last_clean":"2024-09-12T18:33:42.073004+0000","last_became_active":"2024-09-12T18:08:44.185217+0000","last_became_peered":"2024-09-12T18:08:44.185217+0000","last_unstale":"2024-09-12T18:33:42.073004+0000","last_undegraded":"2024-09-12T18:33:42.073004+0000","last_fullsized":"2024-09-12T18:33:42.073004+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.072907+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.072907+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:31.992134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'9","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.551587+0000","last_change":"2024-09-12T18:33:47.551587+0000","last_active":"2024-09-12T18:33:47.551587+0000","last_peered":"2024-09-12T18:33:47.551587+0000","last_clean":"2024-09-12T18:33:47.551587+0000","last_became_active":"2024-09-12T17:53:15.155912+0000","last_became_peered":"2024-09-12T17:53:15.155912+0000","last_unstale":"2024-09-12T18:33:47.551587+0000","last_undegraded":"2024-09-12T18:33:47.551587+0000","last_fullsized":"2024-09-12T18:33:47.551587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-12T18:33:47.551500+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.551500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:34.296392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":21492,"num_write":14,"num_write_kb":13304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"259'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.142147+0000","last_change":"2024-09-12T18:33:50.142147+0000","last_active":"2024-09-12T18:33:50.142147+0000","last_peered":"2024-09-12T18:33:50.142147+0000","last_clean":"2024-09-12T18:33:50.142147+0000","last_became_active":"2024-09-12T17:53:12.148057+0000","last_became_peered":"2024-09-12T17:53:12.148057+0000","last_unstale":"2024-09-12T18:33:50.142147+0000","last_undegraded":"2024-09-12T18:33:50.142147+0000","last_fullsized":"2024-09-12T18:33:50.142147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:50.142028+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.142028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.397527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'63","reported_seq":229,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.667526+0000","last_change":"2024-09-12T18:33:47.667434+0000","last_active":"2024-09-12T18:33:47.667526+0000","last_peered":"2024-09-12T18:33:47.667526+0000","last_clean":"2024-09-12T18:33:47.667526+0000","last_became_active":"2024-09-12T17:50:14.845523+0000","last_became_peered":"2024-09-12T17:50:14.845523+0000","last_unstale":"2024-09-12T18:33:47.667526+0000","last_undegraded":"2024-09-12T18:33:47.667526+0000","last_fullsized":"2024-09-12T18:33:47.667526+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'63","last_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_deep_scrub":"262'63","last_deep_scrub_stamp":"2024-09-12T18:33:47.667339+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.667339+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:42.294995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":220,"num_write":113,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:08.678599+0000","last_change":"2024-09-12T18:34:08.678599+0000","last_active":"2024-09-12T18:34:08.678599+0000","last_peered":"2024-09-12T18:34:08.678599+0000","last_clean":"2024-09-12T18:34:08.678599+0000","last_became_active":"2024-09-12T18:08:44.181482+0000","last_became_peered":"2024-09-12T18:08:44.181482+0000","last_unstale":"2024-09-12T18:34:08.678599+0000","last_undegraded":"2024-09-12T18:34:08.678599+0000","last_fullsized":"2024-09-12T18:34:08.678599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:08.678510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:08.678510+0000","last_clean_scrub_stamp":"2024-09-12T18:34:08.678510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:51.760983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"262'4","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.701536+0000","last_change":"2024-09-12T18:33:52.701536+0000","last_active":"2024-09-12T18:33:52.701536+0000","last_peered":"2024-09-12T18:33:52.701536+0000","last_clean":"2024-09-12T18:33:52.701536+0000","last_became_active":"2024-09-12T17:53:15.159109+0000","last_became_peered":"2024-09-12T17:53:15.159109+0000","last_unstale":"2024-09-12T18:33:52.701536+0000","last_undegraded":"2024-09-12T18:33:52.701536+0000","last_fullsized":"2024-09-12T18:33:52.701536+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:52.701450+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:52.701450+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.701450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:55.312962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4192,"num_write":4,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.137464+0000","last_change":"2024-09-12T18:33:52.137464+0000","last_active":"2024-09-12T18:33:52.137464+0000","last_peered":"2024-09-12T18:33:52.137464+0000","last_clean":"2024-09-12T18:33:52.137464+0000","last_became_active":"2024-09-12T17:53:12.141035+0000","last_became_peered":"2024-09-12T17:53:12.141035+0000","last_unstale":"2024-09-12T18:33:52.137464+0000","last_undegraded":"2024-09-12T18:33:52.137464+0000","last_fullsized":"2024-09-12T18:33:52.137464+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:52.137345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.137345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:19.251983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'27","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.410686+0000","last_change":"2024-09-12T18:33:47.410627+0000","last_active":"2024-09-12T18:33:47.410686+0000","last_peered":"2024-09-12T18:33:47.410686+0000","last_clean":"2024-09-12T18:33:47.410686+0000","last_became_active":"2024-09-12T17:50:14.840702+0000","last_became_peered":"2024-09-12T17:50:14.840702+0000","last_unstale":"2024-09-12T18:33:47.410686+0000","last_undegraded":"2024-09-12T18:33:47.410686+0000","last_fullsized":"2024-09-12T18:33:47.410686+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-12T18:33:47.410546+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.410546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:13.633680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:34:04.633381+0000","last_change":"2024-09-12T18:34:04.633381+0000","last_active":"2024-09-12T18:34:04.633381+0000","last_peered":"2024-09-12T18:34:04.633381+0000","last_clean":"2024-09-12T18:34:04.633381+0000","last_became_active":"2024-09-12T18:08:44.178515+0000","last_became_peered":"2024-09-12T18:08:44.178515+0000","last_unstale":"2024-09-12T18:34:04.633381+0000","last_undegraded":"2024-09-12T18:34:04.633381+0000","last_fullsized":"2024-09-12T18:34:04.633381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:34:04.633261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:34:04.633261+0000","last_clean_scrub_stamp":"2024-09-12T18:34:04.633261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:18.388540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.746737+0000","last_change":"2024-09-12T18:33:44.746737+0000","last_active":"2024-09-12T18:33:44.746737+0000","last_peered":"2024-09-12T18:33:44.746737+0000","last_clean":"2024-09-12T18:33:44.746737+0000","last_became_active":"2024-09-12T17:53:15.166750+0000","last_became_peered":"2024-09-12T17:53:15.166750+0000","last_unstale":"2024-09-12T18:33:44.746737+0000","last_undegraded":"2024-09-12T18:33:44.746737+0000","last_fullsized":"2024-09-12T18:33:44.746737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-12T18:33:44.746644+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.746644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:18.534212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.527686+0000","last_change":"2024-09-12T18:33:41.527686+0000","last_active":"2024-09-12T18:33:41.527686+0000","last_peered":"2024-09-12T18:33:41.527686+0000","last_clean":"2024-09-12T18:33:41.527686+0000","last_became_active":"2024-09-12T17:53:12.145227+0000","last_became_peered":"2024-09-12T17:53:12.145227+0000","last_unstale":"2024-09-12T18:33:41.527686+0000","last_undegraded":"2024-09-12T18:33:41.527686+0000","last_fullsized":"2024-09-12T18:33:41.527686+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:41.527572+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.527572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:40.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'52","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.802501+0000","last_change":"2024-09-12T18:33:37.802441+0000","last_active":"2024-09-12T18:33:37.802501+0000","last_peered":"2024-09-12T18:33:37.802501+0000","last_clean":"2024-09-12T18:33:37.802501+0000","last_became_active":"2024-09-12T17:50:14.840022+0000","last_became_peered":"2024-09-12T17:50:14.840022+0000","last_unstale":"2024-09-12T18:33:37.802501+0000","last_undegraded":"2024-09-12T18:33:37.802501+0000","last_fullsized":"2024-09-12T18:33:37.802501+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'52","last_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_deep_scrub":"262'52","last_deep_scrub_stamp":"2024-09-12T18:33:37.802357+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.802357+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:54.223569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":186,"num_write":85,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.111458+0000","last_change":"2024-09-12T18:33:59.111458+0000","last_active":"2024-09-12T18:33:59.111458+0000","last_peered":"2024-09-12T18:33:59.111458+0000","last_clean":"2024-09-12T18:33:59.111458+0000","last_became_active":"2024-09-12T18:08:44.186426+0000","last_became_peered":"2024-09-12T18:08:44.186426+0000","last_unstale":"2024-09-12T18:33:59.111458+0000","last_undegraded":"2024-09-12T18:33:59.111458+0000","last_fullsized":"2024-09-12T18:33:59.111458+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:59.111334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:59.111334+0000","last_clean_scrub_stamp":"2024-09-12T18:33:59.111334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:07.084191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.373207+0000","last_change":"2024-09-12T18:33:55.373207+0000","last_active":"2024-09-12T18:33:55.373207+0000","last_peered":"2024-09-12T18:33:55.373207+0000","last_clean":"2024-09-12T18:33:55.373207+0000","last_became_active":"2024-09-12T17:53:15.157240+0000","last_became_peered":"2024-09-12T17:53:15.157240+0000","last_unstale":"2024-09-12T18:33:55.373207+0000","last_undegraded":"2024-09-12T18:33:55.373207+0000","last_fullsized":"2024-09-12T18:33:55.373207+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:55.373123+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:55.373123+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.373123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:35.554496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.749770+0000","last_change":"2024-09-12T18:33:42.749770+0000","last_active":"2024-09-12T18:33:42.749770+0000","last_peered":"2024-09-12T18:33:42.749770+0000","last_clean":"2024-09-12T18:33:42.749770+0000","last_became_active":"2024-09-12T17:53:12.143581+0000","last_became_peered":"2024-09-12T17:53:12.143581+0000","last_unstale":"2024-09-12T18:33:42.749770+0000","last_undegraded":"2024-09-12T18:33:42.749770+0000","last_fullsized":"2024-09-12T18:33:42.749770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:42.749692+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.749692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.877571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'24","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.076324+0000","last_change":"2024-09-12T18:33:45.076246+0000","last_active":"2024-09-12T18:33:45.076324+0000","last_peered":"2024-09-12T18:33:45.076324+0000","last_clean":"2024-09-12T18:33:45.076324+0000","last_became_active":"2024-09-12T17:50:14.843126+0000","last_became_peered":"2024-09-12T17:50:14.843126+0000","last_unstale":"2024-09-12T18:33:45.076324+0000","last_undegraded":"2024-09-12T18:33:45.076324+0000","last_fullsized":"2024-09-12T18:33:45.076324+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-12T18:33:45.076154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.076154+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:12.368273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'356","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.002581+0000","last_change":"2024-09-12T18:33:23.002517+0000","last_active":"2024-09-12T18:33:23.002581+0000","last_peered":"2024-09-12T18:33:23.002581+0000","last_clean":"2024-09-12T18:33:23.002581+0000","last_became_active":"2024-09-12T17:35:40.896449+0000","last_became_peered":"2024-09-12T17:35:40.896449+0000","last_unstale":"2024-09-12T18:33:23.002581+0000","last_undegraded":"2024-09-12T18:33:23.002581+0000","last_fullsized":"2024-09-12T18:33:23.002581+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'356","last_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_deep_scrub":"262'356","last_deep_scrub_stamp":"2024-09-12T18:33:23.002381+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.002381+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:15.336304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":13512,"num_write":1124,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'539","reported_seq":1959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.650205+0000","last_change":"2024-09-12T18:33:28.650205+0000","last_active":"2024-09-12T18:33:28.650205+0000","last_peered":"2024-09-12T18:33:28.650205+0000","last_clean":"2024-09-12T18:33:28.650205+0000","last_became_active":"2024-09-12T17:35:42.889849+0000","last_became_peered":"2024-09-12T17:35:42.889849+0000","last_unstale":"2024-09-12T18:33:28.650205+0000","last_undegraded":"2024-09-12T18:33:28.650205+0000","last_fullsized":"2024-09-12T18:33:28.650205+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'539","last_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_deep_scrub":"262'539","last_deep_scrub_stamp":"2024-09-12T18:33:28.650119+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.650119+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:52.021435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2402,"num_write":705,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":773,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'418","reported_seq":1206,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.544344+0000","last_change":"2024-09-12T18:33:18.544275+0000","last_active":"2024-09-12T18:33:18.544344+0000","last_peered":"2024-09-12T18:33:18.544344+0000","last_clean":"2024-09-12T18:33:18.544344+0000","last_became_active":"2024-09-12T17:35:40.895019+0000","last_became_peered":"2024-09-12T17:35:40.895019+0000","last_unstale":"2024-09-12T18:33:18.544344+0000","last_undegraded":"2024-09-12T18:33:18.544344+0000","last_fullsized":"2024-09-12T18:33:18.544344+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'418","last_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_deep_scrub":"262'418","last_deep_scrub_stamp":"2024-09-12T18:33:18.544159+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.544159+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:31.620304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342084,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":23039,"num_write":1345,"num_write_kb":35744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'487","reported_seq":2080,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.047086+0000","last_change":"2024-09-12T18:33:27.047086+0000","last_active":"2024-09-12T18:33:27.047086+0000","last_peered":"2024-09-12T18:33:27.047086+0000","last_clean":"2024-09-12T18:33:27.047086+0000","last_became_active":"2024-09-12T17:35:42.887515+0000","last_became_peered":"2024-09-12T17:35:42.887515+0000","last_unstale":"2024-09-12T18:33:27.047086+0000","last_undegraded":"2024-09-12T18:33:27.047086+0000","last_fullsized":"2024-09-12T18:33:27.047086+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:27.047001+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.047001+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:35.965293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2400,"num_write":576,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'386","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.295051+0000","last_change":"2024-09-12T18:33:24.295051+0000","last_active":"2024-09-12T18:33:24.295051+0000","last_peered":"2024-09-12T18:33:24.295051+0000","last_clean":"2024-09-12T18:33:24.295051+0000","last_became_active":"2024-09-12T17:36:16.047860+0000","last_became_peered":"2024-09-12T17:36:16.047860+0000","last_unstale":"2024-09-12T18:33:24.295051+0000","last_undegraded":"2024-09-12T18:33:24.295051+0000","last_fullsized":"2024-09-12T18:33:24.295051+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'386","last_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_deep_scrub":"262'386","last_deep_scrub_stamp":"2024-09-12T18:33:24.294831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.294831+0000","objects_scrubbed":9,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:26.207847+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342186,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":764,"num_read_kb":32762,"num_write":1205,"num_write_kb":33682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"262'420","reported_seq":1932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.309452+0000","last_change":"2024-09-12T18:33:30.309452+0000","last_active":"2024-09-12T18:33:30.309452+0000","last_peered":"2024-09-12T18:33:30.309452+0000","last_clean":"2024-09-12T18:33:30.309452+0000","last_became_active":"2024-09-12T17:35:42.891763+0000","last_became_peered":"2024-09-12T17:35:42.891763+0000","last_unstale":"2024-09-12T18:33:30.309452+0000","last_undegraded":"2024-09-12T18:33:30.309452+0000","last_fullsized":"2024-09-12T18:33:30.309452+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:30.309353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.309353+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.906318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2119,"num_write":486,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'347","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.680429+0000","last_change":"2024-09-12T18:33:22.680367+0000","last_active":"2024-09-12T18:33:22.680429+0000","last_peered":"2024-09-12T18:33:22.680429+0000","last_clean":"2024-09-12T18:33:22.680429+0000","last_became_active":"2024-09-12T17:35:40.878316+0000","last_became_peered":"2024-09-12T17:35:40.878316+0000","last_unstale":"2024-09-12T18:33:22.680429+0000","last_undegraded":"2024-09-12T18:33:22.680429+0000","last_fullsized":"2024-09-12T18:33:22.680429+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'347","last_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_deep_scrub":"262'347","last_deep_scrub_stamp":"2024-09-12T18:33:22.680245+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.680245+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:30.990184+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":25007,"num_write":1079,"num_write_kb":32775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'463","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.634928+0000","last_change":"2024-09-12T18:33:24.634928+0000","last_active":"2024-09-12T18:33:24.634928+0000","last_peered":"2024-09-12T18:33:24.634928+0000","last_clean":"2024-09-12T18:33:24.634928+0000","last_became_active":"2024-09-12T17:35:42.901212+0000","last_became_peered":"2024-09-12T17:35:42.901212+0000","last_unstale":"2024-09-12T18:33:24.634928+0000","last_undegraded":"2024-09-12T18:33:24.634928+0000","last_fullsized":"2024-09-12T18:33:24.634928+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'463","last_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_deep_scrub":"262'463","last_deep_scrub_stamp":"2024-09-12T18:33:24.634835+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.634835+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.682588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2544,"num_read_kb":2384,"num_write":557,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'325","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.976983+0000","last_change":"2024-09-12T18:33:21.976983+0000","last_active":"2024-09-12T18:33:21.976983+0000","last_peered":"2024-09-12T18:33:21.976983+0000","last_clean":"2024-09-12T18:33:21.976983+0000","last_became_active":"2024-09-12T17:35:40.893434+0000","last_became_peered":"2024-09-12T17:35:40.893434+0000","last_unstale":"2024-09-12T18:33:21.976983+0000","last_undegraded":"2024-09-12T18:33:21.976983+0000","last_fullsized":"2024-09-12T18:33:21.976983+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-12T18:33:21.976849+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.976849+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:40.343209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":10934,"num_write":1041,"num_write_kb":25100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'858","reported_seq":2391,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.686947+0000","last_change":"2024-09-12T18:33:25.686890+0000","last_active":"2024-09-12T18:33:25.686947+0000","last_peered":"2024-09-12T18:33:25.686947+0000","last_clean":"2024-09-12T18:33:25.686947+0000","last_became_active":"2024-09-12T17:35:42.896335+0000","last_became_peered":"2024-09-12T17:35:42.896335+0000","last_unstale":"2024-09-12T18:33:25.686947+0000","last_undegraded":"2024-09-12T18:33:25.686947+0000","last_fullsized":"2024-09-12T18:33:25.686947+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'858","last_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_deep_scrub":"262'858","last_deep_scrub_stamp":"2024-09-12T18:33:25.686759+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.686759+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:21.725139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3995,"num_read_kb":3568,"num_write":1134,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'339","reported_seq":1142,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.669828+0000","last_change":"2024-09-12T18:33:19.669828+0000","last_active":"2024-09-12T18:33:19.669828+0000","last_peered":"2024-09-12T18:33:19.669828+0000","last_clean":"2024-09-12T18:33:19.669828+0000","last_became_active":"2024-09-12T17:35:40.882156+0000","last_became_peered":"2024-09-12T17:35:40.882156+0000","last_unstale":"2024-09-12T18:33:19.669828+0000","last_undegraded":"2024-09-12T18:33:19.669828+0000","last_fullsized":"2024-09-12T18:33:19.669828+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-12T18:33:19.669637+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.669637+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:57.288656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287593,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":903,"num_read_kb":42337,"num_write":1288,"num_write_kb":35188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'786","reported_seq":2416,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.356890+0000","last_change":"2024-09-12T18:33:31.356822+0000","last_active":"2024-09-12T18:33:31.356890+0000","last_peered":"2024-09-12T18:33:31.356890+0000","last_clean":"2024-09-12T18:33:31.356890+0000","last_became_active":"2024-09-12T17:35:42.891861+0000","last_became_peered":"2024-09-12T17:35:42.891861+0000","last_unstale":"2024-09-12T18:33:31.356890+0000","last_undegraded":"2024-09-12T18:33:31.356890+0000","last_fullsized":"2024-09-12T18:33:31.356890+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'786","last_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_deep_scrub":"262'786","last_deep_scrub_stamp":"2024-09-12T18:33:31.356710+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.356710+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:49.539854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3771,"num_read_kb":3428,"num_write":1001,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'359","reported_seq":997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.952233+0000","last_change":"2024-09-12T18:33:20.952233+0000","last_active":"2024-09-12T18:33:20.952233+0000","last_peered":"2024-09-12T18:33:20.952233+0000","last_clean":"2024-09-12T18:33:20.952233+0000","last_became_active":"2024-09-12T17:35:40.890921+0000","last_became_peered":"2024-09-12T17:35:40.890921+0000","last_unstale":"2024-09-12T18:33:20.952233+0000","last_undegraded":"2024-09-12T18:33:20.952233+0000","last_fullsized":"2024-09-12T18:33:20.952233+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:20.952116+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.952116+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.745872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170843,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":26409,"num_write":1171,"num_write_kb":40310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'466","reported_seq":1972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.600823+0000","last_change":"2024-09-12T18:33:29.600741+0000","last_active":"2024-09-12T18:33:29.600823+0000","last_peered":"2024-09-12T18:33:29.600823+0000","last_clean":"2024-09-12T18:33:29.600823+0000","last_became_active":"2024-09-12T17:35:42.887488+0000","last_became_peered":"2024-09-12T17:35:42.887488+0000","last_unstale":"2024-09-12T18:33:29.600823+0000","last_undegraded":"2024-09-12T18:33:29.600823+0000","last_fullsized":"2024-09-12T18:33:29.600823+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'466","last_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_deep_scrub":"262'466","last_deep_scrub_stamp":"2024-09-12T18:33:29.600661+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.600661+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:52.255182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2355,"num_read_kb":2198,"num_write":562,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'400","reported_seq":1043,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.292029+0000","last_change":"2024-09-12T18:33:22.292029+0000","last_active":"2024-09-12T18:33:22.292029+0000","last_peered":"2024-09-12T18:33:22.292029+0000","last_clean":"2024-09-12T18:33:22.292029+0000","last_became_active":"2024-09-12T17:35:40.879021+0000","last_became_peered":"2024-09-12T17:35:40.879021+0000","last_unstale":"2024-09-12T18:33:22.292029+0000","last_undegraded":"2024-09-12T18:33:22.292029+0000","last_fullsized":"2024-09-12T18:33:22.292029+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'400","last_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_deep_scrub":"262'400","last_deep_scrub_stamp":"2024-09-12T18:33:22.291796+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.291796+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:58.671981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":10679,"num_write":1254,"num_write_kb":20230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'487","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.075176+0000","last_change":"2024-09-12T18:33:21.075118+0000","last_active":"2024-09-12T18:33:21.075176+0000","last_peered":"2024-09-12T18:33:21.075176+0000","last_clean":"2024-09-12T18:33:21.075176+0000","last_became_active":"2024-09-12T17:35:42.886945+0000","last_became_peered":"2024-09-12T17:35:42.886945+0000","last_unstale":"2024-09-12T18:33:21.075176+0000","last_undegraded":"2024-09-12T18:33:21.075176+0000","last_fullsized":"2024-09-12T18:33:21.075176+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'487","last_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_deep_scrub":"262'487","last_deep_scrub_stamp":"2024-09-12T18:33:21.075019+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.075019+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:54.397374+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2329,"num_write":573,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.300873+0000","last_change":"2024-09-12T18:33:28.300808+0000","last_active":"2024-09-12T18:33:28.300873+0000","last_peered":"2024-09-12T18:33:28.300873+0000","last_clean":"2024-09-12T18:33:28.300873+0000","last_became_active":"2024-09-12T17:35:42.896347+0000","last_became_peered":"2024-09-12T17:35:42.896347+0000","last_unstale":"2024-09-12T18:33:28.300873+0000","last_undegraded":"2024-09-12T18:33:28.300873+0000","last_fullsized":"2024-09-12T18:33:28.300873+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'760","last_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_deep_scrub":"262'760","last_deep_scrub_stamp":"2024-09-12T18:33:28.300716+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.300716+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:14.805759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3156,"num_write":987,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'355","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.957389+0000","last_change":"2024-09-12T18:33:19.957318+0000","last_active":"2024-09-12T18:33:19.957389+0000","last_peered":"2024-09-12T18:33:19.957389+0000","last_clean":"2024-09-12T18:33:19.957389+0000","last_became_active":"2024-09-12T17:35:40.894766+0000","last_became_peered":"2024-09-12T17:35:40.894766+0000","last_unstale":"2024-09-12T18:33:19.957389+0000","last_undegraded":"2024-09-12T18:33:19.957389+0000","last_fullsized":"2024-09-12T18:33:19.957389+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'355","last_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_deep_scrub":"262'355","last_deep_scrub_stamp":"2024-09-12T18:33:19.957207+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.957207+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:43.487020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":71616,"num_write":1141,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'420","reported_seq":1944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.032683+0000","last_change":"2024-09-12T18:33:26.032588+0000","last_active":"2024-09-12T18:33:26.032683+0000","last_peered":"2024-09-12T18:33:26.032683+0000","last_clean":"2024-09-12T18:33:26.032683+0000","last_became_active":"2024-09-12T17:36:16.050536+0000","last_became_peered":"2024-09-12T17:36:16.050536+0000","last_unstale":"2024-09-12T18:33:26.032683+0000","last_undegraded":"2024-09-12T18:33:26.032683+0000","last_fullsized":"2024-09-12T18:33:26.032683+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:26.032490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.032490+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.483514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2208,"num_read_kb":2095,"num_write":462,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'319","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.672779+0000","last_change":"2024-09-12T18:33:18.672682+0000","last_active":"2024-09-12T18:33:18.672779+0000","last_peered":"2024-09-12T18:33:18.672779+0000","last_clean":"2024-09-12T18:33:18.672779+0000","last_became_active":"2024-09-12T17:35:40.901279+0000","last_became_peered":"2024-09-12T17:35:40.901279+0000","last_unstale":"2024-09-12T18:33:18.672779+0000","last_undegraded":"2024-09-12T18:33:18.672779+0000","last_fullsized":"2024-09-12T18:33:18.672779+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'319","last_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_deep_scrub":"262'319","last_deep_scrub_stamp":"2024-09-12T18:33:18.672393+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.672393+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:47.254680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49172,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":3270,"num_write":1020,"num_write_kb":23487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'872","reported_seq":2494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.641439+0000","last_change":"2024-09-12T18:33:26.641379+0000","last_active":"2024-09-12T18:33:26.641439+0000","last_peered":"2024-09-12T18:33:26.641439+0000","last_clean":"2024-09-12T18:33:26.641439+0000","last_became_active":"2024-09-12T17:35:42.888307+0000","last_became_peered":"2024-09-12T17:35:42.888307+0000","last_unstale":"2024-09-12T18:33:26.641439+0000","last_undegraded":"2024-09-12T18:33:26.641439+0000","last_fullsized":"2024-09-12T18:33:26.641439+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'872","last_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_deep_scrub":"262'872","last_deep_scrub_stamp":"2024-09-12T18:33:26.641291+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.641291+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.568382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4240,"num_read_kb":3820,"num_write":1195,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'387","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.697556+0000","last_change":"2024-09-12T18:33:17.697469+0000","last_active":"2024-09-12T18:33:17.697556+0000","last_peered":"2024-09-12T18:33:17.697556+0000","last_clean":"2024-09-12T18:33:17.697556+0000","last_became_active":"2024-09-12T17:35:40.898869+0000","last_became_peered":"2024-09-12T17:35:40.898869+0000","last_unstale":"2024-09-12T18:33:17.697556+0000","last_undegraded":"2024-09-12T18:33:17.697556+0000","last_fullsized":"2024-09-12T18:33:17.697556+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'387","last_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_deep_scrub":"262'387","last_deep_scrub_stamp":"2024-09-12T18:33:17.697260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.697260+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:05.335710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":65942,"num_write":1264,"num_write_kb":36153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'1106","reported_seq":2620,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.099467+0000","last_change":"2024-09-12T18:33:19.099374+0000","last_active":"2024-09-12T18:33:19.099467+0000","last_peered":"2024-09-12T18:33:19.099467+0000","last_clean":"2024-09-12T18:33:19.099467+0000","last_became_active":"2024-09-12T17:35:42.889642+0000","last_became_peered":"2024-09-12T17:35:42.889642+0000","last_unstale":"2024-09-12T18:33:19.099467+0000","last_undegraded":"2024-09-12T18:33:19.099467+0000","last_fullsized":"2024-09-12T18:33:19.099467+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1106","last_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_deep_scrub":"262'1106","last_deep_scrub_stamp":"2024-09-12T18:33:19.099250+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.099250+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":1000,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:44.344091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4988,"num_read_kb":4418,"num_write":1502,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'292","reported_seq":1067,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.238977+0000","last_change":"2024-09-12T18:33:15.238905+0000","last_active":"2024-09-12T18:33:15.238977+0000","last_peered":"2024-09-12T18:33:15.238977+0000","last_clean":"2024-09-12T18:33:15.238977+0000","last_became_active":"2024-09-12T17:35:40.895909+0000","last_became_peered":"2024-09-12T17:35:40.895909+0000","last_unstale":"2024-09-12T18:33:15.238977+0000","last_undegraded":"2024-09-12T18:33:15.238977+0000","last_fullsized":"2024-09-12T18:33:15.238977+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:15.238775+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.238775+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.181757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":760,"num_read_kb":33658,"num_write":1067,"num_write_kb":16485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'615","reported_seq":2390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.104238+0000","last_change":"2024-09-12T18:33:20.104176+0000","last_active":"2024-09-12T18:33:20.104238+0000","last_peered":"2024-09-12T18:33:20.104238+0000","last_clean":"2024-09-12T18:33:20.104238+0000","last_became_active":"2024-09-12T17:35:42.897114+0000","last_became_peered":"2024-09-12T17:35:42.897114+0000","last_unstale":"2024-09-12T18:33:20.104238+0000","last_undegraded":"2024-09-12T18:33:20.104238+0000","last_fullsized":"2024-09-12T18:33:20.104238+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'615","last_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_deep_scrub":"262'615","last_deep_scrub_stamp":"2024-09-12T18:33:20.104093+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.104093+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:14.426305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3421,"num_read_kb":3143,"num_write":803,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3278,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'324","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.256820+0000","last_change":"2024-09-12T18:33:21.256705+0000","last_active":"2024-09-12T18:33:21.256820+0000","last_peered":"2024-09-12T18:33:21.256820+0000","last_clean":"2024-09-12T18:33:21.256820+0000","last_became_active":"2024-09-12T17:35:40.885255+0000","last_became_peered":"2024-09-12T17:35:40.885255+0000","last_unstale":"2024-09-12T18:33:21.256820+0000","last_undegraded":"2024-09-12T18:33:21.256820+0000","last_fullsized":"2024-09-12T18:33:21.256820+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:21.256481+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.256481+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:27.688415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452413,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":42765,"num_write":983,"num_write_kb":35853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'308","reported_seq":1690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.287422+0000","last_change":"2024-09-12T18:33:29.287368+0000","last_active":"2024-09-12T18:33:29.287422+0000","last_peered":"2024-09-12T18:33:29.287422+0000","last_clean":"2024-09-12T18:33:29.287422+0000","last_became_active":"2024-09-12T17:35:42.902622+0000","last_became_peered":"2024-09-12T17:35:42.902622+0000","last_unstale":"2024-09-12T18:33:29.287422+0000","last_undegraded":"2024-09-12T18:33:29.287422+0000","last_fullsized":"2024-09-12T18:33:29.287422+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'308","last_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_deep_scrub":"262'308","last_deep_scrub_stamp":"2024-09-12T18:33:29.287289+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.287289+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.869873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":1663,"num_write":332,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'376","reported_seq":1070,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.613430+0000","last_change":"2024-09-12T18:33:15.613356+0000","last_active":"2024-09-12T18:33:15.613430+0000","last_peered":"2024-09-12T18:33:15.613430+0000","last_clean":"2024-09-12T18:33:15.613430+0000","last_became_active":"2024-09-12T17:35:40.900753+0000","last_became_peered":"2024-09-12T17:35:40.900753+0000","last_unstale":"2024-09-12T18:33:15.613430+0000","last_undegraded":"2024-09-12T18:33:15.613430+0000","last_fullsized":"2024-09-12T18:33:15.613430+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:15.613239+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.613239+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:10.394785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5481568,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":590,"num_read_kb":95728,"num_write":1139,"num_write_kb":47429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'131","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.436104+0000","last_change":"2024-09-12T18:33:46.435999+0000","last_active":"2024-09-12T18:33:46.436104+0000","last_peered":"2024-09-12T18:33:46.436104+0000","last_clean":"2024-09-12T18:33:46.436104+0000","last_became_active":"2024-09-12T17:35:50.910901+0000","last_became_peered":"2024-09-12T17:35:50.910901+0000","last_unstale":"2024-09-12T18:33:46.436104+0000","last_undegraded":"2024-09-12T18:33:46.436104+0000","last_fullsized":"2024-09-12T18:33:46.436104+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:46.435880+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.435880+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:52.500901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":304,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'777","reported_seq":2380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.354192+0000","last_change":"2024-09-12T18:33:31.354132+0000","last_active":"2024-09-12T18:33:31.354192+0000","last_peered":"2024-09-12T18:33:31.354192+0000","last_clean":"2024-09-12T18:33:31.354192+0000","last_became_active":"2024-09-12T17:35:42.891497+0000","last_became_peered":"2024-09-12T17:35:42.891497+0000","last_unstale":"2024-09-12T18:33:31.354192+0000","last_undegraded":"2024-09-12T18:33:31.354192+0000","last_fullsized":"2024-09-12T18:33:31.354192+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'777","last_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_deep_scrub":"262'777","last_deep_scrub_stamp":"2024-09-12T18:33:31.354052+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.354052+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.571288+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3874,"num_read_kb":3533,"num_write":1021,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'350","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.989308+0000","last_change":"2024-09-12T18:33:16.989242+0000","last_active":"2024-09-12T18:33:16.989308+0000","last_peered":"2024-09-12T18:33:16.989308+0000","last_clean":"2024-09-12T18:33:16.989308+0000","last_became_active":"2024-09-12T17:35:40.893561+0000","last_became_peered":"2024-09-12T17:35:40.893561+0000","last_unstale":"2024-09-12T18:33:16.989308+0000","last_undegraded":"2024-09-12T18:33:16.989308+0000","last_fullsized":"2024-09-12T18:33:16.989308+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'350","last_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_deep_scrub":"262'350","last_deep_scrub_stamp":"2024-09-12T18:33:16.989082+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.989082+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:55.856138+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424710,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":775,"num_read_kb":10756,"num_write":1135,"num_write_kb":52323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.608311+0000","last_change":"2024-09-12T18:33:32.608235+0000","last_active":"2024-09-12T18:33:32.608311+0000","last_peered":"2024-09-12T18:33:32.608311+0000","last_clean":"2024-09-12T18:33:32.608311+0000","last_became_active":"2024-09-12T17:35:44.894586+0000","last_became_peered":"2024-09-12T17:35:44.894586+0000","last_unstale":"2024-09-12T18:33:32.608311+0000","last_undegraded":"2024-09-12T18:33:32.608311+0000","last_fullsized":"2024-09-12T18:33:32.608311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.608146+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.608146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:01.224220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'345","reported_seq":958,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.658758+0000","last_change":"2024-09-12T18:33:32.658656+0000","last_active":"2024-09-12T18:33:32.658758+0000","last_peered":"2024-09-12T18:33:32.658758+0000","last_clean":"2024-09-12T18:33:32.658758+0000","last_became_active":"2024-09-12T17:35:46.891422+0000","last_became_peered":"2024-09-12T17:35:46.891422+0000","last_unstale":"2024-09-12T18:33:32.658758+0000","last_undegraded":"2024-09-12T18:33:32.658758+0000","last_fullsized":"2024-09-12T18:33:32.658758+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:32.658547+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.658547+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:56.181606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1162,"num_write":438,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.090112+0000","last_change":"2024-09-12T18:33:41.090051+0000","last_active":"2024-09-12T18:33:41.090112+0000","last_peered":"2024-09-12T18:33:41.090112+0000","last_clean":"2024-09-12T18:33:41.090112+0000","last_became_active":"2024-09-12T17:35:48.908518+0000","last_became_peered":"2024-09-12T17:35:48.908518+0000","last_unstale":"2024-09-12T18:33:41.090112+0000","last_undegraded":"2024-09-12T18:33:41.090112+0000","last_fullsized":"2024-09-12T18:33:41.090112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.089965+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.089965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:10.358903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'162","reported_seq":720,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.710251+0000","last_change":"2024-09-12T18:33:45.710192+0000","last_active":"2024-09-12T18:33:45.710251+0000","last_peered":"2024-09-12T18:33:45.710251+0000","last_clean":"2024-09-12T18:33:45.710251+0000","last_became_active":"2024-09-12T17:35:50.920658+0000","last_became_peered":"2024-09-12T17:35:50.920658+0000","last_unstale":"2024-09-12T18:33:45.710251+0000","last_undegraded":"2024-09-12T18:33:45.710251+0000","last_fullsized":"2024-09-12T18:33:45.710251+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-12T18:33:45.710098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.710098+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:46.772373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":244,"num_read_kb":238,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'480","reported_seq":2076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.693703+0000","last_change":"2024-09-12T18:33:23.693653+0000","last_active":"2024-09-12T18:33:23.693703+0000","last_peered":"2024-09-12T18:33:23.693703+0000","last_clean":"2024-09-12T18:33:23.693703+0000","last_became_active":"2024-09-12T17:35:42.890340+0000","last_became_peered":"2024-09-12T17:35:42.890340+0000","last_unstale":"2024-09-12T18:33:23.693703+0000","last_undegraded":"2024-09-12T18:33:23.693703+0000","last_fullsized":"2024-09-12T18:33:23.693703+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'480","last_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_deep_scrub":"262'480","last_deep_scrub_stamp":"2024-09-12T18:33:23.693570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.693570+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:07.678162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2700,"num_read_kb":2546,"num_write":578,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'420","reported_seq":1117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.540227+0000","last_change":"2024-09-12T18:33:11.540174+0000","last_active":"2024-09-12T18:33:11.540227+0000","last_peered":"2024-09-12T18:33:11.540227+0000","last_clean":"2024-09-12T18:33:11.540227+0000","last_became_active":"2024-09-12T17:35:40.889341+0000","last_became_peered":"2024-09-12T17:35:40.889341+0000","last_unstale":"2024-09-12T18:33:11.540227+0000","last_undegraded":"2024-09-12T18:33:11.540227+0000","last_fullsized":"2024-09-12T18:33:11.540227+0000","mapping_epoch":24,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'420","last_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_deep_scrub":"262'420","last_deep_scrub_stamp":"2024-09-12T18:33:11.540056+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.540056+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:31.139934+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468829,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":675,"num_read_kb":80579,"num_write":1292,"num_write_kb":52533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.341256+0000","last_change":"2024-09-12T18:33:38.341205+0000","last_active":"2024-09-12T18:33:38.341256+0000","last_peered":"2024-09-12T18:33:38.341256+0000","last_clean":"2024-09-12T18:33:38.341256+0000","last_became_active":"2024-09-12T17:35:44.894420+0000","last_became_peered":"2024-09-12T17:35:44.894420+0000","last_unstale":"2024-09-12T18:33:38.341256+0000","last_undegraded":"2024-09-12T18:33:38.341256+0000","last_fullsized":"2024-09-12T18:33:38.341256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.341117+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.341117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:17.987429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'92","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.290482+0000","last_change":"2024-09-12T18:33:38.290382+0000","last_active":"2024-09-12T18:33:38.290482+0000","last_peered":"2024-09-12T18:33:38.290482+0000","last_clean":"2024-09-12T18:33:38.290482+0000","last_became_active":"2024-09-12T17:35:46.899070+0000","last_became_peered":"2024-09-12T17:35:46.899070+0000","last_unstale":"2024-09-12T18:33:38.290482+0000","last_undegraded":"2024-09-12T18:33:38.290482+0000","last_fullsized":"2024-09-12T18:33:38.290482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'92","last_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_deep_scrub":"262'92","last_deep_scrub_stamp":"2024-09-12T18:33:38.290283+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.290283+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:04.859768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.338961+0000","last_change":"2024-09-12T18:33:42.338879+0000","last_active":"2024-09-12T18:33:42.338961+0000","last_peered":"2024-09-12T18:33:42.338961+0000","last_clean":"2024-09-12T18:33:42.338961+0000","last_became_active":"2024-09-12T17:35:48.901032+0000","last_became_peered":"2024-09-12T17:35:48.901032+0000","last_unstale":"2024-09-12T18:33:42.338961+0000","last_undegraded":"2024-09-12T18:33:42.338961+0000","last_fullsized":"2024-09-12T18:33:42.338961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:42.338782+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.338782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:35.618694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'176","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.740708+0000","last_change":"2024-09-12T18:33:46.740708+0000","last_active":"2024-09-12T18:33:46.740708+0000","last_peered":"2024-09-12T18:33:46.740708+0000","last_clean":"2024-09-12T18:33:46.740708+0000","last_became_active":"2024-09-12T17:35:50.915858+0000","last_became_peered":"2024-09-12T17:35:50.915858+0000","last_unstale":"2024-09-12T18:33:46.740708+0000","last_undegraded":"2024-09-12T18:33:46.740708+0000","last_fullsized":"2024-09-12T18:33:46.740708+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-12T18:33:46.740623+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.740623+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:29.705946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":297,"num_read_kb":260,"num_write":293,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'1215","reported_seq":2944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.625377+0000","last_change":"2024-09-12T18:33:21.625322+0000","last_active":"2024-09-12T18:33:21.625377+0000","last_peered":"2024-09-12T18:33:21.625377+0000","last_clean":"2024-09-12T18:33:21.625377+0000","last_became_active":"2024-09-12T17:35:42.901268+0000","last_became_peered":"2024-09-12T17:35:42.901268+0000","last_unstale":"2024-09-12T18:33:21.625377+0000","last_undegraded":"2024-09-12T18:33:21.625377+0000","last_fullsized":"2024-09-12T18:33:21.625377+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1215","last_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_deep_scrub":"262'1215","last_deep_scrub_stamp":"2024-09-12T18:33:21.625227+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.625227+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.877851+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5664,"num_read_kb":5045,"num_write":1631,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'399","reported_seq":1054,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.014002+0000","last_change":"2024-09-12T18:33:15.013929+0000","last_active":"2024-09-12T18:33:15.014002+0000","last_peered":"2024-09-12T18:33:15.014002+0000","last_clean":"2024-09-12T18:33:15.014002+0000","last_became_active":"2024-09-12T17:35:40.890899+0000","last_became_peered":"2024-09-12T17:35:40.890899+0000","last_unstale":"2024-09-12T18:33:15.014002+0000","last_undegraded":"2024-09-12T18:33:15.014002+0000","last_fullsized":"2024-09-12T18:33:15.014002+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:15.013801+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.013801+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:15.692669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386468,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":554,"num_read_kb":8447,"num_write":1280,"num_write_kb":39400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.356723+0000","last_change":"2024-09-12T18:33:36.356617+0000","last_active":"2024-09-12T18:33:36.356723+0000","last_peered":"2024-09-12T18:33:36.356723+0000","last_clean":"2024-09-12T18:33:36.356723+0000","last_became_active":"2024-09-12T17:35:44.891335+0000","last_became_peered":"2024-09-12T17:35:44.891335+0000","last_unstale":"2024-09-12T18:33:36.356723+0000","last_undegraded":"2024-09-12T18:33:36.356723+0000","last_fullsized":"2024-09-12T18:33:36.356723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.356499+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.356499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'127","reported_seq":674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.152130+0000","last_change":"2024-09-12T18:33:29.152071+0000","last_active":"2024-09-12T18:33:29.152130+0000","last_peered":"2024-09-12T18:33:29.152130+0000","last_clean":"2024-09-12T18:33:29.152130+0000","last_became_active":"2024-09-12T17:35:46.900916+0000","last_became_peered":"2024-09-12T17:35:46.900916+0000","last_unstale":"2024-09-12T18:33:29.152130+0000","last_undegraded":"2024-09-12T18:33:29.152130+0000","last_fullsized":"2024-09-12T18:33:29.152130+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-12T18:33:29.151970+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.151970+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:49.592865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'764","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.112566+0000","last_change":"2024-09-12T18:33:40.112474+0000","last_active":"2024-09-12T18:33:40.112566+0000","last_peered":"2024-09-12T18:33:40.112566+0000","last_clean":"2024-09-12T18:33:40.112566+0000","last_became_active":"2024-09-12T17:35:48.907253+0000","last_became_peered":"2024-09-12T17:35:48.907253+0000","last_unstale":"2024-09-12T18:33:40.112566+0000","last_undegraded":"2024-09-12T18:33:40.112566+0000","last_fullsized":"2024-09-12T18:33:40.112566+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'764","last_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_deep_scrub":"262'764","last_deep_scrub_stamp":"2024-09-12T18:33:40.112394+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.112394+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:40.492683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'232","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.439968+0000","last_change":"2024-09-12T18:33:48.439968+0000","last_active":"2024-09-12T18:33:48.439968+0000","last_peered":"2024-09-12T18:33:48.439968+0000","last_clean":"2024-09-12T18:33:48.439968+0000","last_became_active":"2024-09-12T17:35:51.346339+0000","last_became_peered":"2024-09-12T17:35:51.346339+0000","last_unstale":"2024-09-12T18:33:48.439968+0000","last_undegraded":"2024-09-12T18:33:48.439968+0000","last_fullsized":"2024-09-12T18:33:48.439968+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-12T18:33:48.439884+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.439884+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:58.280243+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":665,"num_read_kb":661,"num_write":508,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'673","reported_seq":2094,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.396572+0000","last_change":"2024-09-12T18:33:27.396515+0000","last_active":"2024-09-12T18:33:27.396572+0000","last_peered":"2024-09-12T18:33:27.396572+0000","last_clean":"2024-09-12T18:33:27.396572+0000","last_became_active":"2024-09-12T17:35:42.894174+0000","last_became_peered":"2024-09-12T17:35:42.894174+0000","last_unstale":"2024-09-12T18:33:27.396572+0000","last_undegraded":"2024-09-12T18:33:27.396572+0000","last_fullsized":"2024-09-12T18:33:27.396572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'673","last_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_deep_scrub":"262'673","last_deep_scrub_stamp":"2024-09-12T18:33:27.396425+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.396425+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:51.901322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3316,"num_read_kb":3029,"num_write":878,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'341","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.715500+0000","last_change":"2024-09-12T18:33:14.715413+0000","last_active":"2024-09-12T18:33:14.715500+0000","last_peered":"2024-09-12T18:33:14.715500+0000","last_clean":"2024-09-12T18:33:14.715500+0000","last_became_active":"2024-09-12T17:35:40.898596+0000","last_became_peered":"2024-09-12T17:35:40.898596+0000","last_unstale":"2024-09-12T18:33:14.715500+0000","last_undegraded":"2024-09-12T18:33:14.715500+0000","last_fullsized":"2024-09-12T18:33:14.715500+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:14.715259+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.715259+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:05.915818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399179,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":57705,"num_write":1124,"num_write_kb":42871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.621558+0000","last_change":"2024-09-12T18:33:33.621485+0000","last_active":"2024-09-12T18:33:33.621558+0000","last_peered":"2024-09-12T18:33:33.621558+0000","last_clean":"2024-09-12T18:33:33.621558+0000","last_became_active":"2024-09-12T17:35:44.893373+0000","last_became_peered":"2024-09-12T17:35:44.893373+0000","last_unstale":"2024-09-12T18:33:33.621558+0000","last_undegraded":"2024-09-12T18:33:33.621558+0000","last_fullsized":"2024-09-12T18:33:33.621558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.621371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.621371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:49.117251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'282","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.181143+0000","last_change":"2024-09-12T18:33:37.181082+0000","last_active":"2024-09-12T18:33:37.181143+0000","last_peered":"2024-09-12T18:33:37.181143+0000","last_clean":"2024-09-12T18:33:37.181143+0000","last_became_active":"2024-09-12T17:35:47.464607+0000","last_became_peered":"2024-09-12T17:35:47.464607+0000","last_unstale":"2024-09-12T18:33:37.181143+0000","last_undegraded":"2024-09-12T18:33:37.181143+0000","last_fullsized":"2024-09-12T18:33:37.181143+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-12T18:33:37.180990+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.180990+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:25.430774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1082,"num_write":378,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'819","reported_seq":2363,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:47.348765+0000","last_change":"2024-09-12T18:33:47.348692+0000","last_active":"2024-09-12T18:33:47.348765+0000","last_peered":"2024-09-12T18:33:47.348765+0000","last_clean":"2024-09-12T18:33:47.348765+0000","last_became_active":"2024-09-12T17:35:48.899228+0000","last_became_peered":"2024-09-12T17:35:48.899228+0000","last_unstale":"2024-09-12T18:33:47.348765+0000","last_undegraded":"2024-09-12T18:33:47.348765+0000","last_fullsized":"2024-09-12T18:33:47.348765+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:47.348609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:47.348609+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.230213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'542","reported_seq":2121,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.657819+0000","last_change":"2024-09-12T18:33:24.657751+0000","last_active":"2024-09-12T18:33:24.657819+0000","last_peered":"2024-09-12T18:33:24.657819+0000","last_clean":"2024-09-12T18:33:24.657819+0000","last_became_active":"2024-09-12T17:35:42.890758+0000","last_became_peered":"2024-09-12T17:35:42.890758+0000","last_unstale":"2024-09-12T18:33:24.657819+0000","last_undegraded":"2024-09-12T18:33:24.657819+0000","last_fullsized":"2024-09-12T18:33:24.657819+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.657662+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.657662+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:53.428163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2699,"num_read_kb":2492,"num_write":669,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2021,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'394","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.039545+0000","last_change":"2024-09-12T18:33:14.039545+0000","last_active":"2024-09-12T18:33:14.039545+0000","last_peered":"2024-09-12T18:33:14.039545+0000","last_clean":"2024-09-12T18:33:14.039545+0000","last_became_active":"2024-09-12T17:36:16.047867+0000","last_became_peered":"2024-09-12T17:36:16.047867+0000","last_unstale":"2024-09-12T18:33:14.039545+0000","last_undegraded":"2024-09-12T18:33:14.039545+0000","last_fullsized":"2024-09-12T18:33:14.039545+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:14.039390+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.039390+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:37.692448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512425,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":23815,"num_write":1238,"num_write_kb":48399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.090769+0000","last_change":"2024-09-12T18:33:28.090664+0000","last_active":"2024-09-12T18:33:28.090769+0000","last_peered":"2024-09-12T18:33:28.090769+0000","last_clean":"2024-09-12T18:33:28.090769+0000","last_became_active":"2024-09-12T17:35:44.897151+0000","last_became_peered":"2024-09-12T17:35:44.897151+0000","last_unstale":"2024-09-12T18:33:28.090769+0000","last_undegraded":"2024-09-12T18:33:28.090769+0000","last_fullsized":"2024-09-12T18:33:28.090769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.090568+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.090568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:48.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'375","reported_seq":998,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.647306+0000","last_change":"2024-09-12T18:33:36.647244+0000","last_active":"2024-09-12T18:33:36.647306+0000","last_peered":"2024-09-12T18:33:36.647306+0000","last_clean":"2024-09-12T18:33:36.647306+0000","last_became_active":"2024-09-12T17:35:47.464548+0000","last_became_peered":"2024-09-12T17:35:47.464548+0000","last_unstale":"2024-09-12T18:33:36.647306+0000","last_undegraded":"2024-09-12T18:33:36.647306+0000","last_fullsized":"2024-09-12T18:33:36.647306+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:36.647139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.647139+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:42.082985+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45931,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":1150,"num_write":454,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.611787+0000","last_change":"2024-09-12T18:33:31.611701+0000","last_active":"2024-09-12T18:33:31.611787+0000","last_peered":"2024-09-12T18:33:31.611787+0000","last_clean":"2024-09-12T18:33:31.611787+0000","last_became_active":"2024-09-12T17:35:48.908268+0000","last_became_peered":"2024-09-12T17:35:48.908268+0000","last_unstale":"2024-09-12T18:33:31.611787+0000","last_undegraded":"2024-09-12T18:33:31.611787+0000","last_fullsized":"2024-09-12T18:33:31.611787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.611583+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.611583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.249892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'588","reported_seq":1449,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.673375+0000","last_change":"2024-09-12T18:33:43.673311+0000","last_active":"2024-09-12T18:33:43.673375+0000","last_peered":"2024-09-12T18:33:43.673375+0000","last_clean":"2024-09-12T18:33:43.673375+0000","last_became_active":"2024-09-12T17:35:50.922494+0000","last_became_peered":"2024-09-12T17:35:50.922494+0000","last_unstale":"2024-09-12T18:33:43.673375+0000","last_undegraded":"2024-09-12T18:33:43.673375+0000","last_fullsized":"2024-09-12T18:33:43.673375+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'588","last_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_deep_scrub":"262'588","last_deep_scrub_stamp":"2024-09-12T18:33:43.673226+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.673226+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:33.941746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1535,"num_read_kb":1486,"num_write":1240,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'544","reported_seq":2029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.216879+0000","last_change":"2024-09-12T18:33:17.216806+0000","last_active":"2024-09-12T18:33:17.216879+0000","last_peered":"2024-09-12T18:33:17.216879+0000","last_clean":"2024-09-12T18:33:17.216879+0000","last_became_active":"2024-09-12T17:35:42.902694+0000","last_became_peered":"2024-09-12T17:35:42.902694+0000","last_unstale":"2024-09-12T18:33:17.216879+0000","last_undegraded":"2024-09-12T18:33:17.216879+0000","last_fullsized":"2024-09-12T18:33:17.216879+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'544","last_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_deep_scrub":"262'544","last_deep_scrub_stamp":"2024-09-12T18:33:17.216707+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.216707+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.670785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2695,"num_read_kb":2471,"num_write":706,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'393","reported_seq":1039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.215990+0000","last_change":"2024-09-12T18:33:15.215990+0000","last_active":"2024-09-12T18:33:15.215990+0000","last_peered":"2024-09-12T18:33:15.215990+0000","last_clean":"2024-09-12T18:33:15.215990+0000","last_became_active":"2024-09-12T17:36:16.051086+0000","last_became_peered":"2024-09-12T17:36:16.051086+0000","last_unstale":"2024-09-12T18:33:15.215990+0000","last_undegraded":"2024-09-12T18:33:15.215990+0000","last_fullsized":"2024-09-12T18:33:15.215990+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'393","last_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_deep_scrub":"262'393","last_deep_scrub_stamp":"2024-09-12T18:33:15.215872+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.215872+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:55.176918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":15948,"num_write":1231,"num_write_kb":46764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1,2],"acting":[3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.079463+0000","last_change":"2024-09-12T18:33:26.079381+0000","last_active":"2024-09-12T18:33:26.079463+0000","last_peered":"2024-09-12T18:33:26.079463+0000","last_clean":"2024-09-12T18:33:26.079463+0000","last_became_active":"2024-09-12T17:35:44.891159+0000","last_became_peered":"2024-09-12T17:35:44.891159+0000","last_unstale":"2024-09-12T18:33:26.079463+0000","last_undegraded":"2024-09-12T18:33:26.079463+0000","last_fullsized":"2024-09-12T18:33:26.079463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.079288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.079288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:46.736637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'277","reported_seq":855,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.370014+0000","last_change":"2024-09-12T18:33:37.369936+0000","last_active":"2024-09-12T18:33:37.370014+0000","last_peered":"2024-09-12T18:33:37.370014+0000","last_clean":"2024-09-12T18:33:37.370014+0000","last_became_active":"2024-09-12T17:35:46.895692+0000","last_became_peered":"2024-09-12T17:35:46.895692+0000","last_unstale":"2024-09-12T18:33:37.370014+0000","last_undegraded":"2024-09-12T18:33:37.370014+0000","last_fullsized":"2024-09-12T18:33:37.370014+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-12T18:33:37.369842+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.369842+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:52.872806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47879,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1045,"num_write":366,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:48.319279+0000","last_change":"2024-09-12T18:33:48.319279+0000","last_active":"2024-09-12T18:33:48.319279+0000","last_peered":"2024-09-12T18:33:48.319279+0000","last_clean":"2024-09-12T18:33:48.319279+0000","last_became_active":"2024-09-12T17:35:48.897898+0000","last_became_peered":"2024-09-12T17:35:48.897898+0000","last_unstale":"2024-09-12T18:33:48.319279+0000","last_undegraded":"2024-09-12T18:33:48.319279+0000","last_fullsized":"2024-09-12T18:33:48.319279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:48.319179+0000","last_clean_scrub_stamp":"2024-09-12T18:33:48.319179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:54.098870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2400","reported_seq":4246,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.748919+0000","last_change":"2024-09-12T18:33:33.748814+0000","last_active":"2024-09-12T18:33:33.748919+0000","last_peered":"2024-09-12T18:33:33.748919+0000","last_clean":"2024-09-12T18:33:33.748919+0000","last_became_active":"2024-09-12T17:35:50.920734+0000","last_became_peered":"2024-09-12T17:35:50.920734+0000","last_unstale":"2024-09-12T18:33:33.748919+0000","last_undegraded":"2024-09-12T18:33:33.748919+0000","last_fullsized":"2024-09-12T18:33:33.748919+0000","mapping_epoch":34,"log_start":"262'2300","ondisk_log_start":"262'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2400","last_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_deep_scrub":"262'2400","last_deep_scrub_stamp":"2024-09-12T18:33:33.748704+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.748704+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:42.848648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6096,"num_read_kb":6082,"num_write":4854,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'1123","reported_seq":2593,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.691987+0000","last_change":"2024-09-12T18:33:21.691930+0000","last_active":"2024-09-12T18:33:21.691987+0000","last_peered":"2024-09-12T18:33:21.691987+0000","last_clean":"2024-09-12T18:33:21.691987+0000","last_became_active":"2024-09-12T17:35:42.900604+0000","last_became_peered":"2024-09-12T17:35:42.900604+0000","last_unstale":"2024-09-12T18:33:21.691987+0000","last_undegraded":"2024-09-12T18:33:21.691987+0000","last_fullsized":"2024-09-12T18:33:21.691987+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1123","last_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_deep_scrub":"262'1123","last_deep_scrub_stamp":"2024-09-12T18:33:21.691845+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.691845+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":1100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:09.232918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5062,"num_read_kb":4473,"num_write":1561,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'336","reported_seq":1014,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.086221+0000","last_change":"2024-09-12T18:33:12.086221+0000","last_active":"2024-09-12T18:33:12.086221+0000","last_peered":"2024-09-12T18:33:12.086221+0000","last_clean":"2024-09-12T18:33:12.086221+0000","last_became_active":"2024-09-12T17:36:16.049525+0000","last_became_peered":"2024-09-12T17:36:16.049525+0000","last_unstale":"2024-09-12T18:33:12.086221+0000","last_undegraded":"2024-09-12T18:33:12.086221+0000","last_fullsized":"2024-09-12T18:33:12.086221+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-12T18:33:12.086103+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.086103+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:25.986928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4614985,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":185869,"num_write":1150,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.088600+0000","last_change":"2024-09-12T18:33:27.088545+0000","last_active":"2024-09-12T18:33:27.088600+0000","last_peered":"2024-09-12T18:33:27.088600+0000","last_clean":"2024-09-12T18:33:27.088600+0000","last_became_active":"2024-09-12T17:35:44.893656+0000","last_became_peered":"2024-09-12T17:35:44.893656+0000","last_unstale":"2024-09-12T18:33:27.088600+0000","last_undegraded":"2024-09-12T18:33:27.088600+0000","last_fullsized":"2024-09-12T18:33:27.088600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.088448+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.088448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:18.854173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'331","reported_seq":926,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.118822+0000","last_change":"2024-09-12T18:33:32.118752+0000","last_active":"2024-09-12T18:33:32.118822+0000","last_peered":"2024-09-12T18:33:32.118822+0000","last_clean":"2024-09-12T18:33:32.118822+0000","last_became_active":"2024-09-12T17:35:46.898817+0000","last_became_peered":"2024-09-12T17:35:46.898817+0000","last_unstale":"2024-09-12T18:33:32.118822+0000","last_undegraded":"2024-09-12T18:33:32.118822+0000","last_fullsized":"2024-09-12T18:33:32.118822+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:32.118640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.118640+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:59.747985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49626,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":529,"num_read_kb":1160,"num_write":428,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'791","reported_seq":4768,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.808554+0000","last_change":"2024-09-12T18:33:37.808463+0000","last_active":"2024-09-12T18:33:37.808554+0000","last_peered":"2024-09-12T18:33:37.808554+0000","last_clean":"2024-09-12T18:33:37.808554+0000","last_became_active":"2024-09-12T17:35:48.902040+0000","last_became_peered":"2024-09-12T17:35:48.902040+0000","last_unstale":"2024-09-12T18:33:37.808554+0000","last_undegraded":"2024-09-12T18:33:37.808554+0000","last_fullsized":"2024-09-12T18:33:37.808554+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'791","last_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_deep_scrub":"262'791","last_deep_scrub_stamp":"2024-09-12T18:33:37.808355+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.808355+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.046104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'118","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.708488+0000","last_change":"2024-09-12T18:33:43.708437+0000","last_active":"2024-09-12T18:33:43.708488+0000","last_peered":"2024-09-12T18:33:43.708488+0000","last_clean":"2024-09-12T18:33:43.708488+0000","last_became_active":"2024-09-12T17:35:50.915709+0000","last_became_peered":"2024-09-12T17:35:50.915709+0000","last_unstale":"2024-09-12T18:33:43.708488+0000","last_undegraded":"2024-09-12T18:33:43.708488+0000","last_fullsized":"2024-09-12T18:33:43.708488+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:43.708371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.708371+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:01.056983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'520","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.619106+0000","last_change":"2024-09-12T18:33:25.619048+0000","last_active":"2024-09-12T18:33:25.619106+0000","last_peered":"2024-09-12T18:33:25.619106+0000","last_clean":"2024-09-12T18:33:25.619106+0000","last_became_active":"2024-09-12T17:35:42.892141+0000","last_became_peered":"2024-09-12T17:35:42.892141+0000","last_unstale":"2024-09-12T18:33:25.619106+0000","last_undegraded":"2024-09-12T18:33:25.619106+0000","last_fullsized":"2024-09-12T18:33:25.619106+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'520","last_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_deep_scrub":"262'520","last_deep_scrub_stamp":"2024-09-12T18:33:25.618938+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.618938+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.541602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2757,"num_read_kb":2564,"num_write":639,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'349","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.659217+0000","last_change":"2024-09-12T18:33:15.659128+0000","last_active":"2024-09-12T18:33:15.659217+0000","last_peered":"2024-09-12T18:33:15.659217+0000","last_clean":"2024-09-12T18:33:15.659217+0000","last_became_active":"2024-09-12T17:35:40.892695+0000","last_became_peered":"2024-09-12T17:35:40.892695+0000","last_unstale":"2024-09-12T18:33:15.659217+0000","last_undegraded":"2024-09-12T18:33:15.659217+0000","last_fullsized":"2024-09-12T18:33:15.659217+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'349","last_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_deep_scrub":"262'349","last_deep_scrub_stamp":"2024-09-12T18:33:15.658993+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.658993+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:57.692359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399009,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":648,"num_read_kb":11855,"num_write":1224,"num_write_kb":21132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.132818+0000","last_change":"2024-09-12T18:33:24.132737+0000","last_active":"2024-09-12T18:33:24.132818+0000","last_peered":"2024-09-12T18:33:24.132818+0000","last_clean":"2024-09-12T18:33:24.132818+0000","last_became_active":"2024-09-12T17:35:44.893057+0000","last_became_peered":"2024-09-12T17:35:44.893057+0000","last_unstale":"2024-09-12T18:33:24.132818+0000","last_undegraded":"2024-09-12T18:33:24.132818+0000","last_fullsized":"2024-09-12T18:33:24.132818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:24.132652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.132652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:47.476929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'483","reported_seq":1126,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.697734+0000","last_change":"2024-09-12T18:33:31.697675+0000","last_active":"2024-09-12T18:33:31.697734+0000","last_peered":"2024-09-12T18:33:31.697734+0000","last_clean":"2024-09-12T18:33:31.697734+0000","last_became_active":"2024-09-12T17:35:46.894160+0000","last_became_peered":"2024-09-12T17:35:46.894160+0000","last_unstale":"2024-09-12T18:33:31.697734+0000","last_undegraded":"2024-09-12T18:33:31.697734+0000","last_fullsized":"2024-09-12T18:33:31.697734+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:31.697587+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.697587+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:36.471785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":846,"num_read_kb":2056,"num_write":694,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.119018+0000","last_change":"2024-09-12T18:33:33.118962+0000","last_active":"2024-09-12T18:33:33.119018+0000","last_peered":"2024-09-12T18:33:33.119018+0000","last_clean":"2024-09-12T18:33:33.119018+0000","last_became_active":"2024-09-12T17:35:48.900901+0000","last_became_peered":"2024-09-12T17:35:48.900901+0000","last_unstale":"2024-09-12T18:33:33.119018+0000","last_undegraded":"2024-09-12T18:33:33.119018+0000","last_fullsized":"2024-09-12T18:33:33.119018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.118887+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.118887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:16.556316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'165","reported_seq":697,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.564174+0000","last_change":"2024-09-12T18:33:38.564112+0000","last_active":"2024-09-12T18:33:38.564174+0000","last_peered":"2024-09-12T18:33:38.564174+0000","last_clean":"2024-09-12T18:33:38.564174+0000","last_became_active":"2024-09-12T17:35:50.911513+0000","last_became_peered":"2024-09-12T17:35:50.911513+0000","last_unstale":"2024-09-12T18:33:38.564174+0000","last_undegraded":"2024-09-12T18:33:38.564174+0000","last_fullsized":"2024-09-12T18:33:38.564174+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-12T18:33:38.564022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.564022+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:01.761974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":282,"num_read_kb":260,"num_write":410,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'555","reported_seq":2203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.239491+0000","last_change":"2024-09-12T18:33:19.239412+0000","last_active":"2024-09-12T18:33:19.239491+0000","last_peered":"2024-09-12T18:33:19.239491+0000","last_clean":"2024-09-12T18:33:19.239491+0000","last_became_active":"2024-09-12T17:35:42.900474+0000","last_became_peered":"2024-09-12T17:35:42.900474+0000","last_unstale":"2024-09-12T18:33:19.239491+0000","last_undegraded":"2024-09-12T18:33:19.239491+0000","last_fullsized":"2024-09-12T18:33:19.239491+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'555","last_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_deep_scrub":"262'555","last_deep_scrub_stamp":"2024-09-12T18:33:19.239331+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.239331+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:45.930298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3024,"num_read_kb":2809,"num_write":739,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'381","reported_seq":1211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.171387+0000","last_change":"2024-09-12T18:33:14.171237+0000","last_active":"2024-09-12T18:33:14.171387+0000","last_peered":"2024-09-12T18:33:14.171387+0000","last_clean":"2024-09-12T18:33:14.171387+0000","last_became_active":"2024-09-12T17:35:40.888048+0000","last_became_peered":"2024-09-12T17:35:40.888048+0000","last_unstale":"2024-09-12T18:33:14.171387+0000","last_undegraded":"2024-09-12T18:33:14.171387+0000","last_fullsized":"2024-09-12T18:33:14.171387+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'381","last_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_deep_scrub":"262'381","last_deep_scrub_stamp":"2024-09-12T18:33:14.171043+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.171043+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:04.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":952,"num_read_kb":1817,"num_write":1243,"num_write_kb":24560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.119605+0000","last_change":"2024-09-12T18:33:25.119518+0000","last_active":"2024-09-12T18:33:25.119605+0000","last_peered":"2024-09-12T18:33:25.119605+0000","last_clean":"2024-09-12T18:33:25.119605+0000","last_became_active":"2024-09-12T17:35:44.894067+0000","last_became_peered":"2024-09-12T17:35:44.894067+0000","last_unstale":"2024-09-12T18:33:25.119605+0000","last_undegraded":"2024-09-12T18:33:25.119605+0000","last_fullsized":"2024-09-12T18:33:25.119605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:25.119405+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.119405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:06.087705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'298","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.275449+0000","last_change":"2024-09-12T18:33:37.275377+0000","last_active":"2024-09-12T18:33:37.275449+0000","last_peered":"2024-09-12T18:33:37.275449+0000","last_clean":"2024-09-12T18:33:37.275449+0000","last_became_active":"2024-09-12T17:35:46.898776+0000","last_became_peered":"2024-09-12T17:35:46.898776+0000","last_unstale":"2024-09-12T18:33:37.275449+0000","last_undegraded":"2024-09-12T18:33:37.275449+0000","last_fullsized":"2024-09-12T18:33:37.275449+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:37.275279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.275279+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:10.198848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47571,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1071,"num_write":444,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.769182+0000","last_change":"2024-09-12T18:33:38.769070+0000","last_active":"2024-09-12T18:33:38.769182+0000","last_peered":"2024-09-12T18:33:38.769182+0000","last_clean":"2024-09-12T18:33:38.769182+0000","last_became_active":"2024-09-12T17:35:48.901757+0000","last_became_peered":"2024-09-12T17:35:48.901757+0000","last_unstale":"2024-09-12T18:33:38.769182+0000","last_undegraded":"2024-09-12T18:33:38.769182+0000","last_fullsized":"2024-09-12T18:33:38.769182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.768975+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.768975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:12.755941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'97","reported_seq":593,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.288176+0000","last_change":"2024-09-12T18:33:51.288112+0000","last_active":"2024-09-12T18:33:51.288176+0000","last_peered":"2024-09-12T18:33:51.288176+0000","last_clean":"2024-09-12T18:33:51.288176+0000","last_became_active":"2024-09-12T17:35:50.921414+0000","last_became_peered":"2024-09-12T17:35:50.921414+0000","last_unstale":"2024-09-12T18:33:51.288176+0000","last_undegraded":"2024-09-12T18:33:51.288176+0000","last_fullsized":"2024-09-12T18:33:51.288176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'97","last_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_deep_scrub":"262'97","last_deep_scrub_stamp":"2024-09-12T18:33:51.288022+0000","last_clean_scrub_stamp":"2024-09-12T18:33:51.288022+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:57.163162+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":208,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'574","reported_seq":2089,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.219222+0000","last_change":"2024-09-12T18:33:18.219164+0000","last_active":"2024-09-12T18:33:18.219222+0000","last_peered":"2024-09-12T18:33:18.219222+0000","last_clean":"2024-09-12T18:33:18.219222+0000","last_became_active":"2024-09-12T17:35:42.891141+0000","last_became_peered":"2024-09-12T17:35:42.891141+0000","last_unstale":"2024-09-12T18:33:18.219222+0000","last_undegraded":"2024-09-12T18:33:18.219222+0000","last_fullsized":"2024-09-12T18:33:18.219222+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-12T18:33:18.219044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.219044+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.862000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2858,"num_read_kb":2596,"num_write":772,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'374","reported_seq":1027,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.728627+0000","last_change":"2024-09-12T18:33:13.728566+0000","last_active":"2024-09-12T18:33:13.728627+0000","last_peered":"2024-09-12T18:33:13.728627+0000","last_clean":"2024-09-12T18:33:13.728627+0000","last_became_active":"2024-09-12T17:35:40.893682+0000","last_became_peered":"2024-09-12T17:35:40.893682+0000","last_unstale":"2024-09-12T18:33:13.728627+0000","last_undegraded":"2024-09-12T18:33:13.728627+0000","last_fullsized":"2024-09-12T18:33:13.728627+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'374","last_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_deep_scrub":"262'374","last_deep_scrub_stamp":"2024-09-12T18:33:13.728424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.728424+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:02.902426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30147,"num_write":1155,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"262'6","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.630460+0000","last_change":"2024-09-12T18:33:25.630372+0000","last_active":"2024-09-12T18:33:25.630460+0000","last_peered":"2024-09-12T18:33:25.630460+0000","last_clean":"2024-09-12T18:33:25.630460+0000","last_became_active":"2024-09-12T17:35:44.897727+0000","last_became_peered":"2024-09-12T17:35:44.897727+0000","last_unstale":"2024-09-12T18:33:25.630460+0000","last_undegraded":"2024-09-12T18:33:25.630460+0000","last_fullsized":"2024-09-12T18:33:25.630460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T18:33:25.630267+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.630267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:05.121838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'320","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.109341+0000","last_change":"2024-09-12T18:33:28.109281+0000","last_active":"2024-09-12T18:33:28.109341+0000","last_peered":"2024-09-12T18:33:28.109341+0000","last_clean":"2024-09-12T18:33:28.109341+0000","last_became_active":"2024-09-12T17:35:46.902066+0000","last_became_peered":"2024-09-12T17:35:46.902066+0000","last_unstale":"2024-09-12T18:33:28.109341+0000","last_undegraded":"2024-09-12T18:33:28.109341+0000","last_fullsized":"2024-09-12T18:33:28.109341+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'320","last_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_deep_scrub":"262'320","last_deep_scrub_stamp":"2024-09-12T18:33:28.109177+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.109177+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:16.884085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1126,"num_write":412,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'741","reported_seq":2540,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.102145+0000","last_change":"2024-09-12T18:33:30.102053+0000","last_active":"2024-09-12T18:33:30.102145+0000","last_peered":"2024-09-12T18:33:30.102145+0000","last_clean":"2024-09-12T18:33:30.102145+0000","last_became_active":"2024-09-12T17:35:48.905785+0000","last_became_peered":"2024-09-12T17:35:48.905785+0000","last_unstale":"2024-09-12T18:33:30.102145+0000","last_undegraded":"2024-09-12T18:33:30.102145+0000","last_fullsized":"2024-09-12T18:33:30.102145+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'741","last_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_deep_scrub":"262'741","last_deep_scrub_stamp":"2024-09-12T18:33:30.101923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.101923+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:48.452566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.609173+0000","last_change":"2024-09-12T18:33:36.609114+0000","last_active":"2024-09-12T18:33:36.609173+0000","last_peered":"2024-09-12T18:33:36.609173+0000","last_clean":"2024-09-12T18:33:36.609173+0000","last_became_active":"2024-09-12T17:35:50.909575+0000","last_became_peered":"2024-09-12T17:35:50.909575+0000","last_unstale":"2024-09-12T18:33:36.609173+0000","last_undegraded":"2024-09-12T18:33:36.609173+0000","last_fullsized":"2024-09-12T18:33:36.609173+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:36.609016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.609016+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:23.806384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":294,"num_read_kb":256,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'392","reported_seq":1820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.266415+0000","last_change":"2024-09-12T18:33:20.266301+0000","last_active":"2024-09-12T18:33:20.266415+0000","last_peered":"2024-09-12T18:33:20.266415+0000","last_clean":"2024-09-12T18:33:20.266415+0000","last_became_active":"2024-09-12T17:35:42.898448+0000","last_became_peered":"2024-09-12T17:35:42.898448+0000","last_unstale":"2024-09-12T18:33:20.266415+0000","last_undegraded":"2024-09-12T18:33:20.266415+0000","last_fullsized":"2024-09-12T18:33:20.266415+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:20.266203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.266203+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:44.161180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1884,"num_write":439,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'343","reported_seq":995,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.228767+0000","last_change":"2024-09-12T18:33:14.228696+0000","last_active":"2024-09-12T18:33:14.228767+0000","last_peered":"2024-09-12T18:33:14.228767+0000","last_clean":"2024-09-12T18:33:14.228767+0000","last_became_active":"2024-09-12T17:35:40.904228+0000","last_became_peered":"2024-09-12T17:35:40.904228+0000","last_unstale":"2024-09-12T18:33:14.228767+0000","last_undegraded":"2024-09-12T18:33:14.228767+0000","last_fullsized":"2024-09-12T18:33:14.228767+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'343","last_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_deep_scrub":"262'343","last_deep_scrub_stamp":"2024-09-12T18:33:14.228588+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.228588+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.850074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":4238,"num_write":1153,"num_write_kb":22774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1457,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.577484+0000","last_change":"2024-09-12T18:33:31.577388+0000","last_active":"2024-09-12T18:33:31.577484+0000","last_peered":"2024-09-12T18:33:31.577484+0000","last_clean":"2024-09-12T18:33:31.577484+0000","last_became_active":"2024-09-12T17:35:44.897721+0000","last_became_peered":"2024-09-12T17:35:44.897721+0000","last_unstale":"2024-09-12T18:33:31.577484+0000","last_undegraded":"2024-09-12T18:33:31.577484+0000","last_fullsized":"2024-09-12T18:33:31.577484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:31.577293+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.577293+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:13.603685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'100","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.309148+0000","last_change":"2024-09-12T18:33:43.309087+0000","last_active":"2024-09-12T18:33:43.309148+0000","last_peered":"2024-09-12T18:33:43.309148+0000","last_clean":"2024-09-12T18:33:43.309148+0000","last_became_active":"2024-09-12T17:35:47.464460+0000","last_became_peered":"2024-09-12T17:35:47.464460+0000","last_unstale":"2024-09-12T18:33:43.309148+0000","last_undegraded":"2024-09-12T18:33:43.309148+0000","last_fullsized":"2024-09-12T18:33:43.309148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-12T18:33:43.308986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.308986+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:25.653762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'780","reported_seq":2611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.729585+0000","last_change":"2024-09-12T18:33:30.729528+0000","last_active":"2024-09-12T18:33:30.729585+0000","last_peered":"2024-09-12T18:33:30.729585+0000","last_clean":"2024-09-12T18:33:30.729585+0000","last_became_active":"2024-09-12T17:35:48.904595+0000","last_became_peered":"2024-09-12T17:35:48.904595+0000","last_unstale":"2024-09-12T18:33:30.729585+0000","last_undegraded":"2024-09-12T18:33:30.729585+0000","last_fullsized":"2024-09-12T18:33:30.729585+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'780","last_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_deep_scrub":"262'780","last_deep_scrub_stamp":"2024-09-12T18:33:30.729444+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.729444+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:31.980020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'109","reported_seq":619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.378689+0000","last_change":"2024-09-12T18:33:44.378623+0000","last_active":"2024-09-12T18:33:44.378689+0000","last_peered":"2024-09-12T18:33:44.378689+0000","last_clean":"2024-09-12T18:33:44.378689+0000","last_became_active":"2024-09-12T17:35:50.909320+0000","last_became_peered":"2024-09-12T17:35:50.909320+0000","last_unstale":"2024-09-12T18:33:44.378689+0000","last_undegraded":"2024-09-12T18:33:44.378689+0000","last_fullsized":"2024-09-12T18:33:44.378689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-12T18:33:44.378497+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.378497+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.199226+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":153,"num_write":258,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'457","reported_seq":2060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.675081+0000","last_change":"2024-09-12T18:33:24.674992+0000","last_active":"2024-09-12T18:33:24.675081+0000","last_peered":"2024-09-12T18:33:24.675081+0000","last_clean":"2024-09-12T18:33:24.675081+0000","last_became_active":"2024-09-12T17:35:42.892875+0000","last_became_peered":"2024-09-12T17:35:42.892875+0000","last_unstale":"2024-09-12T18:33:24.675081+0000","last_undegraded":"2024-09-12T18:33:24.675081+0000","last_fullsized":"2024-09-12T18:33:24.675081+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-12T18:33:24.674869+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.674869+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:09.706871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2459,"num_read_kb":2320,"num_write":514,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'370","reported_seq":1125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.177745+0000","last_change":"2024-09-12T18:33:11.177644+0000","last_active":"2024-09-12T18:33:11.177745+0000","last_peered":"2024-09-12T18:33:11.177745+0000","last_clean":"2024-09-12T18:33:11.177745+0000","last_became_active":"2024-09-12T17:35:40.884634+0000","last_became_peered":"2024-09-12T17:35:40.884634+0000","last_unstale":"2024-09-12T18:33:11.177745+0000","last_undegraded":"2024-09-12T18:33:11.177745+0000","last_fullsized":"2024-09-12T18:33:11.177745+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:11.177401+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.177401+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:34.320877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":622,"num_read_kb":18794,"num_write":1042,"num_write_kb":39844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.355773+0000","last_change":"2024-09-12T18:33:33.355707+0000","last_active":"2024-09-12T18:33:33.355773+0000","last_peered":"2024-09-12T18:33:33.355773+0000","last_clean":"2024-09-12T18:33:33.355773+0000","last_became_active":"2024-09-12T17:35:44.894103+0000","last_became_peered":"2024-09-12T17:35:44.894103+0000","last_unstale":"2024-09-12T18:33:33.355773+0000","last_undegraded":"2024-09-12T18:33:33.355773+0000","last_fullsized":"2024-09-12T18:33:33.355773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.355619+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.355619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:16.546019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'359","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.632752+0000","last_change":"2024-09-12T18:33:37.632679+0000","last_active":"2024-09-12T18:33:37.632752+0000","last_peered":"2024-09-12T18:33:37.632752+0000","last_clean":"2024-09-12T18:33:37.632752+0000","last_became_active":"2024-09-12T17:35:46.898737+0000","last_became_peered":"2024-09-12T17:35:46.898737+0000","last_unstale":"2024-09-12T18:33:37.632752+0000","last_undegraded":"2024-09-12T18:33:37.632752+0000","last_fullsized":"2024-09-12T18:33:37.632752+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:37.632556+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.632556+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.327875+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1185,"num_write":448,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.693032+0000","last_change":"2024-09-12T18:33:29.692945+0000","last_active":"2024-09-12T18:33:29.693032+0000","last_peered":"2024-09-12T18:33:29.693032+0000","last_clean":"2024-09-12T18:33:29.693032+0000","last_became_active":"2024-09-12T17:35:48.906089+0000","last_became_peered":"2024-09-12T17:35:48.906089+0000","last_unstale":"2024-09-12T18:33:29.693032+0000","last_undegraded":"2024-09-12T18:33:29.693032+0000","last_fullsized":"2024-09-12T18:33:29.693032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.692847+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.692847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:00.807529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'125","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:37.607461+0000","last_change":"2024-09-12T18:33:37.607363+0000","last_active":"2024-09-12T18:33:37.607461+0000","last_peered":"2024-09-12T18:33:37.607461+0000","last_clean":"2024-09-12T18:33:37.607461+0000","last_became_active":"2024-09-12T17:35:50.921075+0000","last_became_peered":"2024-09-12T17:35:50.921075+0000","last_unstale":"2024-09-12T18:33:37.607461+0000","last_undegraded":"2024-09-12T18:33:37.607461+0000","last_fullsized":"2024-09-12T18:33:37.607461+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-12T18:33:37.607260+0000","last_clean_scrub_stamp":"2024-09-12T18:33:37.607260+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.329098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":301,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'928","reported_seq":2668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.649178+0000","last_change":"2024-09-12T18:33:22.649116+0000","last_active":"2024-09-12T18:33:22.649178+0000","last_peered":"2024-09-12T18:33:22.649178+0000","last_clean":"2024-09-12T18:33:22.649178+0000","last_became_active":"2024-09-12T17:35:42.902315+0000","last_became_peered":"2024-09-12T17:35:42.902315+0000","last_unstale":"2024-09-12T18:33:22.649178+0000","last_undegraded":"2024-09-12T18:33:22.649178+0000","last_fullsized":"2024-09-12T18:33:22.649178+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'928","last_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_deep_scrub":"262'928","last_deep_scrub_stamp":"2024-09-12T18:33:22.648951+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.648951+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:49.317398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4734,"num_read_kb":4276,"num_write":1264,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.024561+0000","last_change":"2024-09-12T18:33:13.024500+0000","last_active":"2024-09-12T18:33:13.024561+0000","last_peered":"2024-09-12T18:33:13.024561+0000","last_clean":"2024-09-12T18:33:13.024561+0000","last_became_active":"2024-09-12T17:35:23.840063+0000","last_became_peered":"2024-09-12T17:35:23.840063+0000","last_unstale":"2024-09-12T18:33:13.024561+0000","last_undegraded":"2024-09-12T18:33:13.024561+0000","last_fullsized":"2024-09-12T18:33:13.024561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-12T18:33:13.024409+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.024409+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.444574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":532,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.699824+0000","last_change":"2024-09-12T18:33:13.699741+0000","last_active":"2024-09-12T18:33:13.699824+0000","last_peered":"2024-09-12T18:33:13.699824+0000","last_clean":"2024-09-12T18:33:13.699824+0000","last_became_active":"2024-09-12T17:35:29.709496+0000","last_became_peered":"2024-09-12T17:35:29.709496+0000","last_unstale":"2024-09-12T18:33:13.699824+0000","last_undegraded":"2024-09-12T18:33:13.699824+0000","last_fullsized":"2024-09-12T18:33:13.699824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:13.699652+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.699652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.289929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046903199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'314","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.163489+0000","last_change":"2024-09-12T18:33:12.163437+0000","last_active":"2024-09-12T18:33:12.163489+0000","last_peered":"2024-09-12T18:33:12.163489+0000","last_clean":"2024-09-12T18:33:12.163489+0000","last_became_active":"2024-09-12T17:35:40.885099+0000","last_became_peered":"2024-09-12T17:35:40.885099+0000","last_unstale":"2024-09-12T18:33:12.163489+0000","last_undegraded":"2024-09-12T18:33:12.163489+0000","last_fullsized":"2024-09-12T18:33:12.163489+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:12.163325+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.163325+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:48.898263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":16545,"num_write":1010,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.096910+0000","last_change":"2024-09-12T18:33:29.096831+0000","last_active":"2024-09-12T18:33:29.096910+0000","last_peered":"2024-09-12T18:33:29.096910+0000","last_clean":"2024-09-12T18:33:29.096910+0000","last_became_active":"2024-09-12T17:35:44.895720+0000","last_became_peered":"2024-09-12T17:35:44.895720+0000","last_unstale":"2024-09-12T18:33:29.096910+0000","last_undegraded":"2024-09-12T18:33:29.096910+0000","last_fullsized":"2024-09-12T18:33:29.096910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:29.096728+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.096728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:58.036440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'730","reported_seq":1439,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.603944+0000","last_change":"2024-09-12T18:33:35.603889+0000","last_active":"2024-09-12T18:33:35.603944+0000","last_peered":"2024-09-12T18:33:35.603944+0000","last_clean":"2024-09-12T18:33:35.603944+0000","last_became_active":"2024-09-12T17:35:46.902258+0000","last_became_peered":"2024-09-12T17:35:46.902258+0000","last_unstale":"2024-09-12T18:33:35.603944+0000","last_undegraded":"2024-09-12T18:33:35.603944+0000","last_fullsized":"2024-09-12T18:33:35.603944+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'730","last_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_deep_scrub":"262'730","last_deep_scrub_stamp":"2024-09-12T18:33:35.603786+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.603786+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:41.577909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141929,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1422,"num_read_kb":3270,"num_write":1334,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89062,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.772640+0000","last_change":"2024-09-12T18:33:36.772578+0000","last_active":"2024-09-12T18:33:36.772640+0000","last_peered":"2024-09-12T18:33:36.772640+0000","last_clean":"2024-09-12T18:33:36.772640+0000","last_became_active":"2024-09-12T17:35:48.901597+0000","last_became_peered":"2024-09-12T17:35:48.901597+0000","last_unstale":"2024-09-12T18:33:36.772640+0000","last_undegraded":"2024-09-12T18:33:36.772640+0000","last_fullsized":"2024-09-12T18:33:36.772640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:36.772490+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.772490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:45.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'188","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.751159+0000","last_change":"2024-09-12T18:33:35.751069+0000","last_active":"2024-09-12T18:33:35.751159+0000","last_peered":"2024-09-12T18:33:35.751159+0000","last_clean":"2024-09-12T18:33:35.751159+0000","last_became_active":"2024-09-12T17:35:50.920913+0000","last_became_peered":"2024-09-12T17:35:50.920913+0000","last_unstale":"2024-09-12T18:33:35.751159+0000","last_undegraded":"2024-09-12T18:33:35.751159+0000","last_fullsized":"2024-09-12T18:33:35.751159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:35.750947+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.750947+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.223486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":448,"num_write":380,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'774","reported_seq":2229,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.642199+0000","last_change":"2024-09-12T18:33:18.642138+0000","last_active":"2024-09-12T18:33:18.642199+0000","last_peered":"2024-09-12T18:33:18.642199+0000","last_clean":"2024-09-12T18:33:18.642199+0000","last_became_active":"2024-09-12T17:35:42.900565+0000","last_became_peered":"2024-09-12T17:35:42.900565+0000","last_unstale":"2024-09-12T18:33:18.642199+0000","last_undegraded":"2024-09-12T18:33:18.642199+0000","last_fullsized":"2024-09-12T18:33:18.642199+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-12T18:33:18.642044+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.642044+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:43.372937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3614,"num_read_kb":3254,"num_write":1026,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.980769+0000","last_change":"2024-09-12T18:33:13.980705+0000","last_active":"2024-09-12T18:33:13.980769+0000","last_peered":"2024-09-12T18:33:13.980769+0000","last_clean":"2024-09-12T18:33:13.980769+0000","last_became_active":"2024-09-12T17:35:29.706378+0000","last_became_peered":"2024-09-12T17:35:29.706378+0000","last_unstale":"2024-09-12T18:33:13.980769+0000","last_undegraded":"2024-09-12T18:33:13.980769+0000","last_fullsized":"2024-09-12T18:33:13.980769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:13.980562+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.980562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:37.681267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053318799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'360","reported_seq":1009,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.527002+0000","last_change":"2024-09-12T18:33:10.526881+0000","last_active":"2024-09-12T18:33:10.527002+0000","last_peered":"2024-09-12T18:33:10.527002+0000","last_clean":"2024-09-12T18:33:10.527002+0000","last_became_active":"2024-09-12T17:35:40.898915+0000","last_became_peered":"2024-09-12T17:35:40.898915+0000","last_unstale":"2024-09-12T18:33:10.527002+0000","last_undegraded":"2024-09-12T18:33:10.527002+0000","last_fullsized":"2024-09-12T18:33:10.527002+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'360","last_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_deep_scrub":"262'360","last_deep_scrub_stamp":"2024-09-12T18:33:10.526734+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.526734+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:39.807485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493074,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":8966,"num_write":1133,"num_write_kb":42039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.623309+0000","last_change":"2024-09-12T18:33:30.623233+0000","last_active":"2024-09-12T18:33:30.623309+0000","last_peered":"2024-09-12T18:33:30.623309+0000","last_clean":"2024-09-12T18:33:30.623309+0000","last_became_active":"2024-09-12T17:35:44.894515+0000","last_became_peered":"2024-09-12T17:35:44.894515+0000","last_unstale":"2024-09-12T18:33:30.623309+0000","last_undegraded":"2024-09-12T18:33:30.623309+0000","last_fullsized":"2024-09-12T18:33:30.623309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.623129+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.623129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:40.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'1313","reported_seq":2944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.641708+0000","last_change":"2024-09-12T18:33:30.641646+0000","last_active":"2024-09-12T18:33:30.641708+0000","last_peered":"2024-09-12T18:33:30.641708+0000","last_clean":"2024-09-12T18:33:30.641708+0000","last_became_active":"2024-09-12T17:35:46.899229+0000","last_became_peered":"2024-09-12T17:35:46.899229+0000","last_unstale":"2024-09-12T18:33:30.641708+0000","last_undegraded":"2024-09-12T18:33:30.641708+0000","last_fullsized":"2024-09-12T18:33:30.641708+0000","mapping_epoch":30,"log_start":"262'1300","ondisk_log_start":"262'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1313","last_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_deep_scrub":"262'1313","last_deep_scrub_stamp":"2024-09-12T18:33:30.641550+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.641550+0000","objects_scrubbed":11,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:54.537058+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2069,"num_read_kb":3913,"num_write":1176,"num_write_kb":1005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.140384+0000","last_change":"2024-09-12T18:33:39.140324+0000","last_active":"2024-09-12T18:33:39.140384+0000","last_peered":"2024-09-12T18:33:39.140384+0000","last_clean":"2024-09-12T18:33:39.140384+0000","last_became_active":"2024-09-12T17:35:48.903423+0000","last_became_peered":"2024-09-12T17:35:48.903423+0000","last_unstale":"2024-09-12T18:33:39.140384+0000","last_undegraded":"2024-09-12T18:33:39.140384+0000","last_fullsized":"2024-09-12T18:33:39.140384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.140223+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.140223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:37.908935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'255","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.582810+0000","last_change":"2024-09-12T18:33:39.582810+0000","last_active":"2024-09-12T18:33:39.582810+0000","last_peered":"2024-09-12T18:33:39.582810+0000","last_clean":"2024-09-12T18:33:39.582810+0000","last_became_active":"2024-09-12T17:35:51.345291+0000","last_became_peered":"2024-09-12T17:35:51.345291+0000","last_unstale":"2024-09-12T18:33:39.582810+0000","last_undegraded":"2024-09-12T18:33:39.582810+0000","last_fullsized":"2024-09-12T18:33:39.582810+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'255","last_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_deep_scrub":"262'255","last_deep_scrub_stamp":"2024-09-12T18:33:39.582714+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.582714+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:12.204164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":438,"num_write":579,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'492","reported_seq":2078,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.578069+0000","last_change":"2024-09-12T18:33:19.577961+0000","last_active":"2024-09-12T18:33:19.578069+0000","last_peered":"2024-09-12T18:33:19.578069+0000","last_clean":"2024-09-12T18:33:19.578069+0000","last_became_active":"2024-09-12T17:35:42.896997+0000","last_became_peered":"2024-09-12T17:35:42.896997+0000","last_unstale":"2024-09-12T18:33:19.578069+0000","last_undegraded":"2024-09-12T18:33:19.578069+0000","last_fullsized":"2024-09-12T18:33:19.578069+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'492","last_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_deep_scrub":"262'492","last_deep_scrub_stamp":"2024-09-12T18:33:19.577829+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.577829+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:20.823502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2672,"num_read_kb":2501,"num_write":607,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.033844+0000","last_change":"2024-09-12T18:33:11.033801+0000","last_active":"2024-09-12T18:33:11.033844+0000","last_peered":"2024-09-12T18:33:11.033844+0000","last_clean":"2024-09-12T18:33:11.033844+0000","last_became_active":"2024-09-12T17:35:29.832938+0000","last_became_peered":"2024-09-12T17:35:29.832938+0000","last_unstale":"2024-09-12T18:33:11.033844+0000","last_undegraded":"2024-09-12T18:33:11.033844+0000","last_fullsized":"2024-09-12T18:33:11.033844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:11.033735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.033735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:58.231249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042535400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'331","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.619986+0000","last_change":"2024-09-12T18:33:11.619922+0000","last_active":"2024-09-12T18:33:11.619986+0000","last_peered":"2024-09-12T18:33:11.619986+0000","last_clean":"2024-09-12T18:33:11.619986+0000","last_became_active":"2024-09-12T17:35:40.892106+0000","last_became_peered":"2024-09-12T17:35:40.892106+0000","last_unstale":"2024-09-12T18:33:11.619986+0000","last_undegraded":"2024-09-12T18:33:11.619986+0000","last_fullsized":"2024-09-12T18:33:11.619986+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:11.619798+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.619798+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.863692+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":5597,"num_write":1146,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.139531+0000","last_change":"2024-09-12T18:33:23.139449+0000","last_active":"2024-09-12T18:33:23.139531+0000","last_peered":"2024-09-12T18:33:23.139531+0000","last_clean":"2024-09-12T18:33:23.139531+0000","last_became_active":"2024-09-12T17:35:44.894322+0000","last_became_peered":"2024-09-12T17:35:44.894322+0000","last_unstale":"2024-09-12T18:33:23.139531+0000","last_undegraded":"2024-09-12T18:33:23.139531+0000","last_fullsized":"2024-09-12T18:33:23.139531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:23.139366+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.139366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:40.988736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'270","reported_seq":1505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.160980+0000","last_change":"2024-09-12T18:33:33.160919+0000","last_active":"2024-09-12T18:33:33.160980+0000","last_peered":"2024-09-12T18:33:33.160980+0000","last_clean":"2024-09-12T18:33:33.160980+0000","last_became_active":"2024-09-12T17:35:47.465610+0000","last_became_peered":"2024-09-12T17:35:47.465610+0000","last_unstale":"2024-09-12T18:33:33.160980+0000","last_undegraded":"2024-09-12T18:33:33.160980+0000","last_fullsized":"2024-09-12T18:33:33.160980+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-12T18:33:33.160821+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.160821+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:28.353872+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":203,"num_write":189,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.734542+0000","last_change":"2024-09-12T18:33:35.734478+0000","last_active":"2024-09-12T18:33:35.734542+0000","last_peered":"2024-09-12T18:33:35.734542+0000","last_clean":"2024-09-12T18:33:35.734542+0000","last_became_active":"2024-09-12T17:35:48.899968+0000","last_became_peered":"2024-09-12T17:35:48.899968+0000","last_unstale":"2024-09-12T18:33:35.734542+0000","last_undegraded":"2024-09-12T18:33:35.734542+0000","last_fullsized":"2024-09-12T18:33:35.734542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.734345+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.734345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.078776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'286","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.322482+0000","last_change":"2024-09-12T18:33:49.322388+0000","last_active":"2024-09-12T18:33:49.322482+0000","last_peered":"2024-09-12T18:33:49.322482+0000","last_clean":"2024-09-12T18:33:49.322482+0000","last_became_active":"2024-09-12T17:35:50.910251+0000","last_became_peered":"2024-09-12T17:35:50.910251+0000","last_unstale":"2024-09-12T18:33:49.322482+0000","last_undegraded":"2024-09-12T18:33:49.322482+0000","last_fullsized":"2024-09-12T18:33:49.322482+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'286","last_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_deep_scrub":"262'286","last_deep_scrub_stamp":"2024-09-12T18:33:49.322271+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.322271+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:03.810804+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":585,"num_write":638,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'396","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.585138+0000","last_change":"2024-09-12T18:33:15.585034+0000","last_active":"2024-09-12T18:33:15.585138+0000","last_peered":"2024-09-12T18:33:15.585138+0000","last_clean":"2024-09-12T18:33:15.585138+0000","last_became_active":"2024-09-12T17:35:42.887612+0000","last_became_peered":"2024-09-12T17:35:42.887612+0000","last_unstale":"2024-09-12T18:33:15.585138+0000","last_undegraded":"2024-09-12T18:33:15.585138+0000","last_fullsized":"2024-09-12T18:33:15.585138+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-12T18:33:15.584923+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.584923+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:08.823358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2056,"num_read_kb":1955,"num_write":454,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.668532+0000","last_change":"2024-09-12T18:33:12.668450+0000","last_active":"2024-09-12T18:33:12.668532+0000","last_peered":"2024-09-12T18:33:12.668532+0000","last_clean":"2024-09-12T18:33:12.668532+0000","last_became_active":"2024-09-12T17:35:29.706563+0000","last_became_peered":"2024-09-12T17:35:29.706563+0000","last_unstale":"2024-09-12T18:33:12.668532+0000","last_undegraded":"2024-09-12T18:33:12.668532+0000","last_fullsized":"2024-09-12T18:33:12.668532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T18:33:12.668348+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.668348+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:16.360994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001018283,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'318","reported_seq":964,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.277548+0000","last_change":"2024-09-12T18:33:11.277484+0000","last_active":"2024-09-12T18:33:11.277548+0000","last_peered":"2024-09-12T18:33:11.277548+0000","last_clean":"2024-09-12T18:33:11.277548+0000","last_became_active":"2024-09-12T17:35:40.895290+0000","last_became_peered":"2024-09-12T17:35:40.895290+0000","last_unstale":"2024-09-12T18:33:11.277548+0000","last_undegraded":"2024-09-12T18:33:11.277548+0000","last_fullsized":"2024-09-12T18:33:11.277548+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'318","last_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_deep_scrub":"262'318","last_deep_scrub_stamp":"2024-09-12T18:33:11.277353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.277353+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.314572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524430,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":24675,"num_write":1010,"num_write_kb":30610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.643041+0000","last_change":"2024-09-12T18:33:28.642978+0000","last_active":"2024-09-12T18:33:28.643041+0000","last_peered":"2024-09-12T18:33:28.643041+0000","last_clean":"2024-09-12T18:33:28.643041+0000","last_became_active":"2024-09-12T17:35:44.893872+0000","last_became_peered":"2024-09-12T17:35:44.893872+0000","last_unstale":"2024-09-12T18:33:28.643041+0000","last_undegraded":"2024-09-12T18:33:28.643041+0000","last_fullsized":"2024-09-12T18:33:28.643041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.642877+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.642877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:30.605913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'134","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.359479+0000","last_change":"2024-09-12T18:33:40.359405+0000","last_active":"2024-09-12T18:33:40.359479+0000","last_peered":"2024-09-12T18:33:40.359479+0000","last_clean":"2024-09-12T18:33:40.359479+0000","last_became_active":"2024-09-12T17:35:46.901269+0000","last_became_peered":"2024-09-12T17:35:46.901269+0000","last_unstale":"2024-09-12T18:33:40.359479+0000","last_undegraded":"2024-09-12T18:33:40.359479+0000","last_fullsized":"2024-09-12T18:33:40.359479+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-12T18:33:40.359314+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.359314+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:16.651907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.713690+0000","last_change":"2024-09-12T18:33:28.713622+0000","last_active":"2024-09-12T18:33:28.713690+0000","last_peered":"2024-09-12T18:33:28.713690+0000","last_clean":"2024-09-12T18:33:28.713690+0000","last_became_active":"2024-09-12T17:35:48.903678+0000","last_became_peered":"2024-09-12T17:35:48.903678+0000","last_unstale":"2024-09-12T18:33:28.713690+0000","last_undegraded":"2024-09-12T18:33:28.713690+0000","last_fullsized":"2024-09-12T18:33:28.713690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:28.713538+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.713538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:28.237723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'124","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.674459+0000","last_change":"2024-09-12T18:33:41.674395+0000","last_active":"2024-09-12T18:33:41.674459+0000","last_peered":"2024-09-12T18:33:41.674459+0000","last_clean":"2024-09-12T18:33:41.674459+0000","last_became_active":"2024-09-12T17:35:50.920282+0000","last_became_peered":"2024-09-12T17:35:50.920282+0000","last_unstale":"2024-09-12T18:33:41.674459+0000","last_undegraded":"2024-09-12T18:33:41.674459+0000","last_fullsized":"2024-09-12T18:33:41.674459+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:41.674307+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.674307+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:10.525733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":274,"num_write":301,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'754","reported_seq":2212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.610760+0000","last_change":"2024-09-12T18:33:16.610690+0000","last_active":"2024-09-12T18:33:16.610760+0000","last_peered":"2024-09-12T18:33:16.610760+0000","last_clean":"2024-09-12T18:33:16.610760+0000","last_became_active":"2024-09-12T17:35:42.897037+0000","last_became_peered":"2024-09-12T17:35:42.897037+0000","last_unstale":"2024-09-12T18:33:16.610760+0000","last_undegraded":"2024-09-12T18:33:16.610760+0000","last_fullsized":"2024-09-12T18:33:16.610760+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'754","last_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_deep_scrub":"262'754","last_deep_scrub_stamp":"2024-09-12T18:33:16.610589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.610589+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:33.968420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3595,"num_read_kb":3235,"num_write":993,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'326","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.624440+0000","last_change":"2024-09-12T18:33:11.624372+0000","last_active":"2024-09-12T18:33:11.624440+0000","last_peered":"2024-09-12T18:33:11.624440+0000","last_clean":"2024-09-12T18:33:11.624440+0000","last_became_active":"2024-09-12T17:35:40.897937+0000","last_became_peered":"2024-09-12T17:35:40.897937+0000","last_unstale":"2024-09-12T18:33:11.624440+0000","last_undegraded":"2024-09-12T18:33:11.624440+0000","last_fullsized":"2024-09-12T18:33:11.624440+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'326","last_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_deep_scrub":"262'326","last_deep_scrub_stamp":"2024-09-12T18:33:11.624231+0000","last_clean_scrub_stamp":"2024-09-12T18:33:11.624231+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:49.428871+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":16635,"num_write":1112,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.624608+0000","last_change":"2024-09-12T18:33:10.624559+0000","last_active":"2024-09-12T18:33:10.624608+0000","last_peered":"2024-09-12T18:33:10.624608+0000","last_clean":"2024-09-12T18:33:10.624608+0000","last_became_active":"2024-09-12T17:35:29.891360+0000","last_became_peered":"2024-09-12T17:35:29.891360+0000","last_unstale":"2024-09-12T18:33:10.624608+0000","last_undegraded":"2024-09-12T18:33:10.624608+0000","last_fullsized":"2024-09-12T18:33:10.624608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:10.624487+0000","last_clean_scrub_stamp":"2024-09-12T18:33:10.624487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:45.146624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059723800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.683081+0000","last_change":"2024-09-12T18:33:27.683023+0000","last_active":"2024-09-12T18:33:27.683081+0000","last_peered":"2024-09-12T18:33:27.683081+0000","last_clean":"2024-09-12T18:33:27.683081+0000","last_became_active":"2024-09-12T17:35:44.896663+0000","last_became_peered":"2024-09-12T17:35:44.896663+0000","last_unstale":"2024-09-12T18:33:27.683081+0000","last_undegraded":"2024-09-12T18:33:27.683081+0000","last_fullsized":"2024-09-12T18:33:27.683081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.682917+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.682917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.162425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'575","reported_seq":1254,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.671234+0000","last_change":"2024-09-12T18:33:29.671171+0000","last_active":"2024-09-12T18:33:29.671234+0000","last_peered":"2024-09-12T18:33:29.671234+0000","last_clean":"2024-09-12T18:33:29.671234+0000","last_became_active":"2024-09-12T17:35:46.895769+0000","last_became_peered":"2024-09-12T17:35:46.895769+0000","last_unstale":"2024-09-12T18:33:29.671234+0000","last_undegraded":"2024-09-12T18:33:29.671234+0000","last_fullsized":"2024-09-12T18:33:29.671234+0000","mapping_epoch":30,"log_start":"262'500","ondisk_log_start":"262'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'575","last_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_deep_scrub":"262'575","last_deep_scrub_stamp":"2024-09-12T18:33:29.671062+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.671062+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:47.544425+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1576,"num_read_kb":2723,"num_write":2042,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.306634+0000","last_change":"2024-09-12T18:33:41.306515+0000","last_active":"2024-09-12T18:33:41.306634+0000","last_peered":"2024-09-12T18:33:41.306634+0000","last_clean":"2024-09-12T18:33:41.306634+0000","last_became_active":"2024-09-12T17:35:48.894357+0000","last_became_peered":"2024-09-12T17:35:48.894357+0000","last_unstale":"2024-09-12T18:33:41.306634+0000","last_undegraded":"2024-09-12T18:33:41.306634+0000","last_fullsized":"2024-09-12T18:33:41.306634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.306424+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.306424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:48.065960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'112","reported_seq":619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.735720+0000","last_change":"2024-09-12T18:33:44.735660+0000","last_active":"2024-09-12T18:33:44.735720+0000","last_peered":"2024-09-12T18:33:44.735720+0000","last_clean":"2024-09-12T18:33:44.735720+0000","last_became_active":"2024-09-12T17:35:51.346438+0000","last_became_peered":"2024-09-12T17:35:51.346438+0000","last_unstale":"2024-09-12T18:33:44.735720+0000","last_undegraded":"2024-09-12T18:33:44.735720+0000","last_fullsized":"2024-09-12T18:33:44.735720+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-12T18:33:44.735567+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.735567+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:53.162317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":249,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'1008","reported_seq":2579,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.613589+0000","last_change":"2024-09-12T18:33:19.613529+0000","last_active":"2024-09-12T18:33:19.613589+0000","last_peered":"2024-09-12T18:33:19.613589+0000","last_clean":"2024-09-12T18:33:19.613589+0000","last_became_active":"2024-09-12T17:35:42.894421+0000","last_became_peered":"2024-09-12T17:35:42.894421+0000","last_unstale":"2024-09-12T18:33:19.613589+0000","last_undegraded":"2024-09-12T18:33:19.613589+0000","last_fullsized":"2024-09-12T18:33:19.613589+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1008","last_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_deep_scrub":"262'1008","last_deep_scrub_stamp":"2024-09-12T18:33:19.613439+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.613439+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:00.782809+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4794,"num_read_kb":4233,"num_write":1485,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'378","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.566916+0000","last_change":"2024-09-12T18:33:17.566857+0000","last_active":"2024-09-12T18:33:17.566916+0000","last_peered":"2024-09-12T18:33:17.566916+0000","last_clean":"2024-09-12T18:33:17.566916+0000","last_became_active":"2024-09-12T17:35:40.892782+0000","last_became_peered":"2024-09-12T17:35:40.892782+0000","last_unstale":"2024-09-12T18:33:17.566916+0000","last_undegraded":"2024-09-12T18:33:17.566916+0000","last_fullsized":"2024-09-12T18:33:17.566916+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:17.566746+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.566746+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:24.317944+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820443,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":48347,"num_write":1175,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.966235+0000","last_change":"2024-09-12T18:33:15.966167+0000","last_active":"2024-09-12T18:33:15.966235+0000","last_peered":"2024-09-12T18:33:15.966235+0000","last_clean":"2024-09-12T18:33:15.966235+0000","last_became_active":"2024-09-12T17:35:29.891356+0000","last_became_peered":"2024-09-12T17:35:29.891356+0000","last_unstale":"2024-09-12T18:33:15.966235+0000","last_undegraded":"2024-09-12T18:33:15.966235+0000","last_fullsized":"2024-09-12T18:33:15.966235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:15.966071+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.966071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.134360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052177799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.689440+0000","last_change":"2024-09-12T18:33:23.689372+0000","last_active":"2024-09-12T18:33:23.689440+0000","last_peered":"2024-09-12T18:33:23.689440+0000","last_clean":"2024-09-12T18:33:23.689440+0000","last_became_active":"2024-09-12T17:35:44.893075+0000","last_became_peered":"2024-09-12T17:35:44.893075+0000","last_unstale":"2024-09-12T18:33:23.689440+0000","last_undegraded":"2024-09-12T18:33:23.689440+0000","last_fullsized":"2024-09-12T18:33:23.689440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.689279+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.689279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:38.802520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'209","reported_seq":787,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.622174+0000","last_change":"2024-09-12T18:33:29.622114+0000","last_active":"2024-09-12T18:33:29.622174+0000","last_peered":"2024-09-12T18:33:29.622174+0000","last_clean":"2024-09-12T18:33:29.622174+0000","last_became_active":"2024-09-12T17:35:47.464633+0000","last_became_peered":"2024-09-12T17:35:47.464633+0000","last_unstale":"2024-09-12T18:33:29.622174+0000","last_undegraded":"2024-09-12T18:33:29.622174+0000","last_fullsized":"2024-09-12T18:33:29.622174+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-12T18:33:29.622018+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.622018+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:47.767617+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":251,"num_write":228,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'787","reported_seq":2487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.600739+0000","last_change":"2024-09-12T18:33:38.600687+0000","last_active":"2024-09-12T18:33:38.600739+0000","last_peered":"2024-09-12T18:33:38.600739+0000","last_clean":"2024-09-12T18:33:38.600739+0000","last_became_active":"2024-09-12T17:35:48.904949+0000","last_became_peered":"2024-09-12T17:35:48.904949+0000","last_unstale":"2024-09-12T18:33:38.600739+0000","last_undegraded":"2024-09-12T18:33:38.600739+0000","last_fullsized":"2024-09-12T18:33:38.600739+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'787","last_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_deep_scrub":"262'787","last_deep_scrub_stamp":"2024-09-12T18:33:38.600601+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.600601+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:11.236866+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'113","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:53.301657+0000","last_change":"2024-09-12T18:33:53.301657+0000","last_active":"2024-09-12T18:33:53.301657+0000","last_peered":"2024-09-12T18:33:53.301657+0000","last_clean":"2024-09-12T18:33:53.301657+0000","last_became_active":"2024-09-12T17:35:51.344944+0000","last_became_peered":"2024-09-12T17:35:51.344944+0000","last_unstale":"2024-09-12T18:33:53.301657+0000","last_undegraded":"2024-09-12T18:33:53.301657+0000","last_fullsized":"2024-09-12T18:33:53.301657+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-12T18:33:53.301560+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-12T18:33:53.301560+0000","last_clean_scrub_stamp":"2024-09-12T18:33:53.301560+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:09.047130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":133,"num_write":247,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'444","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.284135+0000","last_change":"2024-09-12T18:33:23.284074+0000","last_active":"2024-09-12T18:33:23.284135+0000","last_peered":"2024-09-12T18:33:23.284135+0000","last_clean":"2024-09-12T18:33:23.284135+0000","last_became_active":"2024-09-12T17:35:42.883619+0000","last_became_peered":"2024-09-12T17:35:42.883619+0000","last_unstale":"2024-09-12T18:33:23.284135+0000","last_undegraded":"2024-09-12T18:33:23.284135+0000","last_fullsized":"2024-09-12T18:33:23.284135+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-12T18:33:23.283986+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.283986+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.932404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2331,"num_read_kb":2199,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'361","reported_seq":1021,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.141815+0000","last_change":"2024-09-12T18:33:13.141754+0000","last_active":"2024-09-12T18:33:13.141815+0000","last_peered":"2024-09-12T18:33:13.141815+0000","last_clean":"2024-09-12T18:33:13.141815+0000","last_became_active":"2024-09-12T17:35:40.888562+0000","last_became_peered":"2024-09-12T17:35:40.888562+0000","last_unstale":"2024-09-12T18:33:13.141815+0000","last_undegraded":"2024-09-12T18:33:13.141815+0000","last_fullsized":"2024-09-12T18:33:13.141815+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-12T18:33:13.141659+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.141659+0000","objects_scrubbed":8,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:39.600554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079933,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":50118,"num_write":1078,"num_write_kb":29885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.639195+0000","last_change":"2024-09-12T18:33:22.639195+0000","last_active":"2024-09-12T18:33:22.639195+0000","last_peered":"2024-09-12T18:33:22.639195+0000","last_clean":"2024-09-12T18:33:22.639195+0000","last_became_active":"2024-09-12T17:35:29.707236+0000","last_became_peered":"2024-09-12T17:35:29.707236+0000","last_unstale":"2024-09-12T18:33:22.639195+0000","last_undegraded":"2024-09-12T18:33:22.639195+0000","last_fullsized":"2024-09-12T18:33:22.639195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:22.639106+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.639106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:28.364727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00060247700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.333132+0000","last_change":"2024-09-12T18:33:32.333034+0000","last_active":"2024-09-12T18:33:32.333132+0000","last_peered":"2024-09-12T18:33:32.333132+0000","last_clean":"2024-09-12T18:33:32.333132+0000","last_became_active":"2024-09-12T17:35:44.888495+0000","last_became_peered":"2024-09-12T17:35:44.888495+0000","last_unstale":"2024-09-12T18:33:32.333132+0000","last_undegraded":"2024-09-12T18:33:32.333132+0000","last_fullsized":"2024-09-12T18:33:32.333132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:32.332939+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.332939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:24.535431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'118","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.295676+0000","last_change":"2024-09-12T18:33:36.295611+0000","last_active":"2024-09-12T18:33:36.295676+0000","last_peered":"2024-09-12T18:33:36.295676+0000","last_clean":"2024-09-12T18:33:36.295676+0000","last_became_active":"2024-09-12T17:35:46.896606+0000","last_became_peered":"2024-09-12T17:35:46.896606+0000","last_unstale":"2024-09-12T18:33:36.295676+0000","last_undegraded":"2024-09-12T18:33:36.295676+0000","last_fullsized":"2024-09-12T18:33:36.295676+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-12T18:33:36.295511+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.295511+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:50.229082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'819","reported_seq":2755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.319053+0000","last_change":"2024-09-12T18:33:44.318998+0000","last_active":"2024-09-12T18:33:44.319053+0000","last_peered":"2024-09-12T18:33:44.319053+0000","last_clean":"2024-09-12T18:33:44.319053+0000","last_became_active":"2024-09-12T17:35:48.899838+0000","last_became_peered":"2024-09-12T17:35:48.899838+0000","last_unstale":"2024-09-12T18:33:44.319053+0000","last_undegraded":"2024-09-12T18:33:44.319053+0000","last_fullsized":"2024-09-12T18:33:44.319053+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'819","last_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_deep_scrub":"262'819","last_deep_scrub_stamp":"2024-09-12T18:33:44.318903+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.318903+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:11.329999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'188","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.757910+0000","last_change":"2024-09-12T18:33:42.757850+0000","last_active":"2024-09-12T18:33:42.757910+0000","last_peered":"2024-09-12T18:33:42.757910+0000","last_clean":"2024-09-12T18:33:42.757910+0000","last_became_active":"2024-09-12T17:35:50.910474+0000","last_became_peered":"2024-09-12T17:35:50.910474+0000","last_unstale":"2024-09-12T18:33:42.757910+0000","last_undegraded":"2024-09-12T18:33:42.757910+0000","last_fullsized":"2024-09-12T18:33:42.757910+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:42.757762+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.757762+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:52.059548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":428,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'541","reported_seq":2154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.238309+0000","last_change":"2024-09-12T18:33:16.238244+0000","last_active":"2024-09-12T18:33:16.238309+0000","last_peered":"2024-09-12T18:33:16.238309+0000","last_clean":"2024-09-12T18:33:16.238309+0000","last_became_active":"2024-09-12T17:35:42.895257+0000","last_became_peered":"2024-09-12T17:35:42.895257+0000","last_unstale":"2024-09-12T18:33:16.238309+0000","last_undegraded":"2024-09-12T18:33:16.238309+0000","last_fullsized":"2024-09-12T18:33:16.238309+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:16.238154+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.238154+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.758872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2752,"num_read_kb":2553,"num_write":652,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'301","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.484174+0000","last_change":"2024-09-12T18:33:09.484120+0000","last_active":"2024-09-12T18:33:09.484174+0000","last_peered":"2024-09-12T18:33:09.484174+0000","last_clean":"2024-09-12T18:33:09.484174+0000","last_became_active":"2024-09-12T17:35:40.895858+0000","last_became_peered":"2024-09-12T17:35:40.895858+0000","last_unstale":"2024-09-12T18:33:09.484174+0000","last_undegraded":"2024-09-12T18:33:09.484174+0000","last_fullsized":"2024-09-12T18:33:09.484174+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'301","last_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_deep_scrub":"262'301","last_deep_scrub_stamp":"2024-09-12T18:33:09.484014+0000","last_clean_scrub_stamp":"2024-09-12T18:33:09.484014+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:09.383970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":18058,"num_write":1049,"num_write_kb":25199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.699256+0000","last_change":"2024-09-12T18:33:12.699204+0000","last_active":"2024-09-12T18:33:12.699256+0000","last_peered":"2024-09-12T18:33:12.699256+0000","last_clean":"2024-09-12T18:33:12.699256+0000","last_became_active":"2024-09-12T17:35:29.707491+0000","last_became_peered":"2024-09-12T17:35:29.707491+0000","last_unstale":"2024-09-12T18:33:12.699256+0000","last_undegraded":"2024-09-12T18:33:12.699256+0000","last_fullsized":"2024-09-12T18:33:12.699256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:12.699122+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.699122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.717334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046213599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.430298+0000","last_change":"2024-09-12T18:33:33.430244+0000","last_active":"2024-09-12T18:33:33.430298+0000","last_peered":"2024-09-12T18:33:33.430298+0000","last_clean":"2024-09-12T18:33:33.430298+0000","last_became_active":"2024-09-12T17:35:44.892848+0000","last_became_peered":"2024-09-12T17:35:44.892848+0000","last_unstale":"2024-09-12T18:33:33.430298+0000","last_undegraded":"2024-09-12T18:33:33.430298+0000","last_fullsized":"2024-09-12T18:33:33.430298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:33.430169+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.430169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.537046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'727","reported_seq":1454,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.152053+0000","last_change":"2024-09-12T18:33:36.151989+0000","last_active":"2024-09-12T18:33:36.152053+0000","last_peered":"2024-09-12T18:33:36.152053+0000","last_clean":"2024-09-12T18:33:36.152053+0000","last_became_active":"2024-09-12T17:35:47.464561+0000","last_became_peered":"2024-09-12T17:35:47.464561+0000","last_unstale":"2024-09-12T18:33:36.152053+0000","last_undegraded":"2024-09-12T18:33:36.152053+0000","last_fullsized":"2024-09-12T18:33:36.152053+0000","mapping_epoch":30,"log_start":"262'700","ondisk_log_start":"262'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'727","last_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_deep_scrub":"262'727","last_deep_scrub_stamp":"2024-09-12T18:33:36.151761+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.151761+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:16.853655+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125283,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":3013,"num_write":1042,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.392851+0000","last_change":"2024-09-12T18:33:46.392777+0000","last_active":"2024-09-12T18:33:46.392851+0000","last_peered":"2024-09-12T18:33:46.392851+0000","last_clean":"2024-09-12T18:33:46.392851+0000","last_became_active":"2024-09-12T17:35:48.898753+0000","last_became_peered":"2024-09-12T17:35:48.898753+0000","last_unstale":"2024-09-12T18:33:46.392851+0000","last_undegraded":"2024-09-12T18:33:46.392851+0000","last_fullsized":"2024-09-12T18:33:46.392851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:46.392690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.392690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.346518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'132","reported_seq":636,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.642381+0000","last_change":"2024-09-12T18:33:42.642288+0000","last_active":"2024-09-12T18:33:42.642381+0000","last_peered":"2024-09-12T18:33:42.642381+0000","last_clean":"2024-09-12T18:33:42.642381+0000","last_became_active":"2024-09-12T17:35:50.924185+0000","last_became_peered":"2024-09-12T17:35:50.924185+0000","last_unstale":"2024-09-12T18:33:42.642381+0000","last_undegraded":"2024-09-12T18:33:42.642381+0000","last_fullsized":"2024-09-12T18:33:42.642381+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-12T18:33:42.642175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.642175+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:14.865789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'131","reported_seq":712,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.666991+0000","last_change":"2024-09-12T18:33:49.666901+0000","last_active":"2024-09-12T18:33:49.666991+0000","last_peered":"2024-09-12T18:33:49.666991+0000","last_clean":"2024-09-12T18:33:49.666991+0000","last_became_active":"2024-09-12T17:35:50.922831+0000","last_became_peered":"2024-09-12T17:35:50.922831+0000","last_unstale":"2024-09-12T18:33:49.666991+0000","last_undegraded":"2024-09-12T18:33:49.666991+0000","last_fullsized":"2024-09-12T18:33:49.666991+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:49.666810+0000","last_clean_scrub_stamp":"2024-09-12T18:33:49.666810+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:28.057997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":295,"num_read_kb":278,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'397","reported_seq":1909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.247083+0000","last_change":"2024-09-12T18:33:21.247025+0000","last_active":"2024-09-12T18:33:21.247083+0000","last_peered":"2024-09-12T18:33:21.247083+0000","last_clean":"2024-09-12T18:33:21.247083+0000","last_became_active":"2024-09-12T17:35:42.897941+0000","last_became_peered":"2024-09-12T17:35:42.897941+0000","last_unstale":"2024-09-12T18:33:21.247083+0000","last_undegraded":"2024-09-12T18:33:21.247083+0000","last_fullsized":"2024-09-12T18:33:21.247083+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'397","last_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_deep_scrub":"262'397","last_deep_scrub_stamp":"2024-09-12T18:33:21.246937+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.246937+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:02.793084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2166,"num_read_kb":2061,"num_write":452,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'323","reported_seq":998,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.235845+0000","last_change":"2024-09-12T18:33:12.235775+0000","last_active":"2024-09-12T18:33:12.235845+0000","last_peered":"2024-09-12T18:33:12.235845+0000","last_clean":"2024-09-12T18:33:12.235845+0000","last_became_active":"2024-09-12T17:35:40.903876+0000","last_became_peered":"2024-09-12T17:35:40.903876+0000","last_unstale":"2024-09-12T18:33:12.235845+0000","last_undegraded":"2024-09-12T18:33:12.235845+0000","last_fullsized":"2024-09-12T18:33:12.235845+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:12.235626+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.235626+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:59.915198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":63909,"num_write":1001,"num_write_kb":32848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.626749+0000","last_change":"2024-09-12T18:33:23.626695+0000","last_active":"2024-09-12T18:33:23.626749+0000","last_peered":"2024-09-12T18:33:23.626749+0000","last_clean":"2024-09-12T18:33:23.626749+0000","last_became_active":"2024-09-12T17:35:44.896819+0000","last_became_peered":"2024-09-12T17:35:44.896819+0000","last_unstale":"2024-09-12T18:33:23.626749+0000","last_undegraded":"2024-09-12T18:33:23.626749+0000","last_fullsized":"2024-09-12T18:33:23.626749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:23.626609+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.626609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:00.714762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'267","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.389853+0000","last_change":"2024-09-12T18:33:39.389784+0000","last_active":"2024-09-12T18:33:39.389853+0000","last_peered":"2024-09-12T18:33:39.389853+0000","last_clean":"2024-09-12T18:33:39.389853+0000","last_became_active":"2024-09-12T17:35:46.897293+0000","last_became_peered":"2024-09-12T17:35:46.897293+0000","last_unstale":"2024-09-12T18:33:39.389853+0000","last_undegraded":"2024-09-12T18:33:39.389853+0000","last_fullsized":"2024-09-12T18:33:39.389853+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'267","last_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_deep_scrub":"262'267","last_deep_scrub_stamp":"2024-09-12T18:33:39.389682+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.389682+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:45.899532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":1008,"num_write":356,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.344063+0000","last_change":"2024-09-12T18:33:45.343989+0000","last_active":"2024-09-12T18:33:45.344063+0000","last_peered":"2024-09-12T18:33:45.344063+0000","last_clean":"2024-09-12T18:33:45.344063+0000","last_became_active":"2024-09-12T17:35:48.899034+0000","last_became_peered":"2024-09-12T17:35:48.899034+0000","last_unstale":"2024-09-12T18:33:45.344063+0000","last_undegraded":"2024-09-12T18:33:45.344063+0000","last_fullsized":"2024-09-12T18:33:45.344063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:45.343882+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.343882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:12.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'139","reported_seq":643,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.263846+0000","last_change":"2024-09-12T18:33:55.263744+0000","last_active":"2024-09-12T18:33:55.263846+0000","last_peered":"2024-09-12T18:33:55.263846+0000","last_clean":"2024-09-12T18:33:55.263846+0000","last_became_active":"2024-09-12T17:35:50.915037+0000","last_became_peered":"2024-09-12T17:35:50.915037+0000","last_unstale":"2024-09-12T18:33:55.263846+0000","last_undegraded":"2024-09-12T18:33:55.263846+0000","last_fullsized":"2024-09-12T18:33:55.263846+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'139","last_scrub_stamp":"2024-09-12T18:33:55.263600+0000","last_deep_scrub":"262'139","last_deep_scrub_stamp":"2024-09-12T18:33:55.263600+0000","last_clean_scrub_stamp":"2024-09-12T18:33:55.263600+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:02.481985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'977","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.612807+0000","last_change":"2024-09-12T18:33:20.612697+0000","last_active":"2024-09-12T18:33:20.612807+0000","last_peered":"2024-09-12T18:33:20.612807+0000","last_clean":"2024-09-12T18:33:20.612807+0000","last_became_active":"2024-09-12T17:35:42.896402+0000","last_became_peered":"2024-09-12T17:35:42.896402+0000","last_unstale":"2024-09-12T18:33:20.612807+0000","last_undegraded":"2024-09-12T18:33:20.612807+0000","last_fullsized":"2024-09-12T18:33:20.612807+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'977","last_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_deep_scrub":"262'977","last_deep_scrub_stamp":"2024-09-12T18:33:20.612589+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.612589+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":900,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:51.536947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4420,"num_read_kb":3934,"num_write":1343,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'391","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.958442+0000","last_change":"2024-09-12T18:33:17.958378+0000","last_active":"2024-09-12T18:33:17.958442+0000","last_peered":"2024-09-12T18:33:17.958442+0000","last_clean":"2024-09-12T18:33:17.958442+0000","last_became_active":"2024-09-12T17:35:40.885997+0000","last_became_peered":"2024-09-12T17:35:40.885997+0000","last_unstale":"2024-09-12T18:33:17.958442+0000","last_undegraded":"2024-09-12T18:33:17.958442+0000","last_fullsized":"2024-09-12T18:33:17.958442+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'391","last_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_deep_scrub":"262'391","last_deep_scrub_stamp":"2024-09-12T18:33:17.958248+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.958248+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:10.190084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079946,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":8296,"num_write":1132,"num_write_kb":38245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"262'4","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.361509+0000","last_change":"2024-09-12T18:33:35.361447+0000","last_active":"2024-09-12T18:33:35.361509+0000","last_peered":"2024-09-12T18:33:35.361509+0000","last_clean":"2024-09-12T18:33:35.361509+0000","last_became_active":"2024-09-12T17:35:44.893616+0000","last_became_peered":"2024-09-12T17:35:44.893616+0000","last_unstale":"2024-09-12T18:33:35.361509+0000","last_undegraded":"2024-09-12T18:33:35.361509+0000","last_fullsized":"2024-09-12T18:33:35.361509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T18:33:35.361353+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.361353+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:39.149109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'58","reported_seq":571,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.690334+0000","last_change":"2024-09-12T18:33:33.690280+0000","last_active":"2024-09-12T18:33:33.690334+0000","last_peered":"2024-09-12T18:33:33.690334+0000","last_clean":"2024-09-12T18:33:33.690334+0000","last_became_active":"2024-09-12T17:35:46.898677+0000","last_became_peered":"2024-09-12T17:35:46.898677+0000","last_unstale":"2024-09-12T18:33:33.690334+0000","last_undegraded":"2024-09-12T18:33:33.690334+0000","last_fullsized":"2024-09-12T18:33:33.690334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'58","last_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_deep_scrub":"262'58","last_deep_scrub_stamp":"2024-09-12T18:33:33.690203+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.690203+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:57.510406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.159845+0000","last_change":"2024-09-12T18:33:38.159733+0000","last_active":"2024-09-12T18:33:38.159845+0000","last_peered":"2024-09-12T18:33:38.159845+0000","last_clean":"2024-09-12T18:33:38.159845+0000","last_became_active":"2024-09-12T17:35:48.905800+0000","last_became_peered":"2024-09-12T17:35:48.905800+0000","last_unstale":"2024-09-12T18:33:38.159845+0000","last_undegraded":"2024-09-12T18:33:38.159845+0000","last_fullsized":"2024-09-12T18:33:38.159845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:38.159640+0000","last_clean_scrub_stamp":"2024-09-12T18:33:38.159640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:36.092462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.769766+0000","last_change":"2024-09-12T18:33:45.769766+0000","last_active":"2024-09-12T18:33:45.769766+0000","last_peered":"2024-09-12T18:33:45.769766+0000","last_clean":"2024-09-12T18:33:45.769766+0000","last_became_active":"2024-09-12T17:35:50.911069+0000","last_became_peered":"2024-09-12T17:35:50.911069+0000","last_unstale":"2024-09-12T18:33:45.769766+0000","last_undegraded":"2024-09-12T18:33:45.769766+0000","last_fullsized":"2024-09-12T18:33:45.769766+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-12T18:33:45.769648+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.769648+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.982175+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":334,"num_write":410,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'556","reported_seq":2190,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.320005+0000","last_change":"2024-09-12T18:33:25.319941+0000","last_active":"2024-09-12T18:33:25.320005+0000","last_peered":"2024-09-12T18:33:25.320005+0000","last_clean":"2024-09-12T18:33:25.320005+0000","last_became_active":"2024-09-12T17:35:42.894024+0000","last_became_peered":"2024-09-12T17:35:42.894024+0000","last_unstale":"2024-09-12T18:33:25.320005+0000","last_undegraded":"2024-09-12T18:33:25.320005+0000","last_fullsized":"2024-09-12T18:33:25.320005+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'556","last_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_deep_scrub":"262'556","last_deep_scrub_stamp":"2024-09-12T18:33:25.319848+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.319848+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:58.204185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3064,"num_read_kb":2878,"num_write":717,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'368","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.702588+0000","last_change":"2024-09-12T18:33:14.702522+0000","last_active":"2024-09-12T18:33:14.702588+0000","last_peered":"2024-09-12T18:33:14.702588+0000","last_clean":"2024-09-12T18:33:14.702588+0000","last_became_active":"2024-09-12T17:35:40.895601+0000","last_became_peered":"2024-09-12T17:35:40.895601+0000","last_unstale":"2024-09-12T18:33:14.702588+0000","last_undegraded":"2024-09-12T18:33:14.702588+0000","last_fullsized":"2024-09-12T18:33:14.702588+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'368","last_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_deep_scrub":"262'368","last_deep_scrub_stamp":"2024-09-12T18:33:14.702321+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.702321+0000","objects_scrubbed":11,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:33.790945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350736,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":674,"num_read_kb":8078,"num_write":1180,"num_write_kb":11834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.114024+0000","last_change":"2024-09-12T18:33:30.113931+0000","last_active":"2024-09-12T18:33:30.114024+0000","last_peered":"2024-09-12T18:33:30.114024+0000","last_clean":"2024-09-12T18:33:30.114024+0000","last_became_active":"2024-09-12T17:35:44.898820+0000","last_became_peered":"2024-09-12T17:35:44.898820+0000","last_unstale":"2024-09-12T18:33:30.114024+0000","last_undegraded":"2024-09-12T18:33:30.114024+0000","last_fullsized":"2024-09-12T18:33:30.114024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.113831+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.113831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:05.941190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'324","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.326821+0000","last_change":"2024-09-12T18:33:41.326761+0000","last_active":"2024-09-12T18:33:41.326821+0000","last_peered":"2024-09-12T18:33:41.326821+0000","last_clean":"2024-09-12T18:33:41.326821+0000","last_became_active":"2024-09-12T17:35:46.899320+0000","last_became_peered":"2024-09-12T17:35:46.899320+0000","last_unstale":"2024-09-12T18:33:41.326821+0000","last_undegraded":"2024-09-12T18:33:41.326821+0000","last_fullsized":"2024-09-12T18:33:41.326821+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-12T18:33:41.326666+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.326666+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:22.806748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48623,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1190,"num_write":438,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.748116+0000","last_change":"2024-09-12T18:33:31.747999+0000","last_active":"2024-09-12T18:33:31.748116+0000","last_peered":"2024-09-12T18:33:31.748116+0000","last_clean":"2024-09-12T18:33:31.748116+0000","last_became_active":"2024-09-12T17:35:48.903733+0000","last_became_peered":"2024-09-12T17:35:48.903733+0000","last_unstale":"2024-09-12T18:33:31.748116+0000","last_undegraded":"2024-09-12T18:33:31.748116+0000","last_fullsized":"2024-09-12T18:33:31.748116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.747908+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.747908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:11.279329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'99","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.682050+0000","last_change":"2024-09-12T18:33:46.682050+0000","last_active":"2024-09-12T18:33:46.682050+0000","last_peered":"2024-09-12T18:33:46.682050+0000","last_clean":"2024-09-12T18:33:46.682050+0000","last_became_active":"2024-09-12T17:35:50.920802+0000","last_became_peered":"2024-09-12T17:35:50.920802+0000","last_unstale":"2024-09-12T18:33:46.682050+0000","last_undegraded":"2024-09-12T18:33:46.682050+0000","last_fullsized":"2024-09-12T18:33:46.682050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'99","last_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_deep_scrub":"262'99","last_deep_scrub_stamp":"2024-09-12T18:33:46.681959+0000","last_clean_scrub_stamp":"2024-09-12T18:33:46.681959+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:42.683159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":238,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'1027","reported_seq":2675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.355236+0000","last_change":"2024-09-12T18:33:26.355171+0000","last_active":"2024-09-12T18:33:26.355236+0000","last_peered":"2024-09-12T18:33:26.355236+0000","last_clean":"2024-09-12T18:33:26.355236+0000","last_became_active":"2024-09-12T17:35:42.891353+0000","last_became_peered":"2024-09-12T17:35:42.891353+0000","last_unstale":"2024-09-12T18:33:26.355236+0000","last_undegraded":"2024-09-12T18:33:26.355236+0000","last_fullsized":"2024-09-12T18:33:26.355236+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1027","last_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_deep_scrub":"262'1027","last_deep_scrub_stamp":"2024-09-12T18:33:26.355090+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.355090+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:15.967085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4850,"num_read_kb":4310,"num_write":1459,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'378","reported_seq":1007,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.546254+0000","last_change":"2024-09-12T18:33:13.546149+0000","last_active":"2024-09-12T18:33:13.546254+0000","last_peered":"2024-09-12T18:33:13.546254+0000","last_clean":"2024-09-12T18:33:13.546254+0000","last_became_active":"2024-09-12T17:35:40.897967+0000","last_became_peered":"2024-09-12T17:35:40.897967+0000","last_unstale":"2024-09-12T18:33:13.546254+0000","last_undegraded":"2024-09-12T18:33:13.546254+0000","last_fullsized":"2024-09-12T18:33:13.546254+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'378","last_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_deep_scrub":"262'378","last_deep_scrub_stamp":"2024-09-12T18:33:13.546033+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.546033+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:18.615258+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":38183,"num_write":1089,"num_write_kb":40446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.721094+0000","last_change":"2024-09-12T18:33:26.720977+0000","last_active":"2024-09-12T18:33:26.721094+0000","last_peered":"2024-09-12T18:33:26.721094+0000","last_clean":"2024-09-12T18:33:26.721094+0000","last_became_active":"2024-09-12T17:35:44.895419+0000","last_became_peered":"2024-09-12T17:35:44.895419+0000","last_unstale":"2024-09-12T18:33:26.721094+0000","last_undegraded":"2024-09-12T18:33:26.721094+0000","last_fullsized":"2024-09-12T18:33:26.721094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:26.720886+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.720886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:00.916187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'279","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.187372+0000","last_change":"2024-09-12T18:33:34.187275+0000","last_active":"2024-09-12T18:33:34.187372+0000","last_peered":"2024-09-12T18:33:34.187372+0000","last_clean":"2024-09-12T18:33:34.187372+0000","last_became_active":"2024-09-12T17:35:46.898877+0000","last_became_peered":"2024-09-12T17:35:46.898877+0000","last_unstale":"2024-09-12T18:33:34.187372+0000","last_undegraded":"2024-09-12T18:33:34.187372+0000","last_fullsized":"2024-09-12T18:33:34.187372+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'279","last_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_deep_scrub":"262'279","last_deep_scrub_stamp":"2024-09-12T18:33:34.187165+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.187165+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:03.540694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54427,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":1013,"num_write":368,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.747990+0000","last_change":"2024-09-12T18:33:40.747900+0000","last_active":"2024-09-12T18:33:40.747990+0000","last_peered":"2024-09-12T18:33:40.747990+0000","last_clean":"2024-09-12T18:33:40.747990+0000","last_became_active":"2024-09-12T17:35:48.900661+0000","last_became_peered":"2024-09-12T17:35:48.900661+0000","last_unstale":"2024-09-12T18:33:40.747990+0000","last_undegraded":"2024-09-12T18:33:40.747990+0000","last_fullsized":"2024-09-12T18:33:40.747990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.747780+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.747780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.596415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'862","reported_seq":2493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.706620+0000","last_change":"2024-09-12T18:33:20.706522+0000","last_active":"2024-09-12T18:33:20.706620+0000","last_peered":"2024-09-12T18:33:20.706620+0000","last_clean":"2024-09-12T18:33:20.706620+0000","last_became_active":"2024-09-12T17:35:42.895893+0000","last_became_peered":"2024-09-12T17:35:42.895893+0000","last_unstale":"2024-09-12T18:33:20.706620+0000","last_undegraded":"2024-09-12T18:33:20.706620+0000","last_fullsized":"2024-09-12T18:33:20.706620+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-12T18:33:20.706397+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.706397+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:46.363194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4299,"num_read_kb":3887,"num_write":1124,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'357","reported_seq":1093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.251831+0000","last_change":"2024-09-12T18:33:16.251755+0000","last_active":"2024-09-12T18:33:16.251831+0000","last_peered":"2024-09-12T18:33:16.251831+0000","last_clean":"2024-09-12T18:33:16.251831+0000","last_became_active":"2024-09-12T17:35:40.884151+0000","last_became_peered":"2024-09-12T17:35:40.884151+0000","last_unstale":"2024-09-12T18:33:16.251831+0000","last_undegraded":"2024-09-12T18:33:16.251831+0000","last_fullsized":"2024-09-12T18:33:16.251831+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-12T18:33:16.251595+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.251595+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.014047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080042,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":5768,"num_write":997,"num_write_kb":32703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.655171+0000","last_change":"2024-09-12T18:33:30.655090+0000","last_active":"2024-09-12T18:33:30.655171+0000","last_peered":"2024-09-12T18:33:30.655171+0000","last_clean":"2024-09-12T18:33:30.655171+0000","last_became_active":"2024-09-12T17:35:44.897445+0000","last_became_peered":"2024-09-12T17:35:44.897445+0000","last_unstale":"2024-09-12T18:33:30.655171+0000","last_undegraded":"2024-09-12T18:33:30.655171+0000","last_fullsized":"2024-09-12T18:33:30.655171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:30.654984+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.654984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.034356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'502","reported_seq":1141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:33.569019+0000","last_change":"2024-09-12T18:33:33.569019+0000","last_active":"2024-09-12T18:33:33.569019+0000","last_peered":"2024-09-12T18:33:33.569019+0000","last_clean":"2024-09-12T18:33:33.569019+0000","last_became_active":"2024-09-12T17:35:46.899451+0000","last_became_peered":"2024-09-12T17:35:46.899451+0000","last_unstale":"2024-09-12T18:33:33.569019+0000","last_undegraded":"2024-09-12T18:33:33.569019+0000","last_fullsized":"2024-09-12T18:33:33.569019+0000","mapping_epoch":30,"log_start":"262'400","ondisk_log_start":"262'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'502","last_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_deep_scrub":"262'502","last_deep_scrub_stamp":"2024-09-12T18:33:33.568933+0000","last_clean_scrub_stamp":"2024-09-12T18:33:33.568933+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:22.637750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110948,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":875,"num_read_kb":2101,"num_write":752,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.630432+0000","last_change":"2024-09-12T18:33:40.630432+0000","last_active":"2024-09-12T18:33:40.630432+0000","last_peered":"2024-09-12T18:33:40.630432+0000","last_clean":"2024-09-12T18:33:40.630432+0000","last_became_active":"2024-09-12T17:35:48.899776+0000","last_became_peered":"2024-09-12T17:35:48.899776+0000","last_unstale":"2024-09-12T18:33:40.630432+0000","last_undegraded":"2024-09-12T18:33:40.630432+0000","last_fullsized":"2024-09-12T18:33:40.630432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:40.630343+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.630343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:27.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'166","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:52.327303+0000","last_change":"2024-09-12T18:33:52.327186+0000","last_active":"2024-09-12T18:33:52.327303+0000","last_peered":"2024-09-12T18:33:52.327303+0000","last_clean":"2024-09-12T18:33:52.327303+0000","last_became_active":"2024-09-12T17:35:51.346343+0000","last_became_peered":"2024-09-12T17:35:51.346343+0000","last_unstale":"2024-09-12T18:33:52.327303+0000","last_undegraded":"2024-09-12T18:33:52.327303+0000","last_fullsized":"2024-09-12T18:33:52.327303+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'166","last_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_deep_scrub":"262'166","last_deep_scrub_stamp":"2024-09-12T18:33:52.327070+0000","last_clean_scrub_stamp":"2024-09-12T18:33:52.327070+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.676098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":263,"num_write":383,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'776","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.637392+0000","last_change":"2024-09-12T18:33:23.637333+0000","last_active":"2024-09-12T18:33:23.637392+0000","last_peered":"2024-09-12T18:33:23.637392+0000","last_clean":"2024-09-12T18:33:23.637392+0000","last_became_active":"2024-09-12T17:35:42.896179+0000","last_became_peered":"2024-09-12T17:35:42.896179+0000","last_unstale":"2024-09-12T18:33:23.637392+0000","last_undegraded":"2024-09-12T18:33:23.637392+0000","last_fullsized":"2024-09-12T18:33:23.637392+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'776","last_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_deep_scrub":"262'776","last_deep_scrub_stamp":"2024-09-12T18:33:23.637244+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.637244+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:07.717470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3564,"num_read_kb":3189,"num_write":1040,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'292","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.609676+0000","last_change":"2024-09-12T18:33:12.609610+0000","last_active":"2024-09-12T18:33:12.609676+0000","last_peered":"2024-09-12T18:33:12.609676+0000","last_clean":"2024-09-12T18:33:12.609676+0000","last_became_active":"2024-09-12T17:35:40.891418+0000","last_became_peered":"2024-09-12T17:35:40.891418+0000","last_unstale":"2024-09-12T18:33:12.609676+0000","last_undegraded":"2024-09-12T18:33:12.609676+0000","last_fullsized":"2024-09-12T18:33:12.609676+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-12T18:33:12.609480+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.609480+0000","objects_scrubbed":9,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:33.114173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694644,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":28092,"num_write":983,"num_write_kb":23636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.710176+0000","last_change":"2024-09-12T18:33:27.710107+0000","last_active":"2024-09-12T18:33:27.710176+0000","last_peered":"2024-09-12T18:33:27.710176+0000","last_clean":"2024-09-12T18:33:27.710176+0000","last_became_active":"2024-09-12T17:35:44.897521+0000","last_became_peered":"2024-09-12T17:35:44.897521+0000","last_unstale":"2024-09-12T18:33:27.710176+0000","last_undegraded":"2024-09-12T18:33:27.710176+0000","last_fullsized":"2024-09-12T18:33:27.710176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.710016+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.710016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:39.343506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'333","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.193064+0000","last_change":"2024-09-12T18:33:35.193064+0000","last_active":"2024-09-12T18:33:35.193064+0000","last_peered":"2024-09-12T18:33:35.193064+0000","last_clean":"2024-09-12T18:33:35.193064+0000","last_became_active":"2024-09-12T17:35:46.899220+0000","last_became_peered":"2024-09-12T17:35:46.899220+0000","last_unstale":"2024-09-12T18:33:35.193064+0000","last_undegraded":"2024-09-12T18:33:35.193064+0000","last_fullsized":"2024-09-12T18:33:35.193064+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:35.192953+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.192953+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:49.112579+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56643,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1253,"num_write":470,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.568479+0000","last_change":"2024-09-12T18:33:34.568479+0000","last_active":"2024-09-12T18:33:34.568479+0000","last_peered":"2024-09-12T18:33:34.568479+0000","last_clean":"2024-09-12T18:33:34.568479+0000","last_became_active":"2024-09-12T17:35:48.906698+0000","last_became_peered":"2024-09-12T17:35:48.906698+0000","last_unstale":"2024-09-12T18:33:34.568479+0000","last_undegraded":"2024-09-12T18:33:34.568479+0000","last_fullsized":"2024-09-12T18:33:34.568479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.568388+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.568388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:39.847789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'203","reported_seq":1083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.763194+0000","last_change":"2024-09-12T18:33:36.763133+0000","last_active":"2024-09-12T18:33:36.763194+0000","last_peered":"2024-09-12T18:33:36.763194+0000","last_clean":"2024-09-12T18:33:36.763194+0000","last_became_active":"2024-09-12T17:35:50.915939+0000","last_became_peered":"2024-09-12T17:35:50.915939+0000","last_unstale":"2024-09-12T18:33:36.763194+0000","last_undegraded":"2024-09-12T18:33:36.763194+0000","last_fullsized":"2024-09-12T18:33:36.763194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-12T18:33:36.763046+0000","last_clean_scrub_stamp":"2024-09-12T18:33:36.763046+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:59.513801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":672,"num_read_kb":661,"num_write":547,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'1297","reported_seq":2877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:29.376494+0000","last_change":"2024-09-12T18:33:29.376494+0000","last_active":"2024-09-12T18:33:29.376494+0000","last_peered":"2024-09-12T18:33:29.376494+0000","last_clean":"2024-09-12T18:33:29.376494+0000","last_became_active":"2024-09-12T17:35:42.890627+0000","last_became_peered":"2024-09-12T17:35:42.890627+0000","last_unstale":"2024-09-12T18:33:29.376494+0000","last_undegraded":"2024-09-12T18:33:29.376494+0000","last_fullsized":"2024-09-12T18:33:29.376494+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1297","last_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_deep_scrub":"262'1297","last_deep_scrub_stamp":"2024-09-12T18:33:29.376406+0000","last_clean_scrub_stamp":"2024-09-12T18:33:29.376406+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":1200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:02.948818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5799,"num_read_kb":5110,"num_write":1804,"num_write_kb":784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'314","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.214145+0000","last_change":"2024-09-12T18:33:13.214086+0000","last_active":"2024-09-12T18:33:13.214145+0000","last_peered":"2024-09-12T18:33:13.214145+0000","last_clean":"2024-09-12T18:33:13.214145+0000","last_became_active":"2024-09-12T17:35:40.904017+0000","last_became_peered":"2024-09-12T17:35:40.904017+0000","last_unstale":"2024-09-12T18:33:13.214145+0000","last_undegraded":"2024-09-12T18:33:13.214145+0000","last_fullsized":"2024-09-12T18:33:13.214145+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'314","last_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_deep_scrub":"262'314","last_deep_scrub_stamp":"2024-09-12T18:33:13.213966+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.213966+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:52.702345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":10892,"num_write":984,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.333184+0000","last_change":"2024-09-12T18:33:35.333184+0000","last_active":"2024-09-12T18:33:35.333184+0000","last_peered":"2024-09-12T18:33:35.333184+0000","last_clean":"2024-09-12T18:33:35.333184+0000","last_became_active":"2024-09-12T17:35:44.893076+0000","last_became_peered":"2024-09-12T17:35:44.893076+0000","last_unstale":"2024-09-12T18:33:35.333184+0000","last_undegraded":"2024-09-12T18:33:35.333184+0000","last_fullsized":"2024-09-12T18:33:35.333184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.333097+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.333097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:34.166308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'296","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.323430+0000","last_change":"2024-09-12T18:33:50.323374+0000","last_active":"2024-09-12T18:33:50.323430+0000","last_peered":"2024-09-12T18:33:50.323430+0000","last_clean":"2024-09-12T18:33:50.323430+0000","last_became_active":"2024-09-12T17:35:47.464491+0000","last_became_peered":"2024-09-12T17:35:47.464491+0000","last_unstale":"2024-09-12T18:33:50.323430+0000","last_undegraded":"2024-09-12T18:33:50.323430+0000","last_fullsized":"2024-09-12T18:33:50.323430+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'296","last_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_deep_scrub":"262'296","last_deep_scrub_stamp":"2024-09-12T18:33:50.323277+0000","last_clean_scrub_stamp":"2024-09-12T18:33:50.323277+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:05.895027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48414,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":1088,"num_write":394,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:35.562086+0000","last_change":"2024-09-12T18:33:35.562025+0000","last_active":"2024-09-12T18:33:35.562086+0000","last_peered":"2024-09-12T18:33:35.562086+0000","last_clean":"2024-09-12T18:33:35.562086+0000","last_became_active":"2024-09-12T17:35:48.900832+0000","last_became_peered":"2024-09-12T17:35:48.900832+0000","last_unstale":"2024-09-12T18:33:35.562086+0000","last_undegraded":"2024-09-12T18:33:35.562086+0000","last_fullsized":"2024-09-12T18:33:35.562086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:35.561926+0000","last_clean_scrub_stamp":"2024-09-12T18:33:35.561926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:05.612440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'137","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.672636+0000","last_change":"2024-09-12T18:33:44.672537+0000","last_active":"2024-09-12T18:33:44.672636+0000","last_peered":"2024-09-12T18:33:44.672636+0000","last_clean":"2024-09-12T18:33:44.672636+0000","last_became_active":"2024-09-12T17:35:50.923977+0000","last_became_peered":"2024-09-12T17:35:50.923977+0000","last_unstale":"2024-09-12T18:33:44.672636+0000","last_undegraded":"2024-09-12T18:33:44.672636+0000","last_fullsized":"2024-09-12T18:33:44.672636+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:44.672419+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.672419+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:11.144320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":225,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'552","reported_seq":2171,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.071677+0000","last_change":"2024-09-12T18:33:17.071677+0000","last_active":"2024-09-12T18:33:17.071677+0000","last_peered":"2024-09-12T18:33:17.071677+0000","last_clean":"2024-09-12T18:33:17.071677+0000","last_became_active":"2024-09-12T17:35:42.885636+0000","last_became_peered":"2024-09-12T17:35:42.885636+0000","last_unstale":"2024-09-12T18:33:17.071677+0000","last_undegraded":"2024-09-12T18:33:17.071677+0000","last_fullsized":"2024-09-12T18:33:17.071677+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'552","last_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_deep_scrub":"262'552","last_deep_scrub_stamp":"2024-09-12T18:33:17.071573+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.071573+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:16.342863+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2875,"num_read_kb":2665,"num_write":699,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'359","reported_seq":1031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.585198+0000","last_change":"2024-09-12T18:33:12.585151+0000","last_active":"2024-09-12T18:33:12.585198+0000","last_peered":"2024-09-12T18:33:12.585198+0000","last_clean":"2024-09-12T18:33:12.585198+0000","last_became_active":"2024-09-12T17:35:40.890120+0000","last_became_peered":"2024-09-12T17:35:40.890120+0000","last_unstale":"2024-09-12T18:33:12.585198+0000","last_undegraded":"2024-09-12T18:33:12.585198+0000","last_fullsized":"2024-09-12T18:33:12.585198+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'359","last_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_deep_scrub":"262'359","last_deep_scrub_stamp":"2024-09-12T18:33:12.585060+0000","last_clean_scrub_stamp":"2024-09-12T18:33:12.585060+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:16.468003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":50516,"num_write":1214,"num_write_kb":38718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.654924+0000","last_change":"2024-09-12T18:33:27.654924+0000","last_active":"2024-09-12T18:33:27.654924+0000","last_peered":"2024-09-12T18:33:27.654924+0000","last_clean":"2024-09-12T18:33:27.654924+0000","last_became_active":"2024-09-12T17:35:44.897796+0000","last_became_peered":"2024-09-12T17:35:44.897796+0000","last_unstale":"2024-09-12T18:33:27.654924+0000","last_undegraded":"2024-09-12T18:33:27.654924+0000","last_fullsized":"2024-09-12T18:33:27.654924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:27.654837+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.654837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.335485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'111","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.303021+0000","last_change":"2024-09-12T18:33:40.302961+0000","last_active":"2024-09-12T18:33:40.303021+0000","last_peered":"2024-09-12T18:33:40.303021+0000","last_clean":"2024-09-12T18:33:40.303021+0000","last_became_active":"2024-09-12T17:35:47.464528+0000","last_became_peered":"2024-09-12T17:35:47.464528+0000","last_unstale":"2024-09-12T18:33:40.303021+0000","last_undegraded":"2024-09-12T18:33:40.303021+0000","last_fullsized":"2024-09-12T18:33:40.303021+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-12T18:33:40.302865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:40.302865+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:11.629757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":150,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18924,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'779","reported_seq":4150,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.779177+0000","last_change":"2024-09-12T18:33:32.779080+0000","last_active":"2024-09-12T18:33:32.779177+0000","last_peered":"2024-09-12T18:33:32.779177+0000","last_clean":"2024-09-12T18:33:32.779177+0000","last_became_active":"2024-09-12T17:35:48.900137+0000","last_became_peered":"2024-09-12T17:35:48.900137+0000","last_unstale":"2024-09-12T18:33:32.779177+0000","last_undegraded":"2024-09-12T18:33:32.779177+0000","last_fullsized":"2024-09-12T18:33:32.779177+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'779","last_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_deep_scrub":"262'779","last_deep_scrub_stamp":"2024-09-12T18:33:32.778980+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.778980+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:29.517178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'137","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.076262+0000","last_change":"2024-09-12T18:33:42.076207+0000","last_active":"2024-09-12T18:33:42.076262+0000","last_peered":"2024-09-12T18:33:42.076262+0000","last_clean":"2024-09-12T18:33:42.076262+0000","last_became_active":"2024-09-12T17:35:50.921882+0000","last_became_peered":"2024-09-12T17:35:50.921882+0000","last_unstale":"2024-09-12T18:33:42.076262+0000","last_undegraded":"2024-09-12T18:33:42.076262+0000","last_fullsized":"2024-09-12T18:33:42.076262+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-12T18:33:42.076124+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.076124+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:59.699672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":353,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'766","reported_seq":2352,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.332245+0000","last_change":"2024-09-12T18:33:24.332245+0000","last_active":"2024-09-12T18:33:24.332245+0000","last_peered":"2024-09-12T18:33:24.332245+0000","last_clean":"2024-09-12T18:33:24.332245+0000","last_became_active":"2024-09-12T17:35:42.900281+0000","last_became_peered":"2024-09-12T17:35:42.900281+0000","last_unstale":"2024-09-12T18:33:24.332245+0000","last_undegraded":"2024-09-12T18:33:24.332245+0000","last_fullsized":"2024-09-12T18:33:24.332245+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'766","last_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_deep_scrub":"262'766","last_deep_scrub_stamp":"2024-09-12T18:33:24.332108+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.332108+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:12.983708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3663,"num_read_kb":3341,"num_write":994,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'337","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.052970+0000","last_change":"2024-09-12T18:33:13.052912+0000","last_active":"2024-09-12T18:33:13.052970+0000","last_peered":"2024-09-12T18:33:13.052970+0000","last_clean":"2024-09-12T18:33:13.052970+0000","last_became_active":"2024-09-12T17:36:16.050755+0000","last_became_peered":"2024-09-12T17:36:16.050755+0000","last_unstale":"2024-09-12T18:33:13.052970+0000","last_undegraded":"2024-09-12T18:33:13.052970+0000","last_fullsized":"2024-09-12T18:33:13.052970+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'337","last_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_deep_scrub":"262'337","last_deep_scrub_stamp":"2024-09-12T18:33:13.052825+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.052825+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:55.171930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":50614,"num_write":1066,"num_write_kb":45649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.118009+0000","last_change":"2024-09-12T18:33:31.118009+0000","last_active":"2024-09-12T18:33:31.118009+0000","last_peered":"2024-09-12T18:33:31.118009+0000","last_clean":"2024-09-12T18:33:31.118009+0000","last_became_active":"2024-09-12T17:35:44.899550+0000","last_became_peered":"2024-09-12T17:35:44.899550+0000","last_unstale":"2024-09-12T18:33:31.118009+0000","last_undegraded":"2024-09-12T18:33:31.118009+0000","last_fullsized":"2024-09-12T18:33:31.118009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:31.117914+0000","last_clean_scrub_stamp":"2024-09-12T18:33:31.117914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:57.868096+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'316","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.605929+0000","last_change":"2024-09-12T18:33:39.605871+0000","last_active":"2024-09-12T18:33:39.605929+0000","last_peered":"2024-09-12T18:33:39.605929+0000","last_clean":"2024-09-12T18:33:39.605929+0000","last_became_active":"2024-09-12T17:35:46.897500+0000","last_became_peered":"2024-09-12T17:35:46.897500+0000","last_unstale":"2024-09-12T18:33:39.605929+0000","last_undegraded":"2024-09-12T18:33:39.605929+0000","last_fullsized":"2024-09-12T18:33:39.605929+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'316","last_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_deep_scrub":"262'316","last_deep_scrub_stamp":"2024-09-12T18:33:39.605754+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.605754+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.157337+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44344,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":1104,"num_write":414,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.720938+0000","last_change":"2024-09-12T18:33:39.720865+0000","last_active":"2024-09-12T18:33:39.720938+0000","last_peered":"2024-09-12T18:33:39.720938+0000","last_clean":"2024-09-12T18:33:39.720938+0000","last_became_active":"2024-09-12T17:35:48.900043+0000","last_became_peered":"2024-09-12T17:35:48.900043+0000","last_unstale":"2024-09-12T18:33:39.720938+0000","last_undegraded":"2024-09-12T18:33:39.720938+0000","last_fullsized":"2024-09-12T18:33:39.720938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:39.720781+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.720781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:42.326695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'124","reported_seq":624,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.111229+0000","last_change":"2024-09-12T18:33:44.111164+0000","last_active":"2024-09-12T18:33:44.111229+0000","last_peered":"2024-09-12T18:33:44.111229+0000","last_clean":"2024-09-12T18:33:44.111229+0000","last_became_active":"2024-09-12T17:35:50.920743+0000","last_became_peered":"2024-09-12T17:35:50.920743+0000","last_unstale":"2024-09-12T18:33:44.111229+0000","last_undegraded":"2024-09-12T18:33:44.111229+0000","last_fullsized":"2024-09-12T18:33:44.111229+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-12T18:33:44.111077+0000","last_clean_scrub_stamp":"2024-09-12T18:33:44.111077+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:13.157135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":309,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'399","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.327113+0000","last_change":"2024-09-12T18:33:23.327113+0000","last_active":"2024-09-12T18:33:23.327113+0000","last_peered":"2024-09-12T18:33:23.327113+0000","last_clean":"2024-09-12T18:33:23.327113+0000","last_became_active":"2024-09-12T17:35:42.899642+0000","last_became_peered":"2024-09-12T17:35:42.899642+0000","last_unstale":"2024-09-12T18:33:23.327113+0000","last_undegraded":"2024-09-12T18:33:23.327113+0000","last_fullsized":"2024-09-12T18:33:23.327113+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'399","last_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_deep_scrub":"262'399","last_deep_scrub_stamp":"2024-09-12T18:33:23.326995+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.326995+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:31.607912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2331,"num_read_kb":2236,"num_write":452,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3241,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'346","reported_seq":993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.675047+0000","last_change":"2024-09-12T18:33:17.675047+0000","last_active":"2024-09-12T18:33:17.675047+0000","last_peered":"2024-09-12T18:33:17.675047+0000","last_clean":"2024-09-12T18:33:17.675047+0000","last_became_active":"2024-09-12T17:35:40.901988+0000","last_became_peered":"2024-09-12T17:35:40.901988+0000","last_unstale":"2024-09-12T18:33:17.675047+0000","last_undegraded":"2024-09-12T18:33:17.675047+0000","last_fullsized":"2024-09-12T18:33:17.675047+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-12T18:33:17.674867+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.674867+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:20.180450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5819619,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":36012,"num_write":1062,"num_write_kb":44461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.607212+0000","last_change":"2024-09-12T18:33:34.607212+0000","last_active":"2024-09-12T18:33:34.607212+0000","last_peered":"2024-09-12T18:33:34.607212+0000","last_clean":"2024-09-12T18:33:34.607212+0000","last_became_active":"2024-09-12T17:35:44.895207+0000","last_became_peered":"2024-09-12T17:35:44.895207+0000","last_unstale":"2024-09-12T18:33:34.607212+0000","last_undegraded":"2024-09-12T18:33:34.607212+0000","last_fullsized":"2024-09-12T18:33:34.607212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.607121+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.607121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:13.500998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'291","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.740254+0000","last_change":"2024-09-12T18:33:34.740198+0000","last_active":"2024-09-12T18:33:34.740254+0000","last_peered":"2024-09-12T18:33:34.740254+0000","last_clean":"2024-09-12T18:33:34.740254+0000","last_became_active":"2024-09-12T17:35:46.894705+0000","last_became_peered":"2024-09-12T17:35:46.894705+0000","last_unstale":"2024-09-12T18:33:34.740254+0000","last_undegraded":"2024-09-12T18:33:34.740254+0000","last_fullsized":"2024-09-12T18:33:34.740254+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-12T18:33:34.740115+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.740115+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:01.234210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53785,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1068,"num_write":382,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.775670+0000","last_change":"2024-09-12T18:33:34.775581+0000","last_active":"2024-09-12T18:33:34.775670+0000","last_peered":"2024-09-12T18:33:34.775670+0000","last_clean":"2024-09-12T18:33:34.775670+0000","last_became_active":"2024-09-12T17:35:48.900905+0000","last_became_peered":"2024-09-12T17:35:48.900905+0000","last_unstale":"2024-09-12T18:33:34.775670+0000","last_undegraded":"2024-09-12T18:33:34.775670+0000","last_fullsized":"2024-09-12T18:33:34.775670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.775485+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.775485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:45.097880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'196","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.300433+0000","last_change":"2024-09-12T18:33:54.300433+0000","last_active":"2024-09-12T18:33:54.300433+0000","last_peered":"2024-09-12T18:33:54.300433+0000","last_clean":"2024-09-12T18:33:54.300433+0000","last_became_active":"2024-09-12T17:35:51.347475+0000","last_became_peered":"2024-09-12T17:35:51.347475+0000","last_unstale":"2024-09-12T18:33:54.300433+0000","last_undegraded":"2024-09-12T18:33:54.300433+0000","last_fullsized":"2024-09-12T18:33:54.300433+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-12T18:33:54.300324+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-12T18:33:54.300324+0000","last_clean_scrub_stamp":"2024-09-12T18:33:54.300324+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.443817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":208,"num_read_kb":207,"num_write":435,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'541","reported_seq":2101,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.367979+0000","last_change":"2024-09-12T18:33:28.367911+0000","last_active":"2024-09-12T18:33:28.367979+0000","last_peered":"2024-09-12T18:33:28.367979+0000","last_clean":"2024-09-12T18:33:28.367979+0000","last_became_active":"2024-09-12T17:35:42.885868+0000","last_became_peered":"2024-09-12T17:35:42.885868+0000","last_unstale":"2024-09-12T18:33:28.367979+0000","last_undegraded":"2024-09-12T18:33:28.367979+0000","last_fullsized":"2024-09-12T18:33:28.367979+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'541","last_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_deep_scrub":"262'541","last_deep_scrub_stamp":"2024-09-12T18:33:28.367828+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.367828+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:11.552948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2782,"num_read_kb":2553,"num_write":680,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'389","reported_seq":1065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.173031+0000","last_change":"2024-09-12T18:33:19.172964+0000","last_active":"2024-09-12T18:33:19.173031+0000","last_peered":"2024-09-12T18:33:19.173031+0000","last_clean":"2024-09-12T18:33:19.173031+0000","last_became_active":"2024-09-12T17:36:16.050796+0000","last_became_peered":"2024-09-12T17:36:16.050796+0000","last_unstale":"2024-09-12T18:33:19.173031+0000","last_undegraded":"2024-09-12T18:33:19.173031+0000","last_fullsized":"2024-09-12T18:33:19.173031+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:19.172834+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.172834+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:19.523494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":33965,"num_write":1123,"num_write_kb":39776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.352053+0000","last_change":"2024-09-12T18:33:34.351970+0000","last_active":"2024-09-12T18:33:34.352053+0000","last_peered":"2024-09-12T18:33:34.352053+0000","last_clean":"2024-09-12T18:33:34.352053+0000","last_became_active":"2024-09-12T17:35:44.890358+0000","last_became_peered":"2024-09-12T17:35:44.890358+0000","last_unstale":"2024-09-12T18:33:34.352053+0000","last_undegraded":"2024-09-12T18:33:34.352053+0000","last_fullsized":"2024-09-12T18:33:34.352053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:34.351852+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.351852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:35.670667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'272","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:42.291517+0000","last_change":"2024-09-12T18:33:42.291517+0000","last_active":"2024-09-12T18:33:42.291517+0000","last_peered":"2024-09-12T18:33:42.291517+0000","last_clean":"2024-09-12T18:33:42.291517+0000","last_became_active":"2024-09-12T17:35:46.899237+0000","last_became_peered":"2024-09-12T17:35:46.899237+0000","last_unstale":"2024-09-12T18:33:42.291517+0000","last_undegraded":"2024-09-12T18:33:42.291517+0000","last_fullsized":"2024-09-12T18:33:42.291517+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'272","last_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_deep_scrub":"262'272","last_deep_scrub_stamp":"2024-09-12T18:33:42.291430+0000","last_clean_scrub_stamp":"2024-09-12T18:33:42.291430+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:36.563443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":1159,"num_write":392,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.332413+0000","last_change":"2024-09-12T18:33:43.332413+0000","last_active":"2024-09-12T18:33:43.332413+0000","last_peered":"2024-09-12T18:33:43.332413+0000","last_clean":"2024-09-12T18:33:43.332413+0000","last_became_active":"2024-09-12T17:35:48.902074+0000","last_became_peered":"2024-09-12T17:35:48.902074+0000","last_unstale":"2024-09-12T18:33:43.332413+0000","last_undegraded":"2024-09-12T18:33:43.332413+0000","last_fullsized":"2024-09-12T18:33:43.332413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:43.332323+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.332323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:02.398841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'147","reported_seq":1258,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:43.089519+0000","last_change":"2024-09-12T18:33:43.089460+0000","last_active":"2024-09-12T18:33:43.089519+0000","last_peered":"2024-09-12T18:33:43.089519+0000","last_clean":"2024-09-12T18:33:43.089519+0000","last_became_active":"2024-09-12T17:35:50.915763+0000","last_became_peered":"2024-09-12T17:35:50.915763+0000","last_unstale":"2024-09-12T18:33:43.089519+0000","last_undegraded":"2024-09-12T18:33:43.089519+0000","last_fullsized":"2024-09-12T18:33:43.089519+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-12T18:33:43.089371+0000","last_clean_scrub_stamp":"2024-09-12T18:33:43.089371+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:04.809899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":831,"num_write":350,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'496","reported_seq":2060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.275373+0000","last_change":"2024-09-12T18:33:22.275302+0000","last_active":"2024-09-12T18:33:22.275373+0000","last_peered":"2024-09-12T18:33:22.275373+0000","last_clean":"2024-09-12T18:33:22.275373+0000","last_became_active":"2024-09-12T17:35:42.899027+0000","last_became_peered":"2024-09-12T17:35:42.899027+0000","last_unstale":"2024-09-12T18:33:22.275373+0000","last_undegraded":"2024-09-12T18:33:22.275373+0000","last_fullsized":"2024-09-12T18:33:22.275373+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-12T18:33:22.275213+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.275213+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:50.196779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2444,"num_read_kb":2288,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'370","reported_seq":1038,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.586921+0000","last_change":"2024-09-12T18:33:14.586776+0000","last_active":"2024-09-12T18:33:14.586921+0000","last_peered":"2024-09-12T18:33:14.586921+0000","last_clean":"2024-09-12T18:33:14.586921+0000","last_became_active":"2024-09-12T17:35:40.899791+0000","last_became_peered":"2024-09-12T17:35:40.899791+0000","last_unstale":"2024-09-12T18:33:14.586921+0000","last_undegraded":"2024-09-12T18:33:14.586921+0000","last_fullsized":"2024-09-12T18:33:14.586921+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'370","last_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_deep_scrub":"262'370","last_deep_scrub_stamp":"2024-09-12T18:33:14.586592+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.586592+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:48.010872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":31832,"num_write":1234,"num_write_kb":32577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.624440+0000","last_change":"2024-09-12T18:33:28.624383+0000","last_active":"2024-09-12T18:33:28.624440+0000","last_peered":"2024-09-12T18:33:28.624440+0000","last_clean":"2024-09-12T18:33:28.624440+0000","last_became_active":"2024-09-12T17:35:44.893578+0000","last_became_peered":"2024-09-12T17:35:44.893578+0000","last_unstale":"2024-09-12T18:33:28.624440+0000","last_undegraded":"2024-09-12T18:33:28.624440+0000","last_fullsized":"2024-09-12T18:33:28.624440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T18:33:28.624288+0000","last_clean_scrub_stamp":"2024-09-12T18:33:28.624288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:54.829284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'310","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.269145+0000","last_change":"2024-09-12T18:33:39.269145+0000","last_active":"2024-09-12T18:33:39.269145+0000","last_peered":"2024-09-12T18:33:39.269145+0000","last_clean":"2024-09-12T18:33:39.269145+0000","last_became_active":"2024-09-12T17:35:46.902279+0000","last_became_peered":"2024-09-12T17:35:46.902279+0000","last_unstale":"2024-09-12T18:33:39.269145+0000","last_undegraded":"2024-09-12T18:33:39.269145+0000","last_fullsized":"2024-09-12T18:33:39.269145+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'310","last_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_deep_scrub":"262'310","last_deep_scrub_stamp":"2024-09-12T18:33:39.269054+0000","last_clean_scrub_stamp":"2024-09-12T18:33:39.269054+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:43.874202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58480,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":1106,"num_write":388,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.760760+0000","last_change":"2024-09-12T18:33:41.760760+0000","last_active":"2024-09-12T18:33:41.760760+0000","last_peered":"2024-09-12T18:33:41.760760+0000","last_clean":"2024-09-12T18:33:41.760760+0000","last_became_active":"2024-09-12T17:35:48.902519+0000","last_became_peered":"2024-09-12T17:35:48.902519+0000","last_unstale":"2024-09-12T18:33:41.760760+0000","last_undegraded":"2024-09-12T18:33:41.760760+0000","last_fullsized":"2024-09-12T18:33:41.760760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:33:41.760663+0000","last_clean_scrub_stamp":"2024-09-12T18:33:41.760663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:29.356520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'131","reported_seq":627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.397263+0000","last_change":"2024-09-12T18:33:45.397186+0000","last_active":"2024-09-12T18:33:45.397263+0000","last_peered":"2024-09-12T18:33:45.397263+0000","last_clean":"2024-09-12T18:33:45.397263+0000","last_became_active":"2024-09-12T17:35:50.910678+0000","last_became_peered":"2024-09-12T17:35:50.910678+0000","last_unstale":"2024-09-12T18:33:45.397263+0000","last_undegraded":"2024-09-12T18:33:45.397263+0000","last_fullsized":"2024-09-12T18:33:45.397263+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-12T18:33:45.397098+0000","last_clean_scrub_stamp":"2024-09-12T18:33:45.397098+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:38.251960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'471","reported_seq":2187,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.650524+0000","last_change":"2024-09-12T18:33:26.650462+0000","last_active":"2024-09-12T18:33:26.650524+0000","last_peered":"2024-09-12T18:33:26.650524+0000","last_clean":"2024-09-12T18:33:26.650524+0000","last_became_active":"2024-09-12T17:35:42.896649+0000","last_became_peered":"2024-09-12T17:35:42.896649+0000","last_unstale":"2024-09-12T18:33:26.650524+0000","last_undegraded":"2024-09-12T18:33:26.650524+0000","last_fullsized":"2024-09-12T18:33:26.650524+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'471","last_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_deep_scrub":"262'471","last_deep_scrub_stamp":"2024-09-12T18:33:26.650376+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.650376+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.061452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2690,"num_read_kb":2550,"num_write":553,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'394","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.702638+0000","last_change":"2024-09-12T18:33:19.702575+0000","last_active":"2024-09-12T18:33:19.702638+0000","last_peered":"2024-09-12T18:33:19.702638+0000","last_clean":"2024-09-12T18:33:19.702638+0000","last_became_active":"2024-09-12T17:35:40.899899+0000","last_became_peered":"2024-09-12T17:35:40.899899+0000","last_unstale":"2024-09-12T18:33:19.702638+0000","last_undegraded":"2024-09-12T18:33:19.702638+0000","last_fullsized":"2024-09-12T18:33:19.702638+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'394","last_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_deep_scrub":"262'394","last_deep_scrub_stamp":"2024-09-12T18:33:19.702403+0000","last_clean_scrub_stamp":"2024-09-12T18:33:19.702403+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:43.504939+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":20627,"num_write":1276,"num_write_kb":31892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'530","reported_seq":2078,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.602717+0000","last_change":"2024-09-12T18:33:32.602618+0000","last_active":"2024-09-12T18:33:32.602717+0000","last_peered":"2024-09-12T18:33:32.602717+0000","last_clean":"2024-09-12T18:33:32.602717+0000","last_became_active":"2024-09-12T17:35:42.902662+0000","last_became_peered":"2024-09-12T17:35:42.902662+0000","last_unstale":"2024-09-12T18:33:32.602717+0000","last_undegraded":"2024-09-12T18:33:32.602717+0000","last_fullsized":"2024-09-12T18:33:32.602717+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'530","last_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_deep_scrub":"262'530","last_deep_scrub_stamp":"2024-09-12T18:33:32.602521+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.602521+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:10.838673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2604,"num_read_kb":2410,"num_write":663,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'405","reported_seq":1097,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.030455+0000","last_change":"2024-09-12T18:33:15.030355+0000","last_active":"2024-09-12T18:33:15.030455+0000","last_peered":"2024-09-12T18:33:15.030455+0000","last_clean":"2024-09-12T18:33:15.030455+0000","last_became_active":"2024-09-12T17:35:40.886555+0000","last_became_peered":"2024-09-12T17:35:40.886555+0000","last_unstale":"2024-09-12T18:33:15.030455+0000","last_undegraded":"2024-09-12T18:33:15.030455+0000","last_fullsized":"2024-09-12T18:33:15.030455+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-12T18:33:15.030175+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.030175+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:29.411062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":58921,"num_write":1278,"num_write_kb":45437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'936","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.628775+0000","last_change":"2024-09-12T18:33:25.628715+0000","last_active":"2024-09-12T18:33:25.628775+0000","last_peered":"2024-09-12T18:33:25.628775+0000","last_clean":"2024-09-12T18:33:25.628775+0000","last_became_active":"2024-09-12T17:35:42.891785+0000","last_became_peered":"2024-09-12T17:35:42.891785+0000","last_unstale":"2024-09-12T18:33:25.628775+0000","last_undegraded":"2024-09-12T18:33:25.628775+0000","last_fullsized":"2024-09-12T18:33:25.628775+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'936","last_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_deep_scrub":"262'936","last_deep_scrub_stamp":"2024-09-12T18:33:25.628616+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.628616+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:44.784169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4423,"num_read_kb":3929,"num_write":1267,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'375","reported_seq":1044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.707611+0000","last_change":"2024-09-12T18:33:20.707536+0000","last_active":"2024-09-12T18:33:20.707611+0000","last_peered":"2024-09-12T18:33:20.707611+0000","last_clean":"2024-09-12T18:33:20.707611+0000","last_became_active":"2024-09-12T17:35:40.887168+0000","last_became_peered":"2024-09-12T17:35:40.887168+0000","last_unstale":"2024-09-12T18:33:20.707611+0000","last_undegraded":"2024-09-12T18:33:20.707611+0000","last_fullsized":"2024-09-12T18:33:20.707611+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'375","last_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_deep_scrub":"262'375","last_deep_scrub_stamp":"2024-09-12T18:33:20.707383+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.707383+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.729608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1189379,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":34034,"num_write":1140,"num_write_kb":33020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'762","reported_seq":2340,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.612686+0000","last_change":"2024-09-12T18:33:21.612612+0000","last_active":"2024-09-12T18:33:21.612686+0000","last_peered":"2024-09-12T18:33:21.612686+0000","last_clean":"2024-09-12T18:33:21.612686+0000","last_became_active":"2024-09-12T17:35:42.890983+0000","last_became_peered":"2024-09-12T17:35:42.890983+0000","last_unstale":"2024-09-12T18:33:21.612686+0000","last_undegraded":"2024-09-12T18:33:21.612686+0000","last_fullsized":"2024-09-12T18:33:21.612686+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'762","last_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_deep_scrub":"262'762","last_deep_scrub_stamp":"2024-09-12T18:33:21.612531+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.612531+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.677937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3788,"num_read_kb":3439,"num_write":1000,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'384","reported_seq":1025,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.645288+0000","last_change":"2024-09-12T18:33:17.645224+0000","last_active":"2024-09-12T18:33:17.645288+0000","last_peered":"2024-09-12T18:33:17.645288+0000","last_clean":"2024-09-12T18:33:17.645288+0000","last_became_active":"2024-09-12T17:35:40.891597+0000","last_became_peered":"2024-09-12T17:35:40.891597+0000","last_unstale":"2024-09-12T18:33:17.645288+0000","last_undegraded":"2024-09-12T18:33:17.645288+0000","last_fullsized":"2024-09-12T18:33:17.645288+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:17.645107+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.645107+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.274616+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":12325,"num_write":1129,"num_write_kb":28630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'439","reported_seq":1939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:32.401213+0000","last_change":"2024-09-12T18:33:32.401142+0000","last_active":"2024-09-12T18:33:32.401213+0000","last_peered":"2024-09-12T18:33:32.401213+0000","last_clean":"2024-09-12T18:33:32.401213+0000","last_became_active":"2024-09-12T17:35:42.893486+0000","last_became_peered":"2024-09-12T17:35:42.893486+0000","last_unstale":"2024-09-12T18:33:32.401213+0000","last_undegraded":"2024-09-12T18:33:32.401213+0000","last_fullsized":"2024-09-12T18:33:32.401213+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'439","last_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_deep_scrub":"262'439","last_deep_scrub_stamp":"2024-09-12T18:33:32.401058+0000","last_clean_scrub_stamp":"2024-09-12T18:33:32.401058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.885116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2259,"num_read_kb":2121,"num_write":504,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'389","reported_seq":1069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.203920+0000","last_change":"2024-09-12T18:33:20.203831+0000","last_active":"2024-09-12T18:33:20.203920+0000","last_peered":"2024-09-12T18:33:20.203920+0000","last_clean":"2024-09-12T18:33:20.203920+0000","last_became_active":"2024-09-12T17:36:15.950068+0000","last_became_peered":"2024-09-12T17:36:15.950068+0000","last_unstale":"2024-09-12T18:33:20.203920+0000","last_undegraded":"2024-09-12T18:33:20.203920+0000","last_fullsized":"2024-09-12T18:33:20.203920+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'389","last_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_deep_scrub":"262'389","last_deep_scrub_stamp":"2024-09-12T18:33:20.203681+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.203681+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.448871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190223,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":520,"num_read_kb":50386,"num_write":1084,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'483","reported_seq":2234,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.286536+0000","last_change":"2024-09-12T18:33:25.286445+0000","last_active":"2024-09-12T18:33:25.286536+0000","last_peered":"2024-09-12T18:33:25.286536+0000","last_clean":"2024-09-12T18:33:25.286536+0000","last_became_active":"2024-09-12T17:35:42.897359+0000","last_became_peered":"2024-09-12T17:35:42.897359+0000","last_unstale":"2024-09-12T18:33:25.286536+0000","last_undegraded":"2024-09-12T18:33:25.286536+0000","last_fullsized":"2024-09-12T18:33:25.286536+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'483","last_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_deep_scrub":"262'483","last_deep_scrub_stamp":"2024-09-12T18:33:25.286332+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.286332+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.078569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2957,"num_read_kb":2804,"num_write":571,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3572,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'331","reported_seq":1023,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:14.626226+0000","last_change":"2024-09-12T18:33:14.626160+0000","last_active":"2024-09-12T18:33:14.626226+0000","last_peered":"2024-09-12T18:33:14.626226+0000","last_clean":"2024-09-12T18:33:14.626226+0000","last_became_active":"2024-09-12T17:35:40.892651+0000","last_became_peered":"2024-09-12T17:35:40.892651+0000","last_unstale":"2024-09-12T18:33:14.626226+0000","last_undegraded":"2024-09-12T18:33:14.626226+0000","last_fullsized":"2024-09-12T18:33:14.626226+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'331","last_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_deep_scrub":"262'331","last_deep_scrub_stamp":"2024-09-12T18:33:14.625987+0000","last_clean_scrub_stamp":"2024-09-12T18:33:14.625987+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:07.872404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":699027,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":70299,"num_write":1012,"num_write_kb":30759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'482","reported_seq":2106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:30.357064+0000","last_change":"2024-09-12T18:33:30.357008+0000","last_active":"2024-09-12T18:33:30.357064+0000","last_peered":"2024-09-12T18:33:30.357064+0000","last_clean":"2024-09-12T18:33:30.357064+0000","last_became_active":"2024-09-12T17:35:42.891422+0000","last_became_peered":"2024-09-12T17:35:42.891422+0000","last_unstale":"2024-09-12T18:33:30.357064+0000","last_undegraded":"2024-09-12T18:33:30.357064+0000","last_fullsized":"2024-09-12T18:33:30.357064+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'482","last_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_deep_scrub":"262'482","last_deep_scrub_stamp":"2024-09-12T18:33:30.356905+0000","last_clean_scrub_stamp":"2024-09-12T18:33:30.356905+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:21.805515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2454,"num_read_kb":2320,"num_write":529,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":975,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'341","reported_seq":994,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:15.696158+0000","last_change":"2024-09-12T18:33:15.696096+0000","last_active":"2024-09-12T18:33:15.696158+0000","last_peered":"2024-09-12T18:33:15.696158+0000","last_clean":"2024-09-12T18:33:15.696158+0000","last_became_active":"2024-09-12T17:35:40.902245+0000","last_became_peered":"2024-09-12T17:35:40.902245+0000","last_unstale":"2024-09-12T18:33:15.696158+0000","last_undegraded":"2024-09-12T18:33:15.696158+0000","last_fullsized":"2024-09-12T18:33:15.696158+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'341","last_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_deep_scrub":"262'341","last_deep_scrub_stamp":"2024-09-12T18:33:15.695906+0000","last_clean_scrub_stamp":"2024-09-12T18:33:15.695906+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.837354+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1407190,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":51065,"num_write":1119,"num_write_kb":27820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'542","reported_seq":2216,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:24.691089+0000","last_change":"2024-09-12T18:33:24.691024+0000","last_active":"2024-09-12T18:33:24.691089+0000","last_peered":"2024-09-12T18:33:24.691089+0000","last_clean":"2024-09-12T18:33:24.691089+0000","last_became_active":"2024-09-12T17:35:42.897139+0000","last_became_peered":"2024-09-12T17:35:42.897139+0000","last_unstale":"2024-09-12T18:33:24.691089+0000","last_undegraded":"2024-09-12T18:33:24.691089+0000","last_fullsized":"2024-09-12T18:33:24.691089+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'542","last_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_deep_scrub":"262'542","last_deep_scrub_stamp":"2024-09-12T18:33:24.690944+0000","last_clean_scrub_stamp":"2024-09-12T18:33:24.690944+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:08.527284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2783,"num_read_kb":2591,"num_write":628,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'284","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:17.232507+0000","last_change":"2024-09-12T18:33:17.232418+0000","last_active":"2024-09-12T18:33:17.232507+0000","last_peered":"2024-09-12T18:33:17.232507+0000","last_clean":"2024-09-12T18:33:17.232507+0000","last_became_active":"2024-09-12T17:35:40.882248+0000","last_became_peered":"2024-09-12T17:35:40.882248+0000","last_unstale":"2024-09-12T18:33:17.232507+0000","last_undegraded":"2024-09-12T18:33:17.232507+0000","last_fullsized":"2024-09-12T18:33:17.232507+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-12T18:33:17.232228+0000","last_clean_scrub_stamp":"2024-09-12T18:33:17.232228+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:12.380580+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511862,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":37901,"num_write":823,"num_write_kb":28486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'587","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.620706+0000","last_change":"2024-09-12T18:33:22.620643+0000","last_active":"2024-09-12T18:33:22.620706+0000","last_peered":"2024-09-12T18:33:22.620706+0000","last_clean":"2024-09-12T18:33:22.620706+0000","last_became_active":"2024-09-12T17:35:42.902170+0000","last_became_peered":"2024-09-12T17:35:42.902170+0000","last_unstale":"2024-09-12T18:33:22.620706+0000","last_undegraded":"2024-09-12T18:33:22.620706+0000","last_fullsized":"2024-09-12T18:33:22.620706+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'587","last_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_deep_scrub":"262'587","last_deep_scrub_stamp":"2024-09-12T18:33:22.620530+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.620530+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:42.505857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3625,"num_read_kb":3380,"num_write":760,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6001,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'376","reported_seq":1035,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.636060+0000","last_change":"2024-09-12T18:33:16.635997+0000","last_active":"2024-09-12T18:33:16.636060+0000","last_peered":"2024-09-12T18:33:16.636060+0000","last_clean":"2024-09-12T18:33:16.636060+0000","last_became_active":"2024-09-12T17:35:40.903729+0000","last_became_peered":"2024-09-12T17:35:40.903729+0000","last_unstale":"2024-09-12T18:33:16.636060+0000","last_undegraded":"2024-09-12T18:33:16.636060+0000","last_fullsized":"2024-09-12T18:33:16.636060+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:16.635865+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.635865+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:02.528484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":34152,"num_write":1143,"num_write_kb":29212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'1181","reported_seq":2819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.253113+0000","last_change":"2024-09-12T18:33:27.253053+0000","last_active":"2024-09-12T18:33:27.253113+0000","last_peered":"2024-09-12T18:33:27.253113+0000","last_clean":"2024-09-12T18:33:27.253113+0000","last_became_active":"2024-09-12T17:35:42.892536+0000","last_became_peered":"2024-09-12T17:35:42.892536+0000","last_unstale":"2024-09-12T18:33:27.253113+0000","last_undegraded":"2024-09-12T18:33:27.253113+0000","last_fullsized":"2024-09-12T18:33:27.253113+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1181","last_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_deep_scrub":"262'1181","last_deep_scrub_stamp":"2024-09-12T18:33:27.252969+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.252969+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":1100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:53.177342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5279,"num_read_kb":4690,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'384","reported_seq":1095,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.196581+0000","last_change":"2024-09-12T18:33:18.196517+0000","last_active":"2024-09-12T18:33:18.196581+0000","last_peered":"2024-09-12T18:33:18.196581+0000","last_clean":"2024-09-12T18:33:18.196581+0000","last_became_active":"2024-09-12T17:35:40.881181+0000","last_became_peered":"2024-09-12T17:35:40.881181+0000","last_unstale":"2024-09-12T18:33:18.196581+0000","last_undegraded":"2024-09-12T18:33:18.196581+0000","last_fullsized":"2024-09-12T18:33:18.196581+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'384","last_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_deep_scrub":"262'384","last_deep_scrub_stamp":"2024-09-12T18:33:18.196285+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.196285+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:32.438997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":17939,"num_write":1185,"num_write_kb":31510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'781","reported_seq":2275,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.057134+0000","last_change":"2024-09-12T18:33:18.057074+0000","last_active":"2024-09-12T18:33:18.057134+0000","last_peered":"2024-09-12T18:33:18.057134+0000","last_clean":"2024-09-12T18:33:18.057134+0000","last_became_active":"2024-09-12T17:35:42.897864+0000","last_became_peered":"2024-09-12T17:35:42.897864+0000","last_unstale":"2024-09-12T18:33:18.057134+0000","last_undegraded":"2024-09-12T18:33:18.057134+0000","last_fullsized":"2024-09-12T18:33:18.057134+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'781","last_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_deep_scrub":"262'781","last_deep_scrub_stamp":"2024-09-12T18:33:18.056988+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.056988+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:37.444745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3628,"num_read_kb":3280,"num_write":1018,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'498","reported_seq":1219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.074483+0000","last_change":"2024-09-12T18:33:16.074483+0000","last_active":"2024-09-12T18:33:16.074483+0000","last_peered":"2024-09-12T18:33:16.074483+0000","last_clean":"2024-09-12T18:33:16.074483+0000","last_became_active":"2024-09-12T17:36:16.041887+0000","last_became_peered":"2024-09-12T17:36:16.041887+0000","last_unstale":"2024-09-12T18:33:16.074483+0000","last_undegraded":"2024-09-12T18:33:16.074483+0000","last_fullsized":"2024-09-12T18:33:16.074483+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'498","last_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_deep_scrub":"262'498","last_deep_scrub_stamp":"2024-09-12T18:33:16.074328+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.074328+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:08.965353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355583,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":996,"num_read_kb":22424,"num_write":1615,"num_write_kb":35546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"262'511","reported_seq":2184,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.297933+0000","last_change":"2024-09-12T18:33:26.297878+0000","last_active":"2024-09-12T18:33:26.297933+0000","last_peered":"2024-09-12T18:33:26.297933+0000","last_clean":"2024-09-12T18:33:26.297933+0000","last_became_active":"2024-09-12T17:35:42.901308+0000","last_became_peered":"2024-09-12T17:35:42.901308+0000","last_unstale":"2024-09-12T18:33:26.297933+0000","last_undegraded":"2024-09-12T18:33:26.297933+0000","last_fullsized":"2024-09-12T18:33:26.297933+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'511","last_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_deep_scrub":"262'511","last_deep_scrub_stamp":"2024-09-12T18:33:26.297768+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.297768+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:12.130346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2704,"num_read_kb":2536,"num_write":605,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'323","reported_seq":949,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.616716+0000","last_change":"2024-09-12T18:33:16.616656+0000","last_active":"2024-09-12T18:33:16.616716+0000","last_peered":"2024-09-12T18:33:16.616716+0000","last_clean":"2024-09-12T18:33:16.616716+0000","last_became_active":"2024-09-12T17:35:40.893231+0000","last_became_peered":"2024-09-12T17:35:40.893231+0000","last_unstale":"2024-09-12T18:33:16.616716+0000","last_undegraded":"2024-09-12T18:33:16.616716+0000","last_fullsized":"2024-09-12T18:33:16.616716+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'323","last_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_deep_scrub":"262'323","last_deep_scrub_stamp":"2024-09-12T18:33:16.616520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.616520+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.598136+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270110,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":8170,"num_write":997,"num_write_kb":36167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'785","reported_seq":2233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:25.000895+0000","last_change":"2024-09-12T18:33:25.000801+0000","last_active":"2024-09-12T18:33:25.000895+0000","last_peered":"2024-09-12T18:33:25.000895+0000","last_clean":"2024-09-12T18:33:25.000895+0000","last_became_active":"2024-09-12T17:35:42.897027+0000","last_became_peered":"2024-09-12T17:35:42.897027+0000","last_unstale":"2024-09-12T18:33:25.000895+0000","last_undegraded":"2024-09-12T18:33:25.000895+0000","last_fullsized":"2024-09-12T18:33:25.000895+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'785","last_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_deep_scrub":"262'785","last_deep_scrub_stamp":"2024-09-12T18:33:25.000690+0000","last_clean_scrub_stamp":"2024-09-12T18:33:25.000690+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.295948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3569,"num_read_kb":3210,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'333","reported_seq":976,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.699347+0000","last_change":"2024-09-12T18:33:16.699288+0000","last_active":"2024-09-12T18:33:16.699347+0000","last_peered":"2024-09-12T18:33:16.699347+0000","last_clean":"2024-09-12T18:33:16.699347+0000","last_became_active":"2024-09-12T17:35:40.893871+0000","last_became_peered":"2024-09-12T17:35:40.893871+0000","last_unstale":"2024-09-12T18:33:16.699347+0000","last_undegraded":"2024-09-12T18:33:16.699347+0000","last_fullsized":"2024-09-12T18:33:16.699347+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'333","last_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_deep_scrub":"262'333","last_deep_scrub_stamp":"2024-09-12T18:33:16.699173+0000","last_clean_scrub_stamp":"2024-09-12T18:33:16.699173+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:06.503747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652723,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":483,"num_read_kb":27896,"num_write":1098,"num_write_kb":20349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'571","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:20.654938+0000","last_change":"2024-09-12T18:33:20.654838+0000","last_active":"2024-09-12T18:33:20.654938+0000","last_peered":"2024-09-12T18:33:20.654938+0000","last_clean":"2024-09-12T18:33:20.654938+0000","last_became_active":"2024-09-12T17:35:42.899789+0000","last_became_peered":"2024-09-12T17:35:42.899789+0000","last_unstale":"2024-09-12T18:33:20.654938+0000","last_undegraded":"2024-09-12T18:33:20.654938+0000","last_fullsized":"2024-09-12T18:33:20.654938+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'571","last_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_deep_scrub":"262'571","last_deep_scrub_stamp":"2024-09-12T18:33:20.654735+0000","last_clean_scrub_stamp":"2024-09-12T18:33:20.654735+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:00.197882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2890,"num_read_kb":2654,"num_write":702,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'290","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.991841+0000","last_change":"2024-09-12T18:33:18.991759+0000","last_active":"2024-09-12T18:33:18.991841+0000","last_peered":"2024-09-12T18:33:18.991841+0000","last_clean":"2024-09-12T18:33:18.991841+0000","last_became_active":"2024-09-12T17:35:40.886560+0000","last_became_peered":"2024-09-12T17:35:40.886560+0000","last_unstale":"2024-09-12T18:33:18.991841+0000","last_undegraded":"2024-09-12T18:33:18.991841+0000","last_fullsized":"2024-09-12T18:33:18.991841+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'290","last_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_deep_scrub":"262'290","last_deep_scrub_stamp":"2024-09-12T18:33:18.991570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.991570+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.511173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":4469,"num_write":888,"num_write_kb":17432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'521","reported_seq":2065,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.398296+0000","last_change":"2024-09-12T18:33:34.398228+0000","last_active":"2024-09-12T18:33:34.398296+0000","last_peered":"2024-09-12T18:33:34.398296+0000","last_clean":"2024-09-12T18:33:34.398296+0000","last_became_active":"2024-09-12T17:35:42.894411+0000","last_became_peered":"2024-09-12T17:35:42.894411+0000","last_unstale":"2024-09-12T18:33:34.398296+0000","last_undegraded":"2024-09-12T18:33:34.398296+0000","last_fullsized":"2024-09-12T18:33:34.398296+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'521","last_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_deep_scrub":"262'521","last_deep_scrub_stamp":"2024-09-12T18:33:34.398139+0000","last_clean_scrub_stamp":"2024-09-12T18:33:34.398139+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:39.160645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2726,"num_read_kb":2527,"num_write":667,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'317","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:22.101807+0000","last_change":"2024-09-12T18:33:22.101698+0000","last_active":"2024-09-12T18:33:22.101807+0000","last_peered":"2024-09-12T18:33:22.101807+0000","last_clean":"2024-09-12T18:33:22.101807+0000","last_became_active":"2024-09-12T17:35:40.893791+0000","last_became_peered":"2024-09-12T17:35:40.893791+0000","last_unstale":"2024-09-12T18:33:22.101807+0000","last_undegraded":"2024-09-12T18:33:22.101807+0000","last_fullsized":"2024-09-12T18:33:22.101807+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'317","last_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_deep_scrub":"262'317","last_deep_scrub_stamp":"2024-09-12T18:33:22.101570+0000","last_clean_scrub_stamp":"2024-09-12T18:33:22.101570+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:04.807102+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":27660,"num_write":1072,"num_write_kb":27845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'392","reported_seq":1876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:23.957534+0000","last_change":"2024-09-12T18:33:23.957476+0000","last_active":"2024-09-12T18:33:23.957534+0000","last_peered":"2024-09-12T18:33:23.957534+0000","last_clean":"2024-09-12T18:33:23.957534+0000","last_became_active":"2024-09-12T17:36:15.950180+0000","last_became_peered":"2024-09-12T17:36:15.950180+0000","last_unstale":"2024-09-12T18:33:23.957534+0000","last_undegraded":"2024-09-12T18:33:23.957534+0000","last_fullsized":"2024-09-12T18:33:23.957534+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'392","last_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_deep_scrub":"262'392","last_deep_scrub_stamp":"2024-09-12T18:33:23.957391+0000","last_clean_scrub_stamp":"2024-09-12T18:33:23.957391+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:40.123662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2027,"num_read_kb":1937,"num_write":436,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'345","reported_seq":990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.705806+0000","last_change":"2024-09-12T18:33:21.705741+0000","last_active":"2024-09-12T18:33:21.705806+0000","last_peered":"2024-09-12T18:33:21.705806+0000","last_clean":"2024-09-12T18:33:21.705806+0000","last_became_active":"2024-09-12T17:35:40.885239+0000","last_became_peered":"2024-09-12T17:35:40.885239+0000","last_unstale":"2024-09-12T18:33:21.705806+0000","last_undegraded":"2024-09-12T18:33:21.705806+0000","last_fullsized":"2024-09-12T18:33:21.705806+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'345","last_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_deep_scrub":"262'345","last_deep_scrub_stamp":"2024-09-12T18:33:21.705579+0000","last_clean_scrub_stamp":"2024-09-12T18:33:21.705579+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.131383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":34548,"num_write":1063,"num_write_kb":24678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'376","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.681028+0000","last_change":"2024-09-12T18:33:18.680955+0000","last_active":"2024-09-12T18:33:18.681028+0000","last_peered":"2024-09-12T18:33:18.681028+0000","last_clean":"2024-09-12T18:33:18.681028+0000","last_became_active":"2024-09-12T17:35:40.892121+0000","last_became_peered":"2024-09-12T17:35:40.892121+0000","last_unstale":"2024-09-12T18:33:18.681028+0000","last_undegraded":"2024-09-12T18:33:18.681028+0000","last_fullsized":"2024-09-12T18:33:18.681028+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'376","last_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_deep_scrub":"262'376","last_deep_scrub_stamp":"2024-09-12T18:33:18.680862+0000","last_clean_scrub_stamp":"2024-09-12T18:33:18.680862+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:43.127892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052945,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":6964,"num_write":1129,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'1473","reported_seq":2931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.668688+0000","last_change":"2024-09-12T18:33:26.668632+0000","last_active":"2024-09-12T18:33:26.668688+0000","last_peered":"2024-09-12T18:33:26.668688+0000","last_clean":"2024-09-12T18:33:26.668688+0000","last_became_active":"2024-09-12T17:35:42.902161+0000","last_became_peered":"2024-09-12T17:35:42.902161+0000","last_unstale":"2024-09-12T18:33:26.668688+0000","last_undegraded":"2024-09-12T18:33:26.668688+0000","last_fullsized":"2024-09-12T18:33:26.668688+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1473","last_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_deep_scrub":"262'1473","last_deep_scrub_stamp":"2024-09-12T18:33:26.668544+0000","last_clean_scrub_stamp":"2024-09-12T18:33:26.668544+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:30.893522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6482,"num_read_kb":5677,"num_write":2086,"num_write_kb":908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'298","reported_seq":938,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.589234+0000","last_change":"2024-09-12T18:33:13.589172+0000","last_active":"2024-09-12T18:33:13.589234+0000","last_peered":"2024-09-12T18:33:13.589234+0000","last_clean":"2024-09-12T18:33:13.589234+0000","last_became_active":"2024-09-12T17:35:40.892454+0000","last_became_peered":"2024-09-12T17:35:40.892454+0000","last_unstale":"2024-09-12T18:33:13.589234+0000","last_undegraded":"2024-09-12T18:33:13.589234+0000","last_fullsized":"2024-09-12T18:33:13.589234+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'298","last_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_deep_scrub":"262'298","last_deep_scrub_stamp":"2024-09-12T18:33:13.589042+0000","last_clean_scrub_stamp":"2024-09-12T18:33:13.589042+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.715072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":8217,"num_write":971,"num_write_kb":26893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'1017","reported_seq":2993,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-12T18:33:27.623685+0000","last_change":"2024-09-12T18:33:27.623624+0000","last_active":"2024-09-12T18:33:27.623685+0000","last_peered":"2024-09-12T18:33:27.623685+0000","last_clean":"2024-09-12T18:33:27.623685+0000","last_became_active":"2024-09-12T17:35:42.894196+0000","last_became_peered":"2024-09-12T17:35:42.894196+0000","last_unstale":"2024-09-12T18:33:27.623685+0000","last_undegraded":"2024-09-12T18:33:27.623685+0000","last_fullsized":"2024-09-12T18:33:27.623685+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1017","last_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_deep_scrub":"262'1017","last_deep_scrub_stamp":"2024-09-12T18:33:27.623520+0000","last_clean_scrub_stamp":"2024-09-12T18:33:27.623520+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.482416+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5233,"num_read_kb":4726,"num_write":1368,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5285,"num_omap_keys":21,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5925,"num_read_kb":4139,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16254,"num_read_kb":15920,"num_write":16697,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1836,"ondisk_log_size":1836,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1571818,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17916,"num_read_kb":37265,"num_write":15035,"num_write_kb":11780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":681712,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212692,"num_read_kb":194324,"num_write":55306,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43805,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3986,"ondisk_log_size":3986,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":68589489,"num_objects":377,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":36438,"num_read_kb":2030723,"num_write":72188,"num_write_kb":2125094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93863936,"data_stored":93863936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":184607,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":188613,"num_write":188,"num_write_kb":130231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834575562,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144872,"kb_used_data":15128,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226968,"statfs":{"total":96636764160,"available":96488415232,"internally_reserved":0,"allocated":15491072,"data_stored":13570247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575562,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333508,"kb_used_data":13556,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038332,"statfs":{"total":96636764160,"available":96295251968,"internally_reserved":0,"allocated":13881344,"data_stored":11918715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575561,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":18096,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":18530304,"data_stored":16608104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575563,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172368,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94199472,"statfs":{"total":96636764160,"available":96460259328,"internally_reserved":0,"allocated":19529728,"data_stored":17538028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575561,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":13664,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":13991936,"data_stored":12011933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575563,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123832,"kb_used_data":12136,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94248008,"statfs":{"total":96636764160,"available":96509960192,"internally_reserved":0,"allocated":12427264,"data_stored":10520336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575561,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191932,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94179908,"statfs":{"total":96636764160,"available":96440225792,"internally_reserved":0,"allocated":16822272,"data_stored":14877078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575564,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295952,"kb_used_data":17664,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94075888,"statfs":{"total":96636764160,"available":96333709312,"internally_reserved":0,"allocated":18087936,"data_stored":16087657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13234176,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12615680,"data_stored":12615680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":8261632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11309056,"data_stored":11309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15278080,"data_stored":15278080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14348288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9068544,"data_stored":9068544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":6062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:34:34.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:34:34.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-12T18:34:34.793+0000 7f7217fff640 0 --2- 172.21.15.94:0/158266898 >> v2:172.21.15.94:3300/0 conn(0x7f72180b08f0 0x7f7218070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:34:34.999 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:34:34.999 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:34:34.999 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:34:34.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.049 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:34:35.049 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:34:35.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.102 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:34:35.102 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:34:35.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.147 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:34:35.147 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:34:35.147 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.199 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:34:35.199 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:34:35.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.242 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:34:35.242 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:34:35.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.300 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:34:35.301 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:34:35.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.353 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:34:35.353 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:34:35.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.405 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:34:35.405 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:34:35.405 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:34:35.405 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.433 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:34:35.433 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:34:35.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.459 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:34:35.459 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:34:35.459 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:34:35.459 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.489 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:34:35.489 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:34:35.489 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.541 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:34:35.541 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:34:35.542 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:34:35.554 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:34:35.554 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:34:35.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:34:35.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:34:35.623 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:34:35.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:34:35.810 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:34:35.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:34:35.927 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:34:36.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:34:36.007 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:34:36.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:34:36.091 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:34:36.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:34:36.241 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:34:36.339 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:34:36.339 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:34:36.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:34:36.426 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:34:36.523 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:34:36.524 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/data/mon.a.tgz 2024-09-12T18:34:36.524 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-12T18:34:36.555 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.AjxAeY2vY2 2024-09-12T18:34:36.556 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AjxAeY2vY2 2024-09-12T18:34:36.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.AjxAeY2vY2 2024-09-12T18:34:36.866 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.AjxAeY2vY2 is 481KB 2024-09-12T18:34:36.965 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.AjxAeY2vY2 2024-09-12T18:34:36.994 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/data/mon.c.tgz 2024-09-12T18:34:36.994 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-12T18:34:37.062 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.W9izSIj8EO 2024-09-12T18:34:37.062 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.W9izSIj8EO 2024-09-12T18:34:37.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.W9izSIj8EO 2024-09-12T18:34:37.352 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.W9izSIj8EO is 487KB 2024-09-12T18:34:37.451 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.W9izSIj8EO 2024-09-12T18:34:37.480 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/data/mon.b.tgz 2024-09-12T18:34:37.480 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T18:34:37.515 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.G5HUtLBzm5 2024-09-12T18:34:37.515 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.G5HUtLBzm5 2024-09-12T18:34:37.717 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.G5HUtLBzm5 2024-09-12T18:34:37.828 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.G5HUtLBzm5 is 487KB 2024-09-12T18:34:37.926 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.G5HUtLBzm5 2024-09-12T18:34:37.956 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:34:37.956 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:34:37.959 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:34:38.141 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:34:38.170 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:34:38.170 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:34:38.172 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi094/crash 2024-09-12T18:34:38.173 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:34:38.211 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi204/crash 2024-09-12T18:34:38.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:34:38.249 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:34:38.250 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:34:38.256 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:34:38.291 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:34:38.347 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32863.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32863.log.gz 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/ceph-osd.7.log: -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32588.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32588.log.gz 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-09-12T18:34:38.348 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-12T18:34:38.349 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-09-12T18:34:38.349 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 2024-09-12T18:34:38.349 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32720.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.32720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32720.log.gz 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz 2024-09-12T18:34:38.352 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:34:38.373 INFO:teuthology.orchestra.run.smithi204.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79989.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112973.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.79989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191034.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.112973.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.79989.log.gz 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190896.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75374.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191034.log.gz 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38466.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190896.log.gz 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.75374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-09-12T18:34:38.432 INFO:teuthology.orchestra.run.smithi094.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.75374.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38466.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112973.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187661.log 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38466.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98248.log 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171232.log 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187661.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.187661.log.gz/var/log/ceph/ceph-client.admin.98248.log: 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38843.log 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.171232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116507.log 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38843.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171232.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38843.log.gz 2024-09-12T18:34:38.433 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54063.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181578.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.116507.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98248.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.54063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43997.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116507.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.54063.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.181578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56419.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.181578.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.43997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190482.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43997.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.56419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113562.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.56419.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183405.log 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190482.log.gz 2024-09-12T18:34:38.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.113562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113562.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.183405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133589.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183405.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.50481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191310.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99426.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191310.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38757.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.99426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96481.log 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99426.log.gz 2024-09-12T18:34:38.435 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38757.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.133589.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114151.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127110.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.96481.log: /var/log/ceph/ceph-client.admin.114151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62309.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96481.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.114151.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146552.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.62309.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.146552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90002.log 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.146552.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-09-12T18:34:38.436 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101782.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.127110.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160729.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.90002.log: /var/log/ceph/ceph-client.admin.101782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185232.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 82.9%/var/log/ceph/ceph-client.admin.160729.log: -- replaced with /var/log/ceph/ceph-client.admin.101782.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46899.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.160729.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.185232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69247.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.185232.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170624.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.46899.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.69247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62373.log 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90002.log.gz 2024-09-12T18:34:38.437 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138303.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62373.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.170624.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152445.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.62373.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66769.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.138303.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69247.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.152445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138303.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39179.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.152445.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.66769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159551.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77356.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39179.log.gz 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.159551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-12T18:34:38.438 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.77356.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.159551.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.77356.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97659.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39044.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.66769.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167658.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.97659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62907.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.97659.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.167658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51707.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62907.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.62907.log.gz 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128877.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51707.log: /var/log/ceph/ceph-client.admin.128877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48690.log 2024-09-12T18:34:38.439 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.51707.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128877.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91769.log 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48690.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191448.log 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40970.log/var/log/ceph/ceph-client.admin.91769.log: 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191448.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91769.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191448.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.174850.log 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127699.log 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.40970.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.174850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111795.log 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127699.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.127699.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167658.log.gz 2024-09-12T18:34:38.440 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.102371.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.111795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38474.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.111795.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.102371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42791.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102371.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38474.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.174850.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38474.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82934.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59436.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42791.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.82934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155406.log 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.82934.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59436.log.gz 2024-09-12T18:34:38.441 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184014.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.155406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167009.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155406.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.184014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54652.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.184014.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.167009.log: /var/log/ceph/ceph-client.admin.54652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61536.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.167009.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54652.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118274.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191402.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61536.log: 62.4% -- replaced with /var/log/ceph/ceph-client.admin.61536.log.gz 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.118274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97070.log 2024-09-12T18:34:38.442 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.118274.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189758.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191402.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.97070.log: /var/log/ceph/ceph-client.admin.122398.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.189758.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97070.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101193.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.122398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191218.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122398.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.101193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187591.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101193.log.gz/var/log/ceph/ceph-client.admin.191218.log: 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191218.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161907.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153049.log 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.187591.log.gz 2024-09-12T18:34:38.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.161907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148909.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.153049.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161907.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155995.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153049.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.148909.log: --verbose -- /var/log/ceph/ceph-client.admin.38064.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.148909.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.155995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191494.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155995.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177924.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38064.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191494.log.gz 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121219.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84701.log 2024-09-12T18:34:38.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.177924.log: /var/log/ceph/ceph-client.admin.121219.log: 84.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62183.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.177924.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.84701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160140.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84701.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64911.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62183.log: /var/log/ceph/ceph-client.admin.160140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179142.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62183.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.64911.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52885.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160140.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.121219.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.179142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172595.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52885.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.179142.log.gz 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145374.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2024-09-12T18:34:38.445 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52885.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.172595.log: /var/log/ceph/ceph-client.admin.145374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32757.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.145374.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62245.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172595.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88824.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32757.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117685.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114740.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.117685.log: /var/log/ceph/ceph-client.admin.88824.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88824.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117685.log.gz 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157762.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.114740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154227.log 2024-09-12T18:34:38.446 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114740.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.157762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143017.log 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.154227.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.157762.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.154227.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108850.log 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70485.log 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.143017.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.108850.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.64911.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49303.log 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.70485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100015.log 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108850.log.gz 2024-09-12T18:34:38.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.49303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38169.log 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49303.log.gz 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100015.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100015.log.gz 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61899.log 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38169.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110028.log 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61899.log: 52.1% -- replaced with /var/log/ceph/ceph-client.admin.61899.log.gz 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191538.log 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163133.log 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110028.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.70485.log.gz 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191538.log: 26.4% -- replaced with /var/log/ceph/ceph-client.admin.191538.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110028.log.gz 2024-09-12T18:34:38.448 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104138.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163133.log.gz 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.104138.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.104138.log.gz 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39155.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95303.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39155.log.gz 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.95303.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95303.log.gz 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38764.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-09-12T18:34:38.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38764.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187613.log 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48714.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39212.log 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187613.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188346.log 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39212.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39212.log.gz 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126521.log 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188346.log: 87.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188346.log.gz 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150676.log 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2024-09-12T18:34:38.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111206.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.126521.log: /var/log/ceph/ceph-client.admin.150676.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.126521.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44600.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150676.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.111206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148320.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111206.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.44600.log: 43.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86468.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.44600.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.148320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39157.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.86468.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.148320.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62106.log 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86468.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39157.log.gz 2024-09-12T18:34:38.451 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187001.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109439.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62106.log: /var/log/ceph/ceph-client.admin.187001.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.62106.log.gz 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.187001.log.gz 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.109439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64291.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109439.log.gz 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39647.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.158351.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.64291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140661.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.158351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133000.log 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr: 86.8% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.158351.log.gz 2024-09-12T18:34:38.452 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.189758.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2%/var/log/ceph/ceph-client.admin.140661.log: -- replaced with /var/log/ceph/ceph-client.admin.64291.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 81.9% -- replaced with /var/log/ceph/ceph-client.admin.140661.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.190942.log 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137125.log 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133000.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142428.log 0.0% 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190942.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.137125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128288.log 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4%/var/log/ceph/ceph-client.admin.142428.log: -- replaced with /var/log/ceph/ceph-client.admin.137125.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191080.log 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.142428.log.gz 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176706.log 2024-09-12T18:34:38.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.128288.log: /var/log/ceph/ceph-client.admin.191080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82345.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.128288.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191080.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.176706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119452.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.176706.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.82345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92358.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82345.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188273.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.119452.log: /var/log/ceph/ceph-client.admin.92358.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.119452.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92358.log.gz 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88235.log 2024-09-12T18:34:38.454 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188273.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89413.log 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.88235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184623.log 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88235.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.89413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84112.log 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89413.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.0.184623.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.118863.log 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.84112.log: gzip 84.1% -- replaced with /var/log/ceph/ceph-client.0.184623.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95892.log 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84112.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.118863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186412.log 81.4% -- replaced with /var/log/ceph/ceph-client.admin.118863.log.gz 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.95892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-09-12T18:34:38.455 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.95892.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.186412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180969.log 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: 82.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38770.log 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.186412.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.180969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81756.log 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.180969.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150087.log 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38770.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.81756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131233.log 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:34:38.456 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81756.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.150087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129466.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.131233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151265.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.131233.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.129466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125343.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129466.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83523.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.151265.log: /var/log/ceph/ceph-client.admin.125343.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.151265.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162496.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.150087.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125343.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.83523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61789.log 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162496.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.83523.log.gz 2024-09-12T18:34:38.457 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162496.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41579.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61789.log: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.61789.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190528.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.41579.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41579.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190528.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190712.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124165.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60049.log 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190712.log.gz 2024-09-12T18:34:38.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.124165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182796.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.124165.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59412.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60049.log: /var/log/ceph/ceph-client.0.182796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191172.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60049.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.182796.log.gz/var/log/ceph/ceph-client.admin.59412.log: 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59412.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178533.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190390.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191172.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.178533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107672.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.178533.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190390.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190390.log.gz 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.78811.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.107672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81167.log 2024-09-12T18:34:38.459 INFO:teuthology.orchestra.run.smithi094.stderr: 81.4%/var/log/ceph/ceph-client.admin.78811.log: -- replaced with /var/log/ceph/ceph-client.admin.107672.log.gz 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 81.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.78811.log.gz -- 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.47488.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.81167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105905.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81167.log.gz 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.105905.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.144785.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105905.log.gz/var/log/ceph/ceph-client.admin.48077.log: 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90591.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.144785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103549.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144785.log.gz 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.90591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107083.log 2024-09-12T18:34:38.460 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90591.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.103549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73433.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103549.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.107083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124754.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107083.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.73433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188321.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.124754.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.188251.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9%/var/log/ceph/ceph-client.admin.188321.log: -- replaced with /var/log/ceph/ceph-client.admin.124754.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188321.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73433.log.gz 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.158940.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188251.log: gzip 24.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.188251.log.gz -- 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.98837.log 2024-09-12T18:34:38.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.158940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55830.log 81.2% -- replaced with /var/log/ceph/ceph-client.admin.158940.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.98837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93536.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98837.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135945.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.55830.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.93536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123576.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93536.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.135945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135945.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.123576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134767.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.123576.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.134767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38841.log 2024-09-12T18:34:38.462 INFO:teuthology.orchestra.run.smithi094.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.134767.log.gz 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55241.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.38841.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115918.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.55241.log.gz/var/log/ceph/ceph-client.admin.49892.log: 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191264.log 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.115918.log: gzip -5 --verbose -- 80.8% -- replaced with /var/log/ceph/ceph-client.admin.115918.log.gz 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.112384.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191264.log.gz 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182187.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.112384.log: --verbose -- /var/log/ceph/ceph-client.admin.121808.log 2024-09-12T18:34:38.463 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8%/var/log/ceph/ceph-client.0.182187.log: -- replaced with /var/log/ceph/ceph-client.admin.112384.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91180.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182187.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100604.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.121808.log: /var/log/ceph/ceph-client.admin.91180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38765.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.121808.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91180.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190758.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8%/var/log/ceph/ceph-client.admin.38765.log: -- replaced with /var/log/ceph/ceph-client.admin.100604.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138893.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38765.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190758.log: /var/log/ceph/ceph-client.admin.138893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147141.log 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190758.log.gz 2024-09-12T18:34:38.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38771.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138893.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173811.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.147141.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52296.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.173811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57008.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.147141.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39758.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: 92.3%/var/log/ceph/ceph-client.admin.52296.log: -- replaced with /var/log/ceph/ceph-client.admin.173811.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57008.log: 0.0% 84.2% -- replaced with /var/log/ceph/ceph-client.admin.57008.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52296.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187637.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.39758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190620.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187637.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190574.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187637.log.gz 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.39758.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53474.log 2024-09-12T18:34:38.465 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190620.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190574.log: gzip 28.8% -- replaced with /var/log/ceph/ceph-client.admin.190574.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.53474.log: gzip -5 --verbose 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53474.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.104727.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115329.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.104727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144196.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104727.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.115329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130055.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.144196.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.115329.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.144196.log.gz 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170016.log 2024-09-12T18:34:38.466 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.130055.log: -- /var/log/ceph/ceph-client.admin.122987.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.130055.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51118.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.122987.log: 92.1% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.170016.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122987.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87646.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85290.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51118.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78222.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.85290.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87646.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.85290.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37977.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.78222.log: -- /var/log/ceph/ceph-client.0.180360.log 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.78222.log.gz 2024-09-12T18:34:38.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gzgzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.180360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.180360.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62971.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38041.log: 61.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38468.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62971.log: 20.8%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26676.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62971.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117096.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38468.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.tmp-client.admin.26676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26676.log.gz 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71151.log 2024-09-12T18:34:38.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.117096.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117096.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.71151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75983.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.71151.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68628.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.75983.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.75983.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80578.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.68628.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.68628.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164335.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.80578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80578.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140072.log 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164335.log.gz 2024-09-12T18:34:38.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154816.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.140072.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140072.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.154816.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.154816.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191356.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72841.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191356.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105316.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.72841.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.72841.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110617.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.105316.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105316.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188370.log 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110617.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110617.log.gz 2024-09-12T18:34:38.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165537.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188370.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.188370.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189065.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.165537.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.165537.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161318.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.189065.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.189065.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190850.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.161318.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.161318.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190436.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190850.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149498.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190436.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179751.log 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.149498.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149498.log.gz 2024-09-12T18:34:38.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188297.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.179751.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.179751.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106494.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188297.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164311.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.106494.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.106494.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151856.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164311.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190988.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.151856.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.151856.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57645.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190988.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72252.log 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57645.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57645.log.gz 2024-09-12T18:34:38.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.72252.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.72252.log.gz 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145963.log 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69866.log 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.145963.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.145963.log.gz 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.69866.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69866.log.gz 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125932.log 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-09-12T18:34:38.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153638.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.125932.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.125932.log.gz 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92947.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.153638.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153638.log.gz 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58823.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.92947.log: /var/log/ceph/ceph-client.admin.38475.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92947.log.gz 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191126.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2024-09-12T18:34:38.492 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191126.log: /var/log/ceph/ceph-client.admin.58823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191126.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.58823.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136534.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.68008.log: /var/log/ceph/ceph-client.admin.39210.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.136534.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136534.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94714.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164948.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94714.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94714.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120630.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164948.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.164948.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137714.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.120630.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.120630.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173203.log 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.137714.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137714.log.gz 2024-09-12T18:34:38.493 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87057.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.173203.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173203.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39457.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87057.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87057.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168266.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39457.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59460.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.168266.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168266.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67388.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59460.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.59460.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177315.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.67388.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67388.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176097.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.177315.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.177315.log.gz 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63672.log 2024-09-12T18:34:38.494 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.176097.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.176097.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.79400.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131822.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63672.log: /var/log/ceph/ceph-client.admin.79400.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79400.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40367.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.131822.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131822.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39735.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40367.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.40367.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39735.log.gz 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120041.log 2024-09-12T18:34:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76747.log 2024-09-12T18:34:38.496 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.120041.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120041.log.gz 2024-09-12T18:34:38.496 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.63672.log.gz 2024-09-12T18:34:38.496 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130644.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.76747.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.76747.log.gz 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.130644.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.130644.log.gz 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139483.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171987.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.139483.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139483.log.gz 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175458.log 2024-09-12T18:34:38.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.171987.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.171987.log.gz 2024-09-12T18:34:38.503 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157173.log 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.175458.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175458.log.gz 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57056.log 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.157173.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157173.log.gz 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39547.log 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57056.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57056.log.gz 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169408.log 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39547.log.gz 2024-09-12T18:34:38.507 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147731.log 2024-09-12T18:34:38.509 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.169408.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.169408.log.gz 2024-09-12T18:34:38.509 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94125.log 2024-09-12T18:34:38.510 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.147731.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147731.log.gz 2024-09-12T18:34:38.510 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2024-09-12T18:34:38.511 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94125.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94125.log.gz 2024-09-12T18:34:38.511 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-09-12T18:34:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.66149.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2024-09-12T18:34:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162544.log 2024-09-12T18:34:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-09-12T18:34:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135356.log 2024-09-12T18:34:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162544.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.162544.log.gz 2024-09-12T18:34:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141839.log 2024-09-12T18:34:38.521 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.135356.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135356.log.gz 2024-09-12T18:34:38.521 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190666.log 2024-09-12T18:34:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.141839.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.141839.log.gz 2024-09-12T18:34:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102960.log 2024-09-12T18:34:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190666.log.gz 2024-09-12T18:34:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37875.log 2024-09-12T18:34:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.102960.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102960.log.gz 2024-09-12T18:34:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74023.log 2024-09-12T18:34:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37875.log.gz 2024-09-12T18:34:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-09-12T18:34:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74023.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.74023.log.gz 2024-09-12T18:34:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143607.log 2024-09-12T18:34:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-09-12T18:34:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156584.log 2024-09-12T18:34:38.531 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143607.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143607.log.gz 2024-09-12T18:34:38.531 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42182.log 2024-09-12T18:34:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.156584.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.156584.log.gz 2024-09-12T18:34:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132411.log 2024-09-12T18:34:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42182.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.42182.log.gz 2024-09-12T18:34:38.533 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162520.log 2024-09-12T18:34:38.535 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.132411.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132411.log.gz 2024-09-12T18:34:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58234.log 2024-09-12T18:34:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162520.log.gz 2024-09-12T18:34:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75205.log 2024-09-12T18:34:38.536 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58234.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.58234.log.gz 2024-09-12T18:34:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39503.log 2024-09-12T18:34:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.75205.log: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.75205.log.gz 2024-09-12T18:34:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65530.log 2024-09-12T18:34:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39503.log.gz 2024-09-12T18:34:38.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39173.log 2024-09-12T18:34:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.65530.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.65530.log.gz 2024-09-12T18:34:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:34:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39173.log.gz 2024-09-12T18:34:38.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159530.log 2024-09-12T18:34:38.557 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60638.log 2024-09-12T18:34:38.557 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.159530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159530.log.gz 2024-09-12T18:34:38.570 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85879.log 2024-09-12T18:34:38.570 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60638.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.60638.log.gz 2024-09-12T18:34:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164359.log 2024-09-12T18:34:38.585 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.85879.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85879.log.gz 2024-09-12T18:34:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134178.log 2024-09-12T18:34:38.594 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164359.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.164359.log.gz 2024-09-12T18:34:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38215.log 2024-09-12T18:34:38.612 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.134178.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.134178.log.gz 2024-09-12T18:34:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38472.log 2024-09-12T18:34:38.621 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38215.log.gz 2024-09-12T18:34:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43394.log 2024-09-12T18:34:38.633 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38472.log.gz 2024-09-12T18:34:38.651 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38842.log 2024-09-12T18:34:38.652 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.43394.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43394.log.gz 2024-09-12T18:34:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163722.log 2024-09-12T18:34:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38842.log.gz 2024-09-12T18:34:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63083.log 2024-09-12T18:34:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163722.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.163722.log.gz 2024-09-12T18:34:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141250.log 2024-09-12T18:34:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63083.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.63083.log.gz 2024-09-12T18:34:38.713 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74614.log 2024-09-12T18:34:38.714 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.141250.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141250.log.gz 2024-09-12T18:34:38.721 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108261.log 2024-09-12T18:34:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76693.log 2024-09-12T18:34:38.735 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.108261.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108261.log.gz 2024-09-12T18:34:38.735 INFO:teuthology.orchestra.run.smithi094.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.74614.log.gz 2024-09-12T18:34:38.742 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190804.log 2024-09-12T18:34:38.756 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.76693.log: 49.9% -- replaced with /var/log/ceph/ceph-client.admin.76693.log.gz 2024-09-12T18:34:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-09-12T18:34:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190804.log.gz 2024-09-12T18:34:38.773 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-09-12T18:34:38.965 INFO:teuthology.orchestra.run.smithi094.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:34:39.080 INFO:teuthology.orchestra.run.smithi204.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:34:39.515 INFO:teuthology.orchestra.run.smithi094.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:34:40.662 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:34:41.486 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:34:47.307 INFO:teuthology.orchestra.run.smithi094.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:34:48.802 INFO:teuthology.orchestra.run.smithi204.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:34:49.357 INFO:teuthology.orchestra.run.smithi204.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:34:49.384 INFO:teuthology.orchestra.run.smithi204.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:34:49.657 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:34:55.452 INFO:teuthology.orchestra.run.smithi094.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:34:57.925 INFO:teuthology.orchestra.run.smithi204.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:34:57.927 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-12T18:34:57.927 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m19.602s 2024-09-12T18:34:57.927 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m50.895s 2024-09-12T18:34:57.927 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m1.931s 2024-09-12T18:35:02.006 INFO:teuthology.orchestra.run.smithi094.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:35:02.007 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-12T18:35:02.007 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m23.727s 2024-09-12T18:35:02.007 INFO:teuthology.orchestra.run.smithi094.stderr:user 1m5.882s 2024-09-12T18:35:02.008 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m2.534s 2024-09-12T18:35:02.009 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:35:02.009 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi094/log 2024-09-12T18:35:02.010 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:35:11.223 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi204/log 2024-09-12T18:35:11.224 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:35:18.562 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:35:18.574 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:35:18.574 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:35:18.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:35:18.674 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:35:18.727 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:35:18.728 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:35:18.732 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:35:18.760 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:35:18.764 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:35:18.766 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:35:18.766 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-12T18:35:18.766 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +542us[ +543us] +/- 40ms 2024-09-12T18:35:18.767 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +436us[ +436us] +/- 60ms 2024-09-12T18:35:18.767 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -1357us[-1357us] +/- 68ms 2024-09-12T18:35:18.767 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:35:18.769 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:35:18.769 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T18:35:18.770 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +547us[ +533us] +/- 40ms 2024-09-12T18:35:18.770 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +425us[ +425us] +/- 60ms 2024-09-12T18:35:18.770 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -1368us[-1381us] +/- 68ms 2024-09-12T18:35:18.770 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:35:18.772 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:35:18.901 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:35:18.902 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:35:19.086 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:35:19.173 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:35:19.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:35:19.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:35:19.302 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:35:19.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:35:19.347 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:35:19.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:35:19.526 INFO:teuthology.task.internal:Duration was 4031.434220 seconds 2024-09-12T18:35:19.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:35:19.656 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:35:19.656 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:35:19.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:35:19.711 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:35:19.715 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:35:20.177 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:35:20.177 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-12T18:35:20.178 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:35:20.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T18:35:20.212 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:35:20.255 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:35:20.255 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:35:20.258 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:35:20.336 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:35:20.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:35:20.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:35:20.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:35:20.503 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:35:20.503 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:35:20.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:35:20.581 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:35:20.660 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:35:20.662 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:35:20.697 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-12T18:35:20.700 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-12T18:35:20.728 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:35:20.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:35:20.783 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:35:20.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:35:20.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:35:20.825 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:35:20.825 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi094 2024-09-12T18:35:20.826 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:35:20.877 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902743/remote/smithi204 2024-09-12T18:35:20.877 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:35:20.927 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:35:20.927 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:35:20.929 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:35:20.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:35:21.047 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:35:21.047 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:35:21.314 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:35:21.314 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:35:21.316 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:35:21.344 INFO:teuthology.orchestra.run.smithi094.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:35 /home/ubuntu/cephtest 2024-09-12T18:35:21.346 INFO:teuthology.orchestra.run.smithi204.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:35 /home/ubuntu/cephtest 2024-09-12T18:35:21.347 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:35:21.434 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:35:21.546 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4031.43421959877 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:35:21.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:35:21.643 INFO:teuthology.run:pass